support for Python code analysis #3

xrenegade100 · 2023-10-10T07:59:54Z

With this PR we want to extend the work done on IDEAL.
List of implemented features:

Support for Python code analysis with a custom deep learning (transformers) text model. The model is able to detect the following linguistic antipatterns in Python source code:
- Not implemented condition (B.1)
- Method signature and comment are opposite (C.2)
- Attribute signature and comment are opposite (F.2)
The tool can now be run using Docker. All the necessary tools and libraries are automatically installed.
Source code was mostly refactored to improve maintainability and reliability; it was also cleaned up by removing unused methods and classes.
Added a test suite with an 80% branch coverage over these packages:
- src.common
- src.service
- src.nlp

Authors

Domenico Antonio Gioia d.gioia7@studenti.unisa.it - https://github.com/antgioia
Giovanni Scorziello g.scorziello5@studenti.unisa.it - https://github.com/braindeadhermit
Antonio Scognamiglio a.scognamiglio32@studenti.unisa.it - https://github.com/xrenegade100

- add autopep8 formatter for vscode - add pytest dep - add pytest configuration

add unit tests as defined in TP document for src.nlp.related_terms

- pos_tag.py - splitter.py

- added PATH constant for temp files

add unit tests as defined in TP document for src.service.factory

add unit tests as defined in TP document for src.service.parser

fix the mock used in the the test case

delete two test case

- add missing tests from pos_tag, term_property - add missing documentation to test_splitter

…rojectSunshine into test/unit-testing

move unit tests to `test/unit`

- remove test cases with no mocks appliable

resolve code smells in test/unit/nlp and test/unit/service

- fix some code smells - remove misplaced integration tests - translate documentation

fix typo for test TC-CMM-8.1

TC-NLP-1.x/2.x/3.x/4.x/6.x

update dockerfile to run tests

- add PythonParser class to parser.py Co-authored-by: BraindeadHermit <scorziello.giovanni00@gmail.com>

implement analysis logic for python files Close #60 Co-authored-by: BraindeadHermit <scorziello.giovanni00@gmail.com> Co-authored-by: antgioia <antgioia10@gmail.com>

getCode -> get_code

add dockerfile for run analysis

update README.md

fix img url

fix size of model downloading

Co-authored-by: antgioia <antgioia10@gmail.com>

Co-authored-by: Antonio Scognamiglio <antonio.scognamiglio12@outlook.it>

BraindeadHermit and others added 30 commits August 14, 2023 10:51

Create CONTRIBUTING.md

7538f33

Update CONTRIBUTING.md

f8030af

add reverse engineering files

5e64276

remove .idea

03f7135

docs: upload reverse engineering document

ec31d7a

test: add vscode and pytest configs

7bc177f

- add autopep8 formatter for vscode - add pytest dep - add pytest configuration

test: add unit tests for src.nlp.related_terms

0dabdd9

add unit tests as defined in TP document for src.nlp.related_terms

fix: ignore IDEAL input files

af817d6

fix: ignore IDEAL input files

8ca43af

test: add unit tests for src.common.util

e0c4347

test: add more unit tests (nlp)

abb8ae3

- pos_tag.py - splitter.py

test: fixed some flakinesses in util test

480eea3

- added PATH constant for temp files

test: add unit tests for src.service.factory

1c270f2

add unit tests as defined in TP document for src.service.factory

test: add unit tests for src.common.error_handler

17b1550

test: add unit tests for src.service.parser

5ac15cd

add unit tests as defined in TP document for src.service.parser

test: fixed some flakinesses in parser test

ccb6684

fix the mock used in the the test case

test: delete two test case from parser test

9e5b9f9

delete two test case

test: add missing unit tests

0bda89a

- add missing tests from pos_tag, term_property - add missing documentation to test_splitter

fix: create better unit tests for src.common.error_handler

af9b65e

Merge branch 'test/unit-testing' of https://github.com/xrenegade100/P…

b642bd0

…rojectSunshine into test/unit-testing

test: rework directory structure

e06c2ec

move unit tests to `test/unit`

test: delete not mocked test cases

efdf8aa

- remove test cases with no mocks appliable

test: resolve code smells by SonarCloud

8744934

resolve code smells in test/unit/nlp and test/unit/service

test: add tests for src.common.util_parsing.py

5d1bbac

doc: add documentation comments to error_handler and util tests files

88f6593

test: fix minor code issues, adjust documentation

2686e9b

- fix some code smells - remove misplaced integration tests - translate documentation

test: impl unit tests (#14)

0f832dd

test: fix typo in test name

6a61b64

fix typo for test TC-CMM-8.1

test: add integration tests for src.nlp

d6f2bb3

TC-NLP-1.x/2.x/3.x/4.x/6.x

test: add dockerfile

3946a17

update dockerfile to run tests

BraindeadHermit and others added 30 commits October 4, 2023 12:20

feat: download model and make prediction

2b7fbdf

feat: add python parser

5b4daa3

- add PythonParser class to parser.py Co-authored-by: BraindeadHermit <scorziello.giovanni00@gmail.com>

test: src.service.parser

9deb50d

feat: impl python analysis with model

66c47eb

implement analysis logic for python files Close #60 Co-authored-by: BraindeadHermit <scorziello.giovanni00@gmail.com> Co-authored-by: antgioia <antgioia10@gmail.com>

fix: rename method names to predict source code

887a734

getCode -> get_code

refactor: delate reduntant code

39dd400

fix: change method name in tests

3c7da3f

fix: method name in test assert

d280172

test: add more test cases for src.service.parser.PythonParser

160f291

fix: src.classifier.Classifier code smells

163f981

feat: add dockerfile for run analysis

dc2d670

add dockerfile for run analysis

ci: test action changes

f096a4c

fix: fix code smells and github action

3256af9

fix: rule file imports

ed499b1

fix: test files

4521feb

fix: delate Parent class extention

bd8f8f6

docs: update README.md

048dc24

update README.md

fix: constructor call from parent

a6b8614

ci: change testing dir

eef8b34

docs: fix img url

a0e6da8

fix img url

ci: run tests

1d97fdb

ci: run tests

0505e94

fix: docker import

5717a27

fix: fix size of model downloading

8af704c

fix size of model downloading

docs: updated test report

01a3ae3

feat: add system testing

d6e5b37

fix: add delated pytest.ini import in docker the file

0ccc4d2

test: add a system test

22f4e1e

docs: upload project documentation (#71)

197dc38

Co-authored-by: antgioia <antgioia10@gmail.com>

docs: delete test report from root (#72)

a5040e9

Co-authored-by: Antonio Scognamiglio <antonio.scognamiglio12@outlook.it>

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

support for Python code analysis #3

support for Python code analysis #3

Uh oh!

xrenegade100 commented Oct 10, 2023

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

support for Python code analysis #3

Are you sure you want to change the base?

support for Python code analysis #3

Uh oh!

Conversation

xrenegade100 commented Oct 10, 2023

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants