pyabsa.tasks.CodeDefectDetection.dataset_utils.cdd_utils
Module Contents
Classes
Built-in mutable sequence. |
Functions
|
|
|
|
|
|
|
|
|
|
|
|
|
Remove comments from code string, |
|
Read examples from filename. |
|
- class pyabsa.tasks.CodeDefectDetection.dataset_utils.cdd_utils.CodeLineIterator(code, strip=True)[source]
Bases:
list
Built-in mutable sequence.
If no argument is given, the constructor creates a new empty list. The argument must be an iterable if specified.
- pyabsa.tasks.CodeDefectDetection.dataset_utils.cdd_utils.random_indices(source, percentage)[source]
- pyabsa.tasks.CodeDefectDetection.dataset_utils.cdd_utils._switch_token(tokens: list, ids: list)[source]
- pyabsa.tasks.CodeDefectDetection.dataset_utils.cdd_utils._replace_token(tokens: list, ids: list)[source]
- pyabsa.tasks.CodeDefectDetection.dataset_utils.cdd_utils._delete_token(tokens: list, ids: list)[source]
- pyabsa.tasks.CodeDefectDetection.dataset_utils.cdd_utils._add_token(tokens: list, ids: list)[source]
- pyabsa.tasks.CodeDefectDetection.dataset_utils.cdd_utils.remove_comment(code_str, tokenizer=None)[source]
Remove comments from code string, :param code_str: code string :param tokenizer: tokenizer if passed, will add <mask> token to the code