[Feature] Unify format of data_sets and files_to_use in DataAccessFactory

[daw3rd]

Search before asking

• I searched the issues and found no similar issues.

Component

Library/core

Feature

According to the way the data-processing-lib parses the parameter data_data_sets, the datasets should be passed as a line (String) with the names of the datasets separated by ",". For example dataset1,dataset2.
While the parameter data_files_to_use should be passed as a list (with []) that includes strings with '. For example ['.ext1', '.ext2'].

This difference is caused by the difference in parsing these two parameters in the library. I think we should unify the way of parsing by changing the way of parsing the data_data_sets to use type=ast.literal_eval. For example:

parser.add_argument(
            f"--{self.cli_arg_prefix}data_sets",
            type=ast.literal_eval,
            default=None,
            help="List of data sets",
        )

Are you willing to submit a PR?

• Yes I am willing to submit a PR!

[blublinsky]

@daw3rd, this is done. Can we close it?

[daw3rd]

yes, we need to mark things "fixed", then they can get attention when browsing the issues.