v0.2.26

[0.2.26] - 2022.03.18

Fixed

• Use traceback module to print full exception from an output map that generates an exception.
• Bug in scripting.get_snippet_signature function that produces code with a syntax error.

v0.2.25

[0.2.25] - 2021.12.20

Fixed

• Fix bug where preparation and processing run options were ignored on workflow load.
• Fix bug where archive options were ignored on workflow load.

v0.2.24

[0.2.24] - 2021.10.06

Fixed

• Fix bug introduced in 0.2.23, where default preparation/processing run options were ignored.

v0.2.23

[0.2.23] - 2021.10.06

Fixed

• Fix inability to override default (preparation/processing) run options with an empty dict.

v0.2.22

[0.2.22] - 2021.08.14

Added

• Add support for multiple archives. Fix #72.

Fixed

• Fix error message if an input mapper function has an unknown argument.
• Catch and print error message from output map function failure.
• Fix incorrect import key when importing from a non-trivial context that is not defined in the schema.

v0.2.21

[0.2.21] - 2021.06.06 (May 2021)

Added

• Allow passing a subset of the task input parameters to the output mapper function. Resolve #102.
• Allow passing all iterations of an input parameter to a function mapper. Resolve #104.
• Allow running an on-demand archive to an existing/completed workflow: matflow archive path/to/workflow/directory ARCHIVE_NAME. Resolve #68.
• Allow specifying default_metadata in the config.yml file. Keys are merged with metadata specified in the workflow spec file. Resolve #98.

Fixed

• Save element resource usage (e.g. run time). Fix #97.
• Fix bug when determining the "producing task" in an iteration pathway. Fix #105.
• Fix bug when a file input parameter is specified with a $HOME tilde: ~/path/to/file.

v0.2.20

[0.2.20] - 2021.05.12

Added

• Add Task.cleanup attribute that can be used to optionally specify a list of glob patterns, representing file names to remove at the end of Workflow.process_task_element. Useful for removing very large simulation outputs that are not required after MatFlow has extracted the requested data.
• Add methods to Element object: get_file_lines and print_file_lines, which take a file name and a slice of lines to get or print.

Changed

• Change working directory to element directory for invoking input/output/function mapper functions. This is required in some cases where a tool or script does not accept a file path as an argument.
• Allow specifying the task_idx directly when importing parameters. This overrides any specified context.

Fixed

• Catch ImportError and SyntaxError when trying to load extensions.
• Import from the highest task index when importing a parameter that has been through a parameter-modifying task - fix #103. The can be overrode by specifying a task_idx directly.

v0.2.19 (April 2021 - Fix 1)

[0.2.19] - 2021.04.12 (April 2021 - Fix 1)

Fixed

• Fix type problem when input schema keys are specified "inline" in the task schema (e.g. as CRC_file_path[file=True,save=False]), in which the keys remain as type str, when they should be bool.
• Fix problem when an imported parameter is used in a task that is iterated.

v0.2.18 (April 2021)

[0.2.18] - 2021.04.10

Fixed

• Fix misleading error message when a task parameter specified as a file path does not actually exist as a file.
• Fix bug where if all possible dependency pathways are circularly dependent, this is not caught by MatFlow. Fix #88.
• Fix issue with accessing parameter data with dot-notation via their "safe names". Fix #87.

Added

• Add new parameter key ignore_dependency_from, which is a list of task names. This allows us to exclude tasks when considering the dependencies of this parameter. Fix #89.
• Allow embedding file-path inputs (inputs that are text files) into the HDF5 file. Fix #86.
• Add Task.unique_name property which adds on the non-trivial Task.context to Task.name.
• Tasks can be accessed from the task list via dot-notation. Fix #90.
• Add Task.elements_idx property to retrieve to correct elements_idx dict for that task.
• Add new exception type: ParameterImportError.
• Add ability to import parameters from existing workflows. Fix #30

Changed

• Non-trivial task contexts are now part of the task directory name to help distinguish task directories where multiple contexts are used. Fix #50.
• Add context argument to Workflow.get_input_tasks and Workflow.get_output_tasks.

v0.2.17

[0.2.17] - 2021.02.15

Fixed

• Fix issue #82 where the default group is not defined in the Workflow.element_idx for tasks where no local inputs are defined.

Added

• Add support for flexible positioning of parameter-modifying tasks (#81)