Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add task/data object groups and names, clarify names #32

Open
gavento opened this issue Apr 12, 2018 · 1 comment
Open

Add task/data object groups and names, clarify names #32

gavento opened this issue Apr 12, 2018 · 1 comment
Assignees
Labels

Comments

@gavento
Copy link
Contributor

gavento commented Apr 12, 2018

Introduce optional task/data object groups and names for better monitoring and possibly debugging. Currently, the data objects have a label indicating the role it plays in the producer task (e.g. log, score, ...).

Introduce:

  • task and data object name - arbitrary string, optional, to be set for any tasks the user wants to distinguish later by their name. May not be unique in the session but is intended to be unique. Always set by the user.

    • Goal: be able to distinguish special tasks in the graph and to query them.
    • Importance: low
    • Perhaps we need to think about possible uses and name vs label on objects (not to be confusing)
  • task and data object groups - a textual label splitting the nodes into disjoint groups (including the None group).

    • Goal: to be able to monitor statistics of different task/DO groups, meaningful progress reporting and stats aggregation
    • Advantage: easy to report compact per-group aggregates, even store them in the log.
    • Variant: add arbitrary tags, aggregate by tags combination. Drawbacks are added complexity (to many tag combinations) and less monitoring meaning (the stats no longer add to all nodes).
@spirali
Copy link
Collaborator

spirali commented Aug 9, 2018

Task names and tasks groups are implemented in the current master, with some basic statistics in dashboard task inspector

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants