Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Schedule the missing signal detector #1417

Open
melange396 opened this issue Apr 15, 2024 · 0 comments
Open

Schedule the missing signal detector #1417

melange396 opened this issue Apr 15, 2024 · 0 comments
Assignees
Labels
data quality devops building, running, deploying, environment stuff, handy utils, repository-related, engineer QoL, etc documentation logs and monitoring logging, monitoring, alerting

Comments

@melange396
Copy link
Collaborator

We have a "missing signal detector" that looks at our metadata to identify signals that are present in the database, but which lack associated semantic metadata information. We should find a way to run this on a schedule and report results to the team so we can act upon it, or at least task someone with running this manually on a periodic basis.

Note that a failure of a GH Actions job for this does not (necessarily) mean that the script did not run as intended... When no missing signal information is found, the job reports "success"; When missing signal info IS found, an artifact is generated by the job that lists offending signals, and the job is reported as a failure.

@melange396 melange396 added documentation logs and monitoring logging, monitoring, alerting devops building, running, deploying, environment stuff, handy utils, repository-related, engineer QoL, etc data quality labels Apr 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
data quality devops building, running, deploying, environment stuff, handy utils, repository-related, engineer QoL, etc documentation logs and monitoring logging, monitoring, alerting
Projects
None yet
Development

No branches or pull requests

2 participants