Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Added support for sending custom datadog metrics from querybook #1390

Open
wants to merge 11 commits into
base: master
Choose a base branch
from

Conversation

jij1949
Copy link
Contributor

@jij1949 jij1949 commented Dec 20, 2023

This PR includes the setup of dogstatsd, a python library used for sending metrics to Datadog as well as the creation of a new stats logger, DatadogStatsLogger.

In addition, it includes 5 metrics: celery.active_workers, celery.active_tasks, task.received, task.failures, and task.successes

The first 2 metrics are sent to datadog every 5 seconds by opening a new thread which continuously runs the send_stats_logger_metrics function. The other 3 metrics are triggered by event handlers so they are sent whenever a task is received by a worker, a task fails, or a task succeeds.

Copy link
Collaborator

@czgu czgu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi Julian, thanks for submitting this PR and the code lgtm, can you make datadog not a required dependency for Querybook in dev mode? Would it work if you move those code to example documentation instead?

@jij1949
Copy link
Contributor Author

jij1949 commented Jan 22, 2024

Datadog is now an optional dependency

@jczhong84
Copy link
Collaborator

@czgu can you help to look the PR again?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants