Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(feedback): add config for feedback DLQ #67068

Merged
merged 4 commits into from Mar 15, 2024
Merged

Conversation

aliu3ntry
Copy link
Member

@aliu3ntry aliu3ntry commented Mar 15, 2024

Need to verify the values of dlq_ fields in consumers/init. These are used to create a DlqPolicy (line 509, same file)

requires getsentry/sentry-kafka-schemas#238

@aliu3ntry aliu3ntry requested a review from a team as a code owner March 15, 2024 19:09
@github-actions github-actions bot added the Scope: Backend Automatically applied to PRs that change backend components label Mar 15, 2024
@aliu3ntry aliu3ntry requested review from lynnagara and a team March 15, 2024 19:10
Copy link

codecov bot commented Mar 15, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 84.27%. Comparing base (93bb8d5) to head (9206e54).

❗ Current head 9206e54 differs from pull request most recent head cf07413. Consider uploading reports for the commit cf07413 to get more accurate results

Additional details and impacted files
@@             Coverage Diff             @@
##           master   #67068       +/-   ##
===========================================
+ Coverage   57.15%   84.27%   +27.11%     
===========================================
  Files        5114     5307      +193     
  Lines      225767   237310    +11543     
  Branches    38996    41050     +2054     
===========================================
+ Hits       129042   199993    +70951     
+ Misses      96504    37099    -59405     
+ Partials      221      218        -3     
Files Coverage Δ
src/sentry/conf/server.py 89.61% <ø> (ø)
src/sentry/conf/types/kafka_definition.py 100.00% <100.00%> (+3.70%) ⬆️
src/sentry/consumers/__init__.py 76.74% <ø> (ø)

... and 2011 files with indirect coverage changes

Comment on lines 271 to 272
"dlq_max_invalid_ratio": 0.01,
"dlq_max_consecutive_count": 1000,
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Mind removing these 2 lines? We experimented with various values but now I think we should just skip these (across the board not specific to your use case)

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure, should we remove from the other ones too?

Copy link
Member

@lynnagara lynnagara Mar 15, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes we probably should. But I'll double check and do it as a follow up -- let's just focus on the ingest-feedback-events-dlq here.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yep, sounds good

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

similarly, I noticed ingest-events consumer doesn't have a dlq_topic. Not something to worry about for this PR though

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm pretty sure it does have now. I just added it. You might need to rebase/merge master to see it.

Comment on lines -19 to -20
"ingest-events",
"ingest-events-dlq",
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks!

@aliu3ntry aliu3ntry enabled auto-merge (squash) March 15, 2024 23:29
@aliu3ntry aliu3ntry disabled auto-merge March 15, 2024 23:29
@aliu3ntry aliu3ntry merged commit 21831a3 into master Mar 15, 2024
49 checks passed
@aliu3ntry aliu3ntry deleted the aliu/config-feedback-dlq branch March 15, 2024 23:29
JonasBa pushed a commit that referenced this pull request Mar 17, 2024
Need to verify the values of `dlq_` fields in consumers/__init__. These
are used to create a DlqPolicy (line 509, same file)

requires getsentry/sentry-kafka-schemas#238
saponifi3d pushed a commit that referenced this pull request Mar 18, 2024
Need to verify the values of `dlq_` fields in consumers/__init__. These
are used to create a DlqPolicy (line 509, same file)

requires getsentry/sentry-kafka-schemas#238
@github-actions github-actions bot locked and limited conversation to collaborators Mar 31, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Scope: Backend Automatically applied to PRs that change backend components
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants