Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Limit rate of ingestion at haystack-collector for incoming spans #781

Open
doctorXWrites opened this issue Sep 25, 2019 · 1 comment
Open

Limit rate of ingestion at haystack-collector for incoming spans #781

doctorXWrites opened this issue Sep 25, 2019 · 1 comment
Assignees
@doctorXWrites
Labels
enhancement

Comments

@doctorXWrites
Copy link
Contributor

This is to safeguard the system from getting overwhelmed in case of unplanned extreme traffic increase. This does not mean we are trading anything with scalability. This is just to ensure the smooth capacity planning and scalability for downstream services in case of onboarding new services and handle unplanned traffic increases if resources are constrained.

Guava rate limiter is one option that could be used here.
@doctorXWrites doctorXWrites self-assigned this Sep 25, 2019
@doctorXWrites
Copy link
Contributor Author

Here is WIP branch https://github.com/ExpediaDotCom/haystack-collector/compare/rate_limiter

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@doctorXWrites doctorXWrites

Labels
enhancement
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@doctorXWrites