New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Backend response duration is too high #3419
Comments
There's lot of ways to improve the perf of TraceQL! Listed in the order I think you should consider them:
|
@joe-elliott thank you for your reply! I'll try it on next week and give feedback about what really helped us! |
This issue has been automatically marked as stale because it has not had any activity in the past 60 days. |
I apologize for such a long duration, so there is our feedback. We've used your 1, 3, and 4 advices and I can certainly say that their order by value in terms of performance is absolutely right for us. We've noticed good changes immediately by optimizing our TraceQL queries. The second one has helped a lot as well. We drop the most heavy and useless attributes in our collector and there are some results: our storage has been filling up more slower and tempo search has been working more faster since these changes have been made. And the fourth one has made the most minor improvements, anyway it's better than nothing :) |
Describe the bug
Hi! We use Grafana Tempo in our team. We faced the issue recently that simple query takes so much time. How can we tune Tempo performance to see traces immediately?
Query:
Response time:
To Reproduce
Steps to reproduce the behavior:
Expected behavior
See traces immediately
Environment:
Additional Context
We use tempo-operational dashboard to monitor our Tempo instance. And there are what we see on screenshots below:
We think that there is the problem in Querier component directly. So we gave him a lot of resources, but it still works slowly.
How can we boost perfomance?
The text was updated successfully, but these errors were encountered: