Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

high memory usage with no_ack=True #34

Open
christianwinkel opened this issue Dec 12, 2016 · 1 comment
Open

high memory usage with no_ack=True #34

christianwinkel opened this issue Dec 12, 2016 · 1 comment
Assignees

Comments

@christianwinkel
Copy link

Hi

I'm using amqpstorm 2.2.0 to consume messages from RabbitMQ.
I need a high rate of messages. With no_ack=false I increased the QOS value higher and higher to get better message rates. With ack I can reach up to 1.5k msg/s

Then I tried with no_ack=True and got the rates (4k/s) I needed. But the QUS value is ignored and it seems that amqpstorm reads all messages from RabbitMQ to its local queue.
The memory usage of my script raises until the system crasches ( this only happens if the rabbit queue is very big, after pausing the consumer for a few days).
Is there a way to limit the amount of used memory in amqpstorm basic.consume?

Chris

@eandersson eandersson self-assigned this Dec 12, 2016
@eandersson
Copy link
Owner

This is indeed a side effect of the current implementation when using no-ack set to True. I'll look into implementing some sort of back pressure functionality that could be used to prevent excessive message buildup.

@eandersson eandersson added this to the 3.X milestone Sep 27, 2017
@eandersson eandersson removed this from the 3.X milestone Mar 14, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants