BentoML
How to implement rabbitmq on BentoML ? #4179
Unanswered
congdaoduy298
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi community,
Currently, I'm using BentoML to deploy my model and when I sent multiple requests I got this error: "bentoml.exceptions.ServiceUnavailable: Service Busy". I found this topic that said BentoML queues the RESTful requests #2242 but I don't know why some of my requests got the above error. How can I fix it or how can I implement something like rabbitmq to distribute requests ?
Thank you for your help.
Beta Was this translation helpful? Give feedback.
All reactions