Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Hawtio-Online installs are displaying an nginx "429 Too Many Requests" error #272

Open
phantomjinx opened this issue Dec 20, 2023 · 4 comments
Open

Hawtio-Online installs are displaying an nginx "429 Too Many Requests" error #272

phantomjinx opened this issue Dec 20, 2023 · 4 comments
Assignees
@phantomjinx
Milestone
2024Q2

Comments

@phantomjinx
Copy link
Member

image

Consider how to modify the rate limiting of the web server.
@phantomjinx phantomjinx added this to the 2.0.0 milestone Dec 20, 2023
@phantomjinx phantomjinx self-assigned this Dec 20, 2023
@phantomjinx
Copy link
Member Author

phantomjinx commented Dec 20, 2023 •
edited

Logs from app:

2023/12/20 06:09:35 [error] 23#23: *58720 limiting connections by zone "limitconnbyaddr", client: 172.17.45.21, server: localhost, request: "GET /maste
r/api/v1/namespaces/openshift-operators/pods?watch=true HTTP/1.1", host: "hawtio-online-hawtio.hawtio-cluster-XXXXX"

172.17.45.21 - - [20/Dec/2023:06:09:35 +0000] "GET /master/api/v1/namespaces/openshift-operators/pods?watch=true HTTP/1.1" 429 564 "-" "Mozilla/5.0 (X1
1; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36" "10.244.0.5"

2023/12/20 06:09:35 [error] 23#23: *58721 limiting connections by zone "limitconnbyaddr", client: 172.17.11.234, server: localhost, request: "GET /mast
er/api/v1/namespaces/xxxxx-cert-store/pods?watch=true HTTP/1.1", host: "hawtio-online-hawtio.hawtio-cluster-XXXXX"

172.17.11.234 - - [20/Dec/2023:06:09:35 +0000] "GET /master/api/v1/namespaces/xxxxx-cert-store/pods?watch=true HTTP/1.1" 429 564 "-" "Mozilla/5.0 (X11; L
inux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36" "10.244.0.4"

2023/12/20 06:09:35 [error] 23#23: *58722 limiting connections by zone "limitconnbyaddr", client: 172.17.11.234, server: localhost, request: "GET /mast
er/api/v1/namespaces/hawtio/pods?watch=true HTTP/1.1", host: "hawtio-online-hawtio.hawtio-cluster-XXXXX"

172.17.11.234 - - [20/Dec/2023:06:09:35 +0000] "GET /master/api/v1/namespaces/hawtio/pods?watch=true HTTP/1.1" 429 564 "-" "Mozilla/5.0 (X11; Linux x86
_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36"

@phantomjinx
Copy link
Member Author

Trying to implement limitations, either through max connections by IP or rate limiting causes parts of the application to fail in different ways. For example, rate limiting to 40 connections / second seems like a good solution (even inserting only in the /online location) yet opening up the app in 5 different tabs kills the 5th tab.

Implementation of any conn/rate limiting is going to require a much more sophisticated approach if it is indeed necessary.

@tadayosi glad for your input on this.

phantomjinx added a commit to phantomjinx/hawtio-online that referenced this issue Dec 20, 2023
@phantomjinx
fix: Removes connection limiting for the moment hawtio#272
5d16a87 
* Trying to connection or rate limiting requests to the nginx server
  fails to provide a satisfactory working application

* Even rate limiting to 40 requests/second can kill the application by
  simply opening it in 5 different tabs

* Needs a far more sophisticated understanding of how to handle implementing
  such limits
@phantomjinx phantomjinx mentioned this issue Dec 20, 2023
Merged
@phantomjinx
Copy link
Member Author

Created #273 in the interim to workaround the too many requests errors.

phantomjinx added a commit that referenced this issue Dec 21, 2023
@phantomjinx
fix: Removes connection limiting for the moment #272
e40f1d5 
* Trying to connection or rate limiting requests to the nginx server
  fails to provide a satisfactory working application

* Even rate limiting to 40 requests/second can kill the application by
  simply opening it in 5 different tabs

* Needs a far more sophisticated understanding of how to handle implementing
  such limits
@phantomjinx phantomjinx modified the milestones: 2.0.0, 2024Q1 Dec 21, 2023
@phantomjinx
Copy link
Member Author

Pushing to subsequent milestone.

@tadayosi tadayosi modified the milestones: 2024Q1, 2024Q2 Apr 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@phantomjinx phantomjinx

Labels
None yet
Projects
Kanban Board
Status: Todo
Milestone
2024Q2
Development

No branches or pull requests
2 participants
@tadayosi @phantomjinx