Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

profile browser fixes: better resource usage + load retry #1599

Merged
merged 1 commit into from Mar 15, 2024

Conversation

ikreymer
Copy link
Member

  • Backend: Use separate resource constraints for profiles: default profile browser resources to either 'profile_browser_cpu' / 'profile_browser_memory' or single browser 'crawler_memory_base' / 'crawler_cpu_base', instead of scaled to the number of browser workers

  • Frontend: check that profile html page is loading, keep retrying if still getting nginx error instead of loading an iframe with the error.

  • Fixes [Feature]: Profile resources + loading improvements #1598
    (Prepared for 1.9.4 release)

- default profile browser resources to either 'profile_browser_cpu' / 'profile_browser_memory' or single browser 'crawler_memory_base' / 'crawler_cpu_base',
instead of scaled to the number of browser workers
- frontend: check that profile html page is loading, retry if getting nginx error
- fixes #1598
@ikreymer ikreymer requested a review from tw4l March 15, 2024 05:46
Copy link
Contributor

@tw4l tw4l left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great! And this solves the issue of profile browsers sometimes not loading in local dev environment, so that's fantastic!

@ikreymer ikreymer merged commit 8945249 into v1.9.4-release Mar 15, 2024
6 checks passed
@ikreymer ikreymer deleted the profile-fix-1.9.4 branch March 15, 2024 17:59
ikreymer added a commit that referenced this pull request Mar 16, 2024
- Backend: Use separate resource constraints for profiles: default
profile browser resources to either 'profile_browser_cpu' /
'profile_browser_memory' or single browser 'crawler_memory_base' /
'crawler_cpu_base', instead of scaled to the number of browser workers

- Frontend: check that profile html page is loading, keep retrying if
still getting nginx error instead of loading an iframe with the error.

Fixes #1598 (Copy of #1599 from 1.9.4)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants