Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

investigate coalescing first and second phase of indexing #4336

Open
vladak opened this issue May 3, 2023 · 0 comments
Open

investigate coalescing first and second phase of indexing #4336

vladak opened this issue May 3, 2023 · 0 comments

Comments

@vladak
Copy link
Member

vladak commented May 3, 2023

As identified when indexing AOPS, the first phase of indexing (when the history cache is generated) can take a long time due to one of the repositories having much bigger revision/commit count than the rest of the repositories which leads to under-utilization of the CPU. It basically leads to a long tail of the first phase. The second phase of the indexing can currently start only after the first phase is completed. To speed up the overall indexing time, some thought should be given to whether it is possible to coalesce the first and second phase (on per repository level).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant