Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature]: Watch Crawl: Graph Queued URLs & Pages Crawled #1792

Open
Shrinks99 opened this issue May 8, 2024 · 0 comments
Open

[Feature]: Watch Crawl: Graph Queued URLs & Pages Crawled #1792

Shrinks99 opened this issue May 8, 2024 · 0 comments
Labels
enhancement New feature or request front end Requires front end dev work ui/ux This issue requires UI/UX work

Comments

@Shrinks99
Copy link
Member

Shrinks99 commented May 8, 2024

What change would you like to see?

I would like more insight into how the crawl queue has grown over time, and how close it might be to finishing.

Screenshot 2024-05-08 144717

Context

We came up with this graph idea while crawling Vice but it never made it into an issue.

@edsu Also came up with this in parallel and prototyped it!! (Above image is also his)

From Ed on Mastodon:

I think it ought to be possible to use the data to project when the crawl might complete, by fitting a line to each and then projecting where they (hopefully) intersect...

@Shrinks99 Shrinks99 added enhancement New feature or request ui/ux This issue requires UI/UX work front end Requires front end dev work labels May 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request front end Requires front end dev work ui/ux This issue requires UI/UX work
Projects
Status: Triage
Development

No branches or pull requests

1 participant