Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

I want to crawl a custom sitemap.xml or CSV file #4057

Open
mgifford opened this issue Jan 10, 2024 · 1 comment
Open

I want to crawl a custom sitemap.xml or CSV file #4057

mgifford opened this issue Jan 10, 2024 · 1 comment

Comments

@mgifford
Copy link

Feature/improvement

Is it possible to evaluate a list of URLs from either a custom sitemap.xml or CSV file.

Crawling is great, but there are times you want to actually be able to compare the same URLs you evaluated 6 months ago, with what you have now.

I know this is possible in Unlighthouse, and am a bit surprised it isn't in the documentation. I can't find it in the code either.

@soulgalore
Copy link
Member

Hi @mgifford you can run your test with a text file with each URL on a new row. I can make that more visible in the documentation.

urls.txt

https://www.sitespeed.io
https://www.sitespeed.io/documentation/

And run like this:

sitespeed.io urls.txt

Collecting from a sitemap maybe, but for now I would use some tool to parse a sitemap to a text file.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants