Skip to content

Crawls a URL following same-domain hyperlinks and saves path and page size in KB into a CSV file.

Notifications You must be signed in to change notification settings

norbu35/site-pagesize-crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 

Repository files navigation

site-pagesize-crawler

Crawls a URL following same-domain hyperlinks and saves path and page size in KB into a CSV file.

Usage

python crawl_webpage_sizes.py [http(s)://example.com]

Saves data into crawled_pages_sizes.csv

About

Crawls a URL following same-domain hyperlinks and saves path and page size in KB into a CSV file.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages