Skip to content

Latest commit

 

History

History
15 lines (9 loc) · 359 Bytes

README.md

File metadata and controls

15 lines (9 loc) · 359 Bytes

web-scraper.py

Usage

There are three main flags you need feed the script:

python3 web-scraper.py --seed --verbose --outfile

--seed is a requirement, it is the seed URL from which the program scrapes

--verbose will print out to the terminal which URLs were accepted or rejected

--outfile is the file to which the scraped text is saved