Skip to content

Lazar-T/gumtree-crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

20 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

gumtree-crawler

About

Spider built with Scrapy. Uses Tor and polipo. Crawls gumtree.com.au and gets fields such as: name, location, sender, description, job type. There are 30k+ job postings currently available.

Screenshot

Screenshot

Installation and Running

git clone https://github.com/Lazar-T/gumtree-crawler
cd gumtree-crawler
scrapy crawl gumtree

Testing

scrapy check gumtree

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages