Skip to content

AndrewMishchenko/thumbtack

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

THUMBTACK

A example of getting a questions and answers from thumbtack.com.

  • Takes all URLs to thumbtack works
  • Returns all questions + answers

Uses:

  • Python3 selenium web driver
  • Multiprocessing module
  • Approximately 1 gigabyte of RAM

Returns:

  • result.txt with the results of data parsing

Installation

Requires Chromedriver. But for Windows it is present!

Install dependencies and starting the parser.

$ virtualenv -p python3 env
$ source env/bin/activate
$ pip install -r requirements.txt
$ python main.py

Using this script, you take full responsibility for the possible consequences of using it!

Good luck!

About

An example of getting a questions and answers from thumbtack.com

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages