ScrapeFromTheApe

Melbourne jazz gig scraper. The scaper is designed for:

Implemented & Working

• Paris Cat
• Jazzlab
• Birds Basement
• Brunswick Green
• Uptown
• The Moldy Fig

Implemented & Not Working

• Open Studio
• Bar 303

To-Do

• The Fitzroy Pinnacle - PDF
• The Rooks Return - Facebook Feed (seems empty for gigs)
• Arts Centre - Need a genre filter for jazz/blues/funk
• The Night Cat
• Dizzy Jazz Club - Once it reopens again
• Lido Jazz Room
• Ruby's Music Room - Relocating & might be dead
• Vamos
• Speakeasy HQ - Mix of genres
• Tranist Rooftop Bar - Sometimes not jazz
• Claypots Seafood Bar - Website down, only facebook at the moment
• Rainbow Hotel
• La Niche Cafe
• New version of Jaspers once it opens
• Candlelight Series
• Lebowskis Music
• Spotted Mallard
  • Unfortunately they're dead

Something Missing?

Notice a venue missing that should be on the list? Create an issue & we'll endeavour to add it in. Better yet, raise a PR with the scaper :)

Running the scraper

First, ensure all libraries are installed:

cd ScrapeFromTheApe
pip install -r requirements.txt

To run a single spider, run:

scrapy crawl jazzlab

To run all spiders, run:

python crawl_all.py

Deployment

The API is managed via the serverless framework, using an AWS backend. To deploy, install the dependencies then run deploy using your desired AWS profile.

npm install
sls deploy --aws-profile <profile-name>