Skip to content
This repository has been archived by the owner on Mar 24, 2023. It is now read-only.

tommeagher/irescraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

54 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Schedule scraper for IRE conferences

This is a command-line Python program that will generate a convenient CSV of the schedules for the annual conferences held by Investigative Reporters and Editors. The program is completely rewritten after growing out of an earlier iteration.

A CSV of the schedule for the NICAR 2016 conference in Denver was generated with the script.

The script also generates a version of the CSV that is easy to import into your Google Calendar.

Schedules for previous conferences are stored in the aptly named pastyears/ dir.

If you want to run this program on your own machine, here's how to do it.

Getting started

I use virtualenv and virtualenvwrapper to manage my Python environments. If you use something else, adjust the instructions accordingly.

git clone git@github.com:tommeagher/irescraper.git   #clone the repo from Github
cd irescraper
mkvirtualenv ire   #make and activate your virtual environment
pip install -r requirements.txt   #install the dependencies

Running the command-line script

It's as easy to run as python sched.py. Without specifying which conference you want (either NICAR or IRE), this will look for the schedule page for the current year's NICAR by default and save it to a CSV called nicar2016sched.csv.

If you want the schedule for the organization's other marquee event--IRE--then try python sched.py ire.

There are a few other optional command-line arguments as well:

 
  -h, --help  show this help message and exit
  -g          Create a CSV in a Gcal-friendly format.
  -u URL      Pass in a different URL to scrape from the standard pattern.
  -y YEAR     Perhaps you want a previous year?

If you want instructions on how to get the Gcal version into your Google Calendar, read these handy instructions.

Contributors

##Etc. If you spot a bug, have questions or ideas for improvement, please file a ticket or ping me on Twitter.

About

Scrapers to grab the schedule for IRE and NICAR conferences

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages