Skip to content

gnagel/kickscraper

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Kickscraper

Kickscraper is a library for interfacing with Kickstarter's undocumented/unannounced API. With it, you can get a lot of data about projects, whether you've backed them or not, including reward levels, amount pledged, links to the videos, updates, if it's been successful or not, and details about the creator.

I've begun to document all the types of data available on the Wiki for this project.

Installation

$ gem install kickscraper

Or for use in another app, add it to your Gemfile # stay crazy up to date' gem 'kickscraper', :git => 'git://github.com/markolson/kickscraper.git' # or use prebuilt gems that are probably pretty stable gem 'kickscraper'

Status

After several hours of quick hacking and copy-pasting, Kickscraper is able to authenticate against the Kickstarter API, store the returned oauth token and user object, fetch the user's backed projects, and view updates for those projects.

Left to do:

  • Gettings/caching for different endpoints
  • Error handling
  • Pagination support
  • Refactor to use object.urls.api values to construct gettings dynamically?
  • Testing!

Sample Usage

Provided with your user credentials this will list the first 20 or so projects you've backed, along with if the project is still active and if it has met it's funding goal.

require 'kickscraper'

Kickscraper.configure do |config|
	config.email = 'your-kickstarter-email-address@domain.com'
	config.password = 'This is not my real password. Seriously.'
end

client = Kickscraper.client
puts " A | C |"
puts "------------------------"
client.user.backed_projects.each {|x| 
	print (x.active? ? ' X |' : '   |')
	print (x.successful? ? ' X | ' : '   | ')
	puts x.name
}

API Examples

c = Kickscraper.client

c.user.class
=> Kickscraper::User

# List what data is available on an object
c.user.keys
=> ["id", "name", "slug", "avatar", "urls", "location", 
	"biography", "backed_projects_count", "created_projects_count", 
	"unread_messages_count", "unanswered_surveys_count", 
	"starred_projects_count", "social", "send_newsletters", 
	"category_wheel", "notify_of_backings", "notify_of_updates", 
	"notify_of_follower", "notify_of_friend_activity", 
	"notify_of_comments", "notify_mobile_of_backings", 
	"notify_mobile_of_updates", "notify_mobile_of_follower", 
	"notify_mobile_of_friend_activity", "notify_mobile_of_comments", 
	"updated_at", "created_at"]


# In addition, User types have "backed_projects" and "starred_projects" available.
c.user.backed_projects
=> [<Project: 'The Veronica Mars Movie Project'>, <Project: 'RiffTrax Wants to Riff TWILIGHT Live in Theaters Nationwide!'>, <Project: 'To Be Or Not To Be: That Is The Adventure'>, <Project: 'Planetary Annihilation - A Next Generation RTS'>, <Project: 'OUYA: A New Kind of Video Game Console'>, <Project: 'Gotham Knight Terrors: Comedic Batman Short'>, <Project: 'Internet Meme Playing Cards'>, <Project: 'GOOD JOB, BRAIN! - A Trivia & Quiz Show Podcast'>, <Project: 'Elevation Dock: The Best Dock For iPhone'>, <Project: 'Trebuchette - the snap-together, desktop trebuchet'>]

# Some values are already converted to their appropriate types. Some aren't yet.
c.user.backed_projects.first.creator.class
=> Kickscraper::User

# You can chain methods together and dig into the objects.
# So get the thumbnail of the person that created the latest project we backed
c.user.backed_projects.first.creator.avatar.thumb

# You can search for projects
c.search_projects('veronica mars')
=> [<Project: 'The Veronica Mars Movie Project'>, <Project: 'Prodigal Daughter - TV Show Pilot'>]

# and view their rewards or updates, in addition to any of the data found in the "keys"
vm = c.search_projects('veronica mars').first
vm.updates
=> [...]
vm.successful?
=> true
vm.video.high
=> "https://d2pq0u4uni88oo.cloudfront.net/projects/56284/video-217182-h264_high.mp4?2013"

# print all the updates for all the current user's projects
c.user.backed_projects.each { |project|
	puts project.name.upcase
	project.updates.reverse.each { |update|
		# strip the HTML out of the body, since this outputs to a terminal
		puts "Update #{update.sequence}: #{update.body.gsub(/<\/?[^>]*>/, "")}\n\n"
	}
	puts "\n\n"
}

Contributing

There are two good ways to contributes:

First, by using it and creating Issues (or pinging me on twitter @mark_olson) as you find problems or rough spots. Second, by taking matters into your own hands:

  1. Fork it
  2. Create your feature branch (git checkout -b my-new-feature)
  3. Commit your changes (git commit -am 'Add some feature')
  4. Push to the branch (git push origin my-new-feature)
  5. Create new Pull Request

Releases

No releases published

Packages

No packages published