Skip to content

eulogik/liveScrape

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

14 Commits
 
 
 
 
 
 
 
 

Repository files navigation

livescrape

Live Scraping service using Express, Cheerio & Artoo-JS on NodeJS. ##NPM Package

https://www.npmjs.com/package/livescrape

##Getting Started Install npm package by npm install livescrape and run as a service on http://localhost:3030. Call the service on http://localhost:3030/scrape with parameters url, repeatedNode and params

###Example parameters:

url = "http://www.amazon.in/s/ref=sr_pg_6?rh=i%3Aaps%2Ck%3Acomputer+table&page=6&keywords=computer+table&ie=UTF8&qid=1459248975&spIA=B015W1X4A4,B015W1X45E,B01683PX36,B01683PK8Y,B019A5PKWS,B01683PPTS,B01D1N852W,B0198NC5DO&lo=apparel";
repeatedNode = '#s-results-list-atf a.s-access-detail-page';
params = {url: 'href', title: 'text', img: function(){return $(this).parent().parent().parent().find('img.s-access-image').attr('src')}, category: function(){return $(this).parent().parent().find('a.a-size-small>span.a-text-bold').text().slice(0, -1);}};

Handcrafted by Eulogik (http://eulogik.com)

About

Live Scraping example using Cheerio & Artoo-JS

Resources

Stars

Watchers

Forks

Packages

No packages published