Skip to content

syedissambukhari/Alibaba-scrapper-using-NodeJs

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Alibaba-scrapper-using-NodeJs

A react web application for Alibaba product scrapping

Alibaba Scraper using Node.js

Overview

This project is a web scraper built with Node.js for the backend. It is designed to scrape data from Alibaba, providing a convenient way to gather information from the platform.

Features

  • Web Scraping: The application uses a headless browser to scrape data from Alibaba. It can extract information such as product details, prices, and ratings.

  • Node.js Backend: The backend is powered by Node.js, handling the scraping logic and serving the data.

Prerequisites

Before running the project, ensure that you have the following installed:

  • Node.js and npm

Installation

  1. Clone the repository:

    git clone https://github.com/syedissambukhari/Alibaba-scrapper-using-NodeJs.git

1.Navigate to the project folder:

cd Alibaba-scrapper-using-NodeJs 2.Install dependencies: npm install

Configuration

1.Web Scraper Settings:

Open config.js and configure the scraper settings such as the URL to scrape, selectors, etc.

javascript

module.exports = { url: 'your-alibaba-url', // Other configuration options };

Modify the configuration according to your scraping requirements.

2.Run the Application:

Start the Node.js server:

npm start The application should now be running. Access it at http://localhost:3000 in your web browser.

Usage

Open the application in your web browser.

Enter the necessary parameters or click the "Scrape" button to initiate the scraping process.

View the scraped data on the console or modify the application to display it on a web interface.