Skip to content

Scraped YouTube site for video links and other meta-data

Notifications You must be signed in to change notification settings

m0-k1/YouTube-Scrapping

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

27 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

YouTube Scraping

In this repository, I have showcased my scraping ability by scraping YouTube 😄

Approach Used - : 🤔

  • First I collected more than 500 links from youtube search page. Used Selenium for automation process.

  • Saved the links in a seperate file. Saving up the links will allow one not to collect links over and over again.

  • Then searched through each link and extracted the following - Video Title, Video Views, Uploading Date, Likes on that video, Dislikes on the video and Comments.

  • Coverted the data into a DataFrame and Saved the result in csv format.

  • Being this a scrapper, care has been taken if there are connection problems and will save up the data collected prior to the connection problem or other problems.

  • A tip for those who want to scrap sites like YouTube -

      Scrapping comments section will take a really long time if there are many comments. Be careful while scrapping those.    
      Always save your progress time to time as no one wants to start all over again, especially when you are playing a video game.
    

Finally, I have made a dataset of 500+ links with the above data is uploaded in this repository. Do check it out!!:sunglasses:

Author 📖