Skip to content

LordRusk/goscrape

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

70 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Go Report Card

Simple and efficient 4chan media scraper written in GO

Goscrape is a very simple and efficient 4chan media scraper written in go that supports multiple treads, custom download directories, and more!

How to install

go get github.com/lordrusk/goscrape

Binaries included in each release. Latest release found here.

How to use

-h for help menu.

-o for original filenames.

-c to set a custom directory.

Each arguement after opts treated as a link to thread.

Features

  • Goscrape is upwards of 4x faster then other scrapers, goscrape does this by using go's concurrency to download multiple images at the same time, taking advantage of more bandwidth. You won't find download speeds like this anywhere else.
  • Goscrape is cross-platform, works everywhere that go does out of the box! (Plan9, etc, etc)

Why?

Because all 4chan scrapers I've seen and used were written in python, I dislike python and wanted to make something in GO.