Skip to content

Go Scraper and Processor for Similar Manga Recommendations

License

Notifications You must be signed in to change notification settings

nekomangaorg/similar-processor

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Similar Manga Recommendations

This repo has both the scraping and matching utilities to find mangas which are close in content to others. The idea is to create a recommendation system outside MangaDex since there isn't one and thus allow for users to discover other content.

This is a fork of https://github.com/similar-manga/similar with the primary changes being optimizations for processing and scraping to run this in a github workflow.

Setup / Dependencies

Client was generated using then tweaked to remove excess swagger. You will need to setup a golang workspace, and then run the following commands. Only manga need to be downloaded / scraped from mangadex to be able to perform similar manga identification.

go get .
go build

Runtime Instructions

The application uses cobra for flags cli processing. running ./similar will give you a list of commands.

Manga Links Data

Key Related site URL URL details
al anilist https://anilist.co/manga/`{id}` Stored as id
ap animeplanet https://www.anime-planet.com/manga/`{slug}` Stored as slug
bw bookwalker.jp https://bookwalker.jp/`{slug}` Stored has "series/{id}"
mu mangaupdates https://www.mangaupdates.com/series.html?id=`{id}` Stored has id
nu novelupdates https://www.novelupdates.com/series/`{slug}` Stored has slug
kt kitsu.io https://kitsu.io/api/edge/manga/`{id}` or https://kitsu.io/api/edge/manga?filter[slug]={slug} If integer, use id version of the URL, otherwise use slug one
amz amazon N/A Stored as full URL
ebj ebookjapan N/A Stored as full URL
mal myanimelist https://myanimelist.net/manga/{id} Store as id
raw N/A N/A Stored as full URL, untranslated stuff URL (original language)
engtl N/A N/A Stored as full URL, official english licenced URL

About

Go Scraper and Processor for Similar Manga Recommendations

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages