Skip to content

A microservice-based video hosting website with additional functionality for group content archival from Bilibili, Niconico, and Youtube

Notifications You must be signed in to change notification settings

animelover1984/horahora

Repository files navigation

horahora

Horahora is a microservice-based video hosting website with additional functionality for group content archival from Niconico, Bilibili, and Youtube.

This project is a WIP, and under active development.

Join our discord here: https://discord.gg/psuj8QQ

Architecture

Currently, there are three microservices:

  1. User Service, which handles registration, logins, and JWT validation
  2. Video Service, which handles video uploads (both from Scheduler and from users), transcoding/chunking as required for DASH, uploads to the origin, and storage of metadata.
  3. Scheduler, which handles content archival requests from users. For example, if a user specifies that they'd like all videos on Niconico with the tag "YTPMV" to be downloaded, Scheduler will download those videos, register them (and their associated creator) with video service and user service, and check that category of content regularly for new videos.

All microservices are horizontally scalable, containerized, and communicate via gRPC.

The MVP will also consist of a frontend service to handle HTML templating, and a Censorship Service (name is a WIP) to manage the workflow for video approvals, and censorship of obscene content from foreign websites.

How to Use

Currently, only local use is supported. To run horahora locally, follow these steps:

  1. First install the following depdendencies:
  • Flyway
  • Docker
  • Kubernetes
  1. Start minikube, and use ./run-local.sh in the Kubernetes directory. If the database migrations fail to apply, keep running run-local.sh until they succeed.
  2. Run ./build.all.sh to build all Docker images and send to the Docker daemon within minikube
  3. ./run-tests.sh will run local integration tests. Currently, this will send an archival request to scheduler for all YTPMVs on Niconico.

Task Roadmap

Missing features are tracked using Trello.

Our Trello board is: https://trello.com/b/Rm5TPR4Q/horahora

About

A microservice-based video hosting website with additional functionality for group content archival from Bilibili, Niconico, and Youtube

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published