Skip to content
@trandoshan-io

Trandoshan Crawler

Project is migrated to https://github.com/darkspot-org/bathyscaphe

Pinned

  1. crawler crawler Public archive

    Go process used to crawl websites

    Go 150 21

  2. k8s k8s Public archive

    Kubernetes configuration file to boostrap trandoshan cluster

    Shell 46 11

  3. trandoshan-parent trandoshan-parent Public archive

    Parent repository used to centralize tools to run the application, manage source code, ...

    Shell 21 7

Repositories

Showing 9 of 9 repositories
  • dashboard Public archive

    Web UI to manage a Trandoshan instance

    TypeScript 11 5 0 7 Updated Jul 31, 2020
  • scheduler Public archive

    Go orchestrator process used to schedule website parsing

    Go 6 GPL-3.0 4 0 0 Updated Dec 20, 2019
  • trandoshan-parent Public archive

    Parent repository used to centralize tools to run the application, manage source code, ...

    Shell 21 7 0 0 Updated Dec 20, 2019
  • persister Public archive

    Go process used to abstract database interaction. It consumes messages from queue and put result in database allowing asynchronous saving operation

    Go 7 GPL-3.0 4 0 (1 issue needs help) 0 Updated Dec 19, 2019
  • api Public archive

    REST API used by other processes to gather data

    Go 5 GPL-3.0 4 0 0 Updated Dec 19, 2019
  • feeder Public archive

    Oneshot process used to put an URL in the todo queue. Useful to start crawling process

    Go 2 GPL-3.0 2 0 0 Updated Dec 19, 2019
  • crawler Public archive

    Go process used to crawl websites

    Go 150 GPL-3.0 21 0 0 Updated Dec 19, 2019
  • k8s Public archive

    Kubernetes configuration file to boostrap trandoshan cluster

    Shell 46 11 0 0 Updated Oct 15, 2019
  • amqp Public archive

    Go wrapper for streadway/amqp

    Go 0 1 0 0 Updated Aug 2, 2019

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…