Skip to content

Downloads demos from QTVs, uploads to file storage and stores info in database.

License

Notifications You must be signed in to change notification settings

vikpe/qw-demo-scraper

Repository files navigation

QuakeWorld Demo Scraper

Downloads demos from QTVs, uploads to file storage and stores info in database

image

Process

  1. Check QTVs for recent demos
  2. Compare to demos already in database
  3. Upload demo to file storage
  4. Parse and add info to database
  5. Prune (delete) old demos

Stack

  • File storage: AWS S3
  • Database: supabase
  • Languages: python + shell script

Rules

Skipped demos

  • game in progress
  • already in database

Ignored demos

  • with bots
  • where game is breaked/aborted
  • with non-standard settings (dmm4 etc)

About

Downloads demos from QTVs, uploads to file storage and stores info in database.

Topics

Resources

License

Stars

Watchers

Forks

Sponsor this project