Skip to content

rugpullindex/crawler-data

 
 

Repository files navigation

neume-network/data

Index data data quality assurance

On-chain music NFT data.

Introduction

The Neume Network's goal is to build an open source, socially scalable, indexer for all activity within the emerging Web3 Music industry.

In this repository, we're frequently crawling the entire Ethereum main network on platforms like:

  • Zora
  • Catalog V1 & V2
  • Mint Songs V2
  • Sound.xyz & Sound Protocol
  • Noizd

for the latest music NFT releases. Every x minutes, a GitHub Action is fired that partially crawls a block range delta depending on the last crawl and so new music NFTs are continuously and automatically committed to this repository's results folder. For https://musicos.xyz/, we have a special file called results/music-os-accumulator-extraction that contains all neatly- formatted track metadata in a parsable JSON file. Our goal is to enable anyone to build the Spotify for Web3.

Continuous Data Retrieval

  • You can find a list of indexing jobs on the GitHub Action's page.
  • Consider also checking out the GitHub Actions work flow file.
  • Note: Neume Network doesn't have to be run on GitHub Actions. It's best run on a Unix machine that has an Erigon node running too.

Continuous Data Quality Assurance

  • All track data within results/music-os-accumulator-extraction is neatly-formatted according to the JSON schema of @neume-network/schema.
  • We ensure consistency over any track's uniqueness in the list.

Can I use this data?

I (Tim) currently don't know how to best license the data in the repository. For the time being if you're in doubt about being able to use this data: Consider configuring and running neume network yourself to download a similar data set as ours!

About

On-chain music NFT data.

Resources

Code of conduct

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • JavaScript 89.9%
  • Shell 10.1%