A set of tools to collect and process Decentraland's data into actionable insights.

How it works:

• All data is collected from public sources (e.g. blockchain or indexing services).
• The scripts run on daily bases and publish the raw data in CSV and JSON formats.
• The data also funneled into Google Sheet and Google DataStudio for further analysis.

Design Principles

• Accessible: Publish the data in many formats.
• Auditable: Open source code and public workflow logs.
• Simple: Easy to understand, easy to contribute.

Third Party Providers

• Infura: Blockchain provider.
• Snapshot: Off-chain voting.
• Catalyst's API: POIs and members Names.
• CovalentHQ: Transfers and balances.

Data Soruces

• Proposals
• Members
• Votes
• Grants
• Balances
• Transactions
• Curations
• API

Outputs Formats

• Transparency Page
• Google Data Studio
• Google Sheets
• Raw Data in CSV and JSON
• Run Logs

Contributing

Feel free to create a Github issue with your suggestions or find us at the DAO's Discord Server on the #general channel.

The commands you need to setup and use the enviroment are:

# Install dependencies
npm install
npm link typescript

# Set up your environment variables
cp .env.example .env
pico .env

# Run script that exports files to ./public/
npx ts-node export-xxxxx.ts

# Upload CSV to shpreadsheet
npx ts-node upload.ts SHEET_NAME ./public/xxxxx.csv

# Add a job the the daily process that collects and publish data
pico .github/workflows/pull-data.yml

# Run tests
npm run test

Copyright & License

This repository is protected with a standard Apache 2 license. See the terms and conditions in the LICENSE file.