Skip to content

Python scripts for ETL (extract, transform and load) jobs for Klaytn blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions.

License

klaytn/klaytn-etl

Repository files navigation

Klaytn ETL

Klaytn ETL lets you convert Klaytn blockchain data into convenient formats like JSONs, CSVs and relational databases. This is a fork of Ethereum ETL.

Full documentation available here.

Notice: Klaytn ETL is still on the beta version. However, CLIs are all functional.

Quickstart

Install Klaytn ETL:

pip3 install klaytn-etl-cli

Export blocks and transactions

> klaytnetl export_blocks_and_transactions --start-block 0 --end-block 5000 \
--blocks-output blocks.json --transactions-output transactions.json

Export ERC20 and ERC721 transfers

> klaytnetl export_token_transfers --start-block 0 --end-block 5000 \
--output token_transfers.json

Export traces

> klaytnetl export_traces --start-block 0 --end-block 5000 \
--output traces.json

Find other commands here.

For the latest version, check out the repo and call

> pip3 install -e . 
> python3 klaytnetl.py

Running in Docker

  1. Install Docker https://docs.docker.com/install/

  2. Build a docker image

    > docker build -t klaytn-etl:latest .
    > docker image ls
  3. Run a container out of the image

    > docker run -v $HOME/output:/klaytn-etl/output klaytn-etl:latest export_all -s 0 -e 5499999 -b 100000
    > docker run -v $HOME/output:/klaytn-etl/output klaytn-etl:latest export_all -s 2018-01-01 -e 2018-01-01

About

Python scripts for ETL (extract, transform and load) jobs for Klaytn blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions.

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages