Dask-Avro

Avro reader for Dask.

Features

This projects provides an Avro format reader for Dask. Provides a convenient function to read one or more Avro files and partition them arbitrarily.

Usage:

import dask.bag
import dask_avro

delayeds = dask_avro.read_avro("data-*.avro", blocksize=2**26)
data = dask.bag.from_delayed(delayeds)

This package was created with Cookiecutter and the rmax/cookiecutter-pypackage project template.

Name		Name	Last commit message	Last commit date
Latest commit History 35 Commits
docs		docs
examples		examples
src/dask_avro		src/dask_avro
tests		tests
.bumpversion.cfg		.bumpversion.cfg
.cookiecutterrc		.cookiecutterrc
.coveragerc		.coveragerc
.editorconfig		.editorconfig
.gitignore		.gitignore
.travis.yml		.travis.yml
AUTHORS.rst		AUTHORS.rst
CONTRIBUTING.rst		CONTRIBUTING.rst
HISTORY.rst		HISTORY.rst
LICENSE		LICENSE
MANIFEST.in		MANIFEST.in
Makefile		Makefile
README.rst		README.rst
TODO.rst		TODO.rst
VERSION		VERSION
pytest.ini		pytest.ini
requirements-dev.txt		requirements-dev.txt
requirements-tests.txt		requirements-tests.txt
requirements.txt		requirements.txt
setup.cfg		setup.cfg
setup.py		setup.py
tox.ini		tox.ini