Contrail Data Pipeline for OpenStack Clouds
-
Updated
Apr 20, 2017 - Python
Contrail Data Pipeline for OpenStack Clouds
Reactive Streams distributed datapipeline for data process. Now support kafka,jdbc,kudu,elasticsearch,hdfs.etc
High speed message passing between various queues and services
A data pipeline to daily pull public transport data from the opentransportdata.swiss portal. This pipeline has three tasks, pull the right data from opentransportdata.swiss, push the data to s3 for storage, and transform and load the transformed data to a database. Hopefully this repository helps people explain ETL / Batch data pipeline.
Code for creating the flying furniture dataset. Used for The Flying Furniture Challenge, an in-class kaggle competition.
Domain-specific language to help build and maintain AWS Data Pipelines
A data pipeline to analyze real time cryptocurrency price
CLI tool to simplify AWS DataPipeline deployment and management
a micro batch processing pipeline
Process any type of data in your projects easily, control the flow of your data.
Add a description, image, and links to the datapipeline topic page so that developers can more easily learn about it.
To associate your repository with the datapipeline topic, visit your repo's landing page and select "manage topics."