Alluxio, data orchestration for analytics and machine learning in the cloud

Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.

cloud-native file store

An open source, standard data file format for graph data storage and retrieval.

A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for cloud data warehouse and Metabase to serve the needs of data visualizations such as analytical dashboards.

Data-aware orchestration with dagster, dbt, and airbyte

Data Engineering - Metropolitan Transportation Authority (MTA) Subway Data Analysis

This repo contains a dataset, exercises, and sample code for an end-to-end SAP BTP data-to-value bootcamp covering SAP HANA Cloud, SAP Data Warehouse Cloud, SAP Data Intelligence Cloud, and SAP Analytics Cloud.

A new Airflow Provider for Fivetran, maintained by Astronomer and Fivetran

Best practices for data workflows, integrations with the Modern Data Stack (MDS), Infrastructure as Code (IaC), Cloud Provider Services

An operator for managing Alluxio system on Kubernetes cluster

Bring Infrastructure as Code best practices to your data workflows with Kestra and Terraform

CI/CD repository template to automate deployments of your production flows

A simple pipeline infrastructure with ETL pipeline contained in a Docker environment on Apache Airflow for orchestration and Postgres for data warehousing

Get started with Dagster ASAP

Data orchestration repo with Docker deployment

Working with SCD Type (Change Data Capture) and need a Data Vault model to test Azure Data Factory v2? - This Code with Help!

Combine all four layers of analytics (descriptive, diagnostic, predictive, and prescriptive) on crypto data in a dashboard format as a web application.

Prefect - Data orchestration tool practice & learning

A poor-man's data lake fill with ducks