Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.
-
Updated
Jun 12, 2024 - Java
Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.
An open source, standard data file format for graph data storage and retrieval.
Alluxio, data orchestration for analytics and machine learning in the cloud
Best practices for data workflows, integrations with the Modern Data Stack (MDS), Infrastructure as Code (IaC), Cloud Provider Services
cloud-native distributed storage
A new Airflow Provider for Fivetran, maintained by Astronomer and Fivetran
I created this repo to follow along with the examples in the Dagster University Essentials course.
Data Engineering - Metropolitan Transportation Authority (MTA) Subway Data Analysis
Get started with Dagster ASAP
End to End data engineering project
An operator for managing Alluxio system on Kubernetes cluster
CI/CD repository template to automate deployments of your production flows
Repository to store scripts and notes on Airflow
A poor-man's data lake fill with ducks
Bring Infrastructure as Code best practices to your data workflows with Kestra and Terraform
This repo contains a dataset, exercises, and sample code for an end-to-end SAP BTP data-to-value bootcamp covering SAP HANA Cloud, SAP Data Warehouse Cloud, SAP Data Intelligence Cloud, and SAP Analytics Cloud.
Prefect - Data orchestration tool practice & learning
Data orchestration repo with Docker deployment
Data-aware orchestration with dagster, dbt, and airbyte
A simple pipeline infrastructure with ETL pipeline contained in a Docker environment on Apache Airflow for orchestration and Postgres for data warehousing
Add a description, image, and links to the data-orchestration topic page so that developers can more easily learn about it.
To associate your repository with the data-orchestration topic, visit your repo's landing page and select "manage topics."