Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
-
Updated
May 14, 2024 - Python
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
This distributed, dockerized Apache Airflow instance runs automated workflows in support of projects from the Department Surface Waters at Eawag.
Apply Data Engineering to Personal Finance
Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code
Workflow Engine for Kubernetes
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
AWS Summit 2022 ASEAN --- COM203 Using IaC with Terraform to provision Big Data Platform on Amazon EMR
Production Grade Terraform for Provisioning Infrastructure
Run your dbt Core projects as Apache Airflow DAGs and Task Groups with a few lines of code
A Helm chart to install Apache Airflow on Kubernetes
Airflow Providers containing Deferrable Operators & Sensors from Astronomer
This project demonstrates how to build and automate an ETL pipeline written in Python and schedule it using open source Apache Airflow orchestration tool on AWS EC2 instance.
TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.
Pipeline de dados automatizado para extração e armazenamento de previsões meteorológicas para o setor de turismo.
Normalization data to 3NF and denormalization back to the initial format
Add a description, image, and links to the airflow topic page so that developers can more easily learn about it.
To associate your repository with the airflow topic, visit your repo's landing page and select "manage topics."