Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
-
Updated
Jun 1, 2024 - Python
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Prefect integrations with NASA Earthdata.
Prefect integrations with Microsoft Planetary Computer.
The code to follow along our tutorials for the dlt rest_api source
DataPulse is a platform for developers to build, schedule and monitor data pipelines.
Apollo is a Python GUI application designed to simplify the complex process of generating random data based on fixed values. It allows users to generate various types of binary datasets, such as Yes/No type questions, by specifying probabilities.
Journey through the cryptic corridors of code. Unravel the secrets encoded in the shadows. Welcome to the realm where algorithms whisper in binary tongues. Dare to explore, for within lies the essence of innovation.
flexible type extensions for pandas
My personal project for data engineering zoomcamp
Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.
Apache Superset is a Data Visualization and Data Exploration Platform
Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.
The containerized Youtube videos analytics streamed to Telegram bot to monitoring the likes and views
Workflow Engine for Kubernetes
The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines
Business intelligence as code: build fast, interactive data visualizations in pure SQL and markdown
The open source high performance ELT framework powered by Apache Arrow
Solução completa dedicada a realizar ETL de dados de cotações de moedas usando Python. Fonte dos dados: https://docs.awesomeapi.com.br/api-de-moedas
Add a description, image, and links to the data-engineering topic page so that developers can more easily learn about it.
To associate your repository with the data-engineering topic, visit your repo's landing page and select "manage topics."