SQL stream processing, analytics, and management. We decouple storage and compute to offer speedy bootstrapping, dynamic scaling, time-travel queries, and efficient joins.
-
Updated
May 15, 2024 - Rust
SQL stream processing, analytics, and management. We decouple storage and compute to offer speedy bootstrapping, dynamic scaling, time-travel queries, and efficient joins.
My personal project for data engineering zoomcamp
Compute over Data framework for public, transparent, and optionally verifiable computation
Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering excellence, developer experience, and community growth.
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Open Source Feature Flagging and A/B Testing Platform
Apply Data Engineering to Personal Finance
The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
Snowflake Snowpark Python API
An orchestration platform for the development, production, and observation of data assets.
Apache Superset is a Data Visualization and Data Exploration Platform
Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines
Business intelligence as code: build fast, interactive data visualizations in pure SQL and markdown
Fancy stream processing made operationally mundane
Final Project for UMD INST 767
Turns Data and AI algorithms into production-ready web applications in no time.
🐚 Python-powered, cross-platform, Unix-gazing shell.
CSVs sliced, diced & analyzed.
🧙 Build, run, and manage data pipelines for integrating and transforming data.
Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.
Add a description, image, and links to the data-engineering topic page so that developers can more easily learn about it.
To associate your repository with the data-engineering topic, visit your repo's landing page and select "manage topics."