Apache Doris is an easy-to-use, high performance and unified analytics database.

A machine-readable, human-editable database of the Yu-Gi-Oh! Trading Card Game, Official Card Game, Master Duel, Rush Duel, Speed Duel.

An automatically-updated collection of wikitexts from Yugipedia. Part of YAML Yugi.

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

In-memory Java DataFrame library

Wikidata and Wikipedia language data extraction

A tool to help anyone build a mountain of public data.

Production Grade Nifi & Nifi Registry. Deploy for VM (Virtual Machine) with Terraform + Ansible, Helm & Helmfile for Kubernetes (EKS)

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

A package supporting the conversion from Synthea CSV to OMOP CDM

Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.

Open source data anonymization and synthetic data orchestration for developers. Create high fidelity synthetic data and sync it across your environments.

Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.

This project implements an end-to-end techstack for a data platform, can be used on production.

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

An open source, standard data file format for graph data storage and retrieval.

The open source high performance ELT framework powered by Apache Arrow

Categorical Query Language IDE

🧙 Build, run, and manage data pipelines for integrating and transforming data.

An orchestration platform for the development, production, and observation of data assets.