#
lakehouse
Here are 72 public repositories matching this topic...
StarRocks, a Linux Foundation project, is a next-generation sub-second MPP OLAP database for full analytics scenarios, including multi-dimensional analytics, real-time analytics, and ad-hoc queries. InfoWorld’s 2023 BOSSIE Award for best open source software.
sql
database
big-data
analytics
olap
join
distributed-database
realtime-database
mpp
cloudnative
iceberg
real-time-analytics
datalake
vectorized
real-time-updates
star-schema
hudi
delta-lake
lakehouse
lakehouse-platform
-
Updated
Apr 28, 2024 - Java
LakeSoul is an end-to-end, realtime and cloud native Lakehouse framework with fast data ingestion, concurrent update and incremental data analytics on cloud storages for both BI and AI applications.
python
rust
streaming
sql
big-data
spark
arrow
postgresql
pytorch
flink
datalake
vectorized
velox
huggingface
datafusion
lakehouse
lakesoul
-
Updated
Apr 26, 2024 - Java
YTsaurus is a scalable and fault-tolerant open-source big data platform.
-
Updated
Apr 28, 2024 - C++
World's most powerful data catalog service with providing a high-performance, geo-distributed and federated metadata lake.
metadata
data-catalog
datalake
stratosphere
federated-query
lakehouse
model-catalog
metalake
skycomputing
ai-catalog
-
Updated
Apr 28, 2024 - Java
Use SQL to build ELT pipelines on a data lakehouse.
sql
apache-spark
etl
pipelines
data-engineering
data-lake
data-transfer
delta
data-integration
upsert
elt
data-pipeline
datalake
data-ingestion
spark-sql
zeppelin-notebook
apache-iceberg
lakehouse
incremental-updates
-
Updated
May 25, 2022 - JavaScript
A modern data marketplace that makes collaboration among diverse users (like business, analysts and engineers) easier, increasing efficiency and agility in data projects on AWS.
aws
data-science
data
aws-s3
redshift
etl-framework
aws-glue
aws-lake-formation
lakehouse
lakeformation
-
Updated
Apr 26, 2024 - Python
The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for several lakehouse algorithms, data flows and utilities for Data Products.
framework
big-data
spark
data-engineering
databricks
data-quality
delta-lake
great-expectations
lakehouse
configuration-driven
-
Updated
Apr 11, 2024 - Python
Examples of using Terraform to deploy Databricks resources
-
Updated
Apr 3, 2024 - HCL
Unified storage framework for the entire machine learning lifecycle
machine-learning
tensorflow
dml
data-warehouse
dataset
dataops
olap
ray
apache-parquet
apache-arrow
multimodal
multimodal-data
tensorflow-dataset
mlops
lakehouse
-
Updated
Mar 3, 2024 - Python
Lakehouse storage system benchmark
-
Updated
Feb 22, 2023 - Scala
A curated list of open source tools used in analytical stacks and data engineering ecosystem
data
awesome
database
etl
analytics
workflow-engine
data-storage
self-hosted
data-warehouse
data-engineering
data-analytics
data-platform
awesome-list
data-integration
observability
data-pipeline
datalake
mlops
lakehouse
data-lakehouse
-
Updated
Apr 3, 2024
Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testing.
-
Updated
Sep 2, 2023 - Dockerfile
DeltaOMS is a solution that help build a centralized repository of Delta Transaction logs and associated operational metrics/statistics for your Delta Lakehouse. Unity Catalog supported in the v0.7.0-rc1 release.Documentation here - https://databrickslabs.github.io/delta-oms/v0.7.0-rc1/
-
Updated
Nov 27, 2023 - Scala
Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data
-
Updated
Dec 2, 2023 - Python
Improve this page
Add a description, image, and links to the lakehouse topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the lakehouse topic, visit your repo's landing page and select "manage topics."