Qbeast-spark: DataSource enabling multi-dimensional indexing and efficient data sampling. Big Data, free from the unnecessary!

A curated list of open source tools used in analytical stacks and data engineering ecosystem

Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testing.

This repository is a place for the Data Warehousing course at the Information Systems & Analytics department, Santa Clara University.

My M.Sc. dissertation: Modern Data Platform using DataOps, Kubernetes, and Cloud-Native ecosystem to build a resilient Big Data platform based on Data Lakehouse architecture which is the base for Machine Learning (MLOps) and Artificial Intelligence (AIOps).

The project aims to process Formula 1 racing data, create an automated data pipeline, and make the data available for presentation and analysis purposes.

Data lakehouse at home with docker compose

STEDI project

#Test - Create a Data Lakehouse in Kubernetes

This project implements an end-to-end techstack for a data platform, can be used on production.

Qbeast-spark: DataSource enabling multi-dimensional indexing and efficient data sampling. Big Data, free from the unnecessary!