scd-type-2

Here are 3 public repositories matching this topic...

minhky2185 / incident_data_warehouse

Build a data warehouse from scratch, including full load, daily incremental load, design schema, SCD Type 1 and 2.

python docker airflow s3 orchestration data-warehouse data-engineering redshift powerbi airflow-plugin staging-area star-schema etl-pipeline etl-automation scd-type-2 airflow-dag bridge-table incident-data-warehouse scd-type-1

Updated Feb 1, 2023
Python

SaadAhmedWaqar / Data-Warehousing-Redshift

Star

A Data Warehousing project for retail sales using dimension modelling best practices with SCD type 2 on AWS Redshift. Utilizing AWS Lambda, Glue Workflows and Python Shell jobs to create and automate an ELT pipeline where batch data coming into S3 is loaded onto Redshift and necessary transformations are performed to meet requirements.

aws-s3 data-warehousing aws-redshift aws-glue scd-type-2 dimensional-modeling