Pinned

1. Data-Pipeline-with-dbt-using-Airflow-on-GCP Data-Pipeline-with-dbt-using-Airflow-on-GCP Public

   This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. There are different tools that have been used in this project su…

   Python 18 3

2. Python-ETL-pipeline-using-Airflow-on-AWS Python-ETL-pipeline-using-Airflow-on-AWS Public

   This project demonstrates how to build and automate an ETL pipeline written in Python and schedule it using open source Apache Airflow orchestration tool on AWS EC2 instance.

   Python 13 2

3. Youtube-video-data-analytics-using-AWS Youtube-video-data-analytics-using-AWS Public

   This project aims to leverage Amazon Web Services to create trending Youtube videos analytics service. Project contains different data engineering, data analysis and data science parts.

   Python 7 1

4. Microsoft-Azure-Medallion-Data-pipeline Microsoft-Azure-Medallion-Data-pipeline Public

   In this project we are going to create an end-to-end data platform right from Data Ingestion, Data Transformation, Data Loading and Reporting.

   Jupyter Notebook 4 5

5. LINHAC-2022-Data-Science-Student-Competition LINHAC-2022-Data-Science-Student-Competition Public

   Linköping Hockey Analytics Conference - LINHAC 2022 | Given the event data, generate findings/patterns related to sequences of events leading up to a particular outcome.

   Jupyter Notebook 7

6. Data-Science-Apache-Spark-Databricks-ETL-Project Data-Science-Apache-Spark-Databricks-ETL-Project Public

   Using Databricks community edition to build multiple end-to-end ETL pipelines using PySpark for different file formats such as CSV, Parquet, Delta table. Predictive modeling is performed using diff…

   Jupyter Notebook 1