Data Engineering Project using Tokyo Olympic Data

A repository to continue my education on Azure Data Services.

Azure Logic App to Pause, Resume, Dial-Up and Dial-Down a Azure Synapse Dedicated SQL Pool

Solution accompanying the article on Serverless architectures

A B2B solution and architecture. This includes code for Azure Function App, SQL Server. Integration with azure synapse and event hubs as well.

Data pipeline that processes Formula1 data with Azure Databricks, DeltaLake, and Azure Data Factory

Unofficial samples that utilise Pigment's API to integrate with data movement and serverless solutions.

Data Engineering Project - Python, PySpark & SQL - Azure Data Factory (ADF), DataBricks, Synapse Analytics, Azure Data Lake Storage (ADLS) Gen2, Power BI, Tableau and Looker Studio

A simple data factory pipeline examples

A simple pipeline to transform data within Azure Data Factory using Azure Databricks. Although it is written in Scala the same can be replicated in Python.

💠 Build ETL for movielens dataset in Microsoft Azure

Azure Resource for CDS DS 310 - Data Mechanics

Azure Data Factory Upsert to Document DB

ADF with self hosted integration runtime based samples

Triggering azure data factory pipeline from c# application

This module gathers and imports data factory run information.

A cutting-edge data project leverages Azure's suite of services to seamlessly transform raw data from GitHub into actionable insights. Using Azure Data Factory for data ingestion, Databricks for PySpark transformations, Synapse Analytics for advanced analysis, and Power BI for intuitive visualization, this project navigates complex data workflows..