AWS Glue scripts and IAC templates to get started easy. code from AWS Glue Immersion days with Danske Bank 8th+9th of July 2022.

Docker container to create a local environment to develop in AWS glue

a toolkit that provides an object-oriented interface for working with parquet datasets on AWS

Implementation of ETL data pipeline to load data from S3 to snowflake and refresh tableau datasource in AWS

Data lake project for a US based Insurance Company

Intro to streaming data with Kafka, Spark and AWS Glue

The Practical Data Science Specialization brings together these disciplines using purpose-built ML tools in the AWS cloud. It helps you develop the practical skills to effectively deploy your data science projects and overcome challenges at each step of the ML workflow using Amazon SageMaker. This Specialization is designed for data-focused develop

Daily Incremental load ETL pipeline for Ecommerce company using AWS Lambda and AWS EMR cluster, Deployed using Apache airflow in a docker container.

AWS hosted enterprise Data Lake with both batch and realtime data pipelines.

Talks co-organized with PyAmsterdam about ETL/ELT in action in the cloud

A simple shell script to delete multiple tables based on table name prefix.

Data Lakehouse solution for data produced by STEDI Step Trainer sensors and the mobile app so that it can train the machine learning module.

Data pipeline for an online order processing system

Streaming data pipeline on aws, Tech session repository for hist

Deployed an OpenSearch domain to index bank transactions and created a Glue ETL job to process transactions generated from upstream on-premise applications into the domain.

Data Lakehouse solution for machine learning data

A beginner guide to do your best with data!

ETL data pipelining using AWS

A starter repository for your next AWS Glue project. This comes with complete IaC, a CD pipeline and a reusable common SDK. Set up jupyter notebook for AWS Glue locally