This is a data engineering project, in which I use Python, MySQL and AWS Services to create and automatically update an online database.

Weather_Difference_Between_SFO/SEA

- Soal tes Ujian Bahasa Kita Data Engineer

Some useful stuff for Data Engineers

Covers the commands for performing various tasks using Transact-SQL, at a very high level.

🐸 Leapfrog_Data-Engineering_Assignments 🐸

Big Data solutions for Sparkify (An online music streaming startup)

A basic ML pipeline with Kubeflow deployed on Google Cloud Platform using Vertex AI

AWS Pipeline examples from Udacity Date Engineering Nanodegree.

A simple etl pipeline orchestrated with dagster, to run both locally and/or on k8s. Uses minIO as both IOManager and destination when on k8s

Automatic Trading System for OANDA. Currency pairs can be analysed by customising the list in the regression algorithms.

Orchestrate OpenSearch operations with Apache Airflow and the OpenSearch Airflow provider

Project for the Methods of Advanced Data Engineering course at FAU

This project showcases the implementation of a data engineering solution using Python within a Jupyter Notebook environment.

DW developed for the bootcamp taught by DataEx in partnership with Microsoft

Crypto trades streaming with azure services

A minimal, responsive and feature-rich Jekyll theme for my technical writing.

Load the Apache Hop (Incubating) community interaction (Mattermost chat, JIRA) to a Neo4j graph database

Insight Data Challenge

ETL Framework