Monitoring Data Pipeline Design Example
An End-To-End data pipeline integration from Website Source to analytical dashboard in AWS using Python flask, ML models, DynamoDB and other AWS services.
Script to write GFW country stats XLS files for download
This repo includes the code which will help beginners pick up tensorflow dataset and build effective pipelines for their Machine Learning and Deep Learning experiments built for my medium post on the same.
Cyber Attack Prediction Model
Building a highly scalable data streaming pipeline in python
Udacity's Data Engineering Nanodegree project: Data Pipeline with Airflow.
This project focuses on the Air Pressure system (APS), which creates pressurized air for truck brakes and gear changes. Positive datasets include component failures. APS component. Negative class trucks have non-APS-related component failures.
This Project aims to automate the process of infrastructure creation.
Streaming data from PostgreSQL to Elasticsearch with masking sensitive data
Moves data from a source to a destination with transformations along the way. For example, you could download a file from an SFTP server, decrypt it, then copy it to a network location.
About The Boston House Price Prediction project utilizes data science methodologies and machine learning algorithms to provide accurate predictions for housing prices in the Boston area.
An anlytics engineering project that utilizes dbt to develop an end to end ELT pipeline by simulating airbnb datasets to provide informed decision through the use of technologies like Snowflakes, Amazon s3, and Preset for setting up BI dashboard
ETL pipeline and analysis of Walmart Dataset using python
Add a description, image, and links to the datapipeline topic page so that developers can more easily learn about it.
To associate your repository with the datapipeline topic, visit your repo's landing page and select "manage topics."