A Rule-Based discount calculating engine for a retail store. The engine reads transaction data, applies various discount rules based on the product, date, and other criteria, and writes the results back to a database.

♻️Pipeline for Extract, Transform and Load articles from news websites into an SQLite database.

This Repo shows how to build a CI/CD process with Azure Pipelines. A python script places in an Azure Repo which extracts data from an API and exports the data to a blob on Azure cloud is utilized for this process.

ETL en lenguaje de programación R, para visualizar el conteo de casos de COVID 19 en Colombia

ETL Pipelines and Dashboard visualizatons

Antenna Distribution is a project that shows how to run business analysis tools on a set of a data.

This project demonstrates an ETL pipeline using Microsoft Azure for IMDb Movie Rating Dataset analysis. It covers data extraction from Azure Blob Storage, transformation with Azure Databricks, and loading into Azure SQL using Azure Data Factory. The pipeline automates insights generation and is a practical example of cloud-based data engineering.

Optimize your marketing agency's data workflow with this repository, focusing solely on news integration. Leverage Google Workspace and TrawlingWeb for efficient news acquisition and analysis, transforming complex information into actionable insights with fast, autonomous processes.

Introduction to the data pipeline management with Airflow. Airflow schedule and maintain numerous ETL processes running on a large scale Enterprise Data Warehouse

Curso oferecido para um DIO sobre ETL utilizando uma linguagem Python e como bibliotecas pandas e pandera.

Creates an automated ETL (Extract, Transform, Load) pipeline that extracts (from three data files), transforms, and loads data into a movies database. Uses Python (Pandas), PostgreSQL, and SQL.

Repository of a Data Science Project

ETL : Extract --> transform --> load

An ETL templating system that takes the busywork out of your data migrations.

Scheduled jobs to load the database with student login data.

ETL processes using a Tkinter GUI with Python

A comprehensive ETL pipeline and sales analysis project leveraging Microsoft Azure and PySpark, designed to optimize e-commerce sales by providing actionable insights through detailed data analysis.

Extract specific information from webpage. Run in standalone mode or as API.

A gui that calls a script to scrape meta critic, create a playlist and store metadata.

Power BI sales project. Creating an automated Power BI dashboard.