Pulling games from the Lichess API into a PostgreSQL database for data analysis.
-
Updated
Jun 8, 2024 - Python
Pulling games from the Lichess API into a PostgreSQL database for data analysis.
Pycon 2017- Creating ETL tasks with Luigi package
amplicon analysisng pipelines based on luigi with qiime2-dada2/ qiime2-deblur/vsearch/usearch
This repository contains an ETL (Extract, Transform, Load) pipeline implemented using Luigi, a Python package for building data pipelines. The pipeline extracts data from a CSV file hosted on a GitHub repository, performs some cleaning and transformation steps, and then loads the data into a SQLite database table.
Universal Luigi ETL pipeline. Validates data received from external sources. Extracts, transforms them and lands.
Shows how luigi can be used with kubernetes
This repository is based on scraping data from a static website through Luigi. This was created to display my ability to utilize the Luigi pipeline to automatically collect data and other tasks.
This repo covers analysis of growing trends in the recruitment in the technology domain in financial organizations i.e. top banks across United States.
Saisoku is a Python module that helps you build complex pipelines of batch file/directory transfer/sync jobs.
EDA and Luigi pipeline for M5 Forecasting (Accuracy) Competition hosted on Kaggle.
A Streamlit Application to assist doctors in prediction of Heart Diseases based on their medical readings & characteristics.
Demo of using Luigi to build ETL Pipelines
🔍 Example of an ETL pipeline using Spotify's Luigi
Easy and powerful template for ML projects
Add a description, image, and links to the luigi-pipeline topic page so that developers can more easily learn about it.
To associate your repository with the luigi-pipeline topic, visit your repo's landing page and select "manage topics."