Shows how luigi can be used with kubernetes
-
Updated
Dec 8, 2022 - Python
Shows how luigi can be used with kubernetes
Easy and powerful template for ML projects
🔍 Example of an ETL pipeline using Spotify's Luigi
This repository contains an ETL (Extract, Transform, Load) pipeline implemented using Luigi, a Python package for building data pipelines. The pipeline extracts data from a CSV file hosted on a GitHub repository, performs some cleaning and transformation steps, and then loads the data into a SQLite database table.
This repo covers analysis of growing trends in the recruitment in the technology domain in financial organizations i.e. top banks across United States.
Demo of using Luigi to build ETL Pipelines
Universal Luigi ETL pipeline. Validates data received from external sources. Extracts, transforms them and lands.
Pycon 2017- Creating ETL tasks with Luigi package
This repository is based on scraping data from a static website through Luigi. This was created to display my ability to utilize the Luigi pipeline to automatically collect data and other tasks.
EDA and Luigi pipeline for M5 Forecasting (Accuracy) Competition hosted on Kaggle.
A Streamlit Application to assist doctors in prediction of Heart Diseases based on their medical readings & characteristics.
Pulling games from the Lichess API into a PostgreSQL database for data analysis.
amplicon analysisng pipelines based on luigi with qiime2-dada2/ qiime2-deblur/vsearch/usearch
Saisoku is a Python module that helps you build complex pipelines of batch file/directory transfer/sync jobs.
Add a description, image, and links to the luigi-pipeline topic page so that developers can more easily learn about it.
To associate your repository with the luigi-pipeline topic, visit your repo's landing page and select "manage topics."