an app engine for your business. Seamlessly implement business logic with a powerful API. Out of the box CMS, blog, forum and email functionality. Developer friendly & easily extendable for your next SaaS/XaaS project. Built with Rails 6, Devise, Sidekiq & PostgreSQL

The Virtual Data Warehouse is a code generation and template management tool. It is part of the data solution automation ecosystem - the 'engine' for data solution automation.

Treats CSV and JSON files as SQL tables, and exports SQL SELECTs back to CSV or JSON.

Real-Time Event Streaming & Change Data Capture

Generic interface exchange format for Data Warehouse Automation and ETL generation.

DIRECT, the Data Integration Run-time Execution Control Tool, is a data logistics control framework that can be used to monitor, log, audit and control data integration / ETL processes.

ETL flow framework based on Yaml configs in Python

BETL. Meta data driven ETL generation using T-SQL

proof of concept to generate Airbyte low-code YAML connectors from API documentation

The goal of this project is to illustrate Extract Transform Load (ETL) using Python and SQL. ETL is a process commonly done in computing, which takes raw data, cleans it and stores it for later use. The extraction phase targets and retrieves the data. Transform manipulates and cleans the data. Then load stores the data, typically in a data wareh…

Automatically download and transform Hetzner invoices.

A small cross-database tool for building excel documents (reports) based on data from database that extacts via View or Stored Procedures with parametres, ordering e.t.c.

An ASP NET MVC 6 Web GUI (Net core) for easy reports generation using ReportGenerator

This is a PHP project which combines ETL with different strategies to extract data from multiple databases, files, and services, transform it and load it into multiple destinations.

End-to-end data engineering processes for the NIGERIA Health Facility Registry (HFR). The project leveraged Selenium, Pandas, PySpark, PostgreSQL and Airflow

Introduction to the data pipeline management with Airflow. Airflow schedule and maintain numerous ETL processes running on a large scale Enterprise Data Warehouse.

Extract specific information from webpage. Run in standalone mode or as API.

Project to scrape CFTC.gov reports and present using Power Query & Power Pivot

Amazon Redshift Serverless RSQL ETL Framework