Media Management System: ingestion, processing, encoding, delivery, ...
-
Updated
Jun 1, 2024 - C++
Media Management System: ingestion, processing, encoding, delivery, ...
A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.
Data Prepper is a component of the OpenSearch project that accepts, filters, transforms, enriches, and routes data at scale.
Service for bulk-loading data to databases with automatic schema management (Redshift, Snowflake, BigQuery, ClickHouse, Postgres, MySQL)
Upload data to PostHog-LLM
Single and multi-threaded custom ingestion crate for Stellar Futurenet, written in Rust.
Rapidly Access, Processes, Analyze & Visualize Your Data
HTTP server that easily ingests data into a database
Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs
Simple python interface for the Fivetran API. Powered by HTTPx.
Real-time Kafka to ClickHouse ingestion service
This project aims to predict smartphone prices using a combination of batch and stream processing techniques in a Big Data environment. The architecture follows the Lambda Architecture pattern, providing both real-time and batch processing capabilities to users.
The dbsched bundle is preconfigured with the Pado scheduler to periodically execute jobs that dump database tables to CSV files from which it automatically extracts column information to generate the corresponding VersionedPortable classes. It then transforms the CSV records to objects using the generated classes before ingesting them into Hazel…
macOS app to chat with your local documents
List of my data engineering projects
A free, open-source, web-based self-service BI tailor-made for clickhouse, google bigquery, mysql, postgresql, vertica
Add a description, image, and links to the ingestion topic page so that developers can more easily learn about it.
To associate your repository with the ingestion topic, visit your repo's landing page and select "manage topics."