Spark Streaming using Flume (pushed based Approach)
-
Updated
Feb 1, 2019 - Python
Spark Streaming using Flume (pushed based Approach)
Demonstration of streaming applications using Spring Cloud Data Flow with microservices written in Spring Cloud Stream.
Stream processing of AIS data with Flink
e2e machine learning pipeline using a config based approach for classification problems. Supports grouping and grading classifiers in addition to online learning algorithms
[IEEE ICASSP 2021] "A fast randomized adaptive CP decomposition for streaming tensors". In 46th IEEE International Conference on Acoustics, Speech, & Signal Processing, 2021.
A framework for Big Data Optimization with multi-objective metaheuristics
Apache Beam stream data analytics template featuring Google PubSub and Google BigQuery
A project for the module (Advanced) Distributed Systems Prototyping at the Technical University of Berlin.
Streaming API for pandas applied to big datasets
Stream Processing and Complex Event Processing Engine
🔥👨💻 Build Big data pipelines with Apache Beam in any language and run it via Spark, Flink, GCP (Google Cloud Dataflow).
[IEEE TKDE 2023] A list of up-to-date papers on streaming tensor decomposition, tensor tracking, dynamic tensor analysis
100% Python stream processing with Streaming DataFrames
Lean and mean distributed stream processing system written in rust and web assembly.
Add a description, image, and links to the streaming-data-processing topic page so that developers can more easily learn about it.
To associate your repository with the streaming-data-processing topic, visit your repo's landing page and select "manage topics."