stream-processing

Here are 953 public repositories matching this topic...

google / mediapipe

Cross-platform, customizable ML solutions for live and streaming media.

android c-plus-plus calculator machine-learning framework computer-vision deep-learning inference pipeline-framework stream-processing video-processing perception mobile-development audio-processing graph-framework graph-based mediapipe

Updated Apr 27, 2024
C++

vectordotdev / vector

Star

A high-performance observability data pipeline.

rust parser events router pipeline metrics vector logs stream-processing forwarder observability

Updated Apr 27, 2024
Rust

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

mysql redis elasticsearch streaming kafka spark influxdb rabbitmq clickhouse hbase stream-processing opentsdb loki flink rocketmq

Updated Feb 23, 2024
Java

newTendermint / awesome-bigdata

Star

A curated list of awesome big data frameworks, ressources and other awesomeness.

data-science data awesome database data-stream bigdata series-database data-visualization data-warehouse stream-processing data-analytics awesome-list distributed-database visualize-data streaming-data

Updated Apr 19, 2024

redpanda-data / redpanda

Star

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

go kubernetes streaming microservices kafka cpp seastar storage-engine containers realtime stream-processing event-driven redpanda

Updated Apr 27, 2024
C++

madd86 / awesome-system-design

Star

A curated list of awesome System Design (A.K.A. Distributed Systems) resources.

distributed-systems microservices nosql interview stream-processing microservices-architecture relational-database message-broker hadoop-ecosystem

Updated Mar 26, 2024

benthosdev / benthos

Star

Fancy stream processing made operationally mundane

go golang kafka cqrs etl rabbitmq amqp logs message-bus event-sourcing nats stream-processing message-queue data-engineering streaming-data stream-processor data-ops

Updated Apr 27, 2024
Go

ThreeDotsLabs / watermill

Star

Building event-driven applications the easy way in Go.

go golang events reactive kafka cqrs sagas rabbitmq event-sourcing nats stream-processing event-driven watermill

Updated Apr 21, 2024
Go

robinhood / faust

Star

Python Stream Processing

python distributed-systems kafka stream-processing asyncio kafka-streams

Updated Nov 23, 2023
Python

risingwavelabs / risingwave

Star

Cloud-native SQL stream processing, analytics, and management. KsqlDB and Apache Flink alternative. 🚀 10x more productive. 🚀 10x more cost-efficient.

Updated Apr 27, 2024
Rust

hazelcast / hazelcast

Star

Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.

java caching distributed-systems real-time big-data hazelcast scalability distributed-computing distributed stream-processing in-memory low-latency hacktoberfest data-insights data-in-motion

Updated Apr 26, 2024
Java

confluentinc / ksql

Star

The database purpose-built for stream processing applications.

real-time sql kafka interactive stream-processing kafka-connect materialized-views ksqldb ksqldb-documentation ksqldb-tutorials streaming-queries event-streaming-database

Updated Apr 27, 2024
Java

MaterializeInc / materialize

Star

The data warehouse for operational workloads.

rust distributed-systems streaming sql database kafka postgresql data-warehouse stream-processing streaming-data materialized-view postgresql-dialect operational-data-warehouse

Updated Apr 27, 2024
Rust

fluent / fluent-bit

Star

Fast and Lightweight Logs and Metrics processor for Linux, BSD, OSX and Windows

c metrics logging logs prometheus data-collector stream-processing fluentd fluent-bit cloudnative sql-queries forwarder traces opentelemetry

Updated Apr 27, 2024
C

apache / hudi

Star

Upserts, Deletes And Incremental Processing on Big Data.

bigdata stream-processing data-integration datalake apachespark hudi apachehudi incremental-processing apacheflink

Updated Apr 27, 2024
Java

online-ml / river

Star

🌊 Online machine learning in Python

python data-science machine-learning streaming stream-processing online-learning streaming-data concept-drift real-time-processing incremental-learning online-machine-learning online-statistics

Updated Apr 25, 2024
Python

javascriptdata / danfojs

Star

Danfo.js is an open source, JavaScript library providing high performance, intuitive, and easy to use data structures for manipulating and processing structured data.