Fink documentation website
-
Updated
Jun 4, 2024
Fink documentation website
Astronomy Broker based on Apache Spark
Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs
This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]
Spark structured streaming examples with using of version 3.5.1
Spark Connector to read and write with Pulsar
This project contains the learning and experiments with the Apache Spark.
This project links together a MongoDB cluster and a Kafka cluster with a Standalone Pyspark cluster all done locally
kafka + structured streaming + phoenix + elasticsearch 基于行为日志实现热门推荐,用户偏好推荐,召回融合策略实现。
My implementation of the Kappa Architecture using Kafka, Spark, the ELK stack, mostly using Scala, and a bit of Python sprinkled all over.
Real-Time Financial Market Data Processing and Prediction application
🔆 spark自学手册,包含了例如spark core、spark sql、spark streaming、spark-kafka、delta-lake,以及scala基础练习,还有一些例如master、shuffle源码分析,总结及翻译。
Kinesis Connector for Structured Streaming
A framework for incremental streaming joins and incremental streaming aggregations over change data feeds from Databricks Delta
This is an academic project which aim to create a data streaming pipeline using Spark Structured Streaming, Elasticsearch and Kibana.
BI solution to get reddit posts and comments and do sentiment analysis.
Spark 3.0.0 Structured Streaming Kafka Avro Demo
Add a description, image, and links to the structured-streaming topic page so that developers can more easily learn about it.
To associate your repository with the structured-streaming topic, visit your repo's landing page and select "manage topics."