Get up and running quickly with Spark Structured Streaming on Azure Databricks using Azure Event Hubs
-
Updated
Aug 17, 2018 - Scala
Get up and running quickly with Spark Structured Streaming on Azure Databricks using Azure Event Hubs
Spark Structured Streaming source implementation for Google Pubsub
Avro File using Apache Spark and Scala
This repository contains an alternative Apache Spark-based analysis tier for the TweetPipe streaming data pipeline
Integrating R into the big data ecosystem using sparklyR
Spark Sample with Kafka
This Code helps take a close look of spark Data Streaming Structure
Sample of code used in the 1st session of the `MoisDelaData`
This project contains the learning and experiments with the Apache Spark.
Sending data to multiple location
This project complements Apache Spark structured streaming with hand-picked streaming sources and sinks.
BI solution to get reddit posts and comments and do sentiment analysis.
My implementation of the Kappa Architecture using Kafka, Spark, the ELK stack, mostly using Scala, and a bit of Python sprinkled all over.
This project is a tempale for performing etl using Kafka, Spark and hive.
Structured Streaming app that can read files from the local system folder as new files are added to the folder as stream data and apply all the operations on the new data and, finally, write the results in an output directory.
基于Spark 3.1.x 数据源API实现的MQ数据源示例代码
Example applications of spark-trend-calculus
Add a description, image, and links to the structured-streaming topic page so that developers can more easily learn about it.
To associate your repository with the structured-streaming topic, visit your repo's landing page and select "manage topics."