sparkstreaming
Here are 35 public repositories matching this topic...
A real-time sales data analysis Application using Spark Structured Streaming, Kafka as a messaging system, PostgreSQL as a storage for processed data, and Superset for creating a dashboard.
-
Updated
Nov 26, 2023 - Python
Developed a real-time streaming analytics pipeline using Apache Spark to calculate and store KPIs for e-commerce sales data, including total volume of sales, orders per minute, rate of return, and average transaction size. Used Spark Streaming to read data from Kafka, Spark SQL to calculate KPIs, and Spark DataFrame to write KPIs to JSON files.
-
Updated
Oct 15, 2023 - Python
Big data computing tasks conducted with PySpark. The problems involve MapReduce and Streaming algorithms.
-
Updated
May 30, 2024 - Python
a streaming app and a dashboard for visualizing cryptocurrency data fetched from the CoinGecko API. The streaming app retrieves real-time cryptocurrency information using Spark Streaming and stores it in a PostgreSQL database.
-
Updated
Dec 4, 2023 - Python
This project gets data from Spotify API , ingests into kafka for streaming and processes it through spark streaming. All this is done on Azure.
-
Updated
May 6, 2024 - Python
BigDataBusinessRuleEngine in Spark, scala, Drools.
-
Updated
Sep 1, 2017 - JavaScript
This Code helps take a close look of spark Data Streaming Structure
-
Updated
Sep 27, 2019 - Scala
SparkStreaming新手友好向模板,简化SparkStreaming开发
-
Updated
Jun 21, 2022 - Java
This is a repository i have created to put up some of the knowledge i have gained around Big Data Technologies especially Spark, GraphX etc.
-
Updated
Apr 20, 2019
Full poc on spark 2, Spark RDD, Spark DStream, Spark SQL, Spark Datasets & DataFrames & Spark Structured Streaming [SCALA][SPARK]
-
Updated
Jul 2, 2018 - Scala
-
Updated
Apr 3, 2018 - Python
This repository contains files, codes and markdown documents for "big data from scratch" writings on my blog (z-ing.net)
-
Updated
Jul 13, 2021 - Jupyter Notebook
Track trending hashtags on Twitter in real time.
-
Updated
Sep 25, 2020 - Python
Improve this page
Add a description, image, and links to the sparkstreaming topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the sparkstreaming topic, visit your repo's landing page and select "manage topics."