Tests with Spark local, kafka streaming and socket streaming

Using kafka streaming to implement the streaming ETL job, append data onto GCP Big Query after formatting.

Example from Designing Event-driven Applications Using Apache Kafka Ecosystem By Bogdan Sucaciu m 5

This repository is a comprehensive guide and toolkit for anyone looking to understand and implement data streaming solutions using Apache Kafka.

Consumer Producer Components

Kafka integration in Springboot, including producer, consumer, streaming, and interactive query of Ktable.

Machine Learning (Streaming) with KAFKA, Debezium and BentoML Service.

studying pyspark with various external applications

Learn kafka real-time stream processing

The purpose of this project is to learn, develop and explore microservices using spring boot, spring cloud, event streaming

Base project for kafka-streams development and testing

The objectives of this project are to get experience of coding with: Spark, Spark SQL, Spark Streaming, Kafka, Scala and functional programming

Scripts for music feature analysis, model training, and real-time recommendation using Apache Kafka. Extract features with Librosa, store in MongoDB, and process with Apache Spark. Web interface included. Contributors: Tashfeen Abbasi, Laiba Mazhar, Rafia Khan.

Kafka streaming performance tests.

Data streaming project with Apache Druid & Grafana: Real-time data processing, alerts, integration with AWS. It uses a combination of technologies and services, including Confluent-Kafka, Apache Druid, AWS SNS, EC2, Athena, S3, Glue and EventBridge, StepFunctions. Contribute to this powerful solution!

Streaming fraud detection system

A pipeline that consumes twitter data to extract meaningful insights about a variety of topics using the following technologies: twitter API, Kafka, MongoDB, and Tableau.

This project implements an end-to-end pipeline for batch to stream processing using Kafka on Docker images. Besides that, there are exercises for a full course in Kafka.