[PROJECT IS NO LONGER MAINTAINED] Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

Examples for gaurav.cc

Benchmark comparing various data serialization libraries (thrift, protobuf etc.) for C++

Generate avro schemas from python classes. Code generation from avro schemas. Serialize/Deserialize python instances with avro schemas

Apache Avro <-> pandas DataFrame

A pure python avro schema validator

Flexible, Fast & Compact Serialization with RPC

Hotel Booking project

Kafka producer application which publishes messages to Kafka and registers the schema of the message in a schema registry

Imaginary manufacturing company event-driven application examples

Kafka consumer application which reads messages from Kafka and based on the schema registered in a schema registry and enriches the data. This is just a prototype on how we can efficiently evolve a schema and read messages with BACKWARD compatibility with out breaking the consumers. This application can be used as a base for a stateless stream p…

Producer and consumer of traffic data for Apache Kafka

A Vehicle Manager Project Using Java + Kotlin

Apache Kafka Producer and Consumer which uses Avro Serialization written in Java.

Clean up attribute names for Apache NiFi to send to Apache Avro

Count records in Avro files efficiently

Construct a streaming event pipeline around Apache Kafka and its ecosystem. Using public data from the Chicago Transit Authority, we will construct an event pipeline around Kafka that allows us to simulate and display the status of train lines in real time.

This project aims to build a streaming application to perform real-time analytics of Covid-19 related tweets and deploy an ML model for real-time sentiment predictions.

📚️ A repository for showcasing my knowledge of the Apache Avro programming language, and continuing to learn the language.

An Eclipse editor plugin for defining Apache Avro IDL