Skip to content

Spark Streaming using Apache Kafka. Event Based Streaming.

Notifications You must be signed in to change notification settings

NavyaTrilok/Spark-Kafka-Streaming

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

STEP 1: GET KAFKA Download the latest Kafka release and extract it:

$ tar -xzf kafka_2.13-3.7.0.tgz

$ cd kafka_2.13-3.7.0

STEP 2: START THE KAFKA ENVIRONMENT

NOTE: Your local environment must have Java 8+ installed.

Apache Kafka can be started using ZooKeeper or KRaft. To get started with either configuration follow one the sections below but not both.

Kafka with ZooKeeper

Run the following commands in order to start all services in the correct order:

Start the ZooKeeper service

$ bin/zookeeper-server-start.sh config/zookeeper.properties

Open another terminal session and run:

Start the Kafka broker service

$ bin/kafka-server-start.sh config/server.properties

Once all services have successfully launched, you will have a basic Kafka environment running and ready to use.

REATE A TOPIC TO STORE YOUR EVENTS

Open another terminal session and run:

$ bin/kafka-topics.sh --create --topic quickstart-events --bootstrap-server localhost:9092

image image image

About

Spark Streaming using Apache Kafka. Event Based Streaming.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages