Skip to content

A demo scene for Real-time Data Processing with ksqlDB, Kafka, and Kafka Connect

License

Notifications You must be signed in to change notification settings

IldarAlmakaev/ksqldb-demo-expert-fridays

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

ksqldb-demo

Prerequisites

  • Docker and docker-compose
  • For ARM-based arch, useCONFLUENT_VERSION=7.2.0.arm64 in .env file. Otherwise, remove arm64 suffix if it's not.

Deployment

  • Deploy all services locally:
docker-compose up -d
  • When Kafka Connect service is started, create source connectors to create Kafka topics with data
 curl -X PUT -H "Content-Type: application/json" -d @connectors/source/mysql-source-logging-v1.json http://localhost:8083/connectors/mysql-source-logging-v1/config
curl -X PUT -H "Content-Type: application/json" -d @connectors/source/mysql-source-users-v1.json http://localhost:8083/connectors/mysql-source-users-v1/config 
  • Connect to ksqlDB using ksql-cli
docker-compose exec ksqldb-cli ksql http://ksqldb:8088
  • Submit ksql queries one-by-one from the demo.sql file
  • Inspect ksql entities, e.g. streams SHOW STREAMS, topics SHOW TOPICS
  • Or go to Web UI for Apache Kafka service deployed locally and review your topics