Skip to content

katosys/kafka

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

19 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

kafka

Build Status

Howto

  1. Start the scheduler:
docker run -it --net host --rm \
--name kafka-mesos \
-e STORAGE=zk:/kafka-mesos \
-e MESOS_NATIVE_JAVA_LIBRARY=/opt/lib/libmesos.so \
-e MASTER=zk://quorum-1:2181,quorum-2:2181,quorum-3:2181/mesos \
-e ZK=quorum-1:2181,quorum-2:2181,quorum-3:2181 \
-e API=http://master-1:7000 \
-v /opt/lib:/opt/lib \
quay.io/kato/kafka scheduler
  1. Add a broker:
docker exec -it kafka-mesos /bin/bash
./kafka-mesos.sh broker add 0 \
--java-cmd "unset LD_LIBRARY_PATH && /usr/glibc-compat/sbin/ldconfig && java" \
--container-type mesos \
--container-image quay.io/kato/kafka \
--container-mounts /opt/lib:/opt/lib:ro
  1. List and start the broker:
./kafka-mesos.sh broker list
./kafka-mesos.sh broker start 0
  1. Publish and read it back:
echo "test" | kafkacat -P -b "worker-1:31000" -t testTopic -p 0
kafkacat -C -b "worker-1:31000" -t testTopic -p 0 -e

Cleanup

  1. Teardown the framework:
curl -H "Content-Type: application/json" -X POST \
-d 'frameworkId=aaaaaaaa-bbbb-cccc-dddd-eeeeeeeeeeee-ffff' \
-v -L http://master:5050/teardown
  1. Purge ZK state:
sudo rkt enter $(rkt list | awk '/zookeeper/ {print $1}') \
/opt/zookeeper/bin/zkCli.sh -server 172.17.8.11:2181 rmr /kafka-mesos

Releases

No releases published

Packages

No packages published

Languages