Skip to content

shivsantham/Confluent-Rest-Proxy-Evaluation

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 

Repository files navigation

Evaluating the producer and consumer throughput via Rest Proxy server by Confluent. Most of the concepts are similar to the description from @Apache-Kafka-Confluent-Evaluation repositry. This uses the Rest proxy service instead of the java client. I would highly recommend reading the http://docs.confluent.io/current/kafka-rest/docs/index.html before using this code for any benchmarking.

Setup Hardware: Mac Os, 15Gb RAM, ~400gb used/ 512gb disk space, 7 cpu cores

Producer -- Around 25k - 30K messages per second. When sending 100k messages per topic with message size (10k) .The numbers should up when the Http connection is used with KEEP_ALIVE property. This is still not done yet.

Consumer -- 40k-60k messages per second (Based up on the partition split)

Releases

No releases published

Packages

No packages published

Languages