Waltz performance tests in Ducktape

[whynick1]

We need to add benchmark test for waltz with ducktape. So that we can

1. test Waltz producer/consumer performance with different deployment (multi-region)
2. detect performance degradation
   Expecting performance report, like:

####################### PERFORMANCE REPORT #######################
Appended 1000000 transactions, with total 488.2813 MB, in 1569.85 secs
Transaction/sec: 637.0052
MB/sec: 0.3110
Retry/Transaction: 0.0000
milliSec/Transaction: 93.6697
##################################################################

[whynick1]

I am curious how the throughput (txn/sec) changes with different number of partitions.

Sure! We can test that out.

Also I am curious what the latency (ms/txn) will look like with a more realistic interval between transactions.

Will test with different interval (current interval == 0)

We are measuring time from the creation of transaction context to the completion of write

Correct!

The congestion at TransactionMonitor may be making the latency look worse. Maybe we should start another timer when transaction is execute to get the time excluding the waiting time on TransactionMonitor.

Sure!

As a summary, three things to do:

1. Add performance test with traffic in multiple partitions (need change in PerformanceCli)
2. Add performance test with different intervals
3. Add another timer that excludes waiting time on TransactionMonitor. (need change in PerformanceCli)