Benchmarking for Puma. Exercise in trying to benchmark Puma against Unicorn to try and replicate the benchmarking results on the Puma site. At the very least just see how Puma stacks up.
This is the primary machine I am running these benchmarks on:
Model Name: iMac
Model Identifier: iMac11,2
Processor Name: Intel Core i3
Processor Speed: 3.06 GHz
Number Of Processors: 1
Total Number Of Cores: 2
L2 Cache (per core): 256 KB
L3 Cache: 4 MB
Memory: 4 GB
Processor Interconnect Speed: 5.86 GT/s
Run under Unicorn or Puma in one terminal and then run the benchmarking in another terminal.
rvm use ruby-1.9.3@puma-benchmarking --create
bundle install
unicorn -c unicorn.rb
rvm use ruby-1.9.3@puma-benchmarking --create
bundle install
rainbows -c unicorn.rb
rvm use jruby-1.6.7.2@puma-benchmarking --create
bundle install
ruby --1.9 `which puma` -t 4:4
rvm jruby-1.7.0.preview1@puma-benchmarking --create
bundle install
puma -t 4:4
rvm use rbx-1.2.4@puma-benchmarking --create
bundle install
puma -t 4:4
rvm use rbx-head@puma-benchmarking --create
bundle install
ruby -X19 `which puma` -t 4:4
ab -n 10000 -c 50 -k http://localhost:9292/health/ping
MRI - 1.9.3 / Unicorn: Requests per second: 1493.28 [#/sec] (mean)
JRuby (1.6.7.2) - 1.9.2 / Puma: Requests per second: 1460.20 [#/sec] (mean)
JRuby (1.7.0.preview1) - 1.9.3 / Puma: Requests per second: 1093.26 [#/sec] (mean)
NOTE: Initial run after starting Puma
JRuby (1.7.0.preview1) - 1.9.3 / Puma: Requests per second: 4044.04 [#/sec] (mean)
NOTE: 2nd run of the benchmarks. VM is doing optimization.
Rubinius (1.2.4) - 1.8.7 / Puma: Requests per second: 55.09 [#/sec] (mean)
Rubinius (Head) - 1.9.3 / Puma: Requests per second: 1225.02 [#/sec] (mean)
Server Software:
Server Hostname: localhost
Server Port: 9292
Document Path: /health/ping
Document Length: 29 bytes
Concurrency Level: 50
Time taken for tests: 6.697 seconds
Complete requests: 10000
Failed requests: 0
Write errors: 0
Keep-Alive requests: 0
Total transferred: 1720143 bytes
HTML transferred: 290000 bytes
Requests per second: 1493.28 [#/sec] (mean)
Time per request: 33.483 [ms] (mean)
Time per request: 0.670 [ms] (mean, across all concurrent requests)
Transfer rate: 250.84 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.5 0 10
Processing: 13 33 5.7 33 72
Waiting: 12 33 5.7 32 68
Total: 14 33 5.7 33 72
Percentage of the requests served within a certain time (ms)
50% 33
66% 35
75% 36
80% 37
90% 41
95% 43
98% 47
99% 50
100% 72 (longest request)
Server Software:
Server Hostname: 127.0.0.1
Server Port: 9292
Document Path: /health/ping
Document Length: 29 bytes
Concurrency Level: 50
Time taken for tests: 6.848 seconds
Complete requests: 10000
Failed requests: 0
Write errors: 0
Keep-Alive requests: 10000
Total transferred: 1240000 bytes
HTML transferred: 290000 bytes
Requests per second: 1460.20 [#/sec] (mean)
Time per request: 34.242 [ms] (mean)
Time per request: 0.685 [ms] (mean, across all concurrent requests)
Transfer rate: 176.82 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.0 0 1
Processing: 1 2 1.0 2 6
Waiting: 1 2 0.9 2 6
Total: 1 2 1.0 2 7
Percentage of the requests served within a certain time (ms)
50% 2
66% 2
75% 3
80% 3
90% 3
95% 4
98% 5
99% 5
100% 7 (longest request)
Server Software:
Server Hostname: localhost
Server Port: 9292
Document Path: /health/ping
Document Length: 29 bytes
Concurrency Level: 50
Time taken for tests: 9.147 seconds
Complete requests: 10000
Failed requests: 1
(Connect: 0, Receive: 0, Length: 1, Exceptions: 0)
Write errors: 0
Keep-Alive requests: 9999
Total transferred: 1239876 bytes
HTML transferred: 289971 bytes
Requests per second: 1093.26 [#/sec] (mean)
Time per request: 45.735 [ms] (mean)
Time per request: 0.915 [ms] (mean, across all concurrent requests)
Transfer rate: 132.37 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.0 0 1
Processing: 1 4 13.7 2 639
Waiting: 0 3 13.5 2 639
Total: 1 4 13.7 2 639
Percentage of the requests served within a certain time (ms)
50% 2
66% 3
75% 4
80% 5
90% 7
95% 11
98% 16
99% 20
100% 639 (longest request)
Server Software:
Server Hostname: localhost
Server Port: 9292
Document Path: /health/ping
Document Length: 29 bytes
Concurrency Level: 50
Time taken for tests: 2.424 seconds
Complete requests: 10000
Failed requests: 0
Write errors: 0
Keep-Alive requests: 10000
Total transferred: 1240000 bytes
HTML transferred: 290000 bytes
Requests per second: 4125.61 [#/sec] (mean)
Time per request: 12.119 [ms] (mean)
Time per request: 0.242 [ms] (mean, across all concurrent requests)
Transfer rate: 499.59 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.0 0 1
Processing: 0 1 0.7 1 10
Waiting: 0 1 0.6 1 10
Total: 0 1 0.7 1 10
Percentage of the requests served within a certain time (ms)
50% 1
66% 1
75% 1
80% 1
90% 2
95% 2
98% 3
99% 4
100% 10 (longest request)
Server Software:
Server Hostname: 127.0.0.1
Server Port: 9292
Document Path: /health/ping
Document Length: 2103 bytes
Concurrency Level: 50
Time taken for tests: 181.526 seconds
Complete requests: 10000
Failed requests: 9989
(Connect: 0, Receive: 0, Length: 9989, Exceptions: 0)
Write errors: 0
Non-2xx responses: 38
Keep-Alive requests: 9976
Total transferred: 1326386 bytes
HTML transferred: 379084 bytes
Requests per second: 55.09 [#/sec] (mean)
Time per request: 907.631 [ms] (mean)
Time per request: 18.153 [ms] (mean, across all concurrent requests)
Transfer rate: 7.14 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.3 0 10
Processing: 1 304 5697.1 2 181511
Waiting: 0 467 7508.0 1 181511
Total: 1 304 5697.4 2 181517
Percentage of the requests served within a certain time (ms)
50% 2
66% 3
75% 4
80% 5
90% 10
95% 28
98% 68
99% 142
100% 181517 (longest request)
Server Software:
Server Hostname: 127.0.0.1
Server Port: 9292
Document Path: /health/ping
Document Length: 29 bytes
Concurrency Level: 50
Time taken for tests: 8.163 seconds
Complete requests: 10000
Failed requests: 0
Write errors: 0
Keep-Alive requests: 10000
Total transferred: 1240000 bytes
HTML transferred: 290000 bytes
Requests per second: 1225.02 [#/sec] (mean)
Time per request: 40.816 [ms] (mean)
Time per request: 0.816 [ms] (mean, across all concurrent requests)
Transfer rate: 148.34 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.0 0 1
Processing: 1 2 5.4 1 367
Waiting: 1 2 5.4 1 367
Total: 1 2 5.4 1 368
Percentage of the requests served within a certain time (ms)
50% 1
66% 1
75% 1
80% 1
90% 2
95% 5
98% 7
99% 8
100% 368 (longest request)