Benchmark Experiment

Run Real Experiment and Calculate Non-Parametric Statistics.

Installation

Install it yourself as:

$ gem install benchmark-experiment

Usage

TODO

Ideas

• compare two different implementations of a same function
  1. get the stats, then compare
  2. use git (commit, branch)
  3. use tests to check no performance regression at the same time
  4. annotate the tests you want to check
• decide the sample size automatically (based on the power you want to reach)
• explain correctly why we should do that

Contributing

1. Fork it ( https://github.com/toch/benchmark-lab/fork )
2. Create your feature branch (git checkout -b my-new-feature)
3. Commit your changes (git commit -am 'Add some feature')
4. Push to the branch (git push origin my-new-feature)
5. Create a new Pull Request