Dornbirn

Features

• Box and automated PHAR build + deployment
• Self-updating PHAR.
• Storage:
  • Xml storage driver
  • DBAL storage driver
  • Support for deleting runs
  • Support for queries.
  • Storage log (like git log)
  • Archive and restore (e.g. from DBAL to XML and vice-versa).
  • Meta UUIDs via. the UUIDResolver (use latest as a UUID)
• Reports:
  • Replaced tabular with better reporting "engine".
  • Side-by-side comparisons of factors.
  • Break tables by arbitrary column values.
• Baseline environment provider standard tests to provide baseline performance mea surements.
• Histogram progress logger.
• Use RMT (Release Management Tool)

Bug fixes

• Fixed bliken logger spacing issue.
• Fixed rendering issues with % NUMBER_OF_COLS = 0 iterations

Improvements

• Use generic registry for storage driver

See the full changelog for more details.

Rock 'N Bowl

Features

• Warmup, execute revolutions before measurement #283 docs
• Environmental information #294 docs
• Availability of Mode statistic #278
• Debug executor (alternative to micotime executor, does not execute anything, deterministic).
• Specify time units in report command

Enhancements

• Better exceptions when no generator|extends key.
• Allow null filename in XSLT report
• Show headers by default in delimited report
• name attribute on report document. Allow %report_name% token in output filesnames.
• diff (time relative to other rows) column in aggregate report.
• Suite document has a functional test.

Bugs

• Warnings when iterations return 0 times (as can happen on Windows)
• Iteration script temp path not escaped.
• Overidden revolutions not recorded in XML doc.
• Multiline cursor position broken.

Nero

Features

• "blinken" progress logger. Highly visual progress logger. #256
• Support for specifying precision from the CLI via the --precision option.
• Generate XDebug profiles. #254 (see docs)
• Support for handling errors: Handle and log errors in iterations. #250
• Benchmark mode: Support for displaying throughput. #243

Improvments

• Travis logger shows number of iterations
• Refactoring factories/registries.
• Symfony 3.0 support: composer allows Symfony 3.0

Bugs

• Fatal error on division by zero.
• Standard deviation format incorrect.
• Non-existing key "bootstrap".
• Iteration processes can time-out.

Upwey

Features

• Time unit specification (microsecond, milliseconds, seconds, etc.) (#230).
• Standard Deviation: Show standard deviation in reports and progress loggers. (#212)
• Report comparison: Compare reports from different runs (#197).
• Better default logger with realtime feedback (#227).

Bugs

• Progress logger output corrupt on travis (#235).
• Uses /usr/bin/php instead of /bin/env php.

Improvements

• Removed 60 second time limit on iteration processes.
• Delimited report can now include a "header".

Zagreb

Features

• Minimum stability enforcement: Specify a retry threshold; Iterations will be run again and again until all iterations times fall within a given tolerance level.
• Before and After Class methods: Specify methods to be run before the benchmark class is executed, establish external state.
• Sleep: Pause imbetween iterations.
• Delimited renderer: Generate reports as delimiited list files (import to things such as spreadsheets, GNUPlot, etc).

Improvements

• Buffer and discard output from user benchmark class
• Show parameter set # in verbose logger
• Use memory_get_peak_usage
• Pretty print parameters in reports.

Kotor

Features

• --bootstrap CLI option to set bootstrap file

Improvements

• Executor class is polymorphic, allowing different ways of executing benchmarks
• Refactored the Launcher class

Bug fixes

• #174 Error parsing files with multiple class keywords
• #173 Markdown report header incorrect
• #166 Validate before/after methods at benchmark level
• #165 Show array parameter values in reports
• Allow path argument to override configured path

Izmir

• Rewritten reports, now using the tabular library
• Report rendering decoupled from report generation via. outputs:
  • XSLT output, including presets for HTML and Markdown
  • Console output
  • Debug output
• New annotation system
• PHPBench is agnostic of the target systems autoloading system
• All iterations executed in separate processes
• Official documentation: http://phpbench.readthedocs.org
• Lots of bug fixes.
• Lots of refactoring.

Due to the amount of changes in this release, the CHANGELOG was largely irrelelevant and will not be included again until the stable release.

0.3

Enhancements

• Improved formatting for console table report (#80)
• Sorting on multiple columns (console_table report) Sort accepts an array, e.g. array('col1' => 'asc', 'col2' => 'desc'). (#72)

Features

• New "simple" report, with no options. Used by default.
• Do not show empty reports on the in the console_table report
• Added variance column for aggregated results (#66)
• Removed redundant title for aggregated subject (#76)
• Added subject_meta option to console report generator.

Bugs

• (console) report is generated when dumping to stdout with a configuration
• Options resolver dependency is too low (#59)
• HHVM build fails

0.2

• Bumped minimum version of PHP to 5.4
  • [Report] Function avg renamed to mean
  • [Report] aggregate_iterations changed to aggregate
  • [Report] Aggregate on either runs or subjects
  • [Report] Explicit column name selection
  • [Report] Deviation step
  • [Report] Added sort and sort_dir options
  • [Report] Added groups option to run report only on specified groups
  • [RunCommand] Slugified option names