Skip to content

Commit

Permalink
Prep for Phoronix Test Suite 10.6.1 release
Browse files Browse the repository at this point in the history
  • Loading branch information
michaellarabel committed Oct 10, 2021
1 parent 58d6f1b commit 9b5f139
Show file tree
Hide file tree
Showing 7 changed files with 45 additions and 44 deletions.
10 changes: 5 additions & 5 deletions ChangeLog
@@ -1,21 +1,21 @@
PHORONIX TEST SUITE CHANGE-LOG

Phoronix Test Suite 10.6.0 (Git)
T.B.A.
Phoronix Test Suite 10.6.1
10 October 2021

pts-core: Allow reporting test run errors inline / as part of the result file XML with null/empty results
pts-core: Remove the old, long deprecated static/JavaScript PTS result viewer that hasn't been used except for rare fallbacks since PTS pre-9.0
pts-core: PHP 8.1 deprecation warning fixes
pts-core: PHP 8.1 deprecation warning/error fixes
pts-core: Support launching PHP web server with PHP_CLI_SERVER_WORKERS to allow multiple workers/threads
pts-core: Windows batch file handling test execution fix
pts-core: Allow running merge-results when pointing to specific XML files outside of standard paths
pts-core: Various minor fixes
phoromatic: Fix possible case of local test profile download issues from Phoromatic Server
phoromatic: Warn when lacking database write access for Phoromatic Server
phoromatic: Support (opt-in) handling of non-text file log files
phoromatic: System log viewer improvements
phoromatic: Make SYSTEM_ID accessible to client
phoromatic: Allow uploading of system logs after initial upload of result XML to deal with HTTP size limitations and other factors with large logs
phoromatic: Use the unified/common log viewer for viewing logs from the Phoromatic web interface
phoromatic: Tweaking of the Phoromatic CSS style to bring it more uniform with OpenBenchmarking.org / PTS Local Result Viewer / first update in ~6 years...
phodevi: Improve detection of new Intel oneAPI DPC++/C++ Compiler
phodevi: ACPI Platform Profile reporting support on Linux
phodevi: Support reporting NVIDIA BAR1 total memory / Radeon vRAM visible memory (Resizable BAR / ReBAR status)
Expand Down
49 changes: 22 additions & 27 deletions README.md
@@ -1,5 +1,5 @@
# Phoronix Test Suite 10.6.0
https://www.phoronix-test-suite.com/
# Phoronix Test Suite 10.6.1
![Phoronix Test Suite](pts-core/static/images/pts-308x160.png)

The **Phoronix Test Suite** is the most comprehensive testing and benchmarking
platform available for Linux, Solaris, macOS, Windows, and BSD operating
Expand All @@ -11,24 +11,23 @@ and is developed by Phoronix Media in cooperation with partners.

The Phoronix Test Suite itself is an open-source framework for conducting
automated tests along with reporting of test results, detection of installed
system software/hardware, and other features. Modules for the Phoronix Test
Suite also allow for integration with git-bisect and other revision control
systems for per-commit regression testing, system sensor monitoring, and other
extras.
system software/hardware, and other features. This framework is designed to be
an extensible architecture so that new test profiles and suites can be easily
added to represent performance benchmarks, unit tests, and other quantitative
and qualitative (e.g. image quality comparison and pass/fail) measurements.
Available through OpenBenchmarking.org, a collaborative storage platform
developed in conjunction with the Phoronix Test Suite, are more than 600
individual test profiles and more than 200 test suites available by default from
the Phoronix Test Suite. Independent users are also able to upload their test
results, profiles, and suites to OpenBenchmarking.org.

This framework is designed to be an extensible architecture so that new test
profiles and suites can be easily added to represent performance benchmarks,
unit tests, and other quantitative and qualitative (e.g. image quality
comparison) measurements. Available through OpenBenchmarking.org, a
collaborative storage platform developed in conjunction with the Phoronix Test
Suite, are more than 200 individual test profiles and more than 60 test suites
available by default from the Phoronix Test Suite. Independent users are also
able to upload their test results, profiles, and suites to OpenBenchmarking.org.
A test profile is a single test that can be executed by the Phoronix Test Suite
-- with a series of options possible within every test -- and a test suite is a
seamless collection of test profiles and/or additional test suites. A test
profile consists of a set of Bash/shell scripts and XML files while a test suite
is a single XML file.
is a single XML file. Modules for the Phoronix Test Suite also allow for
integration with git-bisect and other revision control systems for per-commit
regression testing, system sensor monitoring, and other extras.

[OpenBenchmarking.org](https://www.openbenchmarking.org/) also allows for
conducting side-by-side result comparisons, a central location for storing and
Expand All @@ -46,25 +45,25 @@ Phoromatic, and OpenBenchmarking.org is available by contacting

Full details on the Phoronix Test Suite setup and usage is available from the
included HTML/PDF documentation within the phoronix-test-suite package and from
the Phoronix Test Suite website.
the [Phoronix Test Suite documentation directory](documentation/).

## Installation & Setup

The Phoronix Test Suite is supported on Linux, *BSD, Solaris, macOS, and Windows
systems. However, the most full-featured and well supported operating system for
conducting the tests is Linux with some non-basic functionality not being
available under all platforms. The Phoronix Test Suite software/framework is
compatible with all major CPU architectures (e.g. i686, x86_64, ARM, RISC-V,
PowerPC), but not all of the test profiles/suites are compatible with all
architectures.
compatible with all major CPU architectures (e.g. i686, x86_64, ARM / AArch64,
RISC-V, POWER 64-bit), but not all of the test profiles/suites are compatible
with all architectures.

The Phoronix Test Suite can be installed for system-wide usage or run locally
without installation from the extracted tar.gz/zip package. The only hard
dependency on the Phoronix Test Suite is having command-line support for PHP
(PHP 5.3+) installed. A complete PHP stack (e.g. with web server) is **not**
needed, but merely the PHP command-line support, which is widely available from
operating system package managers under the name `php`, `php7-cli`, `php5-cli`,
or `php7`.
`php7` or `php8`.

## Usage

Expand All @@ -74,7 +73,9 @@ smallpt` to run a simple CPU test profile. If wishing to simply install a test,
it's a matter of running `phoronix-test-suite install <test or suite name>` and
to run it's `phoronix-test-suite run <test or suite name>`. There's also a batch
mode for non-interactive benchmarking by first running `phoronix-test-suite
batch-setup` and then using the `batch-run` sub-command rather than `run`.
batch-setup` and then using the `batch-run` sub-command rather than `run`. For
more guidance see the [Phoronix Test Suite
documentation](documentation/phoronix-test-suite.md).

Viewing installed system hardware and software is available via
`phoronix-test-suite system-info`.
Expand All @@ -84,9 +85,3 @@ running, for example, `phoronix-test-suite benchmark 1204293-BY-PHORONIX357` if
wishing to compare the results of the
`https://openbenchmarking.org/result/1204293-BY-PHORONIX357` result file.

Additional information is available from the Phoronix Test Suite website
<https://www.phoronix-test-suite.com/> and the material bundled within the
`phoronix-test-suite/documentation/` directory or via
<https://www.phoronix-test-suite.com/documentation/>. A man page is also bundled
with the phoronix-test-suite software.

Binary file modified documentation/phoronix-test-suite.pdf
Binary file not shown.
14 changes: 6 additions & 8 deletions documentation/stubs/readme-basics.txt
@@ -1,25 +1,23 @@
The Phoronix Test Suite itself is an open-source framework for conducting automated tests along with reporting of test results, detection of installed system software/hardware, and other features. Modules for the Phoronix Test Suite also allow for integration with git-bisect and other revision control systems for per-commit regression testing, system sensor monitoring, and other extras.
The Phoronix Test Suite itself is an open-source framework for conducting automated tests along with reporting of test results, detection of installed system software/hardware, and other features. This framework is designed to be an extensible architecture so that new test profiles and suites can be easily added to represent performance benchmarks, unit tests, and other quantitative and qualitative (e.g. image quality comparison and pass/fail) measurements. Available through OpenBenchmarking.org, a collaborative storage platform developed in conjunction with the Phoronix Test Suite, are more than 600 individual test profiles and more than 200 test suites available by default from the Phoronix Test Suite. Independent users are also able to upload their test results, profiles, and suites to OpenBenchmarking.org.

This framework is designed to be an extensible architecture so that new test profiles and suites can be easily added to represent performance benchmarks, unit tests, and other quantitative and qualitative (e.g. image quality comparison) measurements. Available through OpenBenchmarking.org, a collaborative storage platform developed in conjunction with the Phoronix Test Suite, are more than 200 individual test profiles and more than 60 test suites available by default from the Phoronix Test Suite. Independent users are also able to upload their test results, profiles, and suites to OpenBenchmarking.org. A test profile is a single test that can be executed by the Phoronix Test Suite -- with a series of options possible within every test -- and a test suite is a seamless collection of test profiles and/or additional test suites. A test profile consists of a set of Bash/shell scripts and XML files while a test suite is a single XML file.
A test profile is a single test that can be executed by the Phoronix Test Suite -- with a series of options possible within every test -- and a test suite is a seamless collection of test profiles and/or additional test suites. A test profile consists of a set of Bash/shell scripts and XML files while a test suite is a single XML file. Modules for the Phoronix Test Suite also allow for integration with git-bisect and other revision control systems for per-commit regression testing, system sensor monitoring, and other extras.

[OpenBenchmarking.org](https://www.openbenchmarking.org/) also allows for conducting side-by-side result comparisons, a central location for storing and sharing test results, and collaborating over test data. [Phoromatic](https://www.phoromatic.com/) is a complementary platform to OpenBenchmarking.org and the Phoronix Test Suite for interfacing with Phoronix Test Suite client(s) to automatically execute test runs on a timed, per-commit, or other trigger-driven basis. Phoromatic is designed for enterprise and allows for the easy management of multiple networked systems running Phoronix Test Suite clients via a single web-based interface.

Professional support and custom engineering for the Phoronix Test Suite, Phoromatic, and OpenBenchmarking.org is available by contacting <https://www.phoronix-test-suite.com/>.

Full details on the Phoronix Test Suite setup and usage is available from the included HTML/PDF documentation within the phoronix-test-suite package and from the Phoronix Test Suite website.
Full details on the Phoronix Test Suite setup and usage is available from the included HTML/PDF documentation within the phoronix-test-suite package and from the [Phoronix Test Suite documentation directory](documentation/).

## Installation & Setup

The Phoronix Test Suite is supported on Linux, *BSD, Solaris, macOS, and Windows systems. However, the most full-featured and well supported operating system for conducting the tests is Linux with some non-basic functionality not being available under all platforms. The Phoronix Test Suite software/framework is compatible with all major CPU architectures (e.g. i686, x86_64, ARM, RISC-V, PowerPC), but not all of the test profiles/suites are compatible with all architectures.
The Phoronix Test Suite is supported on Linux, *BSD, Solaris, macOS, and Windows systems. However, the most full-featured and well supported operating system for conducting the tests is Linux with some non-basic functionality not being available under all platforms. The Phoronix Test Suite software/framework is compatible with all major CPU architectures (e.g. i686, x86_64, ARM / AArch64, RISC-V, POWER 64-bit), but not all of the test profiles/suites are compatible with all architectures.

The Phoronix Test Suite can be installed for system-wide usage or run locally without installation from the extracted tar.gz/zip package. The only hard dependency on the Phoronix Test Suite is having command-line support for PHP (PHP 5.3+) installed. A complete PHP stack (e.g. with web server) is **not** needed, but merely the PHP command-line support, which is widely available from operating system package managers under the name `php`, `php7-cli`, `php5-cli`, or `php7`.
The Phoronix Test Suite can be installed for system-wide usage or run locally without installation from the extracted tar.gz/zip package. The only hard dependency on the Phoronix Test Suite is having command-line support for PHP (PHP 5.3+) installed. A complete PHP stack (e.g. with web server) is **not** needed, but merely the PHP command-line support, which is widely available from operating system package managers under the name `php`, `php7-cli`, `php5-cli`, `php7` or `php8`.

## Usage

The process to download, install/setup, execute, and report the results of a benchmark can be as simple as a command such as `phoronix-test-suite benchmark smallpt` to run a simple CPU test profile. If wishing to simply install a test, it's a matter of running `phoronix-test-suite install <test or suite name>` and to run it's `phoronix-test-suite run <test or suite name>`. There's also a batch mode for non-interactive benchmarking by first running `phoronix-test-suite batch-setup` and then using the `batch-run` sub-command rather than `run`.
The process to download, install/setup, execute, and report the results of a benchmark can be as simple as a command such as `phoronix-test-suite benchmark smallpt` to run a simple CPU test profile. If wishing to simply install a test, it's a matter of running `phoronix-test-suite install <test or suite name>` and to run it's `phoronix-test-suite run <test or suite name>`. There's also a batch mode for non-interactive benchmarking by first running `phoronix-test-suite batch-setup` and then using the `batch-run` sub-command rather than `run`. For more guidance see the [Phoronix Test Suite documentation](documentation/phoronix-test-suite.md).

Viewing installed system hardware and software is available via `phoronix-test-suite system-info`.

Facilitating a result comparison from OpenBenchmarking.org can be done by running, for example, `phoronix-test-suite benchmark 1204293-BY-PHORONIX357` if wishing to compare the results of the `https://openbenchmarking.org/result/1204293-BY-PHORONIX357` result file.

Additional information is available from the Phoronix Test Suite website <https://www.phoronix-test-suite.com/> and the material bundled within the `phoronix-test-suite/documentation/` directory or via <https://www.phoronix-test-suite.com/documentation/>. A man page is also bundled with the phoronix-test-suite software.
2 changes: 1 addition & 1 deletion pts-core/commands/dump_documentation.php
Expand Up @@ -268,7 +268,7 @@ public static function run($r)


// simple README
$readme = '# Phoronix Test Suite ' . PTS_VERSION . PHP_EOL . 'https://www.phoronix-test-suite.com/' . PHP_EOL . PHP_EOL;
$readme = '# Phoronix Test Suite ' . PTS_VERSION . PHP_EOL . '![Phoronix Test Suite](pts-core/static/images/pts-308x160.png)' . PHP_EOL . PHP_EOL;
$readme .= pts_documentation::basic_description() . PHP_EOL . PHP_EOL;
$readme .= pts_file_io::file_get_contents(PTS_PATH . 'documentation/stubs/readme-basics.txt') . PHP_EOL . PHP_EOL;
$readme = wordwrap($readme, 80, PHP_EOL);
Expand Down
6 changes: 3 additions & 3 deletions pts-core/pts-core.php
Expand Up @@ -302,9 +302,9 @@ function pts_version_codenames()
);
}

pts_define('PTS_VERSION', '10.6.0');
pts_define('PTS_CORE_VERSION', 10602);
pts_define('PTS_RELEASE_DATE', '20210806');
pts_define('PTS_VERSION', '10.6.1');
pts_define('PTS_CORE_VERSION', 10610);
pts_define('PTS_RELEASE_DATE', '20211010');
pts_define('PTS_CODENAME', 'Tjeldsund');

pts_define('PTS_IS_CLIENT', (defined('PTS_MODE') && strstr(PTS_MODE, 'CLIENT') !== false));
Expand Down
8 changes: 8 additions & 0 deletions release-highlights.md
@@ -1,5 +1,13 @@
# Phoronix Test Suite Release History

Phoronix Test Suite 10.6
======
#### Release Date: 10 October 2021 | Codename: Tjeldsund
* Improvements to the modern result viewer, removal of the deprecated legacy result viewer
* Support for expressing test run/install errors inline as part of the result file
* Initial compatibility with PHP 8.1
* Many Phoromatic fixes & enhancements

Phoronix Test Suite 10.4
======
#### Release Date: 16 May 2021 | Codename: Ibestad
Expand Down

0 comments on commit 9b5f139

Please sign in to comment.