Skip to content

Commit

Permalink
PTS 9.2 M2 prep
Browse files Browse the repository at this point in the history
  • Loading branch information
@michaellarabel
michaellarabel committed Nov 13, 2019
1 parent 4f7868c commit fcd19c0
Show file tree
Hide file tree
Showing 8 changed files with 133 additions and 165 deletions.
3 changes: 2 additions & 1 deletion ChangeLog
View file
@@ -1,6 +1,7 @@
PHORONIX TEST SUITE CHANGE-LOG

Phoronix Test Suite (Git)
Phoronix Test Suite 9.2.0 Milestone 2
13 November 2019

pts-core: Drop auto-compare sub-command since currently buggy / too server resource intensive
pts-core: Add FORCE_MIN_DURATION_PER_TEST
Expand Down
2 changes: 1 addition & 1 deletion README.md
View file
@@ -1,4 +1,4 @@
# Phoronix Test Suite 9.2.0m1
# Phoronix Test Suite 9.2.0m2
https://www.phoronix-test-suite.com/

The **Phoronix Test Suite** is the most comprehensive testing and benchmarking
Expand Down
5 changes: 1 addition & 4 deletions documentation/man-pages/phoronix-test-suite.1
View file
@@ -1,4 +1,4 @@
.TH phoronix-test-suite 1 "www.phoronix-test-suite.com" "9.2.0m1"
.TH phoronix-test-suite 1 "www.phoronix-test-suite.com" "9.2.0m2"
.SH NAME
phoronix-test-suite \- The Phoronix Test Suite is an extensible open-source platform for performing testing and performance evaluation.
.SH SYNOPSIS
Expand Down Expand Up @@ -45,9 +45,6 @@ This option will create a download cache for use by the Phoronix Test Suite. The
This option will permanently remove a installed test by the Phoronix Test Suite.
.TP
.SH TESTING
.B auto-compare
This option will autonomously determine the most relevant test(s) to run for any selected sub-system(s). The tests to run are determined via OpenBenchmarking.org integration with the global results pool. Related test results from OpenBenchmarking.org are also merged to provide a straight-forward and effective means of carrying out a system comparison. If wishing to find comparable results for any particular test profile(s), simply pass the test profile names as additional arguments to this command.
.TP
.B benchmark [Test | Suite | OpenBenchmarking ID | Test Result] ...
This option will install the selected test(s) (if needed) and will proceed to run the test(s). This option is equivalent to running phoronix-test-suite with the install option followed by the run option. Multiple arguments can be supplied to run additional tests at the same time and save the results into one file.
.TP
Expand Down
94 changes: 42 additions & 52 deletions documentation/phoronix-test-suite.html
View file
Expand Up @@ -294,9 +294,6 @@ <h3>remove-installed-test<em> [Test]</em>
</h3>
<p>This option will permanently remove a installed test by the Phoronix Test Suite.</p>
<h1>Testing</h1>
<h3>auto-compare<em> </em>
</h3>
<p>This option will autonomously determine the most relevant test(s) to run for any selected sub-system(s). The tests to run are determined via OpenBenchmarking.org integration with the global results pool. Related test results from OpenBenchmarking.org are also merged to provide a straight-forward and effective means of carrying out a system comparison. If wishing to find comparable results for any particular test profile(s), simply pass the test profile names as additional arguments to this command.</p>
<h3>benchmark<em> [Test | Suite | OpenBenchmarking ID | Test Result] ...</em>
</h3>
<p>This option will install the selected test(s) (if needed) and will proceed to run the test(s). This option is equivalent to running phoronix-test-suite with the install option followed by the run option. Multiple arguments can be supplied to run additional tests at the same time and save the results into one file.</p>
Expand Down Expand Up @@ -815,6 +812,8 @@ <h1>Environment Variables</h1>
<p>This is similar to the FORCE_TIMES_TO_RUN option but will only be used if the test profile's run count is less than this defined value.</p>
<p><strong>FORCE_MIN_TIMES_TO_RUN_CUTOFF</strong></p>
<p>When used in conjunction with FORCE_MIN_TIMES_TO_RUN, the override value will only be applied to test profiles where its average run-time length (in minutes) is less than the value specified by FORCE_MIN_TIMES_TO_RUN_CUTOFF.</p>
<p><strong>FORCE_MIN_DURATION_PER_TEST</strong></p>
<p>This is similar to FORCE_MIN_TIMES_TO_RUN but allows specifying a time (in minutes) that each test should be run for. Each test will loop at least until that amount of time has elapsed. This can be useful for short-running tests if wanting to ensure each test is run long enough to rule out system noise.</p>
<p><strong>IGNORE_RUNS</strong></p>
<p>IGNORE_RUNS can be passed a comma-separated list of runs to skip on each benchmark. For example, IGNORE_RUNS=1 would always drop the first run from being recorded.</p>
<p><strong>NO_FILE_HASH_CHECKS</strong></p>
Expand Down Expand Up @@ -956,18 +955,24 @@ <h3>Smp Tests<em> pts/smp</em>
<h3>Cuda Tests<em> pts/cuda</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cuda.</p>
<h3>Mpi Tests<em> pts/mpi</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing mpi.</p>
<h3>Openmp Tests<em> pts/openmp</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmp.</p>
<h3>Cloud Tests<em> pts/cloud</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cloud.</p>
<h3>Docker Tests<em> pts/docker</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing docker.</p>
<h3>Python Tests<em> pts/python</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing python.</p>
<h3>Go Tests<em> pts/go</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing go.</p>
<h3>Mpi Tests<em> pts/mpi</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing mpi.</p>
<h3>Vdpau Tests<em> pts/vdpau</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing vdpau.</p>
Expand Down Expand Up @@ -1121,93 +1126,78 @@ <h3>Game Tests<em> git/game</em>
<h3>Smp Tests<em> git/smp</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.</p>
<h3>All PTS Tests<em> pts/all</em>
<h3>All SYSTEM Tests<em> system/all</em>
</h3>
<p>This is a collection of all test profiles found within the specified OpenBenchmarking.org repository.</p>
<h3>Installed Tests<em> pts/installed</em>
<h3>Installed Tests<em> system/installed</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository that are already installed on the system under test.</p>
<h3>Every PTS Test<em> pts/everything</em>
<h3>Every SYSTEM Test<em> system/everything</em>
</h3>
<p>This is a collection of every test profile found within the specified OpenBenchmarking.org repository, including unsupported tests.</p>
<h3>Linux Operating System Tests<em> pts/linux</em>
<h3>Linux Operating System Tests<em> system/linux</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Linux Operating System.</p>
<h3>Solaris Operating System Tests<em> pts/solaris</em>
<h3>Solaris Operating System Tests<em> system/solaris</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Solaris Operating System.</p>
<h3>BSD Operating System Tests<em> pts/bsd</em>
<h3>BSD Operating System Tests<em> system/bsd</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the BSD Operating System.</p>
<h3>MacOSX Operating System Tests<em> pts/macosx</em>
<h3>MacOSX Operating System Tests<em> system/macosx</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the MacOSX Operating System.</p>
<h3>Windows Operating System Tests<em> pts/windows</em>
<h3>Windows Operating System Tests<em> system/windows</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Windows Operating System.</p>
<h3>Hurd Operating System Tests<em> pts/hurd</em>
<h3>Hurd Operating System Tests<em> system/hurd</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Hurd Operating System.</p>
<h3>System Subsystem Tests<em> pts/system</em>
<h3>System Subsystem Tests<em> system/system</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the System sub-system.</p>
<h3>Processor Subsystem Tests<em> pts/processor</em>
<h3>Processor Subsystem Tests<em> system/processor</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Processor sub-system.</p>
<h3>Graphics Subsystem Tests<em> pts/graphics</em>
<h3>Disk Subsystem Tests<em> system/disk</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Disk sub-system.</p>
<h3>Graphics Subsystem Tests<em> system/graphics</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Graphics sub-system.</p>
<h3>Other Subsystem Tests<em> pts/other</em>
<h3>Memory Subsystem Tests<em> system/memory</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Memory sub-system.</p>
<h3>Network Subsystem Tests<em> system/network</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Network sub-system.</p>
<h3>Other Subsystem Tests<em> system/other</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Other sub-system.</p>
<h3>Utility Tests<em> pts/utility</em>
<h3>Utility Tests<em> system/utility</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Utility software test.</p>
<h3>Simulator Tests<em> pts/simulator</em>
<h3>Simulator Tests<em> system/simulator</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Simulator software test.</p>
<h3>Scientific Tests<em> pts/scientific</em>
<h3>Scientific Tests<em> system/scientific</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Scientific software test.</p>
<h3>Benchmark Tests<em> pts/benchmark</em>
<h3>Benchmark Tests<em> system/benchmark</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Benchmark software test.</p>
<h3>Application Tests<em> pts/application</em>
<h3>Application Tests<em> system/application</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Application software test.</p>
<h3>Game Tests<em> pts/game</em>
<h3>Game Tests<em> system/game</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Game software test.</p>
<h3>Smp Tests<em> pts/smp</em>
<h3>Opencl Tests<em> system/opencl</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.</p>
<h3>Cuda Tests<em> pts/cuda</em>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing opencl.</p>
<h3>Cuda Tests<em> system/cuda</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cuda.</p>
<h3>Openmp Tests<em> pts/openmp</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmp.</p>
<h3>Python Tests<em> pts/python</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing python.</p>
<h3>Go Tests<em> pts/go</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing go.</p>
<h3>Mpi Tests<em> pts/mpi</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing mpi.</p>
<h3>Vdpau Tests<em> pts/vdpau</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing vdpau.</p>
<h3>Video Tests<em> pts/video</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing video.</p>
<h3>Responsiveness Tests<em> pts/responsiveness</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing responsiveness.</p>
<h3>Openmpi Tests<em> pts/openmpi</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmpi.</p>
<h3>All WINDOWS Tests<em> windows/all</em>
</h3>
<p>This is a collection of all test profiles found within the specified OpenBenchmarking.org repository.</p>
Expand Down

0 comments on commit fcd19c0

Please sign in to comment.