From 59dd313836243593f3fdf73df40b38abefd31109 Mon Sep 17 00:00:00 2001
From: Michael Larabel Virtual test suites are not like a traditional test suite defined by the XML suite specification. Virtual test suites are dynamically generated in real-time by the Phoronix Test Suite client based upon the specified test critera. Virtual test suites can automatically consist of all test profiles that are compatible with a particular operating system or test profiles that meet other critera. When running a virtual suite, the OpenBenchmarking.org repository of the test profiles to use for generating the dynamic suite must be prefixed. Virtual test suites can be installed and run just like a normal XML test suite and shares nearly all of the same capabilities. However, when running a virtual suite, the user will be prompted to input any user-configuration options for needed test profiles just as they would need to do if running the test individually. When running a virtual suite, the user also has the ability to select individual tests within the suite to run or to run all of the contained test profiles. Virtual test suites are also only supported for an OpenBenchmarking.org repository if there is no test profile or test suite of the same name in the repository. Below is a list of common virtual test suites for the main Phoronix Test Suite repository, but the dynamic list of available virtual test suites based upon the enabled repositories is available by running phoronix-test-suite list-available-virtual-suites. This is a collection of test profiles where there have been successful benchmark results submitted to OpenBenchmarking.org from 64-bit Arm / AArch64 CPU architecture hardware, i.e. these tests are proven to be 64-bit Arm / AArch64 compatible though not necessarily all compatible test profiles for the given architecture - just those with submitted public results previously on OpenBenchmarking.org. This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository. This is a collection of test profiles having an external dependency on C++ Boost This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System. This is a collection of test profiles often useful for C/C++ compiler benchmarks and where the test profiles will respect CFLAGS/CXXFLAGS environment variables. This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the disk sub-system. This is a collection of all test profiles found within the specified OpenBenchmarking.org repository, including unsupported tests, etc. This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the memory sub-system. This is a collection of test profiles that have been detected to be CPU multi-threaded capable. This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmpi. This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the os sub-system. This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing python. This is a collection of test profiles where there have been successful benchmark results submitted to OpenBenchmarking.org from RISC-V CPU architecture hardware, i.e. these tests are proven to be RISC-V compatible though not necessarily all compatible test profiles for the given architecture - just those with submitted public results previously on OpenBenchmarking.org. This is a collection of test profiles having an external dependency on Ruby This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a simulator software test. This is a collection of test profiles that have been detected to be single-threaded or only very poorly CPU threaded. This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing responsiveness. This is a collection of test profiles where there have been successful benchmark results submitted to OpenBenchmarking.org from 64-bit Arm / AArch64 CPU architecture hardware, i.e. these tests are proven to be 64-bit Arm / AArch64 compatible though not necessarily all compatible test profiles for the given architecture - just those with submitted public results previously on OpenBenchmarking.org. This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository. This is a collection of test profiles having an external dependency on C++ Boost This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System. This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the disk sub-system. This is a collection of all test profiles found within the specified OpenBenchmarking.org repository, including unsupported tests, etc. This is a collection of test profiles having an external dependency on Python This is a collection of test profiles where there have been successful benchmark results submitted to OpenBenchmarking.org from RISC-V CPU architecture hardware, i.e. these tests are proven to be RISC-V compatible though not necessarily all compatible test profiles for the given architecture - just those with submitted public results previously on OpenBenchmarking.org. This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a scientific software test. This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp. This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository. This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System. This is a collection of all test profiles found within the specified OpenBenchmarking.org repository, including unsupported tests, etc. Virtual test suites are not like a traditional test suite defined by the XML suite specification. Virtual test suites are dynamically generated in real-time by the Phoronix Test Suite client based upon the specified test critera. Virtual test suites can automatically consist of all test profiles that are compatible with a particular operating system or test profiles that meet other critera. When running a virtual suite, the OpenBenchmarking.org repository of the test profiles to use for generating the dynamic suite must be prefixed. Virtual test suites can be installed and run just like a normal XML test suite and shares nearly all of the same capabilities. However, when running a virtual suite, the user will be prompted to input any user-configuration options for needed test profiles just as they would need to do if running the test individually. When running a virtual suite, the user also has the ability to select individual tests within the suite to run or to run all of the contained test profiles. Virtual test suites are also only supported for an OpenBenchmarking.org repository if there is no test profile or test suite of the same name in the repository. Below is a list of common virtual test suites for the main Phoronix Test Suite repository, but the dynamic list of available virtual test suites based upon the enabled repositories is available by running phoronix-test-suite list-available-virtual-suites.Module Writing
Virtual Test Suites
-All Tests In Pts pts/all
+
64-bit Arm / AArch64 Tests In pts pts/aarch64
+
+All Tests in pts pts/all
Application Tests pts/application
@@ -1309,16 +1312,16 @@
BLAS (Basic Linear Algebra Sub-Routine) Tests pts/blas
C++ Boost Tests pts/boost
Bsd Operating System Tests pts/bsd
+
BSD Operating System Tests pts/bsd
C/C++ Compiler Benchmark Workloads In Pts pts/compiler
+
C/C++ Compiler Benchmark Workloads In pts pts/compiler
Disk Subsystem Tests pts/disk
Everything In Pts pts/everything
+
Everything in pts pts/everything
Fortran Tests pts/fortran
@@ -1351,7 +1354,7 @@
Macosx Operating System Tests pts/macosx
Memory Subsystem Tests pts/memory
Multi-Core/Multi-Threaded Workloads In Pts pts/multicore
+
Multi-Core/Multi-Threaded Workloads In pts pts/multicore
Network Subsystem Tests pts/network
@@ -1366,7 +1369,7 @@
OpenCV Tests pts/opencv
Openmpi Tests pts/openmpi
Os Subsystem Tests pts/os
+
OS Subsystem Tests pts/os
Processor Subsystem Tests pts/processor
@@ -1375,6 +1378,9 @@
Processor Subsystem Tests pts/processor
Python Tests pts/python
RISC-V Tests In pts pts/riscv
+
+Ruby Tests pts/ruby
Scientific Tests pts/scientific
Simulator Tests pts/simulator
Single-Threaded Workloads In Pts pts/single-threaded
+
Single-Threaded Workloads In pts pts/single-threaded
Solaris Operating System Tests pts/solaris
@@ -1438,7 +1444,10 @@
Video Tests pts/video
Responsiveness Tests pts/responsiveness
All Tests In System system/all
+
64-bit Arm / AArch64 Tests In system system/aarch64
+
+All Tests in system system/all
Application Tests system/application
@@ -1453,13 +1462,13 @@
BLAS (Basic Linear Algebra Sub-Routine) Tests system/blas
C++ Boost Tests system/boost
Bsd Operating System Tests system/bsd
+
BSD Operating System Tests system/bsd
Disk Subsystem Tests system/disk
Everything In System system/everything
+
Everything in system system/everything
Game Tests system/game
@@ -1489,6 +1498,9 @@
Processor Subsystem Tests system/processor
Python Tests system/python
RISC-V Tests In system system/riscv
+
+Scientific Tests system/scientific
Cuda Tests system/cuda
Smp Tests system/smp
All Tests In Git git/all
+
All Tests in git git/all
Bsd Operating System Tests git/bsd
+
BSD Operating System Tests git/bsd
Everything In Git git/everything
+
Everything in git git/everything
Linux Operating System Tests git/linux
diff --git a/documentation/phoronix-test-suite.md b/documentation/phoronix-test-suite.md
index ad1658d265..ad753f31a6 100644
--- a/documentation/phoronix-test-suite.md
+++ b/documentation/phoronix-test-suite.md
@@ -1575,7 +1575,10 @@ Virtual test suites can be installed and run just like a normal XML test suite a
---
-#### All Tests In Pts pts/all
+#### 64-bit Arm / AArch64 Tests In pts pts/aarch64
+This is a collection of test profiles where there have been successful benchmark results submitted to OpenBenchmarking.org from 64-bit Arm / AArch64 CPU architecture hardware, i.e. these tests are proven to be 64-bit Arm / AArch64 compatible though not necessarily all compatible test profiles for the given architecture - just those with submitted public results previously on OpenBenchmarking.org.
+
+#### All Tests in pts pts/all
This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.
#### Application Tests pts/application
@@ -1590,16 +1593,16 @@ This is a collection of test profiles having an external dependency on BLAS (Bas
#### C++ Boost Tests pts/boost
This is a collection of test profiles having an external dependency on C++ Boost
-#### Bsd Operating System Tests pts/bsd
+#### BSD Operating System Tests pts/bsd
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.
-#### C/C++ Compiler Benchmark Workloads In Pts pts/compiler
+#### C/C++ Compiler Benchmark Workloads In pts pts/compiler
This is a collection of test profiles often useful for C/C++ compiler benchmarks and where the test profiles will respect CFLAGS/CXXFLAGS environment variables.
#### Disk Subsystem Tests pts/disk
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the disk sub-system.
-#### Everything In Pts pts/everything
+#### Everything in pts pts/everything
This is a collection of all test profiles found within the specified OpenBenchmarking.org repository, including unsupported tests, etc.
#### Fortran Tests pts/fortran
@@ -1632,7 +1635,7 @@ This is a collection of test profiles found within the specified OpenBenchmarkin
#### Memory Subsystem Tests pts/memory
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the memory sub-system.
-#### Multi-Core/Multi-Threaded Workloads In Pts pts/multicore
+#### Multi-Core/Multi-Threaded Workloads In pts pts/multicore
This is a collection of test profiles that have been detected to be CPU multi-threaded capable.
#### Network Subsystem Tests pts/network
@@ -1647,7 +1650,7 @@ This is a collection of test profiles having an external dependency on OpenCV
#### Openmpi Tests pts/openmpi
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmpi.
-#### Os Subsystem Tests pts/os
+#### OS Subsystem Tests pts/os
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the os sub-system.
#### Processor Subsystem Tests pts/processor
@@ -1656,6 +1659,9 @@ This is a collection of test profiles found within the specified OpenBenchmarkin
#### Python Tests pts/python
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing python.
+#### RISC-V Tests In pts pts/riscv
+This is a collection of test profiles where there have been successful benchmark results submitted to OpenBenchmarking.org from RISC-V CPU architecture hardware, i.e. these tests are proven to be RISC-V compatible though not necessarily all compatible test profiles for the given architecture - just those with submitted public results previously on OpenBenchmarking.org.
+
#### Ruby Tests pts/ruby
This is a collection of test profiles having an external dependency on Ruby
@@ -1668,7 +1674,7 @@ This is a collection of test profiles found within the specified OpenBenchmarkin
#### Simulator Tests pts/simulator
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a simulator software test.
-#### Single-Threaded Workloads In Pts pts/single-threaded
+#### Single-Threaded Workloads In pts pts/single-threaded
This is a collection of test profiles that have been detected to be single-threaded or only very poorly CPU threaded.
#### Solaris Operating System Tests pts/solaris
@@ -1719,7 +1725,10 @@ This is a collection of test profiles found within the specified OpenBenchmarkin
#### Responsiveness Tests pts/responsiveness
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing responsiveness.
-#### All Tests In System system/all
+#### 64-bit Arm / AArch64 Tests In system system/aarch64
+This is a collection of test profiles where there have been successful benchmark results submitted to OpenBenchmarking.org from 64-bit Arm / AArch64 CPU architecture hardware, i.e. these tests are proven to be 64-bit Arm / AArch64 compatible though not necessarily all compatible test profiles for the given architecture - just those with submitted public results previously on OpenBenchmarking.org.
+
+#### All Tests in system system/all
This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.
#### Application Tests system/application
@@ -1734,13 +1743,13 @@ This is a collection of test profiles having an external dependency on BLAS (Bas
#### C++ Boost Tests system/boost
This is a collection of test profiles having an external dependency on C++ Boost
-#### Bsd Operating System Tests system/bsd
+#### BSD Operating System Tests system/bsd
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.
#### Disk Subsystem Tests system/disk
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the disk sub-system.
-#### Everything In System system/everything
+#### Everything in system system/everything
This is a collection of all test profiles found within the specified OpenBenchmarking.org repository, including unsupported tests, etc.
#### Game Tests system/game
@@ -1770,6 +1779,9 @@ This is a collection of test profiles found within the specified OpenBenchmarkin
#### Python Tests system/python
This is a collection of test profiles having an external dependency on Python
+#### RISC-V Tests In system system/riscv
+This is a collection of test profiles where there have been successful benchmark results submitted to OpenBenchmarking.org from RISC-V CPU architecture hardware, i.e. these tests are proven to be RISC-V compatible though not necessarily all compatible test profiles for the given architecture - just those with submitted public results previously on OpenBenchmarking.org.
+
#### Scientific Tests system/scientific
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a scientific software test.
@@ -1794,13 +1806,13 @@ This is a collection of test profiles found within the specified OpenBenchmarkin
#### Smp Tests system/smp
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.
-#### All Tests In Git git/all
+#### All Tests in git git/all
This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.
-#### Bsd Operating System Tests git/bsd
+#### BSD Operating System Tests git/bsd
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.
-#### Everything In Git git/everything
+#### Everything in git git/everything
This is a collection of all test profiles found within the specified OpenBenchmarking.org repository, including unsupported tests, etc.
#### Linux Operating System Tests git/linux
diff --git a/documentation/phoronix-test-suite.pdf b/documentation/phoronix-test-suite.pdf
index ba23050b5e5efea532d61e6a6c10e7aa12982db3..f3536b1fb5a2d61a70452b3a82dace5f6a22effd 100644
GIT binary patch
delta 18397
zcmcJ033wD$w*S}NRToHD!oHIZAUjESRrSUqAfO;y1O!AG2pA+v7P7D=1Q3*+Knq89
zP(axO0a_3cRAf-b0mnC@D8lHtjSI~9d?2X*-@R4U>8@hl_x)$)@y$0T=bU@)*_W!y
zxid}AeBQMDBd0^5YhO5<)8)x>gYa(-xuULXB?s1iP*%d8j*}{Su!kEsl<>ttvnrCB
z?{nbCUO&BEu_(D;H3K@ReL0}wK!vB{{2KWA#&@og3MI6k!yjtu1f%rr6-T=^tm9BB
zE)MF%`EziECw+Wv{Cw>Jxuha#JSP{-7eAiF!6^zWsc1Ac3SKq6xR$uHxMImdekUiU
zv%?*=!==0Aie^h1>*!e(2i6^kySmH9h>6PH%TeN*ulK(LVTER%lTqlNQ-e*~sTZQq
zzrXjIN!$5aJo6);jY%@ttoV_mDti5t0{J=P$dxLNIO@m~367-(r$}xifsCXyaonkC
z99Y|4z$#Vy?F%{5v6JIZ=AoHgEF4|k9chNdk$nR#$iNWCG*gxi8S$(mkqM6PWaD1<
zlln=+?>|KTG1)Q06zZ#4QMMmMrp$KywYqWYy(Pw}FPv{j1}}FUF$I~kDdt4At&U<-
ze8>Kn6D0>6A0-;B{&XS+G31nEe1d`K{7wvF=N}yJo0s4EDCUlNpE!O6tH|819XkHEHl{S8du{)ye4C3}<5GkmSs*
zXP(&7*vaE8f?!?R$OMkoob7o8r(AcvOFw_-s27
ABsvd8U8vTs&+G;sO7M*)OZ&>J>mO{OLk=j!80@RAtzaY(gTEOGg>HaS;!u%9h
z3Oy`9wg^iUT}P7=xmN8r7-7ypN1U_cC`#KTHLr@HBH(iy*v}WyvR@fRjzNy?me1P!
zApH(c-D)K7#e9Y{!FY#h(`&yYEUQDldJm;eROe@@9OXQeo}&9rVfx~KIAxl5+7cqK
zN1;`sRz8B<2R2CYa^In&2agkKFUpW*rt=yVSkzR0W^qqBWbQD;fr9Ang)MeD
This is a collection of test profiles where there have been successful benchmark results submitted to OpenBenchmarking.org from 64-bit Arm / AArch64 CPU architecture hardware, i.e. these tests are proven to be 64-bit Arm / AArch64 compatible though not necessarily all compatible test profiles for the given architecture - just those with submitted public results previously on OpenBenchmarking.org.
+This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.
This is a collection of test profiles having an external dependency on C++ Boost
-This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.
-This is a collection of test profiles often useful for C/C++ compiler benchmarks and where the test profiles will respect CFLAGS/CXXFLAGS environment variables.
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the disk sub-system.
-This is a collection of all test profiles found within the specified OpenBenchmarking.org repository, including unsupported tests, etc.
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the memory sub-system.
-This is a collection of test profiles that have been detected to be CPU multi-threaded capable.
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmpi.
-This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the os sub-system.
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing python.
+This is a collection of test profiles where there have been successful benchmark results submitted to OpenBenchmarking.org from RISC-V CPU architecture hardware, i.e. these tests are proven to be RISC-V compatible though not necessarily all compatible test profiles for the given architecture - just those with submitted public results previously on OpenBenchmarking.org.
This is a collection of test profiles having an external dependency on Ruby
@@ -99,7 +105,7 @@This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a simulator software test.
-This is a collection of test profiles that have been detected to be single-threaded or only very poorly CPU threaded.
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing responsiveness.
-This is a collection of test profiles where there have been successful benchmark results submitted to OpenBenchmarking.org from 64-bit Arm / AArch64 CPU architecture hardware, i.e. these tests are proven to be 64-bit Arm / AArch64 compatible though not necessarily all compatible test profiles for the given architecture - just those with submitted public results previously on OpenBenchmarking.org.
+This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.
This is a collection of test profiles having an external dependency on C++ Boost
-This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the disk sub-system.
-This is a collection of all test profiles found within the specified OpenBenchmarking.org repository, including unsupported tests, etc.
This is a collection of test profiles having an external dependency on Python
+This is a collection of test profiles where there have been successful benchmark results submitted to OpenBenchmarking.org from RISC-V CPU architecture hardware, i.e. these tests are proven to be RISC-V compatible though not necessarily all compatible test profiles for the given architecture - just those with submitted public results previously on OpenBenchmarking.org.
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a scientific software test.
@@ -225,13 +237,13 @@This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.
-This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.
-This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.
-This is a collection of all test profiles found within the specified OpenBenchmarking.org repository, including unsupported tests, etc.