Phoronix Test Suite 5.6.0

System Internals / Phoronix Test Suite - Michael Larabel [phoronix.com] - 24 March 2015 07:40 UTC



###

diff --git a/CHANGE-LOG b/CHANGE-LOG
index e9384c8..29d6357 100644
--- a/CHANGE-LOG
+++ b/CHANGE-LOG
@@ -1,6 +1,6 @@
PHORONIX TEST SUITE CHANGE-LOG

-Phoronix Test Suite (Git)
+Phoronix Test Suite 5.6.0-Dedilovo

- pts-core: Drop bilde_renderer since it's been deprecated for a while
- pts-core: Yield /dev/mapper/* points in auto-disk-mount-points
diff --git a/README.md b/README.md
index c302449..03aa9f3 100644
--- a/README.md
+++ b/README.md
@@ -1,4 +1,4 @@
-# Phoronix Test Suite 5.6.0m5
+# Phoronix Test Suite 5.6.0
http://www.phoronix-test-suite.com/

The **Phoronix Test Suite** is the most comprehensive testing and benchmarking
diff --git a/documentation/TODO b/documentation/TODO
index 3a31027..3ff3c9a 100644
--- a/documentation/TODO
+++ b/documentation/TODO
@@ -65,11 +65,9 @@ PHORONIX TEST SUITE PUBLIC TODO LIST:

### PHOROMATIC ####

-- Get the Phoromatic search box implemented/working
- Implement the complementary WebSocket communication to HTTP pulls
- More mobile form factor optimizations
- Ensure sane validating of more user input / resource uploads
- Hook up TriggerTarget for allowing event.php to optionally specify a sub-set of systems/groups to target for a given trigger
- Clean up the code and modularize more of the code into functions
- Sharing results between independent accounts
-- Allow new Phoromatic installation to re-find old system association based on MAC address or similar
diff --git a/documentation/man-pages/phoronix-test-suite.1 b/documentation/man-pages/phoronix-test-suite.1
index 543e50c..d1d4d47 100644
--- a/documentation/man-pages/phoronix-test-suite.1
+++ b/documentation/man-pages/phoronix-test-suite.1
@@ -1,4 +1,4 @@
-.TH phoronix-test-suite 1 "www.phoronix-test-suite.com" "5.6.0m5"
+.TH phoronix-test-suite 1 "www.phoronix-test-suite.com" "5.6.0"
.SH NAME
phoronix-test-suite \- The Phoronix Test Suite is an extensible open-source platform for performing testing and performance evaluation.
.SH SYNOPSIS
diff --git a/documentation/phoronix-test-suite.html b/documentation/phoronix-test-suite.html
index 83f4ccc..cf53c32 100644
--- a/documentation/phoronix-test-suite.html
+++ b/documentation/phoronix-test-suite.html
@@ -1,4 +1,4 @@
-Phoronix Test Suite v5.6.0m5 - Test Client Documentation

Phoronix Test Suite

  1. Getting Started
  2. User Options
  3. Module Options
  4. Installation Instructions
  5. External Dependencies
  6. Configuration
  7. General Information
  8. Virtual Test Suites
  9. Component Testing
  10. Phoromatic
  11. PTS Desktop Live
  12. Development Credits

Getting Started


+Phoronix Test Suite v5.6.0 - Test Client Documentation

Phoronix Test Suite

  1. Getting Started
  2. User Options
  3. Module Options
  4. Installation Instructions
  5. External Dependencies
  6. Configuration
  7. General Information
  8. Virtual Test Suites
  9. Component Testing
  10. Phoromatic
  11. PTS Desktop Live
  12. Development Credits

Getting Started


Overview


The Phoronix Test Suite is the most comprehensive testing and benchmarking platform available for Linux, Solaris, Mac OS X, and BSD operating systems. The Phoronix Test Suite allows for carrying out tests in a fully automated manner from test installation to execution and reporting. All tests are meant to be easily reproducible, easy-to-use, and support fully automated execution. The Phoronix Test Suite is open-source under the GNU GPLv3 license and is developed by Phoronix Media in cooperation with partners. Version 1.0 of the Phoronix Test Suite was publicly released in 2008.


The Phoronix Test Suite client itself is a test framework for providing seamless execution of test profiles and test suites. There are more than 200 tests available by default, which are transparently available via OpenBenchmarking.org integration. Of these default test profiles there is a range of sub-systems that can be tested and a range of hardware from mobile devices to desktops and worksrtations/servers. New tests can be easily introduced via the Phoronix Test Suite's extensible test architecture, with test profiles consisting of XML files and shell scripts. Test profiles can produce a quantitative result or other qualitative/abstract results like image quality comparisons and pass/fail. Using Phoronix Test Suite modules, other data can also be automatically collected at run-time such as the system power consumption, disk usage, and other software/hardware sensors. Test suites contain references to test profiles to execute as part of a set or can also reference other test suites. Test suites are defined via an XML schema.


@@ -171,7 +171,7 @@

- The Phoronix Test Suite recursively determines tests/suites and allows a suite to call another suite.


Module Writing


- By writing a Phoronix Test Suite module, you can easily extend the functionality of the Phoronix Test Suite. Some examples are being able to email the results upon completion, controlling the system's screensaver, updating a text LCD panel with the current test status, etc.


-

Virtual Test Suites

Virtual test suites are not like a traditional test suite defined by the XML suite specification. Virtual test suites are dynamically generated in real-time by the Phoronix Test Suite client based upon the specified test critera. Virtual test suites can automatically consist of all test profiles that are compatible with a particular operating system or test profiles that meet other critera. When running a virtual suite, the OpenBenchmarking.org repository of the test profiles to use for generating the dynamic suite must be prefixed.

Virtual test suites can be installed and run just like a normal XML test suite and shares nearly all of the same capabilities. However, when running a virtual suite, the user will be prompted to input any user-configuration options for needed test profiles just as they would need to do if running the test individually. When running a virtual suite, the user also has the ability to select individual tests within the suite to run or to run all of the contained test profiles. Virtual test suites are also only supported for an OpenBenchmarking.org repository if there is no test profile or test suite of the same name in the repository. Below is a list of common virtual test suites for the main Phoronix Test Suite repository, but the dynamic list of available virtual test suites based upon the enabled repositories is available by running phoronix-test-suite list-available-virtual-suites.

All PTS Tests pts/all

This is a collection of all test profiles found within the specified OpenBenchmarking.org repository.

Installed Tests pts/installed

This is a collection of test profiles found within the specified OpenBenchmarking.org repository that are already installed on the system under test.

Linux Operating System Tests pts/linux

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Linux Operating System.

Solaris Operating System Tests pts/solaris

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Solaris Operating System.

BSD Operating System Tests pts/bsd

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the BSD Operating System.

MacOSX Operating System Tests pts/macosx

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the MacOSX Operating System.

Windows Operating System Tests pts/windows

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Windows Operating System.

Hurd Operating System Tests pts/hurd

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Hurd Operating System.

System Subsystem Tests pts/system

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the System sub-system.

Processor Subsystem Tests pts/processor

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Processor sub-system.

Graphics Subsystem Tests pts/graphics

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Graphics sub-system.

Other Subsystem Tests pts/other

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Other sub-system.

Utility Tests pts/utility

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Utility software test.

Simulator Tests pts/simulator

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Simulator software test.

Scientific Tests pts/scientific

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Scientific software test.

Benchmark Tests pts/benchmark

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Benchmark software test.

Application Tests pts/application

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Application software test.

Game Tests pts/game

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Game software test.

Smp Tests pts/smp

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.

Python Tests pts/python

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing python.

Mpi Tests pts/mpi

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing mpi.

Openmp Tests pts/openmp

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmp.

Vdpau Tests pts/vdpau

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing vdpau.

Video Tests pts/video

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing video.

Component Testing


+

Virtual Test Suites

Virtual test suites are not like a traditional test suite defined by the XML suite specification. Virtual test suites are dynamically generated in real-time by the Phoronix Test Suite client based upon the specified test critera. Virtual test suites can automatically consist of all test profiles that are compatible with a particular operating system or test profiles that meet other critera. When running a virtual suite, the OpenBenchmarking.org repository of the test profiles to use for generating the dynamic suite must be prefixed.

Virtual test suites can be installed and run just like a normal XML test suite and shares nearly all of the same capabilities. However, when running a virtual suite, the user will be prompted to input any user-configuration options for needed test profiles just as they would need to do if running the test individually. When running a virtual suite, the user also has the ability to select individual tests within the suite to run or to run all of the contained test profiles. Virtual test suites are also only supported for an OpenBenchmarking.org repository if there is no test profile or test suite of the same name in the repository. Below is a list of common virtual test suites for the main Phoronix Test Suite repository, but the dynamic list of available virtual test suites based upon the enabled repositories is available by running phoronix-test-suite list-available-virtual-suites.

All PTS Tests pts/all

This is a collection of all test profiles found within the specified OpenBenchmarking.org repository.

Installed Tests pts/installed

This is a collection of test profiles found within the specified OpenBenchmarking.org repository that are already installed on the system under test.

Linux Operating System Tests pts/linux

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Linux Operating System.

Solaris Operating System Tests pts/solaris

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Solaris Operating System.

BSD Operating System Tests pts/bsd

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the BSD Operating System.

MacOSX Operating System Tests pts/macosx

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the MacOSX Operating System.

Windows Operating System Tests pts/windows

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Windows Operating System.

Hurd Operating System Tests pts/hurd

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Hurd Operating System.

System Subsystem Tests pts/system

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the System sub-system.

Processor Subsystem Tests pts/processor

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Processor sub-system.

Graphics Subsystem Tests pts/graphics

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Graphics sub-system.

Other Subsystem Tests pts/other

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Other sub-system.

Utility Tests pts/utility

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Utility software test.

Simulator Tests pts/simulator

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Simulator software test.

Scientific Tests pts/scientific

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Scientific software test.

Benchmark Tests pts/benchmark

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Benchmark software test.

Application Tests pts/application

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Application software test.

Game Tests pts/game

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Game software test.

Smp Tests pts/smp

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.

Python Tests pts/python

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing python.

Mpi Tests pts/mpi

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing mpi.

Openmp Tests pts/openmp

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmp.

Vdpau Tests pts/vdpau

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing vdpau.

Video Tests pts/video

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing video.

All PTS Tests pts/all

This is a collection of all test profiles found within the specified OpenBenchmarking.org repository.

Installed Tests pts/installed

This is a collection of test profiles found within the specified OpenBenchmarking.org repository that are already installed on the system under test.

Linux Operating System Tests pts/linux

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Linux Operating System.

Solaris Operating System Tests pts/solaris

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Solaris Operating System.

BSD Operating System Tests pts/bsd

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the BSD Operating System.

MacOSX Operating System Tests pts/macosx

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the MacOSX Operating System.

Windows Operating System Tests pts/windows

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Windows Operating System.

Hurd Operating System Tests pts/hurd

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Hurd Operating System.

System Subsystem Tests pts/system

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the System sub-system.

Processor Subsystem Tests pts/processor

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Processor sub-system.

Graphics Subsystem Tests pts/graphics

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Graphics sub-system.

Other Subsystem Tests pts/other

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Other sub-system.

Utility Tests pts/utility

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Utility software test.

Simulator Tests pts/simulator

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Simulator software test.

Scientific Tests pts/scientific

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Scientific software test.

Benchmark Tests pts/benchmark

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Benchmark software test.

Application Tests pts/application

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Application software test.

Game Tests pts/game

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Game software test.

Smp Tests pts/smp

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.

Python Tests pts/python

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing python.

Mpi Tests pts/mpi

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing mpi.

Openmp Tests pts/openmp

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmp.

Vdpau Tests pts/vdpau

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing vdpau.

Video Tests pts/video

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing video.

Component Testing


Compiler Testing & Masking


A majority of the test profiles provided by OpenBenchmarking.org to the Phoronix Test Suite are source-based tests. Relying upon the upstream source-code for each program under test allows for the tests to be easily brought to new platforms and architectures, avoids any out-of-tree / non-default packaging differences by different distributions and operating systems, and to allow the Phoronix Test Suite user to easily test new compilers and/or compiler options. For the source-based tests, the Phoronix Test Suite relies upon a compiler (e.g. GCC, LLVM/Clang, Sun Studio, Open64, et al) being present on the system under test. The Phoronix Test Suite does respect CC/CXX environment variables and test profiles are expected to honor CFLAGS/CXXFLAGS and other compiler settings.


As of Phoronix Test Suite 3.8, a compiler masking method is utilized for logging compiler options and other settings with each test profile installation. Prior to installing an open-source test, the Phoronix Test Suite determines the intended compiler to be used based upon the pre-set environment variables or the pre-set compiler(s) within the PATH environment variable. The Phoronix Test Suite then masks the compiler to ensure that any options/flags submitted to the compiler are first passed through pts-core so that they can be logged for later use, then is linked to the original, intended compiler. Additionally, other compiler binary names of the same type are blacklisted to prevent their un-intended use (i.e. if a test profile has hard-coded gcc in its build script, but clang is set as the compiler via CC, a sym-link will automatically be created from gcc to the masked clang for the duration of its test installation).


@@ -199,7 +199,7 @@

Assuming you did not launch any commands from the terminal to alter the disk(s) or its contents or carry out any other changes; PTS Desktop Live will have not touched your data or the installed operating system(s). If you wish to archive any of your test results, upload the results to OpenBenchmarking.org. Alternatively, when going to the Test Results tab and selecting a test, the File menu presents options for exporting results to text, CSV, and PDF files. The contents of the ~/.phoronix-test-suite/test-results/ folder can also be backed up for preserving the test results.


If you wish to use the Phoronix Test Suite from the command-line, open a terminal and run phoronix-test-suite.


Development Credits


-

The Phoronix Test Suite is based upon the extensive testing and internal tools developed by Phoronix.com since 2004 along with support from leading tier-one computer hardware and software vendors. The principal architects of the Phoronix Test Suite are Michael Larabel and Matthew Tippett. The phoronix-test-suite, pts_Graph, bilde_renderer, Phodevi, tandem_Xml, and nye_Xml are some of the related open-source projects provided by Phoronix Media.


+

The Phoronix Test Suite is based upon the extensive testing and internal tools developed by Phoronix.com since 2004 along with support from leading tier-one computer hardware and software vendors. The principal architects of the Phoronix Test Suite are Michael Larabel and Matthew Tippett. The phoronix-test-suite, pts_Graph, Phoromatic, Phodevi, tandem_Xml, and nye_Xml are some of the related open-source projects provided by Phoronix Media.


Below is a list of individuals and organizations that have contributed upstream patches, test profiles, and/or made other contributions to the Phoronix Test Suite that Phoronix Media would like to thank.


  • Achim Gottinger

  • Achim Lange

    • diff --git a/documentation/stubs/55_virtual_suites.html b/documentation/stubs/55_virtual_suites.html
    index ba1173d..ae8016e 100644
    --- a/documentation/stubs/55_virtual_suites.html
    +++ b/documentation/stubs/55_virtual_suites.html
    @@ -1 +1 @@
    -Virtual Test Suites

    Virtual test suites are not like a traditional test suite defined by the XML suite specification. Virtual test suites are dynamically generated in real-time by the Phoronix Test Suite client based upon the specified test critera. Virtual test suites can automatically consist of all test profiles that are compatible with a particular operating system or test profiles that meet other critera. When running a virtual suite, the OpenBenchmarking.org repository of the test profiles to use for generating the dynamic suite must be prefixed.

    Virtual test suites can be installed and run just like a normal XML test suite and shares nearly all of the same capabilities. However, when running a virtual suite, the user will be prompted to input any user-configuration options for needed test profiles just as they would need to do if running the test individually. When running a virtual suite, the user also has the ability to select individual tests within the suite to run or to run all of the contained test profiles. Virtual test suites are also only supported for an OpenBenchmarking.org repository if there is no test profile or test suite of the same name in the repository. Below is a list of common virtual test suites for the main Phoronix Test Suite repository, but the dynamic list of available virtual test suites based upon the enabled repositories is available by running phoronix-test-suite list-available-virtual-suites.

    All PTS Tests pts/all

    This is a collection of all test profiles found within the specified OpenBenchmarking.org repository.

    Installed Tests pts/installed

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository that are already installed on the system under test.

    Linux Operating System Tests pts/linux

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Linux Operating System.

    Solaris Operating System Tests pts/solaris

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Solaris Operating System.

    BSD Operating System Tests pts/bsd

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the BSD Operating System.

    MacOSX Operating System Tests pts/macosx

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the MacOSX Operating System.

    Windows Operating System Tests pts/windows

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Windows Operating System.

    Hurd Operating System Tests pts/hurd

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Hurd Operating System.

    System Subsystem Tests pts/system

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the System sub-system.

    Processor Subsystem Tests pts/processor

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Processor sub-system.

    Graphics Subsystem Tests pts/graphics

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Graphics sub-system.

    Other Subsystem Tests pts/other

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Other sub-system.

    Utility Tests pts/utility

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Utility software test.

    Simulator Tests pts/simulator

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Simulator software test.

    Scientific Tests pts/scientific

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Scientific software test.

    Benchmark Tests pts/benchmark

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Benchmark software test.

    Application Tests pts/application

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Application software test.

    Game Tests pts/game

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Game software test.

    Smp Tests pts/smp

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.

    Python Tests pts/python

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing python.

    Mpi Tests pts/mpi

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing mpi.

    Openmp Tests pts/openmp

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmp.

    Vdpau Tests pts/vdpau

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing vdpau.

    Video Tests pts/video

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing video.


    +Virtual Test Suites

    Virtual test suites are not like a traditional test suite defined by the XML suite specification. Virtual test suites are dynamically generated in real-time by the Phoronix Test Suite client based upon the specified test critera. Virtual test suites can automatically consist of all test profiles that are compatible with a particular operating system or test profiles that meet other critera. When running a virtual suite, the OpenBenchmarking.org repository of the test profiles to use for generating the dynamic suite must be prefixed.

    Virtual test suites can be installed and run just like a normal XML test suite and shares nearly all of the same capabilities. However, when running a virtual suite, the user will be prompted to input any user-configuration options for needed test profiles just as they would need to do if running the test individually. When running a virtual suite, the user also has the ability to select individual tests within the suite to run or to run all of the contained test profiles. Virtual test suites are also only supported for an OpenBenchmarking.org repository if there is no test profile or test suite of the same name in the repository. Below is a list of common virtual test suites for the main Phoronix Test Suite repository, but the dynamic list of available virtual test suites based upon the enabled repositories is available by running phoronix-test-suite list-available-virtual-suites.

    All PTS Tests pts/all

    This is a collection of all test profiles found within the specified OpenBenchmarking.org repository.

    Installed Tests pts/installed

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository that are already installed on the system under test.

    Linux Operating System Tests pts/linux

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Linux Operating System.

    Solaris Operating System Tests pts/solaris

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Solaris Operating System.

    BSD Operating System Tests pts/bsd

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the BSD Operating System.

    MacOSX Operating System Tests pts/macosx

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the MacOSX Operating System.

    Windows Operating System Tests pts/windows

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Windows Operating System.

    Hurd Operating System Tests pts/hurd

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Hurd Operating System.

    System Subsystem Tests pts/system

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the System sub-system.

    Processor Subsystem Tests pts/processor

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Processor sub-system.

    Graphics Subsystem Tests pts/graphics

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Graphics sub-system.

    Other Subsystem Tests pts/other

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Other sub-system.

    Utility Tests pts/utility

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Utility software test.

    Simulator Tests pts/simulator

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Simulator software test.

    Scientific Tests pts/scientific

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Scientific software test.

    Benchmark Tests pts/benchmark

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Benchmark software test.

    Application Tests pts/application

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Application software test.

    Game Tests pts/game

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Game software test.

    Smp Tests pts/smp

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.

    Python Tests pts/python

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing python.

    Mpi Tests pts/mpi

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing mpi.

    Openmp Tests pts/openmp

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmp.

    Vdpau Tests pts/vdpau

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing vdpau.

    Video Tests pts/video

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing video.

    All PTS Tests pts/all

    This is a collection of all test profiles found within the specified OpenBenchmarking.org repository.

    Installed Tests pts/installed

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository that are already installed on the system under test.

    Linux Operating System Tests pts/linux

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Linux Operating System.

    Solaris Operating System Tests pts/solaris

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Solaris Operating System.

    BSD Operating System Tests pts/bsd

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the BSD Operating System.

    MacOSX Operating System Tests pts/macosx

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the MacOSX Operating System.

    Windows Operating System Tests pts/windows

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Windows Operating System.

    Hurd Operating System Tests pts/hurd

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Hurd Operating System.

    System Subsystem Tests pts/system

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the System sub-system.

    Processor Subsystem Tests pts/processor

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Processor sub-system.

    Graphics Subsystem Tests pts/graphics

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Graphics sub-system.

    Other Subsystem Tests pts/other

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Other sub-system.

    Utility Tests pts/utility

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Utility software test.

    Simulator Tests pts/simulator

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Simulator software test.

    Scientific Tests pts/scientific

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Scientific software test.

    Benchmark Tests pts/benchmark

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Benchmark software test.

    Application Tests pts/application

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Application software test.

    Game Tests pts/game

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Game software test.

    Smp Tests pts/smp

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.

    Python Tests pts/python

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing python.

    Mpi Tests pts/mpi

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing mpi.

    Openmp Tests pts/openmp

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmp.

    Vdpau Tests pts/vdpau

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing vdpau.

    Video Tests pts/video

    This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing video.


    diff --git a/pts-core/pts-core.php b/pts-core/pts-core.php
    index 0f4cc32..5ba0b94 100644
    --- a/pts-core/pts-core.php
    +++ b/pts-core/pts-core.php
    @@ -157,8 +157,8 @@ function pts_version_codenames()
    );
    }

    -pts_define('PTS_VERSION', '5.6.0m5');
    -pts_define('PTS_CORE_VERSION', 5550);
    +pts_define('PTS_VERSION', '5.6.0');
    +pts_define('PTS_CORE_VERSION', 5600);
    pts_define('PTS_CODENAME', 'DEDILOVO');
    pts_define('PTS_IS_CLIENT', (defined('PTS_MODE') && strstr(PTS_MODE, 'CLIENT') !== false));
    pts_define('PTS_IS_WEB_CLIENT', (defined('PTS_MODE') && PTS_MODE == 'WEB_CLIENT'));

    71ce513 Phoronix Test Suite 5.6.0
    CHANGE-LOG | 2 +-
    README.md | 2 +-
    documentation/TODO | 2 --
    documentation/man-pages/phoronix-test-suite.1 | 2 +-
    documentation/phoronix-test-suite.html | 6 +++---
    documentation/stubs/55_virtual_suites.html | 2 +-
    pts-core/pts-core.php | 4 ++--
    7 files changed, 9 insertions(+), 11 deletions(-)

    Upstream: phorogit.com

    • Share