framework: Add support for feature readiness

Graphics / Mesa 3D Graphics Library / Piglit - Feceoru, Gabriel [intel.com] - 24 November 2015 18:21 UTC

This adds a new "summary feature" command to piglit which creates a HTML table with the feature x DUT status (useful for multiple features, multiple DUTs). Another use case is the feature status for subsequent test results (depending on the meaning of that test result - DUT or build) A feature readiness is defined by the piglit regexp which selects the tests relevant for that feature and the acceptance percentage threshold (pass rate).

It requires an input json file containing the list of features, in the following format (this is just an example): { "glsl" : { "include_tests" : "glsl", "exclude_tests" : "", "target_rate" : 90 }, "arb" : { "include_tests" : "arb_gpu", "exclude_tests" : "", "target_rate" : 10 }

}

v3: Changed json rate to int instead of string Applied other review comments

v2: Apply review comments (Dylan, Thomas) Fixed 2nd round of review comments

f16d011 framework: Add support for feature readiness.
framework/programs/summary.py | 37 +++++++++++++++
framework/summary/__init__.py | 2 +-
framework/summary/feature.py | 99 +++++++++++++++++++++++++++++++++++++++++
framework/summary/html_.py | 23 +++++++++-
piglit | 4 ++
templates/feature.mako | 73 ++++++++++++++++++++++++++++++
6 files changed, 236 insertions(+), 2 deletions(-)

Upstream: cgit.freedesktop.org

  • Share