How to Verify PTL Results

The results of your PTL test can be saved if you specify where the output goes, using the -o option to pbs_benchpress.

Here is how to interpret the results:

pass

The test case passed with no failures. This test case did not find a bug in the product, and the test case ran without error.

fail

The test case failed with failure(s). Either the test case found a bug in the product (likely if the test case is stable), or there was a bug in the test case.

error

The test case errored with error(s). There was syntax error in a test case or in other PTL tests, or the test case found a bug in the product (unlikely), or there was a bug in the test case. Usually PTL reports errors when there is a syntax error, or steps are missing from the test case itself.

skip

The test case skipped because a required condition was not met. Required conditions can be anything such as a test case requiring two MoMs but the user specified only one MoM via '-p' when running pbs_benchpress.

timeout

The test case didn't complete in the specified time. We have a default timeout of 300 seconds. You can increase it by putting '@timeout(<timeout in seconds>)' above the test case name in the test file. See the section on Decorators in PTL Features for Testing PBS.

OSS Site Map

Developer Guide Pages