public:99_annexes:annex-b-terms-and-definitions:v:verdict

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision		 Previous revision
public:99_annexes:annex-b-terms-and-definitions:v:verdict [2026/09/12 17:42] – removed - external edit (Unknown date) 127.0.0.1public:99_annexes:annex-b-terms-and-definitions:v:verdict [2026/09/12 17:43] (current) – ↷ Links adapted because of a move operation nick_dido
Line 1: Line 1:
 +====== Verdict ======
  
 +[[public:99_annexes:annex-b-terms-and-definitions:start|Go up to Terms and Definitions]]
 +
 +===== Discussion =====
 +
 +A Verdict is a classification assigned to a [[public:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]] according to defined evaluation criteria.
 +
 +A Verdict communicates the evaluated status of a Test Result independently of the detailed values, observations, measurements, and [[public:99_annexes:annex-b-terms-and-definitions:e:evidence|Evidence]] recorded by that Test Result.
 +
 +A Verdict set can include values such as:
 +
 +  * PASS
 +  * FAIL
 +  * INCONCLUSIVE
 +  * ERROR
 +  * NOT EXECUTED
 +  * NOT APPLICABLE
 +
 +The applicable [[public:99_annexes:annex-b-terms-and-definitions:a:acceptance_criteria|Acceptance Criteria]], evaluation criteria, or [[public:99_annexes:annex-b-terms-and-definitions:g:governance_policy|Governance Policy]] defines:
 +
 +  * The permitted Verdict values
 +  * The meaning of each Verdict value
 +  * The conditions for assigning each Verdict value
 +  * The authority permitted to assign or revise a Verdict
 +  * The treatment of missing or incomplete results
 +  * The arbitration of multiple Test Results
 +  * The precedence of conflicting Verdicts
 +  * The use of Verdicts in a [[public:99_annexes:annex-b-terms-and-definitions:v:validation_decision|Validation Decision]]
 +
 +A Verdict can apply to a Test Result associated with a:
 +
 +  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_set|Test Set]]
 +  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Case]]
 +  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Step]]
 +  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_executable|Test Executable]]
 +  * [[public:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Step]]
 +
 +===== Definition =====
 +
 +//classification assigned to a [[public:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]] according to defined evaluation criteria//
 +
 +===== Source =====
 +
 +Adapted from:
 +
 +  * [[https://www.omg.org/spec/TestIF/1.0/Beta3/PDF|OMG Test Information Interchange Format (TestIF), Version 1.0 Beta 3, Sections 7.3.11 and 7.3.18, Verdict]]
 +  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]]
 +  * [[public:99_annexes:annex-b-terms-and-definitions:e:expected_result|Expected Result]]
 +  * [[public:99_annexes:annex-b-terms-and-definitions:a:acceptance_criteria|Acceptance Criteria]]
 +  * DIDO Reference Implementation Conceptual Model
 +  * DIDO-TE draft Requirements Register
 +
 +OMG TestIF defines Verdict as an enumeration of result Verdicts that can be assigned to a TestResult.
 +
 +OMG TestIF supports the storage and interchange of Verdicts but leaves Test Result arbitration rules outside the scope of the specification. This definition therefore requires the applicable Acceptance Criteria, evaluation criteria, or Governance Policy to establish the meaning and assignment rules for each permitted Verdict.
 +
 +===== Note =====
 +
 +Use the singular glossary term Verdict. Link plural usage to the same controlling page:
 +
 +<code dokuwiki>
 +[[dido:99_annexes:annex-b-terms-and-definitions:v:verdict|Verdicts]]
 +</code>
 +
 +A Verdict differs from a [[public:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]]:
 +
 +  * A Test Result records an outcome and its supporting information
 +  * A Verdict classifies that outcome according to defined criteria
 +
 +A Verdict differs from an [[public:99_annexes:annex-b-terms-and-definitions:e:expected_result|Expected Result]]:
 +
 +  * An Expected Result specifies an anticipated value, state, event, or condition
 +  * A Verdict classifies the relationship between the applicable outcome and the evaluation criteria
 +
 +A Verdict differs from a [[public:99_annexes:annex-b-terms-and-definitions:v:validation_decision|Validation Decision]]:
 +
 +  * A Verdict classifies an individual or aggregated Test Result
 +  * A Validation Decision determines whether the evaluated subject satisfies the applicable validation purpose or decision criteria
 +
 +A PASS Verdict for one Test Result does not establish that:
 +
 +  * The entire [[public:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]] passed
 +  * Every related Test Case passed
 +  * Every applicable requirement was satisfied
 +  * The evaluated subject is valid
 +  * The evaluated subject is accepted
 +  * The evaluated subject is authorized for use
 +
 +Those conclusions require the applicable aggregation, arbitration, acceptance, validation, or authorization criteria.
 +
 +A FAIL Verdict indicates failure to satisfy the criteria applicable to the classified Test Result. It does not necessarily identify the cause of the failure.
 +
 +An ERROR Verdict ordinarily indicates that an execution, infrastructure, configuration, or evaluation problem prevented the expected evaluation. An ERROR Verdict does not necessarily indicate that the [[public:99_annexes:annex-b-terms-and-definitions:t:test_item|Test Item]] failed the tested condition.
 +
 +An INCONCLUSIVE Verdict ordinarily indicates that the available Test Result and Evidence do not support a PASS or FAIL determination.
 +
 +A Verdict can be assigned:
 +
 +  * During [[public:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]]
 +  * After Test Execution
 +  * By an automated mechanism
 +  * By an authorized evaluator
 +  * By an arbitration process
 +  * By another mechanism established by the applicable Governance Policy
 +
 +A change to a Verdict should preserve the previous Verdict, the reason for the change, the responsible authority, the supporting Evidence, the applicable criteria, [[public:99_annexes:annex-b-terms-and-definitions:p:provenance|Provenance]], and [[public:99_annexes:annex-b-terms-and-definitions:t:traceability|Traceability]].
 +
 +===== Example =====
 +
 +A [[public:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Step]] requires a selected [[public:99_annexes:annex-b-terms-and-definitions:n:node|Node]] to return a defined state within five seconds.
 +
 +The resulting [[public:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]] records:
 +
 +  * The returned state
 +  * The measured response time
 +  * The applicable [[public:99_annexes:annex-b-terms-and-definitions:e:expected_result|Expected Result]]
 +  * The applicable Acceptance Criteria
 +  * The supporting Evidence
 +
 +The evaluator assigns:
 +
 +  * PASS when the Node returns the required state within five seconds
 +  * FAIL when the Node returns an incorrect state or exceeds five seconds
 +  * ERROR when the Test Environment cannot submit the request
 +  * INCONCLUSIVE when the available Evidence cannot establish the returned state or response time
 +
 +The Verdict classifies the Test Result. A separate [[public:99_annexes:annex-b-terms-and-definitions:v:validation_decision|Validation Decision]] determines whether the evaluated Node Set satisfies the broader validation purpose.
 +
 +----
 +
 +<WRAP centeralign>
 +© 2026 Dido Solutions, Inc. and Jackrabbit Consulting, Inc.
 +</WRAP>