public:99_annexes:annex-b-terms-and-definitions:v:verdict

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
public:99_annexes:annex-b-terms-and-definitions:v:verdict [2026/09/12 17:42] – ↷ Page moved from private:99_annexes:annex-b-terms-and-definitions:v:verdict to public:99_annexes:annex-b-terms-and-definitions:v:verdict nick_didopublic:99_annexes:annex-b-terms-and-definitions:v:verdict [2026/09/12 17:43] (current) – ↷ Links adapted because of a move operation nick_dido
Line 1: Line 1:
 ====== Verdict ====== ====== Verdict ======
  
-[[private:99_annexes:annex-b-terms-and-definitions:start|Go up to Terms and Definitions]]+[[public:99_annexes:annex-b-terms-and-definitions:start|Go up to Terms and Definitions]]
  
 ===== Discussion ===== ===== Discussion =====
  
-A Verdict is a classification assigned to a [[private:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]] according to defined evaluation criteria.+A Verdict is a classification assigned to a [[public:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]] according to defined evaluation criteria.
  
-A Verdict communicates the evaluated status of a Test Result independently of the detailed values, observations, measurements, and [[private:99_annexes:annex-b-terms-and-definitions:e:evidence|Evidence]] recorded by that Test Result.+A Verdict communicates the evaluated status of a Test Result independently of the detailed values, observations, measurements, and [[public:99_annexes:annex-b-terms-and-definitions:e:evidence|Evidence]] recorded by that Test Result.
  
 A Verdict set can include values such as: A Verdict set can include values such as:
Line 18: Line 18:
   * NOT APPLICABLE   * NOT APPLICABLE
  
-The applicable [[private:99_annexes:annex-b-terms-and-definitions:a:acceptance_criteria|Acceptance Criteria]], evaluation criteria, or [[private:99_annexes:annex-b-terms-and-definitions:g:governance_policy|Governance Policy]] defines:+The applicable [[public:99_annexes:annex-b-terms-and-definitions:a:acceptance_criteria|Acceptance Criteria]], evaluation criteria, or [[public:99_annexes:annex-b-terms-and-definitions:g:governance_policy|Governance Policy]] defines:
  
   * The permitted Verdict values   * The permitted Verdict values
Line 27: Line 27:
   * The arbitration of multiple Test Results   * The arbitration of multiple Test Results
   * The precedence of conflicting Verdicts   * The precedence of conflicting Verdicts
-  * The use of Verdicts in a [[private:99_annexes:annex-b-terms-and-definitions:v:validation_decision|Validation Decision]]+  * The use of Verdicts in a [[public:99_annexes:annex-b-terms-and-definitions:v:validation_decision|Validation Decision]]
  
 A Verdict can apply to a Test Result associated with a: A Verdict can apply to a Test Result associated with a:
  
-  * [[private:99_annexes:annex-b-terms-and-definitions:t:test_set|Test Set]] +  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_set|Test Set]] 
-  * [[private:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Case]] +  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Case]] 
-  * [[private:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Step]] +  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Step]] 
-  * [[private:99_annexes:annex-b-terms-and-definitions:t:test_executable|Test Executable]] +  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_executable|Test Executable]] 
-  * [[private:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Step]]+  * [[public:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Step]]
  
 ===== Definition ===== ===== Definition =====
  
-//classification assigned to a [[private:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]] according to defined evaluation criteria//+//classification assigned to a [[public:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]] according to defined evaluation criteria//
  
 ===== Source ===== ===== Source =====
Line 46: Line 46:
  
   * [[https://www.omg.org/spec/TestIF/1.0/Beta3/PDF|OMG Test Information Interchange Format (TestIF), Version 1.0 Beta 3, Sections 7.3.11 and 7.3.18, Verdict]]   * [[https://www.omg.org/spec/TestIF/1.0/Beta3/PDF|OMG Test Information Interchange Format (TestIF), Version 1.0 Beta 3, Sections 7.3.11 and 7.3.18, Verdict]]
-  * [[private:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]] +  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]] 
-  * [[private:99_annexes:annex-b-terms-and-definitions:e:expected_result|Expected Result]] +  * [[public:99_annexes:annex-b-terms-and-definitions:e:expected_result|Expected Result]] 
-  * [[private:99_annexes:annex-b-terms-and-definitions:a:acceptance_criteria|Acceptance Criteria]]+  * [[public:99_annexes:annex-b-terms-and-definitions:a:acceptance_criteria|Acceptance Criteria]]
   * DIDO Reference Implementation Conceptual Model   * DIDO Reference Implementation Conceptual Model
   * DIDO-TE draft Requirements Register   * DIDO-TE draft Requirements Register
Line 64: Line 64:
 </code> </code>
  
-A Verdict differs from a [[private:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]]:+A Verdict differs from a [[public:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]]:
  
   * A Test Result records an outcome and its supporting information   * A Test Result records an outcome and its supporting information
   * A Verdict classifies that outcome according to defined criteria   * A Verdict classifies that outcome according to defined criteria
  
-A Verdict differs from an [[private:99_annexes:annex-b-terms-and-definitions:e:expected_result|Expected Result]]:+A Verdict differs from an [[public:99_annexes:annex-b-terms-and-definitions:e:expected_result|Expected Result]]:
  
   * An Expected Result specifies an anticipated value, state, event, or condition   * An Expected Result specifies an anticipated value, state, event, or condition
   * A Verdict classifies the relationship between the applicable outcome and the evaluation criteria   * A Verdict classifies the relationship between the applicable outcome and the evaluation criteria
  
-A Verdict differs from a [[private:99_annexes:annex-b-terms-and-definitions:v:validation_decision|Validation Decision]]:+A Verdict differs from a [[public:99_annexes:annex-b-terms-and-definitions:v:validation_decision|Validation Decision]]:
  
   * A Verdict classifies an individual or aggregated Test Result   * A Verdict classifies an individual or aggregated Test Result
Line 81: Line 81:
 A PASS Verdict for one Test Result does not establish that: A PASS Verdict for one Test Result does not establish that:
  
-  * The entire [[private:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]] passed+  * The entire [[public:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]] passed
   * Every related Test Case passed   * Every related Test Case passed
   * Every applicable requirement was satisfied   * Every applicable requirement was satisfied
Line 92: Line 92:
 A FAIL Verdict indicates failure to satisfy the criteria applicable to the classified Test Result. It does not necessarily identify the cause of the failure. A FAIL Verdict indicates failure to satisfy the criteria applicable to the classified Test Result. It does not necessarily identify the cause of the failure.
  
-An ERROR Verdict ordinarily indicates that an execution, infrastructure, configuration, or evaluation problem prevented the expected evaluation. An ERROR Verdict does not necessarily indicate that the [[private:99_annexes:annex-b-terms-and-definitions:t:test_item|Test Item]] failed the tested condition.+An ERROR Verdict ordinarily indicates that an execution, infrastructure, configuration, or evaluation problem prevented the expected evaluation. An ERROR Verdict does not necessarily indicate that the [[public:99_annexes:annex-b-terms-and-definitions:t:test_item|Test Item]] failed the tested condition.
  
 An INCONCLUSIVE Verdict ordinarily indicates that the available Test Result and Evidence do not support a PASS or FAIL determination. An INCONCLUSIVE Verdict ordinarily indicates that the available Test Result and Evidence do not support a PASS or FAIL determination.
Line 98: Line 98:
 A Verdict can be assigned: A Verdict can be assigned:
  
-  * During [[private:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]]+  * During [[public:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]]
   * After Test Execution   * After Test Execution
   * By an automated mechanism   * By an automated mechanism
Line 105: Line 105:
   * By another mechanism established by the applicable Governance Policy   * By another mechanism established by the applicable Governance Policy
  
-A change to a Verdict should preserve the previous Verdict, the reason for the change, the responsible authority, the supporting Evidence, the applicable criteria, [[private:99_annexes:annex-b-terms-and-definitions:p:provenance|Provenance]], and [[private:99_annexes:annex-b-terms-and-definitions:t:traceability|Traceability]].+A change to a Verdict should preserve the previous Verdict, the reason for the change, the responsible authority, the supporting Evidence, the applicable criteria, [[public:99_annexes:annex-b-terms-and-definitions:p:provenance|Provenance]], and [[public:99_annexes:annex-b-terms-and-definitions:t:traceability|Traceability]].
  
 ===== Example ===== ===== Example =====
  
-A [[private:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Step]] requires a selected [[private:99_annexes:annex-b-terms-and-definitions:n:node|Node]] to return a defined state within five seconds.+A [[public:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Step]] requires a selected [[public:99_annexes:annex-b-terms-and-definitions:n:node|Node]] to return a defined state within five seconds.
  
-The resulting [[private:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]] records:+The resulting [[public:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]] records:
  
   * The returned state   * The returned state
   * The measured response time   * The measured response time
-  * The applicable [[private:99_annexes:annex-b-terms-and-definitions:e:expected_result|Expected Result]]+  * The applicable [[public:99_annexes:annex-b-terms-and-definitions:e:expected_result|Expected Result]]
   * The applicable Acceptance Criteria   * The applicable Acceptance Criteria
   * The supporting Evidence   * The supporting Evidence
Line 126: Line 126:
   * INCONCLUSIVE when the available Evidence cannot establish the returned state or response time   * INCONCLUSIVE when the available Evidence cannot establish the returned state or response time
  
-The Verdict classifies the Test Result. A separate [[private:99_annexes:annex-b-terms-and-definitions:v:validation_decision|Validation Decision]] determines whether the evaluated Node Set satisfies the broader validation purpose.+The Verdict classifies the Test Result. A separate [[public:99_annexes:annex-b-terms-and-definitions:v:validation_decision|Validation Decision]] determines whether the evaluated Node Set satisfies the broader validation purpose.
  
 ---- ----
  • public/99_annexes/annex-b-terms-and-definitions/v/verdict.1789260175.txt.gz
  • Last modified: 2026/09/12 17:42
  • by nick_dido