====== Test Result ====== [[dido:99_annexes:annex-b-terms-and-definitions:start|Go up to Terms and Definitions]] ===== Discussion ===== A Test Result is a [[dido:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]] that records an outcome associated with a [[dido:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] or [[dido:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Step]]. A Test Result can record an outcome produced during [[dido:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]] or derived later through evaluation or arbitration. A Test Result can identify: * Its identity * Its name * Its description * Its result value * Its applicable [[dido:99_annexes:annex-b-terms-and-definitions:v:verdict|Verdict]] * Its start time * Its completion time * Its completion status * Its related Sequenced Test Object * Its related Sequence Step * Its applicable [[dido:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]] * Its applicable [[dido:99_annexes:annex-b-terms-and-definitions:t:test_item|Test Items]] * Its observed values * Its applicable [[dido:99_annexes:annex-b-terms-and-definitions:e:expected_result|Expected Results]] * Its evaluation criteria * Its error information * Its supporting [[dido:99_annexes:annex-b-terms-and-definitions:e:evidence|Evidence]] * Its applicable [[dido:99_annexes:annex-b-terms-and-definitions:g:governance_policy|Governance Policies]] * Its [[dido:99_annexes:annex-b-terms-and-definitions:p:provenance|Provenance]] * Its [[dido:99_annexes:annex-b-terms-and-definitions:t:traceability|Traceability]] A Test Result can represent an outcome for a: * [[dido:99_annexes:annex-b-terms-and-definitions:t:test_set|Test Set]] * [[dido:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Case]] * [[dido:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Step]] * [[dido:99_annexes:annex-b-terms-and-definitions:t:test_executable|Test Executable]] * Sequence Step ===== Definition ===== //[[dido:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]] that records an outcome associated with a [[dido:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] or [[dido:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Step]]// ===== Source ===== Adapted from: * [[https://www.omg.org/spec/TestIF/1.0/Beta3/PDF|OMG Test Information Interchange Format (TestIF), Version 1.0 Beta 3, Section 7.3.11, TestResult]] * [[dido:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]] * [[dido:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] * [[dido:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Step]] * [[dido:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]] * DIDO Reference Implementation Conceptual Model * DIDO-TE draft Requirements Register OMG TestIF defines TestResult as a TestObject that provides an outcome from executing a test and maintains a reference to the applicable SequencedTestObject and, when applicable, SequenceStep. OMG TestIF permits a tool or external arbiter to assign a result value or Verdict during or after execution. This definition preserves that capability. ===== Note ===== Every Test Result is a [[dido:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]]. A Test Result differs from a [[dido:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]]: * A Test Result records a particular outcome * A Test Run records the execution context and collects the applicable Test Results A Test Result differs from an [[dido:99_annexes:annex-b-terms-and-definitions:e:expected_result|Expected Result]]: * An Expected Result specifies an anticipated value, state, event, or condition * A Test Result records an observed or derived outcome A Test Result differs from a [[dido:99_annexes:annex-b-terms-and-definitions:v:verdict|Verdict]]: * A Test Result records the outcome and its supporting information * A Verdict classifies the Test Result according to defined criteria A Test Result can exist without a Verdict when: * Test Execution remains incomplete * The required Evidence remains unavailable * Evaluation has not occurred * Arbitration remains pending * The applicable criteria do not require a Verdict A Test Result can receive a Verdict during Test Execution or through later evaluation or arbitration. A Test Result for a higher-level Sequenced Test Object can derive from multiple lower-level Test Results. The applicable arbitration rules determine how lower-level Test Results contribute to the higher-level Test Result. A failed lower-level Test Result does not necessarily cause every related higher-level Test Result to fail. The applicable evaluation or arbitration criteria determine that outcome. A Test Result does not by itself constitute a [[dido:99_annexes:annex-b-terms-and-definitions:v:validation_decision|Validation Decision]]. A Validation Decision uses applicable Test Results, Verdicts, Evidence, and decision criteria to determine whether the evaluated subject satisfies its defined purpose. ===== Example ===== A [[dido:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Step]] requires a [[dido:99_annexes:annex-b-terms-and-definitions:n:node|Node]] to accept a valid transaction and return its transaction identifier. The Test Result records: * The related Test Step * The related Sequence Step * The submitted transaction * The observed response * The returned transaction identifier * The start time and completion time * The applicable Expected Result * The comparison between the observed and expected outcomes * The assigned Verdict * The supporting [[dido:99_annexes:annex-b-terms-and-definitions:e:evidence|Evidence]] The applicable [[dido:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]] contains the Test Result and preserves its relationship to the performed Test Step and Sequence Step. ---- © 2026 Dido Solutions, Inc. and Jackrabbit Consulting, Inc.