Test Result [Dido Solutions, Inc Wiki]

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
====== Test Result ======

[[dido:99_annexes:annex-b-terms-and-definitions:start|Go up to Terms and Definitions]]

===== Discussion =====

A Test Result is a [[dido:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]] that records an outcome associated with a [[dido:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] or [[dido:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Step]].

A Test Result can record an outcome produced during [[dido:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]] or derived later through evaluation or arbitration.

A Test Result can identify:

  * Its identity
  * Its name
  * Its description
  * Its result value
  * Its applicable [[dido:99_annexes:annex-b-terms-and-definitions:v:verdict|Verdict]]
  * Its start time
  * Its completion time
  * Its completion status
  * Its related Sequenced Test Object
  * Its related Sequence Step
  * Its applicable [[dido:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]]
  * Its applicable [[dido:99_annexes:annex-b-terms-and-definitions:t:test_item|Test Items]]
  * Its observed values
  * Its applicable [[dido:99_annexes:annex-b-terms-and-definitions:e:expected_result|Expected Results]]
  * Its evaluation criteria
  * Its error information
  * Its supporting [[dido:99_annexes:annex-b-terms-and-definitions:e:evidence|Evidence]]
  * Its applicable [[dido:99_annexes:annex-b-terms-and-definitions:g:governance_policy|Governance Policies]]
  * Its [[dido:99_annexes:annex-b-terms-and-definitions:p:provenance|Provenance]]
  * Its [[dido:99_annexes:annex-b-terms-and-definitions:t:traceability|Traceability]]

A Test Result can represent an outcome for a:

  * [[dido:99_annexes:annex-b-terms-and-definitions:t:test_set|Test Set]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Case]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Step]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:t:test_executable|Test Executable]]
  * Sequence Step

===== Definition =====

//[[dido:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]] that records an outcome associated with a [[dido:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] or [[dido:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Step]]//

===== Source =====

Adapted from:

  * [[https://www.omg.org/spec/TestIF/1.0/Beta3/PDF|OMG Test Information Interchange Format (TestIF), Version 1.0 Beta 3, Section 7.3.11, TestResult]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Step]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]]
  * DIDO Reference Implementation Conceptual Model
  * DIDO-TE draft Requirements Register

OMG TestIF defines TestResult as a TestObject that provides an outcome from executing a test and maintains a reference to the applicable SequencedTestObject and, when applicable, SequenceStep.

OMG TestIF permits a tool or external arbiter to assign a result value or Verdict during or after execution. This definition preserves that capability.

===== Note =====

Every Test Result is a [[dido:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]].

A Test Result differs from a [[dido:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]]:

  * A Test Result records a particular outcome
  * A Test Run records the execution context and collects the applicable Test Results

A Test Result differs from an [[dido:99_annexes:annex-b-terms-and-definitions:e:expected_result|Expected Result]]:

  * An Expected Result specifies an anticipated value, state, event, or condition
  * A Test Result records an observed or derived outcome

A Test Result differs from a [[dido:99_annexes:annex-b-terms-and-definitions:v:verdict|Verdict]]:

  * A Test Result records the outcome and its supporting information
  * A Verdict classifies the Test Result according to defined criteria

A Test Result can exist without a Verdict when:

  * Test Execution remains incomplete
  * The required Evidence remains unavailable
  * Evaluation has not occurred
  * Arbitration remains pending
  * The applicable criteria do not require a Verdict

A Test Result can receive a Verdict during Test Execution or through later evaluation or arbitration.

A Test Result for a higher-level Sequenced Test Object can derive from multiple lower-level Test Results. The applicable arbitration rules determine how lower-level Test Results contribute to the higher-level Test Result.

A failed lower-level Test Result does not necessarily cause every related higher-level Test Result to fail. The applicable evaluation or arbitration criteria determine that outcome.

A Test Result does not by itself constitute a [[dido:99_annexes:annex-b-terms-and-definitions:v:validation_decision|Validation Decision]]. A Validation Decision uses applicable Test Results, Verdicts, Evidence, and decision criteria to determine whether the evaluated subject satisfies its defined purpose.

===== Example =====

A [[dido:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Step]] requires a [[dido:99_annexes:annex-b-terms-and-definitions:n:node|Node]] to accept a valid transaction and return its transaction identifier.

The Test Result records:

  * The related Test Step
  * The related Sequence Step
  * The submitted transaction
  * The observed response
  * The returned transaction identifier
  * The start time and completion time
  * The applicable Expected Result
  * The comparison between the observed and expected outcomes
  * The assigned Verdict
  * The supporting [[dido:99_annexes:annex-b-terms-and-definitions:e:evidence|Evidence]]

The applicable [[dido:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]] contains the Test Result and preserves its relationship to the performed Test Step and Sequence Step.

----

<WRAP centeralign>
© 2026 Dido Solutions, Inc. and Jackrabbit Consulting, Inc.
</WRAP>