public:99_annexes:annex-b-terms-and-definitions:t:test_result

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision		 Previous revision
public:99_annexes:annex-b-terms-and-definitions:t:test_result [2026/09/12 17:42] – removed - external edit (Unknown date) 127.0.0.1public:99_annexes:annex-b-terms-and-definitions:t:test_result [2026/09/12 17:43] (current) – ↷ Links adapted because of a move operation nick_dido
Line 1: Line 1:
 +====== Test Result ======
  
 +[[public:99_annexes:annex-b-terms-and-definitions:start|Go up to Terms and Definitions]]
 +
 +===== Discussion =====
 +
 +A Test Result is a [[public:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]] that records an outcome associated with a [[public:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] or [[public:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Step]].
 +
 +A Test Result can record an outcome produced during [[public:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]] or derived later through evaluation or arbitration.
 +
 +A Test Result can identify:
 +
 +  * Its identity
 +  * Its name
 +  * Its description
 +  * Its result value
 +  * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:v:verdict|Verdict]]
 +  * Its start time
 +  * Its completion time
 +  * Its completion status
 +  * Its related Sequenced Test Object
 +  * Its related Sequence Step
 +  * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]]
 +  * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:t:test_item|Test Items]]
 +  * Its observed values
 +  * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:e:expected_result|Expected Results]]
 +  * Its evaluation criteria
 +  * Its error information
 +  * Its supporting [[public:99_annexes:annex-b-terms-and-definitions:e:evidence|Evidence]]
 +  * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:g:governance_policy|Governance Policies]]
 +  * Its [[public:99_annexes:annex-b-terms-and-definitions:p:provenance|Provenance]]
 +  * Its [[public:99_annexes:annex-b-terms-and-definitions:t:traceability|Traceability]]
 +
 +A Test Result can represent an outcome for a:
 +
 +  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_set|Test Set]]
 +  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Case]]
 +  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Step]]
 +  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_executable|Test Executable]]
 +  * Sequence Step
 +
 +===== Definition =====
 +
 +//[[public:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]] that records an outcome associated with a [[public:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] or [[public:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Step]]//
 +
 +===== Source =====
 +
 +Adapted from:
 +
 +  * [[https://www.omg.org/spec/TestIF/1.0/Beta3/PDF|OMG Test Information Interchange Format (TestIF), Version 1.0 Beta 3, Section 7.3.11, TestResult]]
 +  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]]
 +  * [[public:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]]
 +  * [[public:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Step]]
 +  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]]
 +  * DIDO Reference Implementation Conceptual Model
 +  * DIDO-TE draft Requirements Register
 +
 +OMG TestIF defines TestResult as a TestObject that provides an outcome from executing a test and maintains a reference to the applicable SequencedTestObject and, when applicable, SequenceStep.
 +
 +OMG TestIF permits a tool or external arbiter to assign a result value or Verdict during or after execution. This definition preserves that capability.
 +
 +===== Note =====
 +
 +Every Test Result is a [[public:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]].
 +
 +A Test Result differs from a [[public:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]]:
 +
 +  * A Test Result records a particular outcome
 +  * A Test Run records the execution context and collects the applicable Test Results
 +
 +A Test Result differs from an [[public:99_annexes:annex-b-terms-and-definitions:e:expected_result|Expected Result]]:
 +
 +  * An Expected Result specifies an anticipated value, state, event, or condition
 +  * A Test Result records an observed or derived outcome
 +
 +A Test Result differs from a [[public:99_annexes:annex-b-terms-and-definitions:v:verdict|Verdict]]:
 +
 +  * A Test Result records the outcome and its supporting information
 +  * A Verdict classifies the Test Result according to defined criteria
 +
 +A Test Result can exist without a Verdict when:
 +
 +  * Test Execution remains incomplete
 +  * The required Evidence remains unavailable
 +  * Evaluation has not occurred
 +  * Arbitration remains pending
 +  * The applicable criteria do not require a Verdict
 +
 +A Test Result can receive a Verdict during Test Execution or through later evaluation or arbitration.
 +
 +A Test Result for a higher-level Sequenced Test Object can derive from multiple lower-level Test Results. The applicable arbitration rules determine how lower-level Test Results contribute to the higher-level Test Result.
 +
 +A failed lower-level Test Result does not necessarily cause every related higher-level Test Result to fail. The applicable evaluation or arbitration criteria determine that outcome.
 +
 +A Test Result does not by itself constitute a [[public:99_annexes:annex-b-terms-and-definitions:v:validation_decision|Validation Decision]]. A Validation Decision uses applicable Test Results, Verdicts, Evidence, and decision criteria to determine whether the evaluated subject satisfies its defined purpose.
 +
 +===== Example =====
 +
 +A [[public:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Step]] requires a [[public:99_annexes:annex-b-terms-and-definitions:n:node|Node]] to accept a valid transaction and return its transaction identifier.
 +
 +The Test Result records:
 +
 +  * The related Test Step
 +  * The related Sequence Step
 +  * The submitted transaction
 +  * The observed response
 +  * The returned transaction identifier
 +  * The start time and completion time
 +  * The applicable Expected Result
 +  * The comparison between the observed and expected outcomes
 +  * The assigned Verdict
 +  * The supporting [[public:99_annexes:annex-b-terms-and-definitions:e:evidence|Evidence]]
 +
 +The applicable [[public:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]] contains the Test Result and preserves its relationship to the performed Test Step and Sequence Step.
 +
 +----
 +
 +<WRAP centeralign>
 +© 2026 Dido Solutions, Inc. and Jackrabbit Consulting, Inc.
 +</WRAP>