public:99_annexes:annex-b-terms-and-definitions:t:test_run

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision		 Previous revision
public:99_annexes:annex-b-terms-and-definitions:t:test_run [2026/09/12 17:42] – removed - external edit (Unknown date) 127.0.0.1public:99_annexes:annex-b-terms-and-definitions:t:test_run [2026/09/12 17:43] (current) – ↷ Links adapted because of a move operation nick_dido
Line 1: Line 1:
 +====== Test Run ======
  
 +[[public:99_annexes:annex-b-terms-and-definitions:start|Go up to Terms and Definitions]]
 +
 +===== Discussion =====
 +
 +A Test Run is a [[public:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]] that identifies and records a particular occurrence of [[public:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]], its execution context, and its [[public:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Results]].
 +
 +A Test Run can identify:
 +
 +  * Its identity
 +  * Its name
 +  * Its description
 +  * Its status
 +  * Its start time
 +  * Its completion time
 +  * Its initiating actor
 +  * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequence]]
 +  * Its starting [[public:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]]
 +  * Its performed [[public:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Steps]]
 +  * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:t:test_item|Test Items]]
 +  * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:n:node_set|Node Sets]]
 +  * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:t:test_environment|Test Environment]]
 +  * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:t:test_argument_value|Test Argument Values]]
 +  * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:e:executable_artifact|Executable Artifacts]]
 +  * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:e:execution_facility|Execution Facilities]]
 +  * Its Test Results
 +  * Its supporting [[public:99_annexes:annex-b-terms-and-definitions:e:evidence|Evidence]]
 +  * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:g:governance_policy|Governance Policies]]
 +  * Its [[public:99_annexes:annex-b-terms-and-definitions:p:provenance|Provenance]]
 +  * Its [[public:99_annexes:annex-b-terms-and-definitions:t:traceability|Traceability]]
 +
 +A Test Run can record a completed, failed, interrupted, canceled, timed-out, or incomplete occurrence of Test Execution.
 +
 +===== Definition =====
 +
 +//[[public:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]] that identifies and records a particular occurrence of [[public:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]], its execution context, and its [[public:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Results]]//
 +
 +===== Source =====
 +
 +Adapted from:
 +
 +  * [[https://www.omg.org/spec/TestIF/1.0/Beta3/PDF|OMG Test Information Interchange Format (TestIF), Version 1.0 Beta 3, Section 7.3.12, TestRun]]
 +  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]]
 +  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]]
 +  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]]
 +  * DIDO Reference Implementation Conceptual Model
 +  * DIDO-TE draft Requirements Register
 +
 +OMG TestIF defines TestRun as a TestObject that contains contextual information about an executed test and the results of that run.
 +
 +This definition preserves the TestIF role and explicitly distinguishes the recorded Test Run from the Test Execution activity it records.
 +
 +===== Note =====
 +
 +Every Test Run is a [[public:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]].
 +
 +A Test Run differs from [[public:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]]:
 +
 +  * Test Execution is the activity of performing the applicable Sequenced Test Objects
 +  * A Test Run identifies and records a particular occurrence of that activity
 +
 +A Test Run differs from a [[public:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]]:
 +
 +  * A Test Run records the execution context and collects the applicable Test Results
 +  * A Test Result records an outcome associated with a performed Sequenced Test Object or Sequence Step
 +
 +A Test Run differs from a [[public:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequence]]:
 +
 +  * A Test Sequence defines the planned progression
 +  * A Test Run records the actual occurrence and progression
 +
 +A Test Run can exist without successful completion. The absence of a completion time or complete set of Test Results can indicate an incomplete Test Run.
 +
 +A repeated execution creates a separate Test Run, even when it uses the same:
 +
 +  * Test Sequence
 +  * Sequenced Test Objects
 +  * Test Items
 +  * Test Environment
 +  * Test Argument Values
 +  * Executable Artifacts
 +  * Execution Facilities
 +
 +A Test Run does not automatically constitute a [[public:99_annexes:annex-b-terms-and-definitions:b:baseline|Baseline]]. An applicable authority must select and govern the Test Run or its Test Results as a Baseline.
 +
 +A reproducible Test Run should identify the exact Versions, configurations, content digests, inputs, dependencies, and operating conditions used during Test Execution.
 +
 +===== Example =====
 +
 +Test Run ''TR-2026-0042'' records an occurrence of Test Execution that evaluates a selected [[public:99_annexes:annex-b-terms-and-definitions:n:node_set|Node Set]].
 +
 +The Test Run identifies:
 +
 +  * Test Sequence Version ''1.4''
 +  * The selected Test Items
 +  * The applicable Test Environment
 +  * The applicable Test Argument Values
 +  * The performed Sequence Steps
 +  * The Executable Artifact Versions and content digests
 +  * The Execution Facility Versions and configurations
 +  * The start time and completion time
 +  * The resulting Test Results
 +  * The supporting Evidence
 +
 +A later repetition creates a separate Test Run, even when it uses the same test definitions and produces the same Test Results.
 +
 +----
 +
 +<WRAP centeralign>
 +© 2026 Dido Solutions, Inc. and Jackrabbit Consulting, Inc.
 +</WRAP>