| Both sides previous revision Previous revision | |
| public:99_annexes:annex-b-terms-and-definitions:t:test_run [2026/09/12 17:42] – ↷ Page moved from private:99_annexes:annex-b-terms-and-definitions:t:test_run to public:99_annexes:annex-b-terms-and-definitions:t:test_run nick_dido | public:99_annexes:annex-b-terms-and-definitions:t:test_run [2026/09/12 17:43] (current) – ↷ Links adapted because of a move operation nick_dido |
|---|
| ====== Test Run ====== | ====== Test Run ====== |
| |
| [[private:99_annexes:annex-b-terms-and-definitions:start|Go up to Terms and Definitions]] | [[public:99_annexes:annex-b-terms-and-definitions:start|Go up to Terms and Definitions]] |
| |
| ===== Discussion ===== | ===== Discussion ===== |
| |
| A Test Run is a [[private:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]] that identifies and records a particular occurrence of [[private:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]], its execution context, and its [[private:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Results]]. | A Test Run is a [[public:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]] that identifies and records a particular occurrence of [[public:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]], its execution context, and its [[public:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Results]]. |
| |
| A Test Run can identify: | A Test Run can identify: |
| * Its completion time | * Its completion time |
| * Its initiating actor | * Its initiating actor |
| * Its applicable [[private:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequence]] | * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequence]] |
| * Its starting [[private:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] | * Its starting [[public:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] |
| * Its performed [[private:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Steps]] | * Its performed [[public:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Steps]] |
| * Its applicable [[private:99_annexes:annex-b-terms-and-definitions:t:test_item|Test Items]] | * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:t:test_item|Test Items]] |
| * Its applicable [[private:99_annexes:annex-b-terms-and-definitions:n:node_set|Node Sets]] | * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:n:node_set|Node Sets]] |
| * Its applicable [[private:99_annexes:annex-b-terms-and-definitions:t:test_environment|Test Environment]] | * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:t:test_environment|Test Environment]] |
| * Its applicable [[private:99_annexes:annex-b-terms-and-definitions:t:test_argument_value|Test Argument Values]] | * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:t:test_argument_value|Test Argument Values]] |
| * Its applicable [[private:99_annexes:annex-b-terms-and-definitions:e:executable_artifact|Executable Artifacts]] | * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:e:executable_artifact|Executable Artifacts]] |
| * Its applicable [[private:99_annexes:annex-b-terms-and-definitions:e:execution_facility|Execution Facilities]] | * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:e:execution_facility|Execution Facilities]] |
| * Its Test Results | * Its Test Results |
| * Its supporting [[private:99_annexes:annex-b-terms-and-definitions:e:evidence|Evidence]] | * Its supporting [[public:99_annexes:annex-b-terms-and-definitions:e:evidence|Evidence]] |
| * Its applicable [[private:99_annexes:annex-b-terms-and-definitions:g:governance_policy|Governance Policies]] | * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:g:governance_policy|Governance Policies]] |
| * Its [[private:99_annexes:annex-b-terms-and-definitions:p:provenance|Provenance]] | * Its [[public:99_annexes:annex-b-terms-and-definitions:p:provenance|Provenance]] |
| * Its [[private:99_annexes:annex-b-terms-and-definitions:t:traceability|Traceability]] | * Its [[public:99_annexes:annex-b-terms-and-definitions:t:traceability|Traceability]] |
| |
| A Test Run can record a completed, failed, interrupted, canceled, timed-out, or incomplete occurrence of Test Execution. | A Test Run can record a completed, failed, interrupted, canceled, timed-out, or incomplete occurrence of Test Execution. |
| ===== Definition ===== | ===== Definition ===== |
| |
| //[[private:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]] that identifies and records a particular occurrence of [[private:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]], its execution context, and its [[private:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Results]]// | //[[public:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]] that identifies and records a particular occurrence of [[public:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]], its execution context, and its [[public:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Results]]// |
| |
| ===== Source ===== | ===== Source ===== |
| |
| * [[https://www.omg.org/spec/TestIF/1.0/Beta3/PDF|OMG Test Information Interchange Format (TestIF), Version 1.0 Beta 3, Section 7.3.12, TestRun]] | * [[https://www.omg.org/spec/TestIF/1.0/Beta3/PDF|OMG Test Information Interchange Format (TestIF), Version 1.0 Beta 3, Section 7.3.12, TestRun]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]] | * [[public:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]] | * [[public:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]] | * [[public:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]] |
| * DIDO Reference Implementation Conceptual Model | * DIDO Reference Implementation Conceptual Model |
| * DIDO-TE draft Requirements Register | * DIDO-TE draft Requirements Register |
| ===== Note ===== | ===== Note ===== |
| |
| Every Test Run is a [[private:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]]. | Every Test Run is a [[public:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]]. |
| |
| A Test Run differs from [[private:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]]: | A Test Run differs from [[public:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]]: |
| |
| * Test Execution is the activity of performing the applicable Sequenced Test Objects | * Test Execution is the activity of performing the applicable Sequenced Test Objects |
| * A Test Run identifies and records a particular occurrence of that activity | * A Test Run identifies and records a particular occurrence of that activity |
| |
| A Test Run differs from a [[private:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]]: | A Test Run differs from a [[public:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]]: |
| |
| * A Test Run records the execution context and collects the applicable Test Results | * A Test Run records the execution context and collects the applicable Test Results |
| * A Test Result records an outcome associated with a performed Sequenced Test Object or Sequence Step | * A Test Result records an outcome associated with a performed Sequenced Test Object or Sequence Step |
| |
| A Test Run differs from a [[private:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequence]]: | A Test Run differs from a [[public:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequence]]: |
| |
| * A Test Sequence defines the planned progression | * A Test Sequence defines the planned progression |
| * Execution Facilities | * Execution Facilities |
| |
| A Test Run does not automatically constitute a [[private:99_annexes:annex-b-terms-and-definitions:b:baseline|Baseline]]. An applicable authority must select and govern the Test Run or its Test Results as a Baseline. | A Test Run does not automatically constitute a [[public:99_annexes:annex-b-terms-and-definitions:b:baseline|Baseline]]. An applicable authority must select and govern the Test Run or its Test Results as a Baseline. |
| |
| A reproducible Test Run should identify the exact Versions, configurations, content digests, inputs, dependencies, and operating conditions used during Test Execution. | A reproducible Test Run should identify the exact Versions, configurations, content digests, inputs, dependencies, and operating conditions used during Test Execution. |
| ===== Example ===== | ===== Example ===== |
| |
| Test Run ''TR-2026-0042'' records an occurrence of Test Execution that evaluates a selected [[private:99_annexes:annex-b-terms-and-definitions:n:node_set|Node Set]]. | Test Run ''TR-2026-0042'' records an occurrence of Test Execution that evaluates a selected [[public:99_annexes:annex-b-terms-and-definitions:n:node_set|Node Set]]. |
| |
| The Test Run identifies: | The Test Run identifies: |