| Both sides previous revision Previous revision | |
| public:99_annexes:annex-b-terms-and-definitions:t:test_set [2026/09/12 17:42] – ↷ Page moved from private:99_annexes:annex-b-terms-and-definitions:t:test_set to public:99_annexes:annex-b-terms-and-definitions:t:test_set nick_dido | public:99_annexes:annex-b-terms-and-definitions:t:test_set [2026/09/12 17:43] (current) – ↷ Links adapted because of a move operation nick_dido |
|---|
| ====== Test Set ====== | ====== Test Set ====== |
| |
| [[private:99_annexes:annex-b-terms-and-definitions:start|Go up to Terms and Definitions]] | [[public:99_annexes:annex-b-terms-and-definitions:start|Go up to Terms and Definitions]] |
| |
| ===== Discussion ===== | ===== Discussion ===== |
| |
| A Test Set groups related [[private:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Objects]] for a defined [[private:99_annexes:annex-b-terms-and-definitions:t:test_purpose|Test Purpose]]. | A Test Set groups related [[public:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Objects]] for a defined [[public:99_annexes:annex-b-terms-and-definitions:t:test_purpose|Test Purpose]]. |
| |
| As a [[private:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]], a Test Set can contain or reference a [[private:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequence]]. The Test Sequence establishes the order and progression of the [[private:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Steps]] associated with the Test Set. | As a [[public:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]], a Test Set can contain or reference a [[public:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequence]]. The Test Sequence establishes the order and progression of the [[public:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Steps]] associated with the Test Set. |
| |
| A Test Set can group: | A Test Set can group: |
| |
| * Other Test Sets | * Other Test Sets |
| * [[private:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Cases]] | * [[public:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Cases]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Steps]] | * [[public:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Steps]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:t:test_executable|Test Executables]] | * [[public:99_annexes:annex-b-terms-and-definitions:t:test_executable|Test Executables]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:t:test_item|Test Items]] | * [[public:99_annexes:annex-b-terms-and-definitions:t:test_item|Test Items]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:t:test_environment|Test Environments]] | * [[public:99_annexes:annex-b-terms-and-definitions:t:test_environment|Test Environments]] |
| * Other related Test Objects | * Other related Test Objects |
| |
| * A scenario | * A scenario |
| * A risk | * A risk |
| * A [[private:99_annexes:annex-b-terms-and-definitions:t:test_item|Test Item]] | * A [[public:99_annexes:annex-b-terms-and-definitions:t:test_item|Test Item]] |
| * A [[private:99_annexes:annex-b-terms-and-definitions:s:system_under_test|System Under Test]] | * A [[public:99_annexes:annex-b-terms-and-definitions:s:system_under_test|System Under Test]] |
| * A [[private:99_annexes:annex-b-terms-and-definitions:t:test_environment|Test Environment]] | * A [[public:99_annexes:annex-b-terms-and-definitions:t:test_environment|Test Environment]] |
| * A test category | * A test category |
| * A test phase | * A test phase |
| * Its applicable Test Items | * Its applicable Test Items |
| * Its applicable Test Environments | * Its applicable Test Environments |
| * Its applicable [[private:99_annexes:annex-b-terms-and-definitions:g:governance_policy|Governance Policies]] | * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:g:governance_policy|Governance Policies]] |
| * Its [[private:99_annexes:annex-b-terms-and-definitions:p:provenance|Provenance]] | * Its [[public:99_annexes:annex-b-terms-and-definitions:p:provenance|Provenance]] |
| * Its [[private:99_annexes:annex-b-terms-and-definitions:t:traceability|Traceability]] | * Its [[public:99_annexes:annex-b-terms-and-definitions:t:traceability|Traceability]] |
| |
| A Test Set can be reused within multiple [[private:99_annexes:annex-b-terms-and-definitions:t:test_definition|Test Definitions]] when its identity, version, membership, Test Sequence, and applicable conditions remain controlled. | A Test Set can be reused within multiple [[public:99_annexes:annex-b-terms-and-definitions:t:test_definition|Test Definitions]] when its identity, version, membership, Test Sequence, and applicable conditions remain controlled. |
| |
| ===== Definition ===== | ===== Definition ===== |
| |
| //[[private:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] that groups related [[private:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Objects]] for a defined [[private:99_annexes:annex-b-terms-and-definitions:t:test_purpose|Test Purpose]]// | //[[public:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] that groups related [[public:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Objects]] for a defined [[public:99_annexes:annex-b-terms-and-definitions:t:test_purpose|Test Purpose]]// |
| |
| ===== Source ===== | ===== Source ===== |
| |
| * [[https://www.omg.org/spec/TestIF/1.0/Beta3/PDF|OMG Test Information Interchange Format (TestIF), Version 1.0 Beta 3, Section 7.3.15, TestSet]] | * [[https://www.omg.org/spec/TestIF/1.0/Beta3/PDF|OMG Test Information Interchange Format (TestIF), Version 1.0 Beta 3, Section 7.3.15, TestSet]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]] | * [[public:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] | * [[public:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Case]] | * [[public:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Case]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequence]] | * [[public:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequence]] |
| * DIDO Reference Implementation Conceptual Model | * DIDO Reference Implementation Conceptual Model |
| * DIDO-TE draft Requirements Register | * DIDO-TE draft Requirements Register |
| ===== Note ===== | ===== Note ===== |
| |
| Every Test Set is a [[private:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] and therefore a [[private:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]]. | Every Test Set is a [[public:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] and therefore a [[public:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]]. |
| |
| A Test Set can contain or reference another Test Set. Each nested Test Set retains its own identity, version, Test Purpose, membership, Provenance, and Traceability. | A Test Set can contain or reference another Test Set. Each nested Test Set retains its own identity, version, Test Purpose, membership, Provenance, and Traceability. |
| |
| A Test Set differs from a [[private:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Case]]: | A Test Set differs from a [[public:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Case]]: |
| |
| * A Test Set groups related Test Objects | * A Test Set groups related Test Objects |
| * A Test Case identifies the Test Steps and [[private:99_annexes:annex-b-terms-and-definitions:e:expected_result|Expected Results]] used to verify something | * A Test Case identifies the Test Steps and [[public:99_annexes:annex-b-terms-and-definitions:e:expected_result|Expected Results]] used to verify something |
| |
| A Test Set differs from a [[private:99_annexes:annex-b-terms-and-definitions:n:node_set|Node Set]]: | A Test Set differs from a [[public:99_annexes:annex-b-terms-and-definitions:n:node_set|Node Set]]: |
| |
| * A Test Set groups Test Objects | * A Test Set groups Test Objects |
| * A Node Set groups [[private:99_annexes:annex-b-terms-and-definitions:n:node|Nodes]] for a defined purpose | * A Node Set groups [[public:99_annexes:annex-b-terms-and-definitions:n:node|Nodes]] for a defined purpose |
| |
| A Test Set differs from a [[private:99_annexes:annex-b-terms-and-definitions:t:test_plan|Test Plan]]: | A Test Set differs from a [[public:99_annexes:annex-b-terms-and-definitions:t:test_plan|Test Plan]]: |
| |
| * A Test Set groups Test Objects | * A Test Set groups Test Objects |
| * A Test Plan identifies the objectives, scope, resources, responsibilities, schedule, and approach governing planned testing | * A Test Plan identifies the objectives, scope, resources, responsibilities, schedule, and approach governing planned testing |
| |
| A Test Set differs from a [[private:99_annexes:annex-b-terms-and-definitions:t:test_definition|Test Definition]]: | A Test Set differs from a [[public:99_annexes:annex-b-terms-and-definitions:t:test_definition|Test Definition]]: |
| |
| * A Test Set provides an identified grouping of Test Objects | * A Test Set provides an identified grouping of Test Objects |
| * A Test Definition specifies the controlled information required to conduct and evaluate a [[private:99_annexes:annex-b-terms-and-definitions:t:test|Test]] | * A Test Definition specifies the controlled information required to conduct and evaluate a [[public:99_annexes:annex-b-terms-and-definitions:t:test|Test]] |
| |
| A Test Set does not need to contain copies of its member Test Objects. It can reference independently identified and versioned Test Objects. | A Test Set does not need to contain copies of its member Test Objects. It can reference independently identified and versioned Test Objects. |
| |
| A change to the membership, Test Purpose, Test Sequence, or applicable conditions of a Test Set can create a new Test Set version when the change affects [[private:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]], reproducibility, comparison, or validation. | A change to the membership, Test Purpose, Test Sequence, or applicable conditions of a Test Set can create a new Test Set version when the change affects [[public:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]], reproducibility, comparison, or validation. |
| |
| ===== Example ===== | ===== Example ===== |
| |
| A [[private:99_annexes:annex-b-terms-and-definitions:d:dido-te|DIDO-TE]] interoperability Test Set groups: | A [[public:99_annexes:annex-b-terms-and-definitions:d:dido-te|DIDO-TE]] interoperability Test Set groups: |
| |
| * A [[private:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Case]] for transaction submission | * A [[public:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Case]] for transaction submission |
| * A Test Case for transaction distribution | * A Test Case for transaction distribution |
| * A Test Case for state-transition validation | * A Test Case for state-transition validation |
| * A Test Case for state convergence | * A Test Case for state convergence |
| * A Test Case for recovery after a [[private:99_annexes:annex-b-terms-and-definitions:n:node|Node]] interruption | * A Test Case for recovery after a [[public:99_annexes:annex-b-terms-and-definitions:n:node|Node]] interruption |
| |
| Each Test Case references the applicable: | Each Test Case references the applicable: |
| |
| * [[private:99_annexes:annex-b-terms-and-definitions:t:test_item|Test Items]] | * [[public:99_annexes:annex-b-terms-and-definitions:t:test_item|Test Items]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:t:test_environment|Test Environment]] | * [[public:99_annexes:annex-b-terms-and-definitions:t:test_environment|Test Environment]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Steps]] | * [[public:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Steps]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:t:test_executable|Test Executables]] | * [[public:99_annexes:annex-b-terms-and-definitions:t:test_executable|Test Executables]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:e:expected_result|Expected Results]] | * [[public:99_annexes:annex-b-terms-and-definitions:e:expected_result|Expected Results]] |
| |
| During Test Execution, the [[private:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]] records the [[private:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Results]] associated with the Test Cases and other executed Test Objects in the Test Set. | During Test Execution, the [[public:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]] records the [[public:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Results]] associated with the Test Cases and other executed Test Objects in the Test Set. |
| |
| ---- | ---- |