public:99_annexes:annex-b-terms-and-definitions:t:test_set

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision		 Previous revision
public:99_annexes:annex-b-terms-and-definitions:t:test_set [2026/09/12 17:42] – removed - external edit (Unknown date) 127.0.0.1public:99_annexes:annex-b-terms-and-definitions:t:test_set [2026/09/12 17:43] (current) – ↷ Links adapted because of a move operation nick_dido
Line 1: Line 1:
 +====== Test Set ======
  
 +[[public:99_annexes:annex-b-terms-and-definitions:start|Go up to Terms and Definitions]]
 +
 +===== Discussion =====
 +
 +A Test Set groups related [[public:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Objects]] for a defined [[public:99_annexes:annex-b-terms-and-definitions:t:test_purpose|Test Purpose]].
 +
 +As a [[public:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]], a Test Set can contain or reference a [[public:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequence]]. The Test Sequence establishes the order and progression of the [[public:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Steps]] associated with the Test Set.
 +
 +A Test Set can group:
 +
 +  * Other Test Sets
 +  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Cases]]
 +  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Steps]]
 +  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_executable|Test Executables]]
 +  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_item|Test Items]]
 +  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_environment|Test Environments]]
 +  * Other related Test Objects
 +
 +A Test Set can organize Test Objects according to:
 +
 +  * A capability
 +  * A requirement
 +  * A feature
 +  * A behavior
 +  * A scenario
 +  * A risk
 +  * A [[public:99_annexes:annex-b-terms-and-definitions:t:test_item|Test Item]]
 +  * A [[public:99_annexes:annex-b-terms-and-definitions:s:system_under_test|System Under Test]]
 +  * A [[public:99_annexes:annex-b-terms-and-definitions:t:test_environment|Test Environment]]
 +  * A test category
 +  * A test phase
 +  * A validation objective
 +  * An Implementation Profile
 +
 +A Test Set can identify:
 +
 +  * Its identity
 +  * Its name
 +  * Its Test Purpose
 +  * Its version
 +  * Its member Test Objects
 +  * Its Test Sequence
 +  * Its applicable Test Items
 +  * Its applicable Test Environments
 +  * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:g:governance_policy|Governance Policies]]
 +  * Its [[public:99_annexes:annex-b-terms-and-definitions:p:provenance|Provenance]]
 +  * Its [[public:99_annexes:annex-b-terms-and-definitions:t:traceability|Traceability]]
 +
 +A Test Set can be reused within multiple [[public:99_annexes:annex-b-terms-and-definitions:t:test_definition|Test Definitions]] when its identity, version, membership, Test Sequence, and applicable conditions remain controlled.
 +
 +===== Definition =====
 +
 +//[[public:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] that groups related [[public:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Objects]] for a defined [[public:99_annexes:annex-b-terms-and-definitions:t:test_purpose|Test Purpose]]//
 +
 +===== Source =====
 +
 +Adapted from:
 +
 +  * [[https://www.omg.org/spec/TestIF/1.0/Beta3/PDF|OMG Test Information Interchange Format (TestIF), Version 1.0 Beta 3, Section 7.3.15, TestSet]]
 +  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]]
 +  * [[public:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]]
 +  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Case]]
 +  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequence]]
 +  * DIDO Reference Implementation Conceptual Model
 +  * DIDO-TE draft Requirements Register
 +
 +OMG TestIF defines TestSet as a SequencedTestObject that can serve as a container for multiple Test Sets, Test Cases, and related Test Objects.
 +
 +The DIDO-TE definition preserves the TestIF grouping function while expressing the distinguishing characteristic without defining Test Set in terms of itself.
 +
 +===== Note =====
 +
 +Every Test Set is a [[public:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] and therefore a [[public:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]].
 +
 +A Test Set can contain or reference another Test Set. Each nested Test Set retains its own identity, version, Test Purpose, membership, Provenance, and Traceability.
 +
 +A Test Set differs from a [[public:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Case]]:
 +
 +  * A Test Set groups related Test Objects
 +  * A Test Case identifies the Test Steps and [[public:99_annexes:annex-b-terms-and-definitions:e:expected_result|Expected Results]] used to verify something
 +
 +A Test Set differs from a [[public:99_annexes:annex-b-terms-and-definitions:n:node_set|Node Set]]:
 +
 +  * A Test Set groups Test Objects
 +  * A Node Set groups [[public:99_annexes:annex-b-terms-and-definitions:n:node|Nodes]] for a defined purpose
 +
 +A Test Set differs from a [[public:99_annexes:annex-b-terms-and-definitions:t:test_plan|Test Plan]]:
 +
 +  * A Test Set groups Test Objects
 +  * A Test Plan identifies the objectives, scope, resources, responsibilities, schedule, and approach governing planned testing
 +
 +A Test Set differs from a [[public:99_annexes:annex-b-terms-and-definitions:t:test_definition|Test Definition]]:
 +
 +  * A Test Set provides an identified grouping of Test Objects
 +  * A Test Definition specifies the controlled information required to conduct and evaluate a [[public:99_annexes:annex-b-terms-and-definitions:t:test|Test]]
 +
 +A Test Set does not need to contain copies of its member Test Objects. It can reference independently identified and versioned Test Objects.
 +
 +A change to the membership, Test Purpose, Test Sequence, or applicable conditions of a Test Set can create a new Test Set version when the change affects [[public:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]], reproducibility, comparison, or validation.
 +
 +===== Example =====
 +
 +A [[public:99_annexes:annex-b-terms-and-definitions:d:dido-te|DIDO-TE]] interoperability Test Set groups:
 +
 +  * A [[public:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Case]] for transaction submission
 +  * A Test Case for transaction distribution
 +  * A Test Case for state-transition validation
 +  * A Test Case for state convergence
 +  * A Test Case for recovery after a [[public:99_annexes:annex-b-terms-and-definitions:n:node|Node]] interruption
 +
 +Each Test Case references the applicable:
 +
 +  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_item|Test Items]]
 +  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_environment|Test Environment]]
 +  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Steps]]
 +  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_executable|Test Executables]]
 +  * [[public:99_annexes:annex-b-terms-and-definitions:e:expected_result|Expected Results]]
 +
 +During Test Execution, the [[public:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]] records the [[public:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Results]] associated with the Test Cases and other executed Test Objects in the Test Set.
 +
 +----
 +
 +<WRAP centeralign>
 +© 2026 Dido Solutions, Inc. and Jackrabbit Consulting, Inc.
 +</WRAP>