| Both sides previous revision Previous revision | |
| public:99_annexes:annex-b-terms-and-definitions:t:test_item [2026/09/12 17:42] – ↷ Page moved from private:99_annexes:annex-b-terms-and-definitions:t:test_item to public:99_annexes:annex-b-terms-and-definitions:t:test_item nick_dido | public:99_annexes:annex-b-terms-and-definitions:t:test_item [2026/09/12 17:43] (current) – ↷ Links adapted because of a move operation nick_dido |
|---|
| ====== Test Item ====== | ====== Test Item ====== |
| |
| [[private:99_annexes:annex-b-terms-and-definitions:start|Go up to Terms and Definitions]] | [[public:99_annexes:annex-b-terms-and-definitions:start|Go up to Terms and Definitions]] |
| |
| ===== Discussion ===== | ===== Discussion ===== |
| |
| A Test Item is a [[private:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]] that identifies an entity within the scope of a [[private:99_annexes:annex-b-terms-and-definitions:t:test|Test]]. | A Test Item is a [[public:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]] that identifies an entity within the scope of a [[public:99_annexes:annex-b-terms-and-definitions:t:test|Test]]. |
| |
| A Test Item can identify: | A Test Item can identify: |
| |
| * The complete [[private:99_annexes:annex-b-terms-and-definitions:s:system_under_test|System Under Test]] | * The complete [[public:99_annexes:annex-b-terms-and-definitions:s:system_under_test|System Under Test]] |
| * A component of the System Under Test | * A component of the System Under Test |
| * A [[private:99_annexes:annex-b-terms-and-definitions:d:distributed_system|Distributed System]] | * A [[public:99_annexes:annex-b-terms-and-definitions:d:distributed_system|Distributed System]] |
| * A [[private:99_annexes:annex-b-terms-and-definitions:n:node|Node]] | * A [[public:99_annexes:annex-b-terms-and-definitions:n:node|Node]] |
| * A [[private:99_annexes:annex-b-terms-and-definitions:n:node_set|Node Set]] | * A [[public:99_annexes:annex-b-terms-and-definitions:n:node_set|Node Set]] |
| * A service | * A service |
| * An interface | * An interface |
| * A [[private:99_annexes:annex-b-terms-and-definitions:c:communication_endpoint|Communication Endpoint]] | * A [[public:99_annexes:annex-b-terms-and-definitions:c:communication_endpoint|Communication Endpoint]] |
| * A [[private:99_annexes:annex-b-terms-and-definitions:d:data_object|Data Object]] | * A [[public:99_annexes:annex-b-terms-and-definitions:d:data_object|Data Object]] |
| * An [[private:99_annexes:annex-b-terms-and-definitions:i:immutable_data_object|Immutable Data Object]] | * An [[public:99_annexes:annex-b-terms-and-definitions:i:immutable_data_object|Immutable Data Object]] |
| * A [[private:99_annexes:annex-b-terms-and-definitions:d:dido|Distributed Immutable Data Object (DIDO)]] | * A [[public:99_annexes:annex-b-terms-and-definitions:d:dido|Distributed Immutable Data Object (DIDO)]] |
| * A configuration | * A configuration |
| * A communication path | * A communication path |
| * Another entity relevant to the Test | * Another entity relevant to the Test |
| |
| A Test Item identifies what participates in or affects the Test. The applicable [[private:99_annexes:annex-b-terms-and-definitions:t:test_definition|Test Definition]] determines whether the Test Item constitutes the subject being evaluated, a supporting participant, a test instrument, or another relevant entity. | A Test Item identifies what participates in or affects the Test. The applicable [[public:99_annexes:annex-b-terms-and-definitions:t:test_definition|Test Definition]] determines whether the Test Item constitutes the subject being evaluated, a supporting participant, a test instrument, or another relevant entity. |
| |
| A Test Item can contain or reference other Test Items. This permits a Test Item to represent a composite entity such as a Distributed System, Node Set, application, subsystem, or multi-component service. | A Test Item can contain or reference other Test Items. This permits a Test Item to represent a composite entity such as a Distributed System, Node Set, application, subsystem, or multi-component service. |
| * Its relationship to the System Under Test | * Its relationship to the System Under Test |
| * Its applicable constraints | * Its applicable constraints |
| * Its applicable [[private:99_annexes:annex-b-terms-and-definitions:g:governance_policy|Governance Policies]] | * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:g:governance_policy|Governance Policies]] |
| * Its [[private:99_annexes:annex-b-terms-and-definitions:p:provenance|Provenance]] | * Its [[public:99_annexes:annex-b-terms-and-definitions:p:provenance|Provenance]] |
| * Its [[private:99_annexes:annex-b-terms-and-definitions:t:traceability|Traceability]] | * Its [[public:99_annexes:annex-b-terms-and-definitions:t:traceability|Traceability]] |
| |
| A Test Item can participate in a [[private:99_annexes:annex-b-terms-and-definitions:t:test_environment|Test Environment]] associated with a [[private:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]]. | A Test Item can participate in a [[public:99_annexes:annex-b-terms-and-definitions:t:test_environment|Test Environment]] associated with a [[public:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]]. |
| |
| The Sequenced Test Object can identify the Test Items relevant to a: | The Sequenced Test Object can identify the Test Items relevant to a: |
| |
| * [[private:99_annexes:annex-b-terms-and-definitions:t:test_set|Test Set]] | * [[public:99_annexes:annex-b-terms-and-definitions:t:test_set|Test Set]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Case]] | * [[public:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Case]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Step]] | * [[public:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Step]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:t:test_executable|Test Executable]] | * [[public:99_annexes:annex-b-terms-and-definitions:t:test_executable|Test Executable]] |
| |
| A [[private:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]] records the execution context associated with the Test Items used during [[private:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]]. | A [[public:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]] records the execution context associated with the Test Items used during [[public:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]]. |
| |
| A [[private:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]] can reference the Test Item whose behavior, state, value, or outcome contributed to the recorded result. | A [[public:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]] can reference the Test Item whose behavior, state, value, or outcome contributed to the recorded result. |
| |
| ===== Definition ===== | ===== Definition ===== |
| |
| //[[private:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]] that identifies an entity within the scope of a [[private:99_annexes:annex-b-terms-and-definitions:t:test|Test]]// | //[[public:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]] that identifies an entity within the scope of a [[public:99_annexes:annex-b-terms-and-definitions:t:test|Test]]// |
| |
| ===== Source ===== | ===== Source ===== |
| |
| * [[https://www.omg.org/spec/TestIF/1.0/Beta3/PDF|OMG Test Information Interchange Format (TestIF), Version 1.0 Beta 3, Section 7.3.8, TestItem]] | * [[https://www.omg.org/spec/TestIF/1.0/Beta3/PDF|OMG Test Information Interchange Format (TestIF), Version 1.0 Beta 3, Section 7.3.8, TestItem]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]] | * [[public:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:t:test_environment|Test Environment]] | * [[public:99_annexes:annex-b-terms-and-definitions:t:test_environment|Test Environment]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:d:dido-te|Distributed Immutable Data Object Test Environment (DIDO-TE)]] | * [[public:99_annexes:annex-b-terms-and-definitions:d:dido-te|Distributed Immutable Data Object Test Environment (DIDO-TE)]] |
| * DIDO Reference Implementation Conceptual Model | * DIDO Reference Implementation Conceptual Model |
| * DIDO-TE draft Requirements Register | * DIDO-TE draft Requirements Register |
| ===== Note ===== | ===== Note ===== |
| |
| A Test Item is not necessarily the [[private:99_annexes:annex-b-terms-and-definitions:s:system_under_test|System Under Test]]. | A Test Item is not necessarily the [[public:99_annexes:annex-b-terms-and-definitions:s:system_under_test|System Under Test]]. |
| |
| The System Under Test is the Test Item, or collection of Test Items, whose behavior, properties, state, or outcomes the [[private:99_annexes:annex-b-terms-and-definitions:t:test|Test]] evaluates. | The System Under Test is the Test Item, or collection of Test Items, whose behavior, properties, state, or outcomes the [[public:99_annexes:annex-b-terms-and-definitions:t:test|Test]] evaluates. |
| |
| Supporting Test Items can include: | Supporting Test Items can include: |
| * Evidence-collection components | * Evidence-collection components |
| |
| A Test Item differs from a [[private:99_annexes:annex-b-terms-and-definitions:t:test_environment|Test Environment]]: | A Test Item differs from a [[public:99_annexes:annex-b-terms-and-definitions:t:test_environment|Test Environment]]: |
| |
| * A Test Item identifies an entity within the scope of the Test | * A Test Item identifies an entity within the scope of the Test |
| * A Test Environment identifies the configured combination of Test Items, resources, conditions, and controls within which the Test is executed | * A Test Environment identifies the configured combination of Test Items, resources, conditions, and controls within which the Test is executed |
| |
| A Test Item differs from a [[private:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]]: | A Test Item differs from a [[public:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]]: |
| |
| * A Test Item identifies an entity within the scope of the Test | * A Test Item identifies an entity within the scope of the Test |
| * A Sequenced Test Object identifies test information that can participate in a [[private:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequence]] | * A Sequenced Test Object identifies test information that can participate in a [[public:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequence]] |
| |
| A Test Item differs from a [[private:99_annexes:annex-b-terms-and-definitions:t:test_set|Test Set]]: | A Test Item differs from a [[public:99_annexes:annex-b-terms-and-definitions:t:test_set|Test Set]]: |
| |
| * A Test Item identifies an entity within the scope of the Test | * A Test Item identifies an entity within the scope of the Test |
| * A Test Set groups Test Sets, Test Cases, and related Test Objects for a defined testing purpose | * A Test Set groups Test Sets, Test Cases, and related Test Objects for a defined testing purpose |
| |
| A Test Item differs from a [[private:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Case]]: | A Test Item differs from a [[public:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Case]]: |
| |
| * A Test Item identifies an entity within the scope of the Test | * A Test Item identifies an entity within the scope of the Test |
| * A Test Case identifies the steps and [[private:99_annexes:annex-b-terms-and-definitions:e:expected_result|Expected Results]] used to verify something | * A Test Case identifies the steps and [[public:99_annexes:annex-b-terms-and-definitions:e:expected_result|Expected Results]] used to verify something |
| |
| A Test Item differs from a [[private:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Step]]: | A Test Item differs from a [[public:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Step]]: |
| |
| * A Test Item identifies an entity within the scope of the Test | * A Test Item identifies an entity within the scope of the Test |
| * A Test Step identifies an action or validation performed as part of a Test Sequence | * A Test Step identifies an action or validation performed as part of a Test Sequence |
| |
| A Test Item differs from a [[private:99_annexes:annex-b-terms-and-definitions:t:test_executable|Test Executable]]: | A Test Item differs from a [[public:99_annexes:annex-b-terms-and-definitions:t:test_executable|Test Executable]]: |
| |
| * A Test Item identifies an entity within the scope of the Test | * A Test Item identifies an entity within the scope of the Test |
| * A Test Executable identifies low-level procedural or executable information used for automated Test Execution | * A Test Executable identifies low-level procedural or executable information used for automated Test Execution |
| |
| A Test Item differs from a [[private:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]]: | A Test Item differs from a [[public:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]]: |
| |
| * A Test Item identifies an entity participating in or relevant to the Test | * A Test Item identifies an entity participating in or relevant to the Test |
| * A Test Result records an outcome produced during Test Execution | * A Test Result records an outcome produced during Test Execution |
| |
| A Test Item differs from a [[private:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]]: | A Test Item differs from a [[public:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]]: |
| |
| * A Test Item identifies an entity participating in or relevant to the Test | * A Test Item identifies an entity participating in or relevant to the Test |
| ===== Example ===== | ===== Example ===== |
| |
| A [[private:99_annexes:annex-b-terms-and-definitions:d:dido-te|DIDO-TE]] Test evaluates a changed DIDO Node within a five-Node Distributed System. | A [[public:99_annexes:annex-b-terms-and-definitions:d:dido-te|DIDO-TE]] Test evaluates a changed DIDO Node within a five-Node Distributed System. |
| |
| The Test Items include: | The Test Items include: |
| |
| * The changed [[private:99_annexes:annex-b-terms-and-definitions:n:node|Node]] as part of the System Under Test | * The changed [[public:99_annexes:annex-b-terms-and-definitions:n:node|Node]] as part of the System Under Test |
| * Four validated reference Nodes as other parts of the System Under Test | * Four validated reference Nodes as other parts of the System Under Test |
| * The [[private:99_annexes:annex-b-terms-and-definitions:d:dido|DIDO]] whose state transitions the Test evaluates | * The [[public:99_annexes:annex-b-terms-and-definitions:d:dido|DIDO]] whose state transitions the Test evaluates |
| * A transaction generator as a supporting Test Item | * A transaction generator as a supporting Test Item |
| * A network-condition controller as a supporting Test Item | * A network-condition controller as a supporting Test Item |
| * An [[private:99_annexes:annex-b-terms-and-definitions:e:evidence|Evidence]] collector as a supporting Test Item | * An [[public:99_annexes:annex-b-terms-and-definitions:e:evidence|Evidence]] collector as a supporting Test Item |
| |
| The [[private:99_annexes:annex-b-terms-and-definitions:t:test_definition|Test Definition]] identifies each Test Item and its role. | The [[public:99_annexes:annex-b-terms-and-definitions:t:test_definition|Test Definition]] identifies each Test Item and its role. |
| |
| The applicable [[private:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Case]], [[private:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequence]], [[private:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Steps]], and [[private:99_annexes:annex-b-terms-and-definitions:e:expected_result|Expected Results]] specify how DIDO-TE evaluates the Test Items. | The applicable [[public:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Case]], [[public:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequence]], [[public:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Steps]], and [[public:99_annexes:annex-b-terms-and-definitions:e:expected_result|Expected Results]] specify how DIDO-TE evaluates the Test Items. |
| |
| The resulting [[private:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]] and [[private:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Results]] preserve the Test Item identities, versions, configurations, and roles applicable to the execution. | The resulting [[public:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]] and [[public:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Results]] preserve the Test Item identities, versions, configurations, and roles applicable to the execution. |
| |
| ---- | ---- |