| Both sides previous revision Previous revision | |
| public:99_annexes:annex-b-terms-and-definitions:t:test_step [2026/09/12 17:42] – ↷ Page moved from private:99_annexes:annex-b-terms-and-definitions:t:test_step to public:99_annexes:annex-b-terms-and-definitions:t:test_step nick_dido | public:99_annexes:annex-b-terms-and-definitions:t:test_step [2026/09/12 17:43] (current) – ↷ Links adapted because of a move operation nick_dido |
|---|
| ====== Test Step ====== | ====== Test Step ====== |
| |
| [[private:99_annexes:annex-b-terms-and-definitions:start|Go up to Terms and Definitions]] | [[public:99_annexes:annex-b-terms-and-definitions:start|Go up to Terms and Definitions]] |
| |
| ===== Discussion ===== | ===== Discussion ===== |
| |
| A Test Step specifies one action or validation performed as part of a [[private:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequence]]. | A Test Step specifies one action or validation performed as part of a [[public:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequence]]. |
| |
| As a [[private:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]], a Test Step can contain or reference a Test Sequence that decomposes the Test Step into subordinate Test Steps or [[private:99_annexes:annex-b-terms-and-definitions:t:test_executable|Test Executables]]. | As a [[public:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]], a Test Step can contain or reference a Test Sequence that decomposes the Test Step into subordinate Test Steps or [[public:99_annexes:annex-b-terms-and-definitions:t:test_executable|Test Executables]]. |
| |
| A Test Step can specify an action that: | A Test Step can specify an action that: |
| |
| * Creates a [[private:99_annexes:annex-b-terms-and-definitions:d:data_object|Data Object]] | * Creates a [[public:99_annexes:annex-b-terms-and-definitions:d:data_object|Data Object]] |
| * Submits a transaction | * Submits a transaction |
| * Sends or receives a message | * Sends or receives a message |
| * Changes a state | * Changes a state |
| * Advances or modifies time | * Advances or modifies time |
| * Starts or stops a [[private:99_annexes:annex-b-terms-and-definitions:n:node|Node]] | * Starts or stops a [[public:99_annexes:annex-b-terms-and-definitions:n:node|Node]] |
| * Introduces a fault | * Introduces a fault |
| * Retrieves information | * Retrieves information |
| * Captures [[private:99_annexes:annex-b-terms-and-definitions:e:evidence|Evidence]] | * Captures [[public:99_annexes:annex-b-terms-and-definitions:e:evidence|Evidence]] |
| |
| A Test Step can specify a validation that: | A Test Step can specify a validation that: |
| * Observes a state transition | * Observes a state transition |
| * Evaluates a condition | * Evaluates a condition |
| * Compares an observed value with an [[private:99_annexes:annex-b-terms-and-definitions:e:expected_result|Expected Result]] | * Compares an observed value with an [[public:99_annexes:annex-b-terms-and-definitions:e:expected_result|Expected Result]] |
| * Confirms an event | * Confirms an event |
| * Confirms the absence of an event | * Confirms the absence of an event |
| * Confirms satisfaction of an evaluation criterion | * Confirms satisfaction of an evaluation criterion |
| * Produces a [[private:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]] | * Produces a [[public:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]] |
| |
| A Test Step can identify: | A Test Step can identify: |
| * Its version | * Its version |
| * Its action or validation | * Its action or validation |
| * Its applicable [[private:99_annexes:annex-b-terms-and-definitions:t:test_item|Test Items]] | * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:t:test_item|Test Items]] |
| * Its applicable [[private:99_annexes:annex-b-terms-and-definitions:t:test_environment|Test Environments]] | * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:t:test_environment|Test Environments]] |
| * Its Test Arguments | * Its Test Arguments |
| * Its Test Argument Values | * Its Test Argument Values |
| * Its failure condition | * Its failure condition |
| * Its timeout | * Its timeout |
| * Its applicable [[private:99_annexes:annex-b-terms-and-definitions:g:governance_policy|Governance Policies]] | * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:g:governance_policy|Governance Policies]] |
| * Its [[private:99_annexes:annex-b-terms-and-definitions:p:provenance|Provenance]] | * Its [[public:99_annexes:annex-b-terms-and-definitions:p:provenance|Provenance]] |
| * Its [[private:99_annexes:annex-b-terms-and-definitions:t:traceability|Traceability]] | * Its [[public:99_annexes:annex-b-terms-and-definitions:t:traceability|Traceability]] |
| |
| A [[private:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Step]] identifies the occurrence of a Test Step at a particular position in a Test Sequence. The same Test Step can participate in multiple Test Sequences or occur more than once within the same Test Sequence. | A [[public:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Step]] identifies the occurrence of a Test Step at a particular position in a Test Sequence. The same Test Step can participate in multiple Test Sequences or occur more than once within the same Test Sequence. |
| |
| ===== Definition ===== | ===== Definition ===== |
| |
| //[[private:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] that specifies one action or validation performed as part of a [[private:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequence]]// | //[[public:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] that specifies one action or validation performed as part of a [[public:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequence]]// |
| |
| ===== Source ===== | ===== Source ===== |
| |
| * [[https://www.omg.org/spec/TestIF/1.0/Beta3/PDF|OMG Test Information Interchange Format (TestIF), Version 1.0 Beta 3, Section 7.3.16, TestStep]] | * [[https://www.omg.org/spec/TestIF/1.0/Beta3/PDF|OMG Test Information Interchange Format (TestIF), Version 1.0 Beta 3, Section 7.3.16, TestStep]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]] | * [[public:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] | * [[public:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Case]] | * [[public:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Case]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequence]] | * [[public:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequence]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Step]] | * [[public:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Step]] |
| * DIDO Reference Implementation Conceptual Model | * DIDO Reference Implementation Conceptual Model |
| * DIDO-TE draft Requirements Register | * DIDO-TE draft Requirements Register |
| ===== Note ===== | ===== Note ===== |
| |
| Every Test Step is a [[private:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] and therefore a [[private:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]]. | Every Test Step is a [[public:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] and therefore a [[public:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]]. |
| |
| A Test Step differs from a [[private:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Step]]: | A Test Step differs from a [[public:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Step]]: |
| |
| * A Test Step specifies a reusable action or validation | * A Test Step specifies a reusable action or validation |
| * A Sequence Step identifies an occurrence of a Sequenced Test Object at a position within a Test Sequence | * A Sequence Step identifies an occurrence of a Sequenced Test Object at a position within a Test Sequence |
| |
| A Test Step differs from a [[private:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Case]]: | A Test Step differs from a [[public:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Case]]: |
| |
| * A Test Step specifies one action or validation | * A Test Step specifies one action or validation |
| * A Test Case specifies the Test Steps and Expected Results used to verify a defined subject | * A Test Case specifies the Test Steps and Expected Results used to verify a defined subject |
| |
| A Test Step differs from a [[private:99_annexes:annex-b-terms-and-definitions:t:test_executable|Test Executable]]: | A Test Step differs from a [[public:99_annexes:annex-b-terms-and-definitions:t:test_executable|Test Executable]]: |
| |
| * A Test Step specifies an action or validation independently of a particular execution mechanism | * A Test Step specifies an action or validation independently of a particular execution mechanism |
| * A Test Executable contains or references low-level procedural or executable information used to automate an action or validation | * A Test Executable contains or references low-level procedural or executable information used to automate an action or validation |
| |
| A Test Step differs from a [[private:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]]: | A Test Step differs from a [[public:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]]: |
| |
| * A Test Step specifies the action or validation to perform | * A Test Step specifies the action or validation to perform |
| A Test Step can be performed manually or automatically. The Test Step definition remains independent of the execution mechanism. | A Test Step can be performed manually or automatically. The Test Step definition remains independent of the execution mechanism. |
| |
| A change to the action, validation, Expected Results, completion condition, failure condition, or timeout can create a new Test Step version when the change affects [[private:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]], reproducibility, comparison, or validation. | A change to the action, validation, Expected Results, completion condition, failure condition, or timeout can create a new Test Step version when the change affects [[public:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]], reproducibility, comparison, or validation. |
| |
| ===== Example ===== | ===== Example ===== |
| |
| A [[private:99_annexes:annex-b-terms-and-definitions:d:dido-te|DIDO-TE]] [[private:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Case]] verifies a proposed DIDO state transition. | A [[public:99_annexes:annex-b-terms-and-definitions:d:dido-te|DIDO-TE]] [[public:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Case]] verifies a proposed DIDO state transition. |
| |
| One Test Step submits a proposed transaction to a participating [[private:99_annexes:annex-b-terms-and-definitions:n:node|Node]]. | One Test Step submits a proposed transaction to a participating [[public:99_annexes:annex-b-terms-and-definitions:n:node|Node]]. |
| |
| Another Test Step observes the resulting [[private:99_annexes:annex-b-terms-and-definitions:d:dido|DIDO]] state and compares it with the applicable Expected Result. | Another Test Step observes the resulting [[public:99_annexes:annex-b-terms-and-definitions:d:dido|DIDO]] state and compares it with the applicable Expected Result. |
| |
| The [[private:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequence]] uses separate [[private:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Steps]] to identify the order in which the two Test Steps occur. | The [[public:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequence]] uses separate [[public:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Steps]] to identify the order in which the two Test Steps occur. |
| |
| During [[private:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]], the [[private:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]] records the [[private:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]] associated with each executed Test Step. | During [[public:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]], the [[public:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]] records the [[public:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]] associated with each executed Test Step. |
| |
| ---- | ---- |