| Both sides previous revision Previous revision | |
| public:99_annexes:annex-b-terms-and-definitions:t:test_executable [2026/09/12 17:42] – ↷ Page moved from private:99_annexes:annex-b-terms-and-definitions:t:test_executable to public:99_annexes:annex-b-terms-and-definitions:t:test_executable nick_dido | public:99_annexes:annex-b-terms-and-definitions:t:test_executable [2026/09/12 17:43] (current) – ↷ Links adapted because of a move operation nick_dido |
|---|
| ====== Test Executable ====== | ====== Test Executable ====== |
| |
| [[private:99_annexes:annex-b-terms-and-definitions:start|Go up to Terms and Definitions]] | [[public:99_annexes:annex-b-terms-and-definitions:start|Go up to Terms and Definitions]] |
| |
| ===== Discussion ===== | ===== Discussion ===== |
| A Test Executable contains or references executable instructions that implement a test action or validation. | A Test Executable contains or references executable instructions that implement a test action or validation. |
| |
| As a [[public:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]], a Test Executable can participate in a [[private:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequence]]. | As a [[public:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]], a Test Executable can participate in a [[public:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequence]]. |
| |
| A Test Executable can implement an action or validation specified by a [[private:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Step]]. | A Test Executable can implement an action or validation specified by a [[public:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Step]]. |
| |
| Executable instructions can include: | Executable instructions can include: |
| * Its required dependencies | * Its required dependencies |
| * Its required execution facilities | * Its required execution facilities |
| * Its applicable [[private:99_annexes:annex-b-terms-and-definitions:t:test_item|Test Items]] | * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:t:test_item|Test Items]] |
| * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:t:test_environment|Test Environments]] | * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:t:test_environment|Test Environments]] |
| * Its completion condition | * Its completion condition |
| * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:g:governance_policy|Governance Policies]] | * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:g:governance_policy|Governance Policies]] |
| * Its [[public:99_annexes:annex-b-terms-and-definitions:p:provenance|Provenance]] | * Its [[public:99_annexes:annex-b-terms-and-definitions:p:provenance|Provenance]] |
| * Its [[private:99_annexes:annex-b-terms-and-definitions:t:traceability|Traceability]] | * Its [[public:99_annexes:annex-b-terms-and-definitions:t:traceability|Traceability]] |
| |
| A [[public:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Step]] identifies the occurrence of a Test Executable at a particular position within a [[private:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequence]]. | A [[public:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Step]] identifies the occurrence of a Test Executable at a particular position within a [[public:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequence]]. |
| |
| The same Test Executable can participate in multiple [[private:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequences]] or occur more than once within the same Test Sequence. | The same Test Executable can participate in multiple [[public:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequences]] or occur more than once within the same Test Sequence. |
| |
| Each Sequence Step can supply the applicable [[public:99_annexes:annex-b-terms-and-definitions:t:test_argument_value|Test Argument Values]] and [[public:99_annexes:annex-b-terms-and-definitions:e:expected_result|Expected Results]] for that occurrence. | Each Sequence Step can supply the applicable [[public:99_annexes:annex-b-terms-and-definitions:t:test_argument_value|Test Argument Values]] and [[public:99_annexes:annex-b-terms-and-definitions:e:expected_result|Expected Results]] for that occurrence. |
| |
| * [[https://www.omg.org/spec/TestIF/1.0/Beta3/PDF|OMG Test Information Interchange Format (TestIF), Version 1.0 Beta 3, Section 7.3.7, TestExecutable]] | * [[https://www.omg.org/spec/TestIF/1.0/Beta3/PDF|OMG Test Information Interchange Format (TestIF), Version 1.0 Beta 3, Section 7.3.7, TestExecutable]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]] | * [[public:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]] |
| * [[public:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] | * [[public:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Step]] | * [[public:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Step]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequence]] | * [[public:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequence]] |
| * [[public:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Step]] | * [[public:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Step]] |
| * [[public:99_annexes:annex-b-terms-and-definitions:t:test_argument|Test Argument]] | * [[public:99_annexes:annex-b-terms-and-definitions:t:test_argument|Test Argument]] |
| ===== Note ===== | ===== Note ===== |
| |
| Every Test Executable is a [[public:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] and therefore a [[private:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]]. | Every Test Executable is a [[public:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] and therefore a [[public:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]]. |
| |
| A Test Executable differs from a [[private:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Step]]: | A Test Executable differs from a [[public:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Step]]: |
| |
| * A [[private:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Step]] specifies an action or validation independently of a particular execution mechanism | * A [[public:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Step]] specifies an action or validation independently of a particular execution mechanism |
| * A Test Executable contains or references the executable instructions implementing an action or validation | * A Test Executable contains or references the executable instructions implementing an action or validation |
| |
| |
| * A Test Executable identifies reusable executable instructions | * A Test Executable identifies reusable executable instructions |
| * A [[public:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Step]] identifies an occurrence of a [[public:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] within a [[private:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequence]] | * A [[public:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Step]] identifies an occurrence of a [[public:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] within a [[public:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequence]] |
| |
| A Test Executable differs from a [[private:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]]: | A Test Executable differs from a [[public:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]]: |
| |
| * A Test Executable identifies the executable instructions used during [[private:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]] | * A Test Executable identifies the executable instructions used during [[public:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]] |
| * A [[private:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]] records an outcome produced by Test Execution | * A [[public:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]] records an outcome produced by Test Execution |
| |
| A Test Executable can define [[public:99_annexes:annex-b-terms-and-definitions:t:test_argument|Test Arguments]] representing its input and output interface. | A Test Executable can define [[public:99_annexes:annex-b-terms-and-definitions:t:test_argument|Test Arguments]] representing its input and output interface. |
| |
| A Test Executable does not assign occurrence-specific values to those Test Arguments. A [[public:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Step]] supplies the applicable [[public:99_annexes:annex-b-terms-and-definitions:t:test_argument_value|Test Argument Values]] for a particular occurrence of the Test Executable within a [[private:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequence]]. | A Test Executable does not assign occurrence-specific values to those Test Arguments. A [[public:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Step]] supplies the applicable [[public:99_annexes:annex-b-terms-and-definitions:t:test_argument_value|Test Argument Values]] for a particular occurrence of the Test Executable within a [[public:99_annexes:annex-b-terms-and-definitions:t:test_sequence|Test Sequence]]. |
| |
| A Test Executable can depend on a particular tool, programming language, operating system, processor architecture, or execution facility. The associated [[private:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Step]] should remain independent of those implementation details when the action or validation can be expressed independently. | A Test Executable can depend on a particular tool, programming language, operating system, processor architecture, or execution facility. The associated [[public:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Step]] should remain independent of those implementation details when the action or validation can be expressed independently. |
| |
| A change to the executable instructions, referenced artifact, dependency, entry point, [[public:99_annexes:annex-b-terms-and-definitions:t:test_argument|Test Argument]] interface, or execution requirements can create a new Test Executable version. | A change to the executable instructions, referenced artifact, dependency, entry point, [[public:99_annexes:annex-b-terms-and-definitions:t:test_argument|Test Argument]] interface, or execution requirements can create a new Test Executable version. |
| |
| A reproducible [[private:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]] should identify: | A reproducible [[public:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]] should identify: |
| |
| * The exact Test Executable identity and version | * The exact Test Executable identity and version |
| * The applicable [[public:99_annexes:annex-b-terms-and-definitions:t:test_argument|Test Arguments]] | * The applicable [[public:99_annexes:annex-b-terms-and-definitions:t:test_argument|Test Arguments]] |
| * The applicable [[public:99_annexes:annex-b-terms-and-definitions:t:test_argument_value|Test Argument Values]] | * The applicable [[public:99_annexes:annex-b-terms-and-definitions:t:test_argument_value|Test Argument Values]] |
| * Every executable dependency used during [[private:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]] | * Every executable dependency used during [[public:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]] |
| |
| ===== Example ===== | ===== Example ===== |
| |
| A [[public:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Case]] contains a [[private:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Step]] requiring submission of a proposed [[public:99_annexes:annex-b-terms-and-definitions:d:dido|DIDO]] transaction. | A [[public:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Case]] contains a [[public:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Step]] requiring submission of a proposed [[public:99_annexes:annex-b-terms-and-definitions:d:dido|DIDO]] transaction. |
| |
| A Test Executable references a versioned script that: | A Test Executable references a versioned script that: |
| * The applicable [[public:99_annexes:annex-b-terms-and-definitions:n:node|Node]] identity as the Test Argument Value for ''targetNode'' | * The applicable [[public:99_annexes:annex-b-terms-and-definitions:n:node|Node]] identity as the Test Argument Value for ''targetNode'' |
| |
| During [[private:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]], the [[private:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]] records: | During [[public:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]], the [[public:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]] records: |
| |
| * The Test Executable identity and version | * The Test Executable identity and version |
| * The output [[public:99_annexes:annex-b-terms-and-definitions:t:test_argument_value|Test Argument Values]] | * The output [[public:99_annexes:annex-b-terms-and-definitions:t:test_argument_value|Test Argument Values]] |
| * The applicable [[public:99_annexes:annex-b-terms-and-definitions:t:test_environment|Test Environment]] | * The applicable [[public:99_annexes:annex-b-terms-and-definitions:t:test_environment|Test Environment]] |
| * The resulting [[private:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]] | * The resulting [[public:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]] |
| * The supporting [[public:99_annexes:annex-b-terms-and-definitions:e:evidence|Evidence]] | * The supporting [[public:99_annexes:annex-b-terms-and-definitions:e:evidence|Evidence]] |
| |