| Both sides previous revision Previous revision | |
| public:99_annexes:annex-b-terms-and-definitions:t:test_result [2026/09/12 17:42] – ↷ Page moved from private:99_annexes:annex-b-terms-and-definitions:t:test_result to public:99_annexes:annex-b-terms-and-definitions:t:test_result nick_dido | public:99_annexes:annex-b-terms-and-definitions:t:test_result [2026/09/12 17:43] (current) – ↷ Links adapted because of a move operation nick_dido |
|---|
| ====== Test Result ====== | ====== Test Result ====== |
| |
| [[private:99_annexes:annex-b-terms-and-definitions:start|Go up to Terms and Definitions]] | [[public:99_annexes:annex-b-terms-and-definitions:start|Go up to Terms and Definitions]] |
| |
| ===== Discussion ===== | ===== Discussion ===== |
| |
| A Test Result is a [[private:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]] that records an outcome associated with a [[private:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] or [[private:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Step]]. | A Test Result is a [[public:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]] that records an outcome associated with a [[public:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] or [[public:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Step]]. |
| |
| A Test Result can record an outcome produced during [[private:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]] or derived later through evaluation or arbitration. | A Test Result can record an outcome produced during [[public:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]] or derived later through evaluation or arbitration. |
| |
| A Test Result can identify: | A Test Result can identify: |
| * Its description | * Its description |
| * Its result value | * Its result value |
| * Its applicable [[private:99_annexes:annex-b-terms-and-definitions:v:verdict|Verdict]] | * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:v:verdict|Verdict]] |
| * Its start time | * Its start time |
| * Its completion time | * Its completion time |
| * Its related Sequenced Test Object | * Its related Sequenced Test Object |
| * Its related Sequence Step | * Its related Sequence Step |
| * Its applicable [[private:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]] | * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]] |
| * Its applicable [[private:99_annexes:annex-b-terms-and-definitions:t:test_item|Test Items]] | * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:t:test_item|Test Items]] |
| * Its observed values | * Its observed values |
| * Its applicable [[private:99_annexes:annex-b-terms-and-definitions:e:expected_result|Expected Results]] | * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:e:expected_result|Expected Results]] |
| * Its evaluation criteria | * Its evaluation criteria |
| * Its error information | * Its error information |
| * Its supporting [[private:99_annexes:annex-b-terms-and-definitions:e:evidence|Evidence]] | * Its supporting [[public:99_annexes:annex-b-terms-and-definitions:e:evidence|Evidence]] |
| * Its applicable [[private:99_annexes:annex-b-terms-and-definitions:g:governance_policy|Governance Policies]] | * Its applicable [[public:99_annexes:annex-b-terms-and-definitions:g:governance_policy|Governance Policies]] |
| * Its [[private:99_annexes:annex-b-terms-and-definitions:p:provenance|Provenance]] | * Its [[public:99_annexes:annex-b-terms-and-definitions:p:provenance|Provenance]] |
| * Its [[private:99_annexes:annex-b-terms-and-definitions:t:traceability|Traceability]] | * Its [[public:99_annexes:annex-b-terms-and-definitions:t:traceability|Traceability]] |
| |
| A Test Result can represent an outcome for a: | A Test Result can represent an outcome for a: |
| |
| * [[private:99_annexes:annex-b-terms-and-definitions:t:test_set|Test Set]] | * [[public:99_annexes:annex-b-terms-and-definitions:t:test_set|Test Set]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Case]] | * [[public:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Case]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Step]] | * [[public:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Step]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:t:test_executable|Test Executable]] | * [[public:99_annexes:annex-b-terms-and-definitions:t:test_executable|Test Executable]] |
| * Sequence Step | * Sequence Step |
| |
| ===== Definition ===== | ===== Definition ===== |
| |
| //[[private:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]] that records an outcome associated with a [[private:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] or [[private:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Step]]// | //[[public:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]] that records an outcome associated with a [[public:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] or [[public:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Step]]// |
| |
| ===== Source ===== | ===== Source ===== |
| |
| * [[https://www.omg.org/spec/TestIF/1.0/Beta3/PDF|OMG Test Information Interchange Format (TestIF), Version 1.0 Beta 3, Section 7.3.11, TestResult]] | * [[https://www.omg.org/spec/TestIF/1.0/Beta3/PDF|OMG Test Information Interchange Format (TestIF), Version 1.0 Beta 3, Section 7.3.11, TestResult]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]] | * [[public:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] | * [[public:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Step]] | * [[public:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Step]] |
| * [[private:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]] | * [[public:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]] |
| * DIDO Reference Implementation Conceptual Model | * DIDO Reference Implementation Conceptual Model |
| * DIDO-TE draft Requirements Register | * DIDO-TE draft Requirements Register |
| ===== Note ===== | ===== Note ===== |
| |
| Every Test Result is a [[private:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]]. | Every Test Result is a [[public:99_annexes:annex-b-terms-and-definitions:t:test_object|Test Object]]. |
| |
| A Test Result differs from a [[private:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]]: | A Test Result differs from a [[public:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]]: |
| |
| * A Test Result records a particular outcome | * A Test Result records a particular outcome |
| * A Test Run records the execution context and collects the applicable Test Results | * A Test Run records the execution context and collects the applicable Test Results |
| |
| A Test Result differs from an [[private:99_annexes:annex-b-terms-and-definitions:e:expected_result|Expected Result]]: | A Test Result differs from an [[public:99_annexes:annex-b-terms-and-definitions:e:expected_result|Expected Result]]: |
| |
| * An Expected Result specifies an anticipated value, state, event, or condition | * An Expected Result specifies an anticipated value, state, event, or condition |
| * A Test Result records an observed or derived outcome | * A Test Result records an observed or derived outcome |
| |
| A Test Result differs from a [[private:99_annexes:annex-b-terms-and-definitions:v:verdict|Verdict]]: | A Test Result differs from a [[public:99_annexes:annex-b-terms-and-definitions:v:verdict|Verdict]]: |
| |
| * A Test Result records the outcome and its supporting information | * A Test Result records the outcome and its supporting information |
| A failed lower-level Test Result does not necessarily cause every related higher-level Test Result to fail. The applicable evaluation or arbitration criteria determine that outcome. | A failed lower-level Test Result does not necessarily cause every related higher-level Test Result to fail. The applicable evaluation or arbitration criteria determine that outcome. |
| |
| A Test Result does not by itself constitute a [[private:99_annexes:annex-b-terms-and-definitions:v:validation_decision|Validation Decision]]. A Validation Decision uses applicable Test Results, Verdicts, Evidence, and decision criteria to determine whether the evaluated subject satisfies its defined purpose. | A Test Result does not by itself constitute a [[public:99_annexes:annex-b-terms-and-definitions:v:validation_decision|Validation Decision]]. A Validation Decision uses applicable Test Results, Verdicts, Evidence, and decision criteria to determine whether the evaluated subject satisfies its defined purpose. |
| |
| ===== Example ===== | ===== Example ===== |
| |
| A [[private:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Step]] requires a [[private:99_annexes:annex-b-terms-and-definitions:n:node|Node]] to accept a valid transaction and return its transaction identifier. | A [[public:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Step]] requires a [[public:99_annexes:annex-b-terms-and-definitions:n:node|Node]] to accept a valid transaction and return its transaction identifier. |
| |
| The Test Result records: | The Test Result records: |
| * The comparison between the observed and expected outcomes | * The comparison between the observed and expected outcomes |
| * The assigned Verdict | * The assigned Verdict |
| * The supporting [[private:99_annexes:annex-b-terms-and-definitions:e:evidence|Evidence]] | * The supporting [[public:99_annexes:annex-b-terms-and-definitions:e:evidence|Evidence]] |
| |
| The applicable [[private:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]] contains the Test Result and preserves its relationship to the performed Test Step and Sequence Step. | The applicable [[public:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Run]] contains the Test Result and preserves its relationship to the performed Test Step and Sequence Step. |
| |
| ---- | ---- |