Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
public:99_annexes:annex-b-terms-and-definitions:t:test_outcome [2026/09/12 17:42] – removed - external edit (Unknown date) 127.0.0.1public:99_annexes:annex-b-terms-and-definitions:t:test_outcome [2026/09/12 17:43] (current) – ↷ Links adapted because of a move operation nick_dido
Line 1: Line 1:
 +====== Test Outcome ======
  
 +[[public:99_annexes:annex-b-terms-and-definitions:start|Go up to Terms and Definitions]]
 +
 +===== Discussion =====
 +
 +A Test Outcome expresses the determination produced by evaluating applicable [[public:99_annexes:annex-b-terms-and-definitions:o:observation|Observations]] against the expected results, acceptance criteria, or other decision rules established by a [[public:99_annexes:annex-b-terms-and-definitions:t:test_definition|Test Definition]].
 +
 +A Test Outcome commonly identifies a determination such as pass, fail, inconclusive, blocked, or error. The Test Definition establishes the permitted outcome values and the criteria governing their assignment.
 +
 +A Test Outcome differs from a [[public:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]]. The Test Outcome expresses the determination reached through evaluation. The Test Result records the outcome together with the supporting context, identifiers, relationships, and other information produced by the [[public:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]].
 +
 +DIDO-TE preserves [[public:99_annexes:annex-b-terms-and-definitions:t:traceability|Traceability]] from each Test Outcome to the Observations and criteria used to determine it.
 +
 +===== Definition =====
 +
 +//determination produced by evaluating test observations against specified expected results, acceptance criteria, or decision rules//
 +
 +===== Source =====
 +
 +Adapted from the test-result and expected-result concepts defined by:
 +
 +  * [[https://www.iso.org/standard/79428.html|ISO/IEC/IEEE 29119-2:2021, Software and systems engineering — Software testing — Part 2: Test processes]]
 +  * [[https://glossary.istqb.org/en_US/term/test-result|ISTQB Glossary, “test result”]]
 +  * [[https://glossary.istqb.org/en_US/term/expected-result|ISTQB Glossary, “expected result”]]
 +
 +===== Note =====
 +
 +The DIDO glossary uses **Test Outcome** in a narrower sense than sources that treat **test outcome**, **test result**, and **result** as synonyms.
 +
 +Within DIDO-TE:
 +
 +  * An Observation records what occurred
 +  * A Test Outcome records the determination reached
 +  * A Test Result preserves the outcome and its supporting test context
 +
 +A Test Outcome record identifies or references:
 +
 +  * The applicable Test Execution
 +  * The evaluated Observations
 +  * The expected result or acceptance criterion
 +  * The applied decision rule
 +  * The resulting determination
 +  * Any reason for an inconclusive, blocked, or error outcome
 +
 +===== Example =====
 +
 +A Test Definition requires a Candidate Solution to reject a Transfer Bundle whose integrity validation fails. DIDO-TE observes that the Candidate Solution rejected the bundle and recorded the applicable integrity error. Evaluation of these Observations against the expected result produces a **pass** Test Outcome.
 +
 +----
 +
 +<WRAP centeralign>
 +© 2026 Dido Solutions, Inc. and Jackrabbit Consulting, Inc.
 +</WRAP>