Differences

This shows you the differences between two versions of the page.

--- public:99_annexes:annex-b-terms-and-definitions:e:expected_result [2026/09/12 17:42] – removed - external edit (Unknown date) 127.0.0.1
+++ public:99_annexes:annex-b-terms-and-definitions:e:expected_result [2026/09/12 17:43] (current) – ↷ Links adapted because of a move operation nick_dido
@@ Line 1: / Line 1: @@
+====== Expected Result ======
+[[public:99_annexes:annex-b-terms-and-definitions:start|Go up to Terms and Definitions]]
+===== Discussion =====
+An Expected Result specifies an anticipated value, state, state transition, event, condition, behavior, response, side effect, or outcome associated with the performance of a [[public:99_annexes:annex-b-terms-and-definitions:s:sequenced_test_object|Sequenced Test Object]] or [[public:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Step]].
+An Expected Result provides the basis for evaluating an observed or derived [[public:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]]. The Expected Result states what the test anticipates. The Test Result records what occurred.
+An Expected Result expresses one or more objectively evaluable conditions, including:
+  * An anticipated value or permitted set of values
+  * An anticipated state or state transition
+  * An anticipated event, response, or behavior
+  * An anticipated side effect
+  * The absence of an event, response, behavior, or side effect
+  * A required range, threshold, tolerance, or precision
+  * A required ordering or temporal relationship
+  * A required completion or error condition
+  * A permitted or prohibited outcome
+An Expected Result applies to a:
+  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_set|Test Set]]
+  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_case|Test Case]]
+  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Step]]
+  * [[public:99_annexes:annex-b-terms-and-definitions:t:test_executable|Test Executable]]
+  * [[public:99_annexes:annex-b-terms-and-definitions:s:sequence_step|Sequence Step]]
+During or after [[public:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]], an evaluator or automated mechanism compares the applicable Test Result with the Expected Result. The evaluator or mechanism then applies the governing [[public:99_annexes:annex-b-terms-and-definitions:e:evaluation_criterion|Evaluation Criteria]] to assign a [[public:99_annexes:annex-b-terms-and-definitions:v:verdict|Verdict]].
+===== Definition =====
+//anticipated value, state, state transition, event, condition, behavior, response, side effect, or outcome used as a basis for evaluating a [[public:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]]//
+===== Source =====
+Adapted from:
+  * [[https://www.omg.org/spec/TestIF/1.0/Beta3/PDF|OMG Test Information Interchange Format (TestIF), Version 1.0 Beta 3, Sections 7.2 and 7.4, expectedResult]]
+  * DIDO Reference Implementation Conceptual Model
+  * DIDO-TE draft Requirements Register
+OMG TestIF defines the ''expectedResult'' attribute for representing expected-result values associated with a ''SequencedTestObject'' or ''SequenceStep''.
+OMG TestIF permits the ''expectedResult'' attribute to contain multiple values when the anticipated result requires more than one value.
+This definition generalizes the TestIF concept beyond a single value while preserving its role as the anticipated result used to evaluate a Test Result.
+===== Note =====
+Use **Expected Result** as the singular glossary term. Link plural occurrences to this page:
+<code dokuwiki>
+[[dido:99_annexes:annex-b-terms-and-definitions:e:expected_result|Expected Results]]
+</code>
+An Expected Result differs from a [[public:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]]:
+  * An Expected Result specifies an anticipated result
+  * A Test Result records an observed or derived result
+An Expected Result differs from a [[public:99_annexes:annex-b-terms-and-definitions:v:verdict|Verdict]]:
+  * An Expected Result states what the test anticipates
+  * A Verdict classifies a Test Result according to the governing Evaluation Criteria
+An Expected Result differs from [[public:99_annexes:annex-b-terms-and-definitions:a:acceptance_criteria|Acceptance Criteria]]:
+  * An Expected Result specifies an anticipated result associated with a test
+  * Acceptance Criteria establish the conditions governing acceptance of an evaluated subject or outcome
+Acceptance Criteria reference applicable Expected Results when acceptance depends upon the results of testing.
+An Expected Result identifies or references the information required for repeatable evaluation, including:
+  * The applicable Sequenced Test Object or Sequence Step
+  * The applicable [[public:99_annexes:annex-b-terms-and-definitions:t:test_item|Test Item]]
+  * The applicable [[public:99_annexes:annex-b-terms-and-definitions:t:test_argument_value|Test Argument Values]]
+  * The anticipated value, state, event, condition, behavior, response, side effect, or outcome
+  * Any applicable unit of measure
+  * Any applicable range, threshold, tolerance, or precision
+  * Any applicable ordering or timing condition
+  * The comparison method
+  * The governing Evaluation Criteria
+  * The applicable Acceptance Criteria
+  * The applicable [[public:99_annexes:annex-b-terms-and-definitions:g:governance_policy|Governance Policies]]
+  * Its [[public:99_annexes:annex-b-terms-and-definitions:p:provenance|Provenance]]
+  * Its [[public:99_annexes:annex-b-terms-and-definitions:t:traceability|Traceability]]
+An Expected Result containing multiple related values preserves the relationship among those values.
+A Sequenced Test Object defines a reusable Expected Result. A Sequence Step refines or supplies an occurrence-specific Expected Result when the anticipated result depends upon:
+  * Test Argument Values
+  * The position of the Sequence Step
+  * A preceding state
+  * The execution path
+  * The applicable Test Item
+  * The [[public:99_annexes:annex-b-terms-and-definitions:t:test_environment|Test Environment]]
+  * Other occurrence-specific conditions
+An Expected Result provides sufficient information for objective and repeatable evaluation. Expressions such as “works correctly,” “responds quickly,” “performs adequately,” or “produces an appropriate result” do not establish an objectively evaluable Expected Result without additional criteria.
+A difference between an Expected Result and a Test Result does not establish the cause of the difference. The Test Result and supporting [[public:99_annexes:annex-b-terms-and-definitions:e:evidence|Evidence]] preserve the observed or derived result.
+An Expected Result does not establish a [[public:99_annexes:annex-b-terms-and-definitions:v:validation_decision|Validation Decision]]. The Validation Decision applies the governing decision criteria to the applicable Test Results, Verdicts, and Evidence.
+===== Example =====
+A [[public:99_annexes:annex-b-terms-and-definitions:t:test_step|Test Step]] directs a selected [[public:99_annexes:annex-b-terms-and-definitions:n:node|Node]] to process a valid transaction.
+The Expected Result specifies that:
+  * The Node accepts the transaction
+  * The Node returns a nonempty transaction identifier
+  * The Node records the committed transaction state
+  * The committed state references the preceding state
+  * The response occurs within five seconds
+  * The Node produces no duplicate committed state
+During Test Execution, the applicable Test Result records:
+  * The observed response
+  * The returned transaction identifier
+  * The resulting transaction state
+  * The predecessor-state reference
+  * The measured response time
+  * Any duplicate committed state
+  * The supporting Evidence
+The evaluator compares the Test Result with the Expected Result and applies the governing Evaluation Criteria to assign the applicable Verdict.
+----
+<WRAP centeralign>
+© 2026 Dido Solutions, Inc. and Jackrabbit Consulting, Inc.
+</WRAP>