public:99_annexes:annex-b-terms-and-definitions:e:evaluation_criterion

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision		 Previous revision
public:99_annexes:annex-b-terms-and-definitions:e:evaluation_criterion [2026/09/12 17:42] – removed - external edit (Unknown date) 127.0.0.1public:99_annexes:annex-b-terms-and-definitions:e:evaluation_criterion [2026/09/12 17:43] (current) – ↷ Links adapted because of a move operation nick_dido
Line 1: Line 1:
 +====== Evaluation Criterion ======
  
 +[[public:99_annexes:annex-b-terms-and-definitions:start|Go up to Terms and Definitions]]
 +
 +===== Discussion =====
 +
 +An Evaluation Criterion establishes a condition used to evaluate one or more [[public:99_annexes:annex-b-terms-and-definitions:o:observation|Observations]].
 +
 +An Evaluation Criterion identifies the relevant observed property, state, behavior, event, or condition and establishes the value, range, tolerance, pattern, threshold, relationship, or other condition used during evaluation.
 +
 +A [[public:99_annexes:annex-b-terms-and-definitions:t:test_definition|Test Definition]] associates Evaluation Criteria with applicable Expected Results. [[public:99_annexes:annex-b-terms-and-definitions:d:dido-te|DIDO-TE]] applies those criteria to the Observations produced during a [[public:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]] when determining the [[public:99_annexes:annex-b-terms-and-definitions:t:test_outcome|Test Outcome]].
 +
 +An Evaluation Criterion differs from an Acceptance Criterion. An Evaluation Criterion governs the evaluation of Observations. An Acceptance Criterion establishes a condition that a subject must satisfy for a designated stakeholder or authority to accept it.
 +
 +An Evaluation Criterion contributes to an acceptance decision when the applicable acceptance process references that criterion.
 +
 +===== Definition =====
 +
 +//condition used to evaluate an observation against an expected result or other specified basis//
 +
 +===== Source =====
 +
 +Adapted from the testing and acceptance-criteria concepts described by:
 +
 +  * [[https://www.iso.org/standard/81291.html|ISO/IEC/IEEE 29119-1:2022, Software and systems engineering — Software testing — Part 1: General concepts]]
 +  * [[https://www.iso.org/standard/79428.html|ISO/IEC/IEEE 29119-2:2021, Software and systems engineering — Software testing — Part 2: Test processes]]
 +  * [[https://glossary.istqb.org/en_US/search?exact_matches_first=true|ISTQB Glossary]]
 +
 +===== Note =====
 +
 +An Evaluation Criterion identifies or references:
 +
 +  * The applicable Test Definition
 +  * The Observation subject
 +  * The observed property, state, behavior, event, or condition
 +  * The applicable Expected Result or other evaluation basis
 +  * The comparison operator or evaluation method
 +  * The required value, range, threshold, tolerance, pattern, or relationship
 +  * The treatment of missing, incomplete, or indeterminate Observations
 +  * The Test Outcome associated with satisfaction or non-satisfaction of the criterion
 +
 +A Test Definition may contain multiple Evaluation Criteria. The Test Definition establishes how DIDO-TE combines their individual determinations into a Test Outcome.
 +
 +===== Example =====
 +
 +An Expected Result states that a Candidate Solution rejects a Transfer Bundle with an invalid integrity value.
 +
 +The associated Evaluation Criteria require:
 +
 +  * A rejected import response
 +  * An integrity-validation error in the applicable record
 +  * No creation or modification of deployed resources
 +
 +DIDO-TE evaluates the recorded Observations against these criteria to determine the Test Outcome.
 +
 +----
 +
 +<WRAP centeralign>
 +© 2026 Dido Solutions, Inc. and Jackrabbit Consulting, Inc.
 +</WRAP>