====== Evaluation Criterion ====== [[dido:99_annexes:annex-b-terms-and-definitions:start|Go up to Terms and Definitions]] ===== Discussion ===== An Evaluation Criterion establishes a condition used to evaluate one or more [[dido:99_annexes:annex-b-terms-and-definitions:o:observation|Observations]]. An Evaluation Criterion identifies the relevant observed property, state, behavior, event, or condition and establishes the value, range, tolerance, pattern, threshold, relationship, or other condition used during evaluation. A [[dido:99_annexes:annex-b-terms-and-definitions:t:test_definition|Test Definition]] associates Evaluation Criteria with applicable Expected Results. [[dido:99_annexes:annex-b-terms-and-definitions:d:dido-te|DIDO-TE]] applies those criteria to the Observations produced during a [[dido:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]] when determining the [[dido:99_annexes:annex-b-terms-and-definitions:t:test_outcome|Test Outcome]]. An Evaluation Criterion differs from an Acceptance Criterion. An Evaluation Criterion governs the evaluation of Observations. An Acceptance Criterion establishes a condition that a subject must satisfy for a designated stakeholder or authority to accept it. An Evaluation Criterion contributes to an acceptance decision when the applicable acceptance process references that criterion. ===== Definition ===== //condition used to evaluate an observation against an expected result or other specified basis// ===== Source ===== Adapted from the testing and acceptance-criteria concepts described by: * [[https://www.iso.org/standard/81291.html|ISO/IEC/IEEE 29119-1:2022, Software and systems engineering — Software testing — Part 1: General concepts]] * [[https://www.iso.org/standard/79428.html|ISO/IEC/IEEE 29119-2:2021, Software and systems engineering — Software testing — Part 2: Test processes]] * [[https://glossary.istqb.org/en_US/search?exact_matches_first=true|ISTQB Glossary]] ===== Note ===== An Evaluation Criterion identifies or references: * The applicable Test Definition * The Observation subject * The observed property, state, behavior, event, or condition * The applicable Expected Result or other evaluation basis * The comparison operator or evaluation method * The required value, range, threshold, tolerance, pattern, or relationship * The treatment of missing, incomplete, or indeterminate Observations * The Test Outcome associated with satisfaction or non-satisfaction of the criterion A Test Definition may contain multiple Evaluation Criteria. The Test Definition establishes how DIDO-TE combines their individual determinations into a Test Outcome. ===== Example ===== An Expected Result states that a Candidate Solution rejects a Transfer Bundle with an invalid integrity value. The associated Evaluation Criteria require: * A rejected import response * An integrity-validation error in the applicable record * No creation or modification of deployed resources DIDO-TE evaluates the recorded Observations against these criteria to determine the Test Outcome. ---- © 2026 Dido Solutions, Inc. and Jackrabbit Consulting, Inc.