====== MO-004a — DIDO Baseline Comparison ======

[[dido:03-dido-te:99-annexes:annex-c-requirements:01-mission-objectives:mo-004:start|Go to MO-004 — DIDO Baseline Comparison and Validation]]

===== Statement =====

[[dido:99_annexes:annex-b-terms-and-definitions:d:dido-te|DIDO-TE]] SHALL compare a selected [[dido:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]] with its corresponding Test Result in the controlling DIDO [[dido:99_annexes:annex-b-terms-and-definitions:b:baseline|Baseline]] according to the [[dido:99_annexes:annex-b-terms-and-definitions:a:acceptance_criteria|Acceptance Criteria]].

===== Derived From =====

This requirement derives from:

  * [[dido:03-dido-te:99-annexes:annex-c-requirements:01-mission-objectives:mo-004:start|MO-004 — DIDO Baseline Comparison and Validation]]

The Original Requirement states:

> //Creating baseline results using validated nodes and comparing them against tests with modified nodes to identify discrepancies or improvements.//

The source material further states:

> //This approach ensures that any changes or updates to the system are validated against a known benchmark, enhancing reliability and trust in the distributed system.//

MO-004a preserves the portion of the Original Requirement addressing comparison of selected Test Results with Test Results in a controlling DIDO Baseline.

The separate requirement derived from MO-004 addresses:

  * [[dido:03-dido-te:99-annexes:annex-c-requirements:01-mission-objectives:mo-004:mo-004b|MO-004b — Validation Decision Based on DIDO Baseline Comparison]]

===== Rationale =====

A DIDO [[dido:99_annexes:annex-b-terms-and-definitions:b:baseline|Baseline]] provides an approved reference for evaluating the behavior, characteristics, and outcomes of a selected [[dido:99_annexes:annex-b-terms-and-definitions:d:distributed_system|Distributed System]].

Comparison with the controlling DIDO Baseline permits an organization to identify:

  * Equality
  * Difference
  * Direction of difference
  * Magnitude of difference
  * Difference within an applicable tolerance
  * Difference outside an applicable tolerance
  * Improvement according to defined criteria
  * Degradation according to defined criteria
  * Insufficient information to complete the comparison

A comparison requires DIDO-TE to identify both:

  * The selected [[dido:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]]
  * The corresponding Test Result in the controlling DIDO Baseline

The Test Results correspond when the [[dido:99_annexes:annex-b-terms-and-definitions:a:acceptance_criteria|Acceptance Criteria]] establish that they represent the same characteristic, measurement, observation, event, output, or other comparison subject under the applicable comparison conditions.

The Acceptance Criteria establish:

  * The controlling DIDO Baseline
  * The controlling DIDO Baseline [[dido:99_annexes:annex-b-terms-and-definitions:v:version|Version]]
  * The Test Result selected for comparison
  * The corresponding Test Result in the controlling DIDO Baseline
  * The characteristic subject to comparison
  * The comparison method
  * The measurement conditions
  * The measurement units
  * The required measurement precision
  * The permitted tolerances
  * The permitted exclusions
  * The treatment of missing values
  * The treatment of invalid values
  * The treatment of nondeterministic behavior
  * The classifications assigned to comparison outcomes
  * The treatment of Test Results produced by [[dido:99_annexes:annex-b-terms-and-definitions:i:incomplete_test_run|Incomplete Test Runs]]

The comparison can be:

  * Quantitative
  * Qualitative
  * Structural
  * Behavioral
  * Temporal
  * Semantic
  * Binary
  * Statistical
  * Another comparison method established by the Acceptance Criteria

MO-004a requires comparison but does not require DIDO-TE to determine whether the comparison outcome satisfies applicable [[dido:99_annexes:annex-b-terms-and-definitions:v:validation_criteria|Validation Criteria]].

MO-004b addresses the resulting [[dido:99_annexes:annex-b-terms-and-definitions:v:validation_decision|Validation Decision]].

Separating comparison from the Validation Decision permits:

  * One comparison outcome to support multiple Validation Decisions
  * Different Validation Criteria to evaluate the same comparison outcome
  * An authorized Actor to review the comparison before making a Validation Decision
  * DIDO-TE to preserve a comparison outcome even when the available information is insufficient for a conclusive Validation Decision

===== Applies To =====

This requirement applies to:

  * [[dido:99_annexes:annex-b-terms-and-definitions:d:dido-te|DIDO-TE]]
  * DIDO [[dido:99_annexes:annex-b-terms-and-definitions:b:baseline|Baselines]]
  * DIDO Baseline Versions
  * Selected [[dido:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Results]]
  * Corresponding Test Results
  * Test Result characteristics
  * Comparison methods
  * Comparison conditions
  * Measurement units
  * Measurement precision
  * Permitted tolerances
  * Permitted exclusions
  * Equality
  * Difference
  * Direction of difference
  * Magnitude of difference
  * Improvement
  * Degradation
  * Inconclusive comparisons
  * Missing values
  * Invalid values
  * Nondeterministic behavior
  * [[dido:99_annexes:annex-b-terms-and-definitions:t:test_definition|Test Definitions]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:t:test_environment|Test Environments]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:t:test_run|Test Runs]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:t:test_run_state|Test Run States]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:t:test_run_termination_reason|Test Run Termination Reasons]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:i:incomplete_test_run|Incomplete Test Runs]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:n:node|Nodes]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:n:node_set|Node Sets]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:c:configuration|Configurations]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:v:version|Versions]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:a:acceptance_criteria|Acceptance Criteria]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:e:evidence|Evidence]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:p:provenance|Provenance]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:t:traceability|Traceability]]

===== Verification =====

Verification confirms that:

  - The controlling DIDO [[dido:99_annexes:annex-b-terms-and-definitions:b:baseline|Baseline]] is identified
  - The controlling DIDO Baseline [[dido:99_annexes:annex-b-terms-and-definitions:v:version|Version]] is identified
  - The selected [[dido:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]] is identified
  - The corresponding Test Result in the controlling DIDO Baseline is identified
  - The [[dido:99_annexes:annex-b-terms-and-definitions:a:acceptance_criteria|Acceptance Criteria]] establish the correspondence between the selected Test Result and the Test Result in the controlling DIDO Baseline
  - The Acceptance Criteria identify each Test Result characteristic subject to comparison
  - The Acceptance Criteria establish the comparison method for each compared characteristic
  - The Acceptance Criteria establish the applicable comparison conditions
  - The Acceptance Criteria establish the applicable measurement units
  - The Acceptance Criteria establish the required measurement precision
  - The Acceptance Criteria establish the permitted tolerances
  - The Acceptance Criteria establish the permitted exclusions
  - The Acceptance Criteria establish the treatment of missing values
  - The Acceptance Criteria establish the treatment of invalid values
  - The Acceptance Criteria establish the treatment of nondeterministic behavior
  - The Acceptance Criteria establish the classifications applicable to comparison outcomes
  - The Acceptance Criteria establish the treatment of Test Results produced by [[dido:99_annexes:annex-b-terms-and-definitions:i:incomplete_test_run|Incomplete Test Runs]]
  - DIDO-TE retrieves the selected Test Result
  - DIDO-TE retrieves the corresponding Test Result from the controlling DIDO Baseline
  - DIDO-TE applies the comparison method established by the Acceptance Criteria
  - DIDO-TE compares each selected Test Result characteristic with its corresponding DIDO Baseline Test Result characteristic
  - DIDO-TE determines the difference between each compared characteristic
  - DIDO-TE determines whether each difference is within the permitted tolerance
  - DIDO-TE classifies each comparison outcome according to the Acceptance Criteria
  - DIDO-TE records each comparison outcome
  - DIDO-TE records any Test Result characteristic it cannot compare
  - DIDO-TE records the reason it cannot complete a comparison
  - The verification record preserves [[dido:99_annexes:annex-b-terms-and-definitions:t:traceability|Traceability]] among the Acceptance Criteria, controlling DIDO Baseline, DIDO Baseline Version, selected Test Result, corresponding DIDO Baseline Test Result, compared characteristics, comparison method, measured differences, permitted tolerances, comparison outcomes, and supporting [[dido:99_annexes:annex-b-terms-and-definitions:e:evidence|Evidence]]

===== Referenced By =====

The following pages reference this requirement:

{{backlinks>.#dido:03-dido-te}}

===== Delivery Phase =====

<todo>TBD</todo>

===== Implementation Status =====

<todo>Assess the current DIDO-TE implementation against the DIDO Baseline comparison obligation established by MO-004a.</todo>

===== Requirement Status =====

<todo>Review and accept MO-004a as a proposed derived requirement created from the evaluation and decomposition of MO-004.</todo>

----
===== Issues =====

The following unresolved issues affect this requirement:

<todo>Determine whether DIDO Baseline requires a separate shared Terms and Definitions entry or identifies a DIDO-specific application of Baseline.</todo>

<todo>Determine whether Baseline Test Result requires a separate shared Terms and Definitions entry.</todo>

<todo>Define how DIDO-TE identifies the controlling DIDO Baseline and DIDO Baseline Version.</todo>

<todo>Define how DIDO-TE establishes correspondence between a selected Test Result and a Test Result in the controlling DIDO Baseline.</todo>

<todo>Define the Test Result characteristics subject to comparison.</todo>

<todo>Define the supported quantitative, qualitative, structural, behavioral, temporal, semantic, binary, and statistical comparison methods.</todo>

<todo>Define the measurement conditions, units, precision, exclusions, and tolerances used for each comparison method.</todo>

<todo>Define the classifications assigned to equality, difference, improvement, degradation, and inconclusive comparison outcomes.</todo>

<todo>Define the treatment of missing, invalid, incompatible, or unavailable Test Results.</todo>

<todo>Define the treatment of nondeterministic Test Results.</todo>

<todo>Define the treatment of Test Results produced by Incomplete Test Runs for each applicable Test Run Termination Reason.</todo>

<todo>Define the Evidence DIDO-TE must preserve for each comparison outcome.</todo>

----
===== Notes for Editors =====

This requirement page should retain the stable requirement identifier ''MO-004a''.

This page is a leaf requirement page and omits a trailing '':start'' from its namespace.

The parent MO-004 page is a non-leaf page and retains a trailing '':start'' in its namespace.

Changes to the Statement should preserve:

  * [[dido:99_annexes:annex-b-terms-and-definitions:d:dido-te|DIDO-TE]] as the responsible Actor
  * A selected [[dido:99_annexes:annex-b-terms-and-definitions:t:test_result|Test Result]] as the subject of comparison
  * The corresponding Test Result in the controlling DIDO [[dido:99_annexes:annex-b-terms-and-definitions:b:baseline|Baseline]] as the comparison reference
  * The [[dido:99_annexes:annex-b-terms-and-definitions:a:acceptance_criteria|Acceptance Criteria]] as the source of the comparison rules

The Acceptance Criteria should identify:

  * The controlling DIDO Baseline
  * The controlling DIDO Baseline Version
  * The selected Test Result
  * The corresponding Test Result in the controlling DIDO Baseline
  * The characteristics subject to comparison
  * The comparison method
  * The comparison conditions
  * The measurement units
  * The required measurement precision
  * The permitted tolerances
  * The permitted exclusions
  * The treatment of missing values
  * The treatment of invalid values
  * The treatment of incompatible values
  * The treatment of unavailable Test Results
  * The treatment of nondeterministic behavior
  * The classifications applicable to comparison outcomes
  * The treatment of Test Results produced by Incomplete Test Runs
  * The required Evidence
  * The required Provenance
  * The required Traceability

MO-004a does not determine whether a comparison outcome satisfies applicable [[dido:99_annexes:annex-b-terms-and-definitions:v:validation_criteria|Validation Criteria]].

MO-004a does not produce the resulting [[dido:99_annexes:annex-b-terms-and-definitions:v:validation_decision|Validation Decision]]. MO-004b addresses that outcome.

Material changes should receive review and should update the verification criteria, source records, parent decomposition record, and Issues section.

To reference this requirement Statement from another Wiki page, insert:

<code dokuwiki>
{{section>dido:03-dido-te:99-annexes:annex-c-requirements:01-mission-objectives:mo-004:mo-004a#Statement&noheader&nofooter&noeditbtn}}
</code>

Do not rename this page after an external citation unless a redirect or move plan is in place.

----

<WRAP centeralign>
© 2026 Dido Solutions, Inc. and Jackrabbit Consulting, Inc.
</WRAP>