MO-005 — Comparative Evaluation of Candidate Solutions

Go to C.1 Mission Objectives

Statement

DIDO-TE SHALL produce a comparative evaluation of at least two selected Candidate Solutions according to the Acceptance Criteria.

Source

This requirement consolidates mission-level intent from the DIDO-TE source material addressing:

Creating baseline results using validated nodes and comparing them against tests with modified nodes to identify discrepancies or improvements.

The source material further identifies:

The ability to emulate real-world conditions, simulate different node configurations, and conduct baseline and comparison testing will be assessed for thoroughness and coverage.

The source material describes the use of DIDO-TE to evaluate different Node configurations, implementations, technologies, and candidate approaches under controlled testing conditions.

MO-005 expresses the common mission-level outcome. Detailed obligations addressing Candidate Solution selection, common evaluation conditions, Test Execution, Test Result collection, comparison methods, evaluation criteria, ranking, reporting, and Evidence preservation remain separate Operational, Functional, Performance, Data Management, and Interoperability Requirements.

Rationale

Organizations need an objective means of comparing alternative implementations, technologies, products, Configurations, architectures, services, or other proposed Candidate Solutions.

A comparative evaluation permits an Organization to determine how selected Candidate Solutions differ according to defined characteristics such as:

Another characteristic established by the Acceptance CriteriaA comparative evaluation requires a common evaluation basis. Differences unrelated to the Candidate Solutions can confound the evaluation and prevent an objective comparison.

The Acceptance Criteria identify:

The selected Candidate SolutionsThe characteristics subject to evaluationThe applicable Test DefinitionsThe applicable Test EnvironmentsThe applicable Test Argument ValuesThe applicable Starting ConditionsThe applicable Timing ConditionsThe permitted Execution PathsThe applicable ConfigurationsThe characteristics held constantThe characteristics permitted to varyThe comparison methodsThe measurement conditionsThe measurement unitsThe required measurement precisionThe permitted tolerancesThe permitted exclusionsThe rules for normalizing measurementsThe rules for combining evaluation characteristicsThe treatment of missing, invalid, incompatible, or unavailable informationThe treatment of nondeterministic behaviorThe permitted comparative-evaluation outcomesThe comparative evaluation can identify:

EqualityDifferenceDirection of differenceMagnitude of differenceRelative advantageRelative disadvantageTrade-offRankEquivalence within an applicable toleranceInsufficient information to complete the evaluationMO-005 does not require DIDO-TE to select a preferred Candidate Solution unless the Acceptance Criteria explicitly establish:

A selection methodThe characteristics contributing to selectionThe relative weight of each characteristicThe rules for resolving equal or conflicting resultsThe applicable decision AuthorityA comparative evaluation can identify relative differences without producing a selection or acquisition decision.

MO-005 differs from MO-004a:

MO-004a compares a selected Test Result with its corresponding Test Result in a controlling DIDO BaselineMO-005 compares the evaluation outcomes of multiple selected Candidate Solutions using a common evaluation basisA comparative evaluation can use DIDO Baseline comparisons as inputs, but MO-005 does not require every Candidate Solution evaluation to use a DIDO Baseline unless the Acceptance Criteria establish that requirement.

Applies To

This requirement applies to:

Candidate SolutionsSelected Candidate SolutionsComparative evaluationsCommon evaluation basesEvaluation characteristicsEvaluation outcomesComparison methodsMeasurement conditionsMeasurement unitsMeasurement precisionPermitted tolerancesPermitted exclusionsMeasurement normalizationRelative advantagesRelative disadvantagesTrade-offsRankingsEquivalence determinationsInconclusive evaluationsAcceptance CriteriaAuthoritiesGovernance PoliciesTest DefinitionsTest EnvironmentsTest ExecutionTest Argument ValuesStarting ConditionsTiming ConditionsExecution PathsConfigurationsVersionsTest RunsTest Run StatesTest Run Termination ReasonsIncomplete Test RunsTest ResultsDIDO BaselinesDIDO Baseline comparison resultsNodesNode SetsDeployment TargetsOperational ResourcesEvidenceProvenanceTraceability

Verification

Verification confirms that:

The selected Candidate Solutions are identifiedAt least two Candidate Solutions participate in the comparative evaluationThe Acceptance Criteria identify the characteristics subject to evaluationThe Acceptance Criteria identify the common evaluation basisThe Acceptance Criteria identify the applicable Test DefinitionsThe Acceptance Criteria identify the applicable Test EnvironmentsThe Acceptance Criteria identify the applicable Test Argument ValuesThe Acceptance Criteria identify the applicable Starting ConditionsThe Acceptance Criteria identify the applicable Timing ConditionsThe Acceptance Criteria identify the permitted Execution PathsThe Acceptance Criteria identify the applicable ConfigurationsThe Acceptance Criteria identify the characteristics held constant among Candidate Solution evaluationsThe Acceptance Criteria identify the characteristics permitted to vary among Candidate Solution evaluationsThe Acceptance Criteria establish the comparison method for each evaluated characteristicThe Acceptance Criteria establish the applicable measurement conditionsThe Acceptance Criteria establish the applicable measurement unitsThe Acceptance Criteria establish the required measurement precisionThe Acceptance Criteria establish the permitted tolerancesThe Acceptance Criteria establish the permitted exclusionsThe Acceptance Criteria establish the rules for normalizing measurementsThe Acceptance Criteria establish the rules for combining evaluation characteristicsThe Acceptance Criteria establish the treatment of missing, invalid, incompatible, and unavailable informationThe Acceptance Criteria establish the treatment of nondeterministic behaviorThe Acceptance Criteria establish the treatment of Incomplete Test Runs for each applicable Test Run Termination ReasonThe Acceptance Criteria establish the permitted comparative-evaluation outcomesDIDO-TE associates each selected Candidate Solution with its applicable Test Runs and Test ResultsDIDO-TE evaluates each selected Candidate Solution using the common evaluation basisDIDO-TE applies the comparison method established for each evaluated characteristicDIDO-TE normalizes measurements according to the Acceptance CriteriaDIDO-TE compares the evaluation outcomes of the selected Candidate SolutionsDIDO-TE identifies the relative difference for each evaluated characteristicDIDO-TE identifies each comparative outcome supported by the available Test ResultsDIDO-TE identifies each characteristic for which the available information is insufficientDIDO-TE records the comparative evaluationThe verification record preserves Traceability among the Acceptance Criteria, selected Candidate Solutions, common evaluation basis, Test Definitions, Test Environments, Test Runs, Test Results, evaluated characteristics, measurement normalization, comparison methods, comparative outcomes, and supporting Evidence

Referenced By

The following pages reference this requirement:

Delivery Phase

Implementation Status

Requirement Status

Issues

The following unresolved issues affect this requirement:

Notes for Editors

This requirement page should retain the stable requirement identifier MO-005.

This page is a leaf requirement page and omits a trailing :start from its namespace.

MO-005 consolidates mission-level intent from multiple source statements. MO-005 does not result from splitting a single parent requirement and therefore uses a Source section rather than a Derived From section.

Changes to the Statement should preserve:

as the responsible ActorAt least two selected Candidate Solutions as the subjects of the comparative evaluationThe comparative evaluation as the required outcomeThe Acceptance Criteria as the source of the evaluation basis and comparison rulesThe Acceptance Criteria should identify:

The selected Candidate SolutionsThe characteristics subject to evaluationThe common evaluation basisThe applicable Test DefinitionsThe applicable Test EnvironmentsThe applicable Test Argument ValuesThe applicable Starting ConditionsThe applicable Timing ConditionsThe permitted Execution PathsThe applicable ConfigurationsThe characteristics held constantThe characteristics permitted to varyThe comparison methodsThe measurement conditionsThe measurement unitsThe required measurement precisionThe permitted tolerancesThe permitted exclusionsThe measurement-normalization rulesThe rules for combining evaluation characteristicsThe treatment of missing, invalid, incompatible, or unavailable informationThe treatment of nondeterministic behaviorThe treatment of Incomplete Test RunsThe permitted comparative-evaluation outcomesThe required EvidenceThe required ProvenanceThe required TraceabilityMO-005 does not require a DIDO Baseline comparison unless the Acceptance Criteria establish that requirement.

MO-005 does not authorize DIDO-TE to recommend, select, approve, acquire, or deploy a Candidate Solution unless a separate Requirement and the applicable Authority establish that obligation.

Material changes should receive review and should update the verification criteria, source records, supporting requirements, and Issues section.

To reference this requirement Statement from another Wiki page, insert:

{{section>dido:03-dido-te:99-annexes:annex-c-requirements:01-mission-objectives:mo-005#Statement&noheader&nofooter&noeditbtn}}

Do not rename this page after an external citation unless a redirect or move plan is in place.

© 2026 Dido Solutions, Inc. and Jackrabbit Consulting, Inc.