MO-002a — Reproducible Test Environments [Dido Solutions, Inc Wiki]

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
====== MO-002a — Reproducible Test Environments ======

[[dido:03-dido-te:99-annexes:annex-c-requirements:01-mission-objectives:mo-002:start|Go to MO-002 — Reproducible Test Environments and Test Execution]]

===== Statement =====

[[dido:99_annexes:annex-b-terms-and-definitions:d:dido-te|DIDO-TE]] SHALL recreate a selected [[dido:99_annexes:annex-b-terms-and-definitions:t:test_environment|Test Environment]] within the permitted variation established by the [[dido:99_annexes:annex-b-terms-and-definitions:a:acceptance_criteria|Acceptance Criteria]].

===== Derived From =====

This requirement derives from:

  * [[dido:03-dido-te:99-annexes:annex-c-requirements:01-mission-objectives:mo-002:start|MO-002 — Reproducible Test Environments and Test Execution]]

MO-002 combines two independently verifiable outcomes:

  * Reproduction of a selected Test Environment
  * Repetition of selected [[dido:99_annexes:annex-b-terms-and-definitions:t:test_execution|Test Execution]]

MO-002a preserves the portion of the source mission-level intent concerning [[dido:99_annexes:annex-b-terms-and-definitions:r:reproducibility|Reproducible]] Test Environments.

The separate requirement derived from MO-002 addresses:

  * [[dido:03-dido-te:99-annexes:annex-c-requirements:01-mission-objectives:mo-002:mo-002b|MO-002b — Reproducible Test Execution]]

The Broad Agency Announcement material identifies mission-level intent concerning:

  * Realistic and controllable Test Environments
  * Deterministic Test Environment states
  * Reusable Node configurations
  * Reusable Node Sets
  * Repeatable testing scenarios
  * Consistent testing across different environments

The Broad Agency Announcement material states:

> //Create repeatable testing scenarios, including regression testing, that allow rigorous evaluation of distributed systems under different conditions and configurations.//

The Original Requirement identifiers in the draft DIDO-TE Requirements Register require confirmation before inclusion on this derived requirement page.

===== Rationale =====

[[dido:99_annexes:annex-b-terms-and-definitions:r:reproducibility|Reproducibility]] requires DIDO-TE to preserve sufficient information to recreate a selected Test Environment and determine whether the recreated Test Environment remains within permitted variation.

The selected Test Environment provides the source against which DIDO-TE evaluates the recreated Test Environment.

The [[dido:99_annexes:annex-b-terms-and-definitions:a:acceptance_criteria|Acceptance Criteria]] identify:

  * The selected Test Environment
  * The Test Environment [[dido:99_annexes:annex-b-terms-and-definitions:v:version|Version]]
  * The applicable [[dido:99_annexes:annex-b-terms-and-definitions:b:baseline|Baseline]]
  * The characteristics subject to reproduction
  * The characteristics requiring exact equivalence
  * The characteristics permitting variation
  * The permitted variation
  * The comparison method
  * The required [[dido:99_annexes:annex-b-terms-and-definitions:e:evidence|Evidence]]
  * The treatment of unavailable or substituted [[dido:99_annexes:annex-b-terms-and-definitions:r:resource|Resources]]
  * The treatment of failed, incomplete, or interrupted recreation attempts

Characteristics subject to reproduction can include:

  * [[dido:99_annexes:annex-b-terms-and-definitions:c:configuration|Configuration]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:r:resource|Resources]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:o:operational_resource|Operational Resources]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:n:node|Nodes]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:n:node_set|Node Sets]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:d:deployment_target|Deployment Targets]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:e:execution_facility|Execution Facilities]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:e:executable_artifact|Executable Artifacts]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:d:dependency|Dependencies]]
  * Network configuration
  * Storage configuration
  * Security configuration
  * Applicable [[dido:99_annexes:annex-b-terms-and-definitions:s:starting_condition|Starting Conditions]]
  * Applicable [[dido:99_annexes:annex-b-terms-and-definitions:g:governance_policy|Governance Policies]]

Reproducibility does not necessarily require physical identity or exact equality for every characteristic.

For example:

  * A recreated Test Environment can use a different physical machine when the Acceptance Criteria require equivalent processing capability
  * A recreated Test Environment can use a different network location when the Acceptance Criteria require the same defined network behavior
  * A recreated Test Environment can use a replacement Resource when the Acceptance Criteria permit substitution and define the required equivalence
  * A recreated Test Environment can receive a new identity while preserving Traceability to the selected Test Environment

The Acceptance Criteria determine whether a difference is:

  * Permitted variation
  * An acceptable substitution
  * An unresolved discrepancy
  * A failure to reproduce the selected Test Environment

MO-002a addresses reproduction of the Test Environment. MO-002b separately addresses whether repeated Test Execution produces Test Results within permitted variation.

===== Applies To =====

This requirement applies to:

  * [[dido:99_annexes:annex-b-terms-and-definitions:d:dido-te|DIDO-TE]]
  * Selected [[dido:99_annexes:annex-b-terms-and-definitions:t:test_environment|Test Environments]]
  * Recreated Test Environments
  * Test Environment identities
  * Test Environment [[dido:99_annexes:annex-b-terms-and-definitions:v:version|Versions]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:b:baseline|Baselines]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:c:configuration|Configurations]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:r:resource|Resources]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:o:operational_resource|Operational Resources]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:n:node|Nodes]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:n:node_set|Node Sets]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:d:deployment_target|Deployment Targets]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:e:execution_facility|Execution Facilities]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:e:executable_artifact|Executable Artifacts]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:d:dependency|Dependencies]]
  * Network configurations
  * Storage configurations
  * Security configurations
  * [[dido:99_annexes:annex-b-terms-and-definitions:s:starting_condition|Starting Conditions]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:g:governance_policy|Governance Policies]]
  * Permitted variations
  * Substituted Resources
  * [[dido:99_annexes:annex-b-terms-and-definitions:a:acceptance_criteria|Acceptance Criteria]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:e:evidence|Evidence]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:p:provenance|Provenance]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:t:traceability|Traceability]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:c:connected_environment|Connected Environments]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:d:disconnected_environment|Disconnected Environments]]
  * [[dido:99_annexes:annex-b-terms-and-definitions:a:air-gapped_environment|Air-Gapped Environments]]

===== Verification =====

Verification confirms that:

  - The selected Test Environment is identified
  - The selected Test Environment Version is identified
  - The applicable Baseline is identified
  - The Acceptance Criteria identify the Test Environment characteristics subject to reproduction
  - The Acceptance Criteria identify the characteristics requiring exact equivalence
  - The Acceptance Criteria identify the characteristics permitting variation
  - The Acceptance Criteria define the permitted variation
  - The Acceptance Criteria define the comparison method
  - DIDO-TE preserves the information required to recreate the selected Test Environment
  - DIDO-TE recreates the selected Test Environment
  - The recreated Test Environment receives an identifiable relationship to the selected Test Environment
  - The recreated Test Environment identifies its Configuration
  - The recreated Test Environment identifies its Resources and Operational Resources
  - The recreated Test Environment identifies its Nodes and Node Sets
  - The recreated Test Environment identifies its Deployment Targets
  - The recreated Test Environment identifies its Execution Facilities
  - The recreated Test Environment identifies its Executable Artifacts and their Versions
  - The recreated Test Environment identifies its Dependencies and their Versions
  - The recreated Test Environment identifies its applicable Starting Conditions
  - The recreated Test Environment identifies its applicable Governance Policies
  - DIDO-TE compares the recreated Test Environment with the selected Test Environment
  - Characteristics requiring exact equivalence satisfy that requirement
  - Characteristics permitting variation remain within the permitted variation
  - Substituted Resources satisfy the equivalence conditions established by the Acceptance Criteria
  - DIDO-TE records discrepancies between the selected and recreated Test Environments
  - DIDO-TE treats failed, incomplete, and interrupted recreation attempts according to the Acceptance Criteria
  - DIDO-TE preserves the Evidence required to evaluate Reproducibility
  - The verification record preserves Traceability among the selected Test Environment, recreated Test Environment, applicable Versions, Baseline, Configurations, Resources, Nodes, Node Sets, Deployment Targets, Execution Facilities, Executable Artifacts, Dependencies, Starting Conditions, Acceptance Criteria, Evidence, and verification result

===== Referenced By =====

The following pages reference this requirement:

{{backlinks>.#dido:03-dido-te}}

===== Delivery Phase =====

<todo>TBD</todo>

===== Implementation Status =====

<todo>Assess the current DIDO-TE implementation against the Test Environment Reproducibility conditions established by the Acceptance Criteria.</todo>

===== Requirement Status =====

<todo>Review and approve MO-002a as a proposed derived requirement created from the decomposition of MO-002.</todo>

----

===== Issues =====

The following unresolved issues affect this requirement:

<todo>Confirm the Original Requirement identifiers in the draft DIDO-TE Requirements Register that provide the source for MO-002a.</todo>

<todo>Define the Test Environment characteristics subject to reproduction.</todo>

<todo>Define which Test Environment characteristics require exact equivalence.</todo>

<todo>Define which Test Environment characteristics permit variation.</todo>

<todo>Define the permitted variation for each applicable Test Environment characteristic.</todo>

<todo>Define the method used to compare the selected and recreated Test Environments.</todo>

<todo>Define the equivalence criteria for substituted Resources.</todo>

<todo>Define the treatment of unavailable Resources and Dependencies.</todo>

<todo>Define the treatment of failed, incomplete, and interrupted Test Environment recreation attempts.</todo>

<todo>Define the Evidence required to demonstrate Test Environment Reproducibility.</todo>

<todo>Define the Test Environment Reproducibility requirements for Connected, Disconnected, and Air-Gapped Environments.</todo>

----

===== Notes for Editors =====

This requirement page retains the stable requirement identifier ''MO-002a''.

This page is a leaf requirement page and omits a trailing '':start'' from its namespace.

The parent MO-002 page is a non-leaf page and retains a trailing '':start'' in its namespace.

Changes to the Statement preserve:

  * [[dido:99_annexes:annex-b-terms-and-definitions:d:dido-te|DIDO-TE]] as the responsible Actor
  * The selected [[dido:99_annexes:annex-b-terms-and-definitions:t:test_environment|Test Environment]] as the source subject
  * Recreation of the selected Test Environment as the required outcome
  * Permitted variation as the applicable Reproducibility boundary
  * The [[dido:99_annexes:annex-b-terms-and-definitions:a:acceptance_criteria|Acceptance Criteria]] as the source of the permitted variation

The Acceptance Criteria identify:

  * The selected Test Environment
  * The selected Test Environment Version
  * The applicable Baseline
  * The characteristics subject to reproduction
  * The characteristics requiring exact equivalence
  * The characteristics permitting variation
  * The permitted variation
  * The comparison method
  * The permitted Resource substitutions
  * The treatment of unavailable Resources and Dependencies
  * The treatment of failed, incomplete, and interrupted recreation attempts
  * The required Evidence

Material changes receive review and update the verification criteria, source records, parent requirement, sibling requirement, and Issues section.

To reference this requirement Statement from another Wiki page, insert:

<code dokuwiki>
{{section>dido:03-dido-te:99-annexes:annex-c-requirements:01-mission-objectives:mo-002:mo-002a#Statement&noheader&nofooter&noeditbtn}}
</code>

Do not rename this page after an external citation unless a redirect or move plan is in place.

----

<WRAP centeralign>
© 2026 Dido Solutions, Inc. and Jackrabbit Consulting, Inc.
</WRAP>