Test Resource

Go up to Terms and Definitions

A Test Resource supports the preparation, execution, evaluation, or reporting of testing.

Test Resources include physical and digital assets such as:

• Test Definitions
• Test Inputs
• Test datasets
• Test scripts and procedures
• Expected results and evaluation criteria
• Configuration and deployment artifacts
• Software tools, simulators, emulators, and instrumentation
• Machine Images and container images
• Templates and reference implementations
• Hardware used for testing

A Test Resource differs from a Candidate Solution. The Candidate Solution constitutes the subject of evaluation. A Test Resource supports the activities that evaluate the Candidate Solution.

A Test Resource also differs from a Test Environment. A Test Environment comprises the conditions, infrastructure, software, equipment, and supporting elements assembled for a Test Execution. A Test Resource represents an individual asset used within or in association with that environment.

A Test Resource does not inherently qualify as reusable. DIDO-TE designates a Test Resource as reusable after identifying its purpose, supported uses, version, dependencies, applicable constraints, and conditions of use.

physical or digital asset used to prepare, execute, evaluate, or report testing

Adapted from the testing and testware concepts defined by:

• ISO/IEC/IEEE 29119-1:2022, Software and systems engineering — Software testing — Part 1: General concepts
• ISTQB Glossary, “testware”
• ISTQB Glossary, “test environment”

The term Test Resource has a broader scope than testware. Testware consists of work products produced during the test process. Test Resources also include acquired assets, physical equipment, infrastructure components, tools, simulators, reference materials, and other assets that support testing.

An asset produced during testing, including an Observation, Test Outcome, Test Result, or Evidence item, becomes a Test Resource when DIDO-TE designates and manages that asset for use in subsequent testing.

A Test Resource description identifies or references:

• A persistent identifier
• Purpose
• Resource type
• Version
• Supported uses
• Applicable constraints
• Dependencies
• Compatibility conditions
• Provenance
• Integrity information
• Maintenance status

DIDO-TE maintains a test script, a signed Transfer Bundle containing known integrity defects, and the associated expected results. These assets constitute Test Resources because they support the execution and evaluation of integrity-validation tests against Candidate Solutions.

DIDO-TE designates the resources as reusable after recording their versions, dependencies, supported uses, applicable Test Environments, and integrity information.