Test Definition

Go up to Terms and Definitions

A Test Definition is a governed specification of the test content, conditions, inputs, expected outcomes, and evaluation information required to conduct and evaluate a test.

A Test Definition can contain or reference:

• The test purpose
• The subject to be tested
• Applicable Test Objects
• Applicable Test Items
• Applicable Test Sets
• Applicable Test Cases
• Applicable Test Steps
• Applicable Test Executables
• Applicable Test Sequences
• Applicable Test Arguments
• Applicable Test Environment requirements
• Applicable preconditions
• Applicable Expected Results
• Applicable evaluation criteria
• Applicable Validation Criteria
• Applicable Acceptance Criteria
• Required Evidence
• Completion conditions
• Failure conditions
• Termination conditions

A Test Definition can identify:

• Its identity
• Its name
• Its description
• Its Version
• Its status
• Its owner
• Its author
• Its approving authority
• Its applicable scope
• Its applicable Baseline
• Its applicable dependencies
• Its applicable Policies
• Its applicable Governance Policies
• Its Provenance
• Its Traceability

A Test Definition provides the governed information from which one or more Test Runs can be created.

governed specification of the test content, conditions, inputs, expected outcomes, and evaluation information required to conduct and evaluate a test

Adapted from:

• OMG Test Information Interchange Format (TestIF), Version 1.0 Beta 3
• Test Object
• Test Environment
• Expected Result
• DIDO Reference Implementation Conceptual Model
• DIDO-TE draft Requirements Register

OMG TestIF defines the Test Objects, sequences, arguments, expected-result information, and related structures needed to represent and exchange test information.

OMG TestIF does not define Test Definition as a separate TestIF model element. This definition introduces Test Definition as the governed aggregation of information required to conduct and evaluate a test.

Use the singular glossary term Test Definition. Link plural usage to the same controlling page:

[[dido:99_annexes:annex-b-terms-and-definitions:t:test_definition|Test Definitions]]

A Test Definition differs from a Test Object:

• A Test Object represents an identifiable item of test information
• A Test Definition aggregates or references the Test Objects and other information required to conduct and evaluate a test

A Test Definition differs from a Test Case:

• A Test Case defines the steps necessary to verify something
• A Test Definition provides the broader governed specification required to conduct and evaluate the test

A Test Definition differs from a Test Run:

• A Test Definition specifies what is to be performed and evaluated
• A Test Run records a particular occurrence of Test Execution

Multiple Test Runs can use the same Test Definition. Each Test Run must identify the exact Test Definition Version used.

A Test Definition differs from a Test Environment:

• A Test Definition specifies the test content and required testing conditions
• A Test Environment identifies the actual or planned conditions, configurations, dependencies, and resources used to conduct testing

A Test Definition can require a particular Test Environment or specify Test Environment constraints.

A Test Definition is not necessarily executable. Manual, automated, and combined testing can use Test Definitions.

A change to the test purpose, Test Objects, required conditions, inputs, Expected Results, evaluation criteria, or Evidence requirements can create a new Version of the Test Definition.

A Test Definition specifies how to evaluate whether a selected Node Set processes a proposed transaction consistently.

The Test Definition contains or references:

• The selected Test Items
• The applicable Test Case
• The applicable Test Steps
• The applicable Test Sequence
• The required Test Arguments
• The required Test Environment characteristics
• The Expected Results
• The Validation Criteria
• The required Evidence
• The completion and failure conditions

A Test Operator selects the approved Test Definition Version when initiating a Test Run.