Test

Go up to Terms and Definitions

A Test is the general testing concept used to evaluate one or more characteristics of a subject under defined conditions.

The term is intentionally broader than more specialized testing concepts such as Test Case, Test Set, Test Step, and Test Run.

A Test may be described, organized, or realized using one or more of those concepts, but it is not synonymous with any one of them.

The Test Information Interchange Format (TestIF) intentionally provides foundational testing concepts that can support differing organizational, tool, and standards-based interpretations of testing terminology. DIDO-TE follows that approach by defining Test broadly enough to support multiple testing structures without imposing a particular implementation or execution model.

A governed specification or activity used to evaluate one or more characteristics of a Test Object under defined conditions and to determine whether observed results satisfy applicable Expected Results, criteria, or requirements.

• Object Management Group, Test Information Interchange Format (TestIF) 1.0
• [DTE4] DIDO Reference Data Model
• DIDO-TE architectural normalization

A Test may include or reference:

• the subject or Test Object being evaluated
• applicable Requirements
• defined test conditions
• Expected Results
• Test Cases
• Test Sets
• Test Steps
• Test Executables
• the Test Environment
• Test Results
• supporting Evidence

The exact internal structure of a Test depends on the applicable testing model, profile, policy, or Test Definition.

A Test is distinct from a Test Run. A Test describes what is to be evaluated, while a Test Run represents a particular execution of applicable test information.

A Test may specify that a candidate Node implementation is evaluated for conformance with a governed protocol requirement under defined network conditions.

The Test may identify:

• the Node as the Test Object
• one or more Test Cases
• applicable Test Executables
• the required Test Environment
• Expected Results
• Validation Criteria

One or more Test Runs may subsequently execute that Test.