Test Item

Go up to Terms and Definitions

A Test Item is a Test Object that identifies an entity within the scope of a Test.

A Test Item can identify:

• The complete System Under Test
• A component of the System Under Test
• A Distributed System
• A Node
• A Node Set
• A service
• An interface
• A Communication Endpoint
• A Data Object
• An Immutable Data Object
• A Distributed Immutable Data Object (DIDO)
• A configuration
• A communication path
• A supporting test component
• An external system
• Another entity relevant to the Test

A Test Item identifies what participates in or affects the Test. The applicable Test Definition determines whether the Test Item constitutes the subject being evaluated, a supporting participant, a test instrument, or another relevant entity.

A Test Item can contain or reference other Test Items. This permits a Test Item to represent a composite entity such as a Distributed System, Node Set, application, subsystem, or multi-component service.

A Test Item can identify:

• Its identity
• Its type
• Its version
• Its configuration
• Its role in the Test
• Its relationship to other Test Items
• Its relationship to the System Under Test
• Its applicable constraints
• Its applicable Governance Policies
• Its Provenance
• Its Traceability

A Test Item can participate in a Test Environment associated with a Sequenced Test Object.

The Sequenced Test Object can identify the Test Items relevant to a:

• Test Set
• Test Case
• Test Step
• Test Executable

A Test Run records the execution context associated with the Test Items used during Test Execution.

A Test Result can reference the Test Item whose behavior, state, value, or outcome contributed to the recorded result.

Test Object that identifies an entity within the scope of a Test

Adapted from:

• OMG Test Information Interchange Format (TestIF), Version 1.0 Beta 3, Section 7.3.8, TestItem
• Test Object
• Test Environment
• Distributed Immutable Data Object Test Environment (DIDO-TE)
• DIDO Reference Implementation Conceptual Model
• DIDO-TE draft Requirements Register

OMG TestIF defines TestItem as an entity within the scope of a Test and permits Test Items to describe the System Under Test and related objects. This definition preserves that scope while distinguishing a Test Item from the Test Objects that specify execution or record results.

A Test Item is not necessarily the System Under Test.

The System Under Test is the Test Item, or collection of Test Items, whose behavior, properties, state, or outcomes the Test evaluates.

Supporting Test Items can include:

• Test drivers
• Test harnesses
• Simulators
• Emulators
• Monitoring components
• External services
• Data sources
• Time sources
• Communication components
• Evidence-collection components

A Test Item differs from a Test Environment:

• A Test Item identifies an entity within the scope of the Test
• A Test Environment identifies the configured combination of Test Items, resources, conditions, and controls within which the Test is executed

A Test Item differs from a Sequenced Test Object:

• A Test Item identifies an entity within the scope of the Test
• A Sequenced Test Object identifies test information that can participate in a Test Sequence

A Test Item differs from a Test Set:

• A Test Item identifies an entity within the scope of the Test
• A Test Set groups Test Sets, Test Cases, and related Test Objects for a defined testing purpose

A Test Item differs from a Test Case:

• A Test Item identifies an entity within the scope of the Test
• A Test Case identifies the steps and Expected Results used to verify something

A Test Item differs from a Test Step:

• A Test Item identifies an entity within the scope of the Test
• A Test Step identifies an action or validation performed as part of a Test Sequence

A Test Item differs from a Test Executable:

• A Test Item identifies an entity within the scope of the Test
• A Test Executable identifies low-level procedural or executable information used for automated Test Execution

A Test Item differs from a Test Result:

• A Test Item identifies an entity participating in or relevant to the Test
• A Test Result records an outcome produced during Test Execution

A Test Item differs from a Test Run:

• A Test Item identifies an entity participating in or relevant to the Test
• A Test Run records an identified Test Execution, its execution context, and its Test Results

The same entity can participate as a Test Item in multiple Tests. Each Test Definition identifies the role and applicable configuration of the Test Item for that Test.

A DIDO-TE Test evaluates a changed DIDO Node within a five-Node Distributed System.

The Test Items include:

• The changed Node as part of the System Under Test
• Four validated reference Nodes as other parts of the System Under Test
• The DIDO whose state transitions the Test evaluates
• A transaction generator as a supporting Test Item
• A network-condition controller as a supporting Test Item
• An Evidence collector as a supporting Test Item

The Test Definition identifies each Test Item and its role.

The applicable Test Case, Test Sequence, Test Steps, and Expected Results specify how DIDO-TE evaluates the Test Items.

The resulting Test Run and Test Results preserve the Test Item identities, versions, configurations, and roles applicable to the execution.