Operational Testing

Definition

Operational testing is the usage testing of the launched application in its production environment(s) to determine if it meets the true needs of its stakeholders (primarily its users).

Goals

The typical goals of functional testing are to:

• Determine if the launched and accepted application meets the true needs of its stakeholders (primarily its users)

Objectives

The typical objectives of operational testing are to:

• Cause failures concerning all requirements that help identify defects that are not efficiently found during other types of testing.
• Report these failures to the development teams so that the associated defects can be fixed.
• Help determine the extent to which the system is truely ready for operation.
• Provide input to the defect trend analysis effort.

Examples

Typical examples include operational testing of an application include:

• Shake-down cruise for a new ship

Preconditions

Operational test execution can typically begin when the following preconditions hold:

• The application has passed acceptance testing.
• The application is in its production environments.
• The application is in use by its users.

Completion Criteria

Operational testing is typically complete when the following postconditions hold:

• The application has been retired.

Tasks

Operational testing typically involves the independent test team performing the following testing tasks:

• Test Planning
• Test Reuse
• Test Design:
• Test Implementation
• Test Execution:
• Test Reporting

Environments

Operational testing is typically performed on the following environments using the following tools:

• Production Environments.

Work Products

Operational testing typically results in the production of all or part of the following work products from the test work product set:

• Documents:
  • System Requirements Specification (operational requirements)
  • Project Test Plan
  • Master Test List
  • Test Procedures
  • Test Report
  • Test Summary Report
• Software and Data:
  • Test Harness
  • Test Scripts
  • Test Suites
  • Test Cases
  • Test Data

Phases

Operational testing typically consists of the following tasks being performed during the following phases:

Guidelines

• TBD