Operations Evaluation

Definition

Operations evaluation is the quality control task during which the operations work products are evaluated.

Objectives

The typical objectives of the operations evaluation task are to:

• Determine if the deliverable operations work products are:
  • Correct.
  • Complete.
  • Consistent (internally, externally with other work products, and externally with related conventions).
  • Understandable.
• Identify defects in the deliverable operations work products so that:
  • The defects can be fixed.
  • Defect trend analysis can be performed to improve the process and staff training.
• Determine if the operations tasks are:
  • Completed.
  • Effective.
  • Efficient.

Preconditions

The operations evaluation task can typically begin when the following preconditions hold:

• The operations inspection team is adequately:
  • Staffed.
  • Trained in the operations evaluation task.
  • Trained in its associated techniques (e.g., inspection).
• At least one operations engineering work product is ready for evaluation.

Completion Criteria

The operations evaluation task is typically complete when the following postconditions hold:

• The following operations work products have passed their evaluations (e.g., inspection):
  • Operations Manual
  • Operations Log

Steps

The operations evaluation task typically involves the following teams performing the following steps:

• The operations team informally evaluates their work products in accordance with the associated technique(s) used.
• The operations inspection team formally evaluates these operations work products in accordance with the associated technique(s) used.

Techniques

The operations evaluation task can typically be performed using the following techniques:

• Quality Evaluation Techniques:
  • Desk Checking
  • Demonstration
  • Inspecting
  • Walkthroughs

Work Products

The operations evaluation task typically results in the production of the following work products:

• Quality Set:
  • Inspection Report
  • Inspection Summary Report

Guidelines

• Inspecting tends to be the most effective quality evaluation technique for identifying defects.
• Evaluations can be incremental and are typically iterative.