Process
Areas
(staged)

Level 2
 RM
 ARD
 PP
 PMC
 AM
 SSAD
 MA
 PPQA
 CM
Level 3
 ATM
 AVER
 AVAL
 OPF
 OPD
 OT
 IPM
 RSKM
 DAR
Level 4
 OPP
 QPM
Level 5
 OID
 CAR

 SP 2.2 Apply Statistical Methods to Understand Variation
Process AreaQPM
Level4
GoalSG 2
PracticeSP 2.2

Establish and maintain an understanding of the variation of selected subprocesses using selected measures and analytic techniques.

Refer to the Measurement and Analysis process area for more information about collecting, analyzing, and using measurement results.

Understanding variation is achieved, in part, by collecting and analyzing process and product measures so that special causes of variation can be identified and addressed to achieve predictable performance.

A special cause of process variation is characterized by an unexpected change in process performance. Special causes are also known as assignable causes because they can be identified, analyzed, and addressed to prevent recurrence.

The identification of special causes of variation is based on departures from the system of common causes of variation. These departures can be identified by the presence of extreme values or other identifiable patterns in data collected from the subprocess or associated work products. Typically, knowledge of variation and insight about potential sources of anomalous patterns are needed to detect special causes of variation.

Sources of anomalous patterns of variation may include the following:

·         Lack of process compliance

·         Undistinguished influences of multiple underlying subprocesses on the data

·         Ordering or timing of activities within the subprocess

·         Uncontrolled inputs to the subprocess

·         Environmental changes during subprocess execution

·         Schedule pressure

·         Inappropriate sampling or grouping of data

 

Typical Work Products

1.    Collected measurements

2.    Natural bounds of process performance for each measured attribute of each selected subprocess

3.    Process performance compared to the natural bounds of process performance for each measured attribute of each selected subprocess

Typical Supplier Deliverables

1.    Collected supplier measurements

2.    Natural bounds of supplier process performance for each measured attribute of each selected subprocess

3.    Supplier process performance compared to the natural bounds of process performance for each measured attribute of each selected subprocess

Subpractices

1.    Establish trial natural bounds for subprocesses having suitable historical performance data.

Refer to the Organizational Process Performance process area for more information about organizational process-performance baselines.

Natural bounds of an attribute are the range within which variation normally occurs. All processes show some variation in process and product measures each time they are executed. The issue is whether this variation is due to common causes of variation in the normal performance of the process or to some special cause that can and should be identified and removed.

When a subprocess is initially executed, suitable data for establishing trial natural bounds are sometimes available from prior instances of the subprocess or comparable subprocesses, process-performance baselines, or process-performance models. Typically, these data are contained in the organization’s measurement repository. As the subprocess is executed, data specific to that instance are collected and used to update and replace the trial natural bounds. However, if the subprocess has been materially tailored, or if conditions are materially different from those in previous instantiations, data in the repository may not be relevant and should not be used.

In some cases, there may be no comparable historical data (e.g., when introducing a new subprocess, when entering a new application domain, or when significant changes have been made to the subprocess). In such cases, trial natural bounds will have to be made from early process data of this subprocess. These trial natural bounds must then be refined and updated as subprocess execution continues.

 

Examples of criteria for determining whether data are comparable include the following:

·       Product lines

·       Application domain

·       Work product and task attributes (e.g., size of product)

·       Size of project

 

2.    Collect data, as defined by selected measures, on subprocesses as they execute.

3.    Calculate the natural bounds of process performance for each measured attribute.

Examples of statistical techniques for calculating natural bounds include the following:

·       Control charts

·       Confidence intervals (for parameters of distributions)

·       Prediction intervals (for future outcomes)

 

4.    Identify special causes of variation.

An example of a criterion for detecting a special cause of process variation in a control chart is a data point that falls outside 3-sigma control limits.

 

The criteria for detecting special causes of variation are based on statistical theory and experience and depend on economic justification. As criteria are added, special causes are more likely to be identified if they are present, but the likelihood of false alarms also increases.

5.    Analyze special cause of process variation to determine the reasons the anomaly occurred.

Examples of techniques for analyzing the reasons for special causes of variation include the following:

·       Cause-and-effect (fishbone) diagrams

·       Designed experiments

·       Control charts (applied to subprocess inputs or lower level subprocesses)

·       Subgrouping (Analyzing the same data segregated into smaller groups based on an understanding of how the subprocess was implemented facilitates isolation of special causes.)

 

Some anomalies may simply be extremes of the underlying distribution rather than problems. Those implementing a subprocess are usually the ones best able to analyze and understand special causes of variation.

6.    Determine the corrective action to be taken when special causes of variation are identified.

Removing a special cause of process variation does not change the underlying subprocess. It addresses an error in the way the subprocess is executed.

Refer to the Project Monitoring and Control process area for more information about taking corrective action.

7.    Recalculate natural bounds for each measured attribute of the selected subprocesses as necessary.

Recalculating the (statistically estimated) natural bounds is based on measured values that signify that the subprocess has changed, not on expectations or arbitrary decisions.

 

Examples of when natural bounds may need to be recalculated include the following:

·       There are incremental improvements to the subprocess

·       New tools are deployed for the subprocess

·       A new subprocess is deployed

·       The collected measures suggest that the subprocess mean has permanently shifted or subprocess variation has permanently changed

Table  | Images  | Glossary  | Index  | Faceted index


Process
Areas(continuous)

Process
management  
 OPF
 OPD
 OT  
 OPP 
 OID
Project
management
 PP
 PMC
 IPM
 QPM
 RSKM
 REQM
Acquisition
 AM
 SSAD 
 ARD
 ATM
 AVER
 AVAL
Support
 CM
 PPQA
 MA
 DAR
 CAR