Process
Areas
(staged)

Level 2
 RM
 ARD
 PP
 PMC
 AM
 SSAD
 MA
 PPQA
 CM
Level 3
 ATM
 AVER
 AVAL
 OPF
 OPD
 OT
 IPM
 RSKM
 DAR
Level 4
 OPP
 QPM
Level 5
 OID
 CAR

 SP 1.4 Specify Analysis Procedures
Process AreaMA
Level2
GoalSG 1
PracticeSP 1.4

Specify how measurement data are analyzed and communicated.

Specifying analysis procedures in advance ensures that appropriate analyses will be conducted and reported to address documented measurement objectives (and thereby the information needs and objectives on which they are based). This approach also provides a check that necessary data will, in fact, be collected.

The supplier agreement defines the required data analysis and the definition and examples of measures the supplier must provide to the acquirer.

Typical Work Products

1.    Analysis specifications and procedures

2.    Data analysis tools

Typical Supplier Deliverables

1.    Recommendations for analysis specification and procedures

Subpractices

1.    Specify and prioritize the analyses to be conducted and the reports to be prepared.

Early on, pay attention to the analyses to be conducted and to the manner in which results will be reported. These should meet the following criteria:

·       The analyses explicitly address the documented measurement objectives.

·       Presentation of results is clearly understandable by the audiences to whom the results are addressed.

Priorities may have to be set within available resources.

Establish and maintain a description of the analysis approach for data elements, a description of reports that must be provided by the supplier; and a reference to analysis specifications and procedures in the supplier agreement.

2.    Select appropriate data analysis methods and tools.

Refer to the Select Measures and Analytic Techniques specific practice and Apply Statistical Methods to Understand Variation specific practice of the Quantitative Project Management process area for more information about the appropriate use of statistical analysis techniques and understanding variation.

Descriptive statistics are typically used in data analysis to do the following:

·       Examine distributions on specified measures (e.g., central tendency, extent of variation, or data points exhibiting unusual variation)

·       Examine interrelationships among specified measures (e.g., comparisons of defects by phase of the product’s lifecycle or by product component)

·       Display changes over time

 

3.    Specify administrative procedures for analyzing data and communicating results.

Data collected from a supplier are subject to validity checks that can be achieved by periodic audits of the supplier’s execution of data collection and analysis procedures for acquirer-required measures. The acquirer’s option to perform validity checks of measurement data collected by the supplier and the supplier’s execution of required analysis procedures must be defined in the supplier agreement.

4.    Review and update the proposed content and format of specified analyses and reports.

All of the proposed content and format are subject to review and revision, including analytic methods and tools, administrative procedures, and priorities. Relevant stakeholders consulted should include end users, sponsors, data analysts, and data providers.

Review specified analyses and reports with suppliers and identify their commitment to support the analysis, and review recommendations they may provide related to the analysis of measurement data.

5.    Update measures and measurement objectives as necessary.

Just as measurement needs drive data analysis, clarification of analysis criteria can affect measurement. Specifications for some measures may be refined further based on specifications established for data analysis procedures. Other measures may prove unnecessary, or a need for additional measures may be recognized.

Specifying how measures will be analyzed and reported may also suggest the need for refining measurement objectives themselves.

6.    Specify criteria for evaluating the utility of analysis results and for evaluating the conduct of measurement and analysis activities.

Criteria for evaluating the utility of the analysis might address the extent to which the following apply:

·       The results are (1) provided in a timely manner, (2) understandable, and (3) used for decision making.

·       The work does not cost more to perform than is justified by the benefits it provides.

 

Criteria for evaluating the conduct of the measurement and analysis might include the extent to which the following apply:

·       The amount of missing data or the number of flagged inconsistencies is beyond specified thresholds.

·       There is selection bias in sampling (e.g., only satisfied end users are surveyed to evaluate end-user satisfaction, or only unsuccessful projects are evaluated to determine overall productivity).

·       Measurement data are repeatable (e.g., statistically reliable).

·       Statistical assumptions have been satisfied (e.g., about the distribution of data or about appropriate measurement scales).

Table  | Images  | Glossary  | Index  | Faceted index


Process
Areas(continuous)

Process
management  
 OPF
 OPD
 OT  
 OPP 
 OID
Project
management
 PP
 PMC
 IPM
 QPM
 RSKM
 REQM
Acquisition
 AM
 SSAD 
 ARD
 ATM
 AVER
 AVAL
Support
 CM
 PPQA
 MA
 DAR
 CAR