Metrics: Software Development Performance Index (SDPI)

Software Development Performance Index (SDPI) for measuring Agile Teams performance.
The concept and principle is described in this whitepaper of "The impact of Agile Quantified" (from the Software Engineering Institute, the organization managing the CMMI model:

• https://www.ca.com/content/dam/ca/us/files/white-paper/the-impact-of-agile-quantified.pdf
• https://www.agilealliance.org/resources/sessions/the-impact-of-agile-quantified-a-de-mystery-thriller/

Get Ready for CMMI V2.0!

And CMMI V2.0 launches today... Eager to hear the news? Yes and no...

Preparation for Launch – Getting Ready for CMMI V2.0

TOOL: Statistical Analyis - Oracle Crystal Ball (Monte Carlo simulation)

Not free, but one very widely used tool for analyzing and improving Process Performance Models (PPM) using Monte Carlo simulations:

• Oracle Crystal Ball - license - 1 application user

Quoting:

"Oracle Crystal Ball is the leading spreadsheet-based application suite for predictive modeling, forecasting, simulation, and optimization. It gives you unparalleled insight into the critical factors affecting risk. With Crystal Ball, you can make the right tactical decisions to reach your objectives and gain a competitive edge under even the most uncertain market conditions.

Using Monte Carlo simulation, Oracle Crystal Ball automatically calculates and records the results of thousands of different "what if" cases. Analysis of these scenarios reveals to you the range of possible outcomes, their probability of occurring, the inputs that most impact your model, and where you should focus your efforts. Oracle Crystal Ball is for strategic planners, financial analysts, engineers, scientists, entrepreneurs, CPAs, marketing managers, venture capitalists, consultants, six sigma professionals, and anyone else who uses spreadsheets to forecast uncertain results."

About PPB and PPMs (Process Performance Baselines and Process Performance Models)

Important to process improvement frameworks (such as CMMI) and to most modern organizations is the ability to measure and detect deviations to common well known (official) process performance baselines (PPB).
Better yet is the capability of "predicting the future" i.e. the behavior of  the process, having as inputs some well known data, supported by the process performance model (PPM).

CMMI-DEV OPP Process Area is intimately related with these concepts (PPB and PPMs) and need them in place for the organizations and its software development process(es) to be be certified.

One example of a process performance model is the COCOMO model, which aims to estimate project cost having as inputs some of the project characteristics:
https://en.wikipedia.org/wiki/COCOMO

RESOURCE: CMMI online knowledge base

The one-stop online reference for the CMMI-DEV model (that will somehow dispense the use of the books on the subject as well as the "appraisal tool" descriptions which BTW for some Process Areas are outdated) is here:

• The CMMI-DEV model provides guidance for applying CMMI best practices in a development organization. Best practices in the model focus on activities for developing quality products and services to meet the needs of customers and end users: 
• http://cmmi.de/cmmi/cmmi-for-development-cmmi-dev-v13

PS. The main site is: https://www.wibas.com/cmmi (or http://cmmi.de)

CMMI Staged Representation (Maturity Levels)

The staged representation for CMMI-DEV introduces maturity levels (1-5):

Maturity Level 2 (ML2)

Requirements Management (RM)
Project Planning (PP)
Project Monitoring and Control (PMC)
Supplier Agreement Management (SAM)
Measurement and Analysis (MA)
Process and Product Quality Assurance (PPQA)
Configuration Management (CM)

Maturity Level 3 (ML3)

Organizational Process Focus (OPF)
Organizational Process Definition (OPD)
Organizational Training (OT)
Integrated Project Management (IPM)
Risk Management (RSKM)
Decision Analysis and Resolution (DAR)
Requirements Development (RD)
Technical Solution (TS)
Product Integration (PI) - how to integrate the system (and dependencies)
Verification (VER) - selected WP meet their specified requirements; build the SW right
Validation (VAL) - build the software right; in the right environment; criteria for validation

Maturity Level 4 (ML4)

Organizational Process Performance (OPP) - establish and maintain a quantitative understanding of the performance of selected processes in the organization’s set of standard processes in support of achieving quality and process performance objectives, and to provide process performance data, baselines, and models to quantitatively manage the organization’s projects
Quantitative Project Management (QPM) - quantitatively manage the project to achieve quality and process performance objectives; metrics infrastructures

Maturity Level 5 (ML5)

Organizational Performance Management (OPM) - manage the org. performance to meet its business obj.

Causal Analysis and Resolution (CAR) - identify causes of problems (more broadly: selected outcomes) and take action to improve performance

RESOURCE: CMMI Summary

I've just found a good attempt on making a summary of this complex topic, CMMI:

• PDF: http://www.tutorialspoint.com/cmmi/pdf/cmmi_quick_guide.pdf
• HTML: http://www.tutorialspoint.com/cmmi/cmmi_quick_guide.htm

CMMI appraisals and related trainings

To learn about the appraisals (SCAMPIs) you can see this resource. In order to participate on them you'll need training.

CMMI trainings include (been there, done some of those):

• Introduction to CMMI-DEV: http://cmmiinstitute.com/training/introduction-cmmi-development

Whether your business is developing high-tech systems, consumer software, or IT hardware, you want to ensure the highest quality product reaches your customer on time. This course will teach you how to use the CMMI for Development to improve the effectiveness, efficiency, and quality of product development work in your organization.

• High Maturity Practices training: http://cmmiinstitute.com/training/understanding-cmmi-high-maturity-practices

High Maturity organizations use statistical methods and quantitative data to understand risk and predict outcomes based on past performance.  As a result of high maturity practices, these organizations consistently perform beyond their competitors.

If your organization plans to be a high-performance organization that consistently uses quantitative data to manage processes, quantitatively understand risk and variation, this course is a must. 

If you want to participate in a SCAMPI-A appraisal you'll need this training: Standard CMMI Appraisal Method for Process Improvement (SCAMPI) Version 1.3 - Class A Team Training.

This course is only delivered by partners so no information is externally provided by CMMI Institute (they will be delivering it internally though).

If you want to be a Lead Appraiser you'll want to have this (with a 7,2K USD price tag):

• SCAMPI℠ Lead Appraiser Training (http://cmmiinstitute.com/training/scampi-lead-appraiser-training).

Organizations around the world work diligently to achieve performance excellence based on CMMI’s benchmark practices. CMMI Lead Appraisers use the Standard CMMI Appraisal Method for Process Improvement (SCAMPI) with thousands of organizations to confirm and publicize their accomplishments.  

Whether working inside an organization as a Team Leader or as an external Lead Appraiser, SCAMPI appraisers serve a vital role in maintaining the vitality of CMMI-based improvement. 

A full list of the CMMI Institute training courses can be found here. 

About CMMI-DEV (Concepts)

CMMI-DEV is divided into process areas (definitions below).

First things first:

• CMMI-DEV, V1.3 =  "CMMI® for Development, Version 1.3" = Improving processes for developing better products and services

Main concepts:

• Process Areas (PA): A cluster of related practices in an area that, when implemented collectively, satitsfies a set of goals considered important for making improvements in that area.
• PA Groups: Support, Project Management, Process Management, Engineering
• Specific Goals (SG): A required model component that describes the unique characteristics that must be present to satisfy a process area. 
• Capability Level: Achievement of process improvement within an individual process area; defined by appropriate SG and GG for a PA.
• Specific Practice (SP): An expected model component that is considered important in achieving a specific goal (SG); the specific practices (SPs) describe the activities expected to result in achievement of the SG of that area.
• Generic Goals (GG): A required model component that describes characteristics that must be present to institutionalize processes that implement a process area.
• Institutionalization: The ingrained way of doing business that an organization follows routinely as part of its corporate culture.
• Stakeholder: A group or individual that is affected by or is in some way accountable for the outcome of an undertaking; may include project or work group members, suppliers, customers, end users, and others.
• Relevant Stakeholder: A stakeholder that is identified for involvement in specific activities and is included in a plan.
• Maturity Level (ML): Degree of process improvement across a predefined set of process areas in which goals in the set are attained.
• Process Performance: A measure of results achieved by following a process.
• For a full glossary of terms see [1, 3].

There are 22 Process Areas for CMMI-DEV and you can find the full list or process areas here.

Sources:

•  [1] "CMMI-DEV 1.3 - Technical Report", SEI, CMU/SEI-2010-TR-033 / ESC-TR-2010-033, Nov. 2010 (available at http://www.sei.cmu.edu; this is "the bible")
• [2] "CMMI for Development - Guidelines for Process Integration and Product Improvement", 3rd. Ed.; Mary Beth Chrissis, Mike Conrad, Sandy Shrum; Addison-Wesley 
• [3] "CMMI for Development Quick Reference" (available from http://www.sei.cmu.edu)