The Future of CMMI

Jay Douglass Software Engineering Institute Carnegie Mellon University Pittsburgh, PA 15213 March 19, 2007

2007 Carnegie Mellon University

Transition from V1.1 to V1.2 Status As reported to the SEI as of 12-31-062

Introduction to CMMI Students Registered for Upgrade Training 1275 Upgrades Complete Lead Appraisers and Instructors Registered for Upgrade training 621 Upgrade Complete 419 717

Update
2007 Carnegie Mellon University

CMMI Adoption Trends

CMMI Web pages views in September 2006

360K/month Exceeded 24K/day

The following were the most downloaded files on the SEI Web site in September 2006:

CMMI-DEV, V1.2 (PDF Version) CMMI V1.1 Overview Presentation CMMI V1.2 Overview Presentation CMMI-DEV, V1.2 (Word Version) CMMI V1.2 Model Changes Presentation

Update
2007 Carnegie Mellon University

CMMI Transition Status 12/31/06

Training Introduction to CMMI 59,434 trained Intermediate CMMI 2,367 trained Introduction to CMMI Instructors 477 SCAMPI Lead Appraisers 684 trained SCAMPI B&C-Only Team Lead -- 33 Authorized Introduction to CMMI V1.1/1.2 Instructors 408/314 SCAMPI V1.1/1.2 Lead Appraisers 455/328 SCAMPI B&C Team Leads -- 456
Update
2007 Carnegie Mellon University

Number of SCAMPI v1.1 Class A Appraisals Conducted by Quarter Reported as of 31 August 2006
300 275 250 225 200 175 150 125 100 75 50 25 0 Q2/02 Q3/02 Q4/02 Q1/03 Q2/03 Q3/03 Q4/03 Q1/04 Q2/04 Q3/04 Q4/04 Q1/05 Q2/05 Q3/05 Q4/05 Q1/06 Q2/06

Update
2007 Carnegie Mellon University

300 275 250 225 200 175 150 125 100 75 50 25 0

Number of SCAMPI v1.1/v1.2 Class A Appraisals Conducted by Quarter Reported as of 31 December 2006

Q2/02 Q3/02 Q4/02 Q1/03 Q2/03 Q3/03 Q4/03 Q1/04 Q2/04 Q3/04 Q4/04 Q1/05 Q2/05 Q3/05 Q4/05 Q1/06 Q2/06 Q3/06 Q4/06

Update
2007 Carnegie Mellon University

Countries where Appraisals have been Performed and Reported to the SEI

Argentina Chile France Japan New Zealand Spain United States

Australia China Germany Korea, Republic of Pakistan Sweden Vietnam

Austria Colombia Hong Kong Latvia Philippines Switzerland

Bahrain Belarus Czech Republic Denmark India Indonesia Malaysia Mauritius Portugal Russia Taiwan Thailand

Belgium Dominican Republic Ireland Mexico Singapore Turkey

Brazil Egypt Israel Morocco Slovakia Ukraine

Canada Finland Italy Netherlands South Africa United Kingdom

Red country name: New additions with this reporting

Update
2007 Carnegie Mellon University

Number of Appraisals and Maturity Levels Reported to the SEI by Country

Country Argentina Australia Austria Bahrain Belarus Belgium Brazil Canada Chile China Colombia Czech Republic Denmark Dominican Republic Egypt Finland France Germany Hong Kong India Indonesia Ireland Israel Italy Japan Number of Appraisals 15 23 10 or fewer 10 or fewer 10 or fewer 10 or fewer 39 18 10 or fewer 158 10 or fewer 10 or fewer 10 or fewer 10 or fewer 10 10 or fewer 65 28 10 or fewer 177 10 or fewer 10 or fewer 10 or fewer 10 or fewer 155 Maturity Maturity Level 1 Level 2 Reported Reported No Yes Yes Yes Maturity Level 3 Reported Yes Yes Maturity Level 4 Reported Yes Yes Maturity Level 5 Reported Country Yes Yes Korea, Republic of Latvia Malaysia Mauritius Mexico Morocco Netherlands New Zealand Pakistan Philippines Portugal Russia Singapore Slovakia South Africa Spain Sweden Switzerland Taiwan Thailand Turkey Ukraine United Kingdom United States Vietnam Maturity Maturity Number of Level 1 Level 2 Appraisals Reported Reported 56 10 or fewer 15 10 or fewer 10 or fewer 10 or fewer 10 or fewer 10 or fewer 10 or fewer 14 10 or fewer 10 or fewer 10 or fewer 10 or fewer 10 or fewer 25 10 or fewer 10 or fewer 31 10 or fewer 10 or fewer 10 or fewer 42 598 10 or fewer Yes No Yes No Maturity Level 3 Reported Yes Yes Maturity Maturity Level 4 Level 5 Reported Reported Yes No Yes Yes

No No Yes

Yes Yes Yes

Yes Yes Yes

Yes No Yes

Yes Yes Yes

No

Yes

Yes

No

Yes

No

Yes

Yes

No

Yes

Yes Yes No

Yes Yes Yes

Yes Yes Yes

Yes Yes Yes

Yes Yes Yes

No

Yes

Yes

No

No

Yes Yes

Yes Yes

Yes Yes

Yes Yes

No Yes

Yes

Yes

Yes

Yes

Yes

Update
2007 Carnegie Mellon University

Combined Appraisal Opportunities

Current ISO 9001
ISO 9001 IA

SCAMPI A & ISO 9001

Rating letter & or certificate with scope indicating in accordance with Level X

(Combined ISO Surveillance using Cat C appraisal)

Visit Report

continues to demonstrate compliance with ISO 9001:2000

Rating letter indicating level achieved

no behaviours inconsistent with operating at level X

Current CMMI
SCAMPI A

SCAMPI A
(Cat C appraisal)

Update
2007 Carnegie Mellon University

Performance Results Summary

Improvements Cost Schedule Productivity Quality Customer Satisfaction Return on Investment Median 20% 37% 67% 50% 14% 4.8 : 1 # of data points 21 19 16 18 6 14 Low 3% 2% 11% 29% -4% 2:1 High 87% 90% 255% 132% 55% 27.7 : 1

N = 25, as of 15 December 2005 Organizations with results expressed as change over time
Update
2007 Carnegie Mellon University

10

CMMI Today
Version 1.1 CMMI Product Suite was released January 2002.

CMMI Web site visits average 20,000/day Over 59,000 people have been trained Over 1600 class A appraisals have been reported to the SEI

Now we want to continuously improve

Update
2007 Carnegie Mellon University

11

CMMI Books
A Guide to the CMMI: Second Edition CMMI: A Framework CMMI Assessments CMMI Distilled: Second Edition CMMI SCAMPI Distilled CMMI Survival Guide CMMI: Un Itinraire Flch: Second Edition De kleine CMMI Interpreting the CMMI Making Process Improvement Work Practical Insight into CMMI Real Process Improvement Using the CMMI Systematic Process Improvement Using ISO 9001:2000 and CMMI
Update
2007 Carnegie Mellon University

12

How about SEI Publications?

Technical notes and special reports:

Interpreting CMMI:

for Operational Organizations for COTS Based Systems for Service Organizations for Marketing (in progress) Earned Value Management Product Line Practices Six Sigma

Using CMMI with:

Supplementing CMMI for Safety Critical Development (in progress) Demonstrating the Impact and Benefits of CMMI (and web pages www.sei.cmu.edu/cmmi/results)
Update
2007 Carnegie Mellon University

13

CMMI V1.2and Beyond

2007 Carnegie Mellon University

Major Themes
Reduce complexity & size Increase coverage Increase confidence in appraisal results

Update
2007 Carnegie Mellon University

15

CMMI Model Combinations

V 1.1
Supplier Sourcing Integrated Product and Process Development

V 1.2

IPPD

Organizational Goal (OPD) Project Goal (IPM)

SE Related Examples SW Related Examples SW Related Examples

SE Related Examples

HW Related Examples

CMMI Core

CMMI Core (now includes SS)

Update
2007 Carnegie Mellon University

16

IPPD Changes
V1.1
Process Mgt PAs

V1.2
OPD SG1 SG2 SG2 = Enable IPPD principles

Support PAs

OEI

SG1 SG2

Project Management PAs

SG1 IPM SG2 SG3 SG4 SG1 SG2

SG1 IPM SG2 SG3

SG3 = Apply IPPD principles

IT

Update
2007 Carnegie Mellon University

17

SCAMPI A Changes for V1.2

Method implementation clarifications
interviews in virtual organizations practice characterization rules organizational unit sampling options

Appraisal Disclosure Statement (ADS) improvements

reduce redundancy with other appraisal documents improve usability for sponsor and government require sponsors signature on the ADS require all team members to show agreement on findings Both V1,1 and V1.2 ADS will reflect these as of Nov 2006

Lead Appraisers must be certified to lead high maturity appraisals Maturity level and capability level shelf life 3 years, given 1 year of V1.2 availability
Update
2007 Carnegie Mellon University

18

Published Appraisal Results

Update
2007 Carnegie Mellon University

19

CMMI V1.2 Schedules

Version 1.2 CMMI Product Suite release Update material available First Lead Appraiser face to face First high maturity oral exam V1.2 ADS required for all SCAMPIs Last V1.1 Intro training First expiration of V1.1 appraisals (3 year validity) Last V1.1 appraisal August 25, 2006 August 25, 2006

Upgrade course available on-line August 25, 2006 October, 2006 October, 2006 November, 2006 December, 2006 August 25, 2007 August 31, 2007
Update
2007 Carnegie Mellon University

20

Beyond V1.2
Improved architecture will allow post-V1.2 expansion.
Extensions of the life cycle (Services,

Outsourcing/Acquisition) could expand use of a common organizational framework:

allows

coverage of more of the enterprise or potential partnering organizations model features to fit non-developmental efforts (e.g., CMMI Services, CMMI Acquisition)

adapts

Update
2007 Carnegie Mellon University

21

3 Complementary Constellations
CMMI-Services provides guidance for those providing services within organizations and to external customers

CMMI-Dev provides guidance for measuring, monitoring and managing development processes

CMMI-SVC
16 Core Process Areas, common to all CMMI-ACQ provides guidance to enable informed and decisive acquisition leadership

CMMI-DEV

CMMI-ACQ

Update
2007 Carnegie Mellon University

22

Acquirer/Supplier Mismatch

High

Mismatch
mature acquirer mentors low maturity supplier outcome not predictable

Matched
acquirer and supplier are both high maturity highest probability of success

Acquirer

Disaster
Low
no discipline no process no product

Mismatch
immature acquirer mature supplier Customer encourages short cuts.

Technical & Management Skill

Low

Supplier

High
Update
2007 Carnegie Mellon University

23

Initial CMMI-ACQ Key Acquisition Processes*

Solicitation & Supplier Agreement Development

Acquisition Management

Core Acquisition Validation Project Management Acquisition Technical Solution

Processes Acquisition Requirement s Development

Acquisition Verification
Update
24

2007 Carnegie Mellon University *based on initial CMMI-ACQ model developed by General Motors/SEI

Acquisition Improvement is needed.

Acquirers cannot ensure that mature processes are applied to their programs
High

Acquirers need more internal process focus

Mismatch
outcome not predictable

XYZ Corp.
Division A Project 1 Project 2 Project 5 Project 3 Project 4 Division B Division N

mature acquirer mentors low maturity supplier

acquirer and supplier are both high maturity

Matched

PMO

highest probability of success

Low

Project 6

MLs usually apply HERE based upon appraisals of THESE

but your project is HERE or HERE

Project 7

Project y

Project x

Project z

Disaster
no discipline no process

less mature acquirer derails mature supplier; encourages short cuts

Mismatch

no product Low

supplier compromises processes

Contractor

High

Technical & Management Skill

Update
2007 Carnegie Mellon University

25

Guidebook Concept
Provide a process toolbox for the acquirer
Include practical guidance on how to recognize the real

practitioners

Encourage the use of capability and maturity profiles vice "single

level" approach

Improve acquisition organizations' understanding of the meaning

of high maturity (levels 4 and 5) and equivalent staging throughout the acquisition lifecycle

Include multiple tools and guidance that may be used

Update
2007 Carnegie Mellon University

26

Planned Sequence of Models

CMMI-SVC

CMMI V1.1

CMMI-DEV V1.2

GM IT Sourcing CMMI-AM

CMMI-ACQ

SA-CMM

Update
2007 Carnegie Mellon University

27

Contact Information

Jay Douglass jcd@sei.cmu.edu Direct +1 412 268 6834 Cell: +1 412 260 2445 Pittsburgh, Pennsylvania 15213

Update
2007 Carnegie Mellon University

28