Sie sind auf Seite 1von 5

Reaching CMMI Level 2:

Challenges, Missteps, and Successes


Rich Cyran & James Cusick
Wolters Kluwer, Corporate Legal Services
111 Eighth Avenue
New York, NY
{richard.cyran; james.cusick}@wolterskluwer.com

ABSTRACT note mistakes made along the way and key success
factors.
Developing a process that supports the requirements of
the CMMI (Capability Maturity Model Integration) and 2. Getting Started
meets business goals can be challenging and brings with it
its own risks. At Wolters Kluwer (WK) Corporate Legal Wolters Kluwer (WK) is a Netherlands based
Services (CLS) a goal was set to develop, document, and international publisher and information services provider
deploy a process that could bring the organization to with operations around the world. Wolters Kluwer is
Level 2 on the CMMI framework and improve established organized into Business Units which then control
processes at the same time. To do this required over two operating companies. The experience documented here
years and the contributions of dozens of participants. focuses on global development teams managed from the
Along the way a variety of challenges were overcome, New York based Corporate Legal Services Division
missteps made, and successes were achieved. This paper which manages six corporations. The practices described
reviews the progress we have made in our process are grounded on numerous projects performed primarily
improvement initiative and the practical steps taken to in the United States and India. The US locations include
achieve Level 2 in a commercial organization. multiple Manhattan sites and facilities in Houston,
Hartford, and San Francisco.
KEY WORDS
The starting point for the organization more than two
Software process, process engineering, software years ago was a set of software teams that were using a
engineering, Capability Maturity Model, Capability loosely documented set of practices with conflicting
Maturity Model Integration, project management, lifecycle models. There were project plans with few
configuration management, software quality. templates. There were some requirements documents
commonly used but no defined approach to developing
them. There were some general process steps defined in
1. Introduction PowerPoint presentations inherited from departed
consultants. There was a shared vision on how to run
Adopting the Software Engineering Institute’s (SEI) releases but this was largely communicated verbally. The
Capability Maturity Model Integration (CMMI) [1] organization was generally successful in estimating using
requires preparation, planning, determination, and a detailed approach based on historical data on effort
experience with process improvement. At Wolters Kluwer related to required work products. The bottom line was
(WK) Corporate Legal Services (CLS) we carried out the that releases were being produced but for anyone entering
development and formalization of a full life-cycle set of the organization it was unclear how this was done in any
processes and deployed them in multiple organizations. defined manner.
This process definition and deployment followed the
CMMI model and we recently achieved a Level 2 rating The CTO of the organization set a goal to improve
on the 5 level scale as provided by a SCAMPI (Standard process maturity and to utilize the CMMI in doing so.
CMMI Appraisal Method for Process Improvement) Since the CTO was sponsoring the initiative, there was
assessment [2]. Doing so required more than two years of strong management support and high visibility to jump
effort by a diverse team that led us through many start this initiative. These two factors are crucial in any
challenges that are documented here. In this paper we process improvement initiative. The initiative was
describe the starting point and goals of the organization proposed to improve on cycle time and quality as well as
and the specific steps taken to define and deploy the providing better managerial control of projects. This
required process maturity to achieve Level 2. We also effort coincided with the beefing up of the PMO (Project

1
Management Office) and was in fact managed from there. 3. Challenges
Being managed out of the PMO, meant that this initiative
was managed as a project with a plan, schedule, weekly Getting the effort off the ground and keeping it moving
status reporting and other project deliverables. Being forward posed numerous challenges. The first challenge
managed as a project would also set the path for the was that processes were in fact followed within each
initiative. At the outset, there was limited understanding separate organization but they were not always
in the organization of what was involved to reach Level 2. documented. This forced the SEPG to hunt for
A 12-month stretch target was established without documentation, interview people on what they did, and
detailed analysis on what was required to reach that level. author new documentation so as to generate the
appropriate procedural artifacts. A second major
Formation of a process group in the PMO became the challenge was resistance to change. The SEPG needed to
driver for the initiative. A first step was the formation of engage people fully to overcome this, soliciting input
the SEPG (Software Engineering Process Group) relentlessly, and allowing people to feel as if they owned
comprised of cross- functional representatives from the the new process. The resistance to change in such an
companies involved. The CTO, the sponsoring executive, initiative should never be underestimated.
nominated his direct reports who in some cases appointed
delegates. The composition of the SEPG included An additional challenge was the diverse organizations in
representatives from the PMO, QA and Engineering different companies with different histories, different
groups This is turn brought with it its own set of locations, and different cultures. These differences led to
complicating circumstances but nonetheless, the SEPG varying degrees of support and involvement as business
began meeting regularly. goals varied and limited integration at the business level
drove a separation at the technical level. This led to
Once the team was organized we began focusing on the different priorities. Some groups preferred to be
process development needs within the context of the “cowboys” and some did not, and this required changing
CMMI framework. The initial work focused on the tactics and communications, which was not always
collection, analysis, and compression of the five diverse successful. Often, process needed to take a back seat to
lifecycles in use throughout the varying organizations and projects, and as a result, one of our organizations needed
major projects going on at the time in CLS. No two to be de-scoped from the eventual SCAMPI, as they did
lifecycles in the three organizations were exactly alike. not meet all the hurdles required.
Different teams in the same organization used different
methodologies. Strong personalities also inserted themselves into the
effort, sometimes pushing things along and sometimes
The 5 lifecycle models were reviewed, compared and then dragging down progress. A learning curve for many
collapsed into one unified model with six phases: participants had to be climbed. The concepts around what
Concept, Analysis, Design, Construction, Test, and a formal process looked like compared to what they were
Implementation. Negotiating sessions were then held to used to had to be worked through. In some cases people
map work activities to these newly agreed to phases. were receptive to taking on more process and in other
However, the proof of the design came when the lifecycle cases they were not. Navigating through the issues raised
model was eventually deployed to get actual feedback on the time required in order to reach consensus and
what made sense. There was extensive discussion around commitment.
terminology and the conversion from existing models to
the new standard model. The new standard was a A SPI (Software Process Improvement) project manager
modified waterfall lifecycle. was brought in from the outside, which was both a
negative and positive. The project manager did not know
The CMMI framework was reviewed, a gap analysis the company or the people and had to win relationships
conducted, and the team created a project plan to start without an established internal track record. Further, the
developing procedures under the framework. A variety of manager did not have local experience in problems faced
loosely defined procedures that needed concrete by typical projects, came from a different organizational
documentation already existed. In some cases we had to culture and had to adapt to local practices, diverse
research best practices to develop new suggested geography, and limited face time with people in remote
procedures. These procedures were reviewed, published, locations. Though the SPI Manager was unfamiliar with
and deployed as they became available. It was expected CLS, he was familiar with the CMM and had managed a
that the project teams would use the procedures as they successful CMM Level 2 implementation at a major
were approved by the SEPG and posted to the Process financial services company. Though the landscape was
Asset Library. different, similar challenges existed. The reliance on
participating over the phone makes it a challenge to
communicate and limits ad hoc integration. Additionally,
informal communications and a mechanism to share best
practices did not exist.
2
• Resistance to change proved to be a major issue and
A key factor in getting started was the relative small we made mistakes in underestimating the amount of
number of people experienced with CMM outside the effort necessary to overcome it. Secondly, getting
core team. A few folks on the core team of the SEPG had people involved was difficult. We held a Q&A
strong backgrounds in process improvement and maturity session, for example, and no one showed up. Only
in applying the CMM. Reaching out to the rest of the when we offered prizes did involvement increase. In
team and to the larger organizations required extensive the beginning there wasn’t a feeling of ownership of
education of the staff to familiarize them with the the new process by the organization. People referred
structure of process. We also had to develop a sense of to the process as the “SEPG’s process” not the
process and process improvement among all the staff, organization’s own process. We could have been
which took an investment in training materials and more proactive in reaching out to the community in
training hours. more ways early on.
• SEPG team flux and levels of dedication often caused
There were also two organizational issues we had to delays. This was understandable since SEPG
overcome in getting started. First we had to overcome members were fully allocated to projects and the
perceptions of earlier unsuccessful process initiatives – process improvement initiative was not their primary
there had been some less directed efforts towards process responsibility. People missed meetings since
improvement that had not been brought to fruition. Also, development projects took greater priority. This
organizational changes occurred which added to the caused the level of participation to vary. Some
challenges. Mid-way through the effort the outsourcing of personnel changes during the life of the effort had
the infrastructure group caused the need for the revision mixed impacts on progress, some positive and some
of multiple processes and process artifacts. negative. At times had trouble making commitments
stick. Generally we were unable to hold people
Finally, we encountered numerous issues with specific accountable to get things done as outside priorities
CMMI process areas. Notably, Configuration superseded commitments. Finally, not all SEPG
Management proved to be a struggle to get to an approach members were “process evangelists” but were more
that fit the needs of the organization. We made several passive members. A more active drive towards
attempts at getting this right and each step led to a misstep getting commitments and forcing them to closure
requiring us to rework the process documentation and could have helped.
training packages again and again. Measurement and • Not all the right people were involved at all times.
Analysis was also a challenge in that limited metrics were Sometimes an adversarial stance was taken between
in place and we needed to start almost from scratch in this the SEPG and those outside the team, and this
area. With SAM (Supplier Agreement Management) there required rework in some cases. Getting processes
was no vendor management function. Generally, reviewed and accepted (by the right people) required
interpretation of the model can be subjective; using our a long time and we did not always succeed in getting
consultant lead appraiser to help us navigate these waters buy-in on some key procedures from all stakeholders
was very beneficial. Our lead appraiser was able to in advance. Better inclusion of all parties could have
provide suggestions that were both beneficial to our helped prevent this from happening.
business and satisfied the CMMI. We ended up with a • SEPG members, already process champions, needed
very pragmatic approach to SAM that is both to be greater advocates and communicators of the
straightforward and useful. process changes to their constituencies. However, in
a large organization it is hard to keep everyone
All of these varied challenges were worked through by equally informed!
the team over a period of more than two years. Some of • We also underestimated the amount of time required
the attempts at solving these issues worked and others did to review and approve processes, procedures and
not. In the next section we share some of the things that other work products. Review sessions often overran
did not go as planned. their one hour time frames and required additional
review sessions and multiple follow-on reviews. It
was not known that members would get hung up on
4. Missteps certain minutia. We did not have past history to look
back on. We could have placed better rules around
As with any project, our SPI initiative hit some snags. reviews including prep time and standard durations.
There were some small glitches and some major • In general, communications could have been
difficulties to overcome. Below we try to chronicle some improved. We published several newsletter issues,
of the challenges that stand out in hopes that others for example, but could have been more consistent in
working on a CMMI process improvement initiative can producing them to keep people informed. Aside from
benefit from the problems we encountered. the newsletter we also made email announcements
and maintained a web site, but we found people were
still not always up to speed on what we were doing. It
3
is possible that we could have also found other ways then documented what was currently done, mapped
to keep people informed such as informational these activities to the new lifecycle and worked from
meetings, status reports, and by getting more of the established practices. As gaps began arising we took
organization involved in developing the process on the challenge of writing required new procedures
artifacts themselves. and building out the process incrementally taking one
• Not getting additional resource(s) earlier (e.g., phase at a time. In rapid order we were able to build
process consultants) slowed down the effort; the on our foundation a full lifecycle phase gate process
lesson here is to ramp up faster. including detailed process flows, procedures, and
• The process team could have done a better job in templates.
carrying out onsite visits to remote locations. Of • Throughout the process of developing the
course budgetary concerns always exist but visits organization’s software development process, we
may have prevented one site from dropping out of the constantly reviewed the process against the CMMI
assessment. framework requirements. This ensured that we
• There was also an inability to leverage work done in maintained good adherence to the model in the
other WK business units. There were some CMM and eventual products.
CMMI initiatives going on elsewhere in the • Training was provided incrementally for SEPG
organization and we found it difficult to get lessons members. Most took the “Intro to CMMI” course and
learned or any reusable assets from them. some took additional courses. This training was both
necessary and essential to make sure everyone had a
full understanding of the model and the assessment
5. What Was Done Right approach.
• We also built a spirit of learning within the SEPG.
While we ran into some problems we also ended up doing Some SEPG members joined process groups,
a few things right. The major factors in leading us to attended SPIN (Software Process Improvement
success are presented below. Network) meetings, and otherwise looked to benefit
from other experiences that related to process
• Initially we created a dedicated process group and improvement. We actively shared papers, documents,
began staffing it with experienced personnel. This and web sites that could help each other in
was a key decision and commitment to the effort that understanding some aspect of process or related
paid dividends by having available resources to technology.
tackle the many tasks associated with the work. This • The decision by management to decide on a CMMI
group provided the drive behind the initiative and course as opposed to a CMM course was also a key
ensured the adherence to sound process improvement enabling factor. Though the pursuit of a CMMI
approaches. The group also provided guidance on the benchmark rating was a more difficult challenge, the
CMMI to process authors and the organization as a benefits realized as well as the foundation to achieve
whole. a higher level of maturity justified the choice of the
• Shortly into the initiative we also engaged a Lead integration model. Additionally, the CMMI was
Appraiser who played a dual role as a process becoming the industry standard and the CMM was
consultant. This brought in crucial guidance to the going to be sunseted.
effort from an outsider and helped us stay focused on • A useful technique we developed was to run some
what mattered most in reaching our assessment goals. meetings as full day sessions off site in order to focus
Our Lead Appraiser was brought in on an ad hoc the team and create an atmosphere of taking a fresh
basis throughout the process and we were able to rely look at the artifacts under development. These days
on him as a mentor and advisor. He was able to offer were sometimes grueling but we accomplished a lot
suggested practices that were both suitable for our when we were sequestered in this manner.
business and satisfied the practices of the CMMI. • Additionally, an outside consulting agency performed
• The core SEPG team was very experienced with the periodic reviews as sanctioned by the WK process
CMM and in some cases with the CMMI as well. The team and these reviews gave us additional external
core team required little ramp up, and they set the objective course corrections.
pace for the rest of the SEPG members and the • Getting all work products available on the internal
organization. They had been through process design intranet to get them publicly visible so as to collect
and deployment activities as well as having worked feedback and to support institutionalization was also
in organizations that had attained high process a winning tactic. The website containing the Process
maturity assessments on the CMM ladder. This Asset Library is easily accessible. Making it easy for
experience and sophistication helped set goals and the staff was a primary concern. This enabled IT
kept the effort balanced and progressing. staff in the organization to begin to look at the web
• We took the pragmatic approach of starting from a site and read over work in progress and provide
broad foundation by creating a unified lifecycle. We feedback.

4
• Communications to the organization was done often 8. Acknowledgements
and on different channels, from newsletter to emails
to meetings. As stated earlier, we learned that greater There was a large cast of people who made this work
communication is clearly better. possible. The entire CLS management team from our
• Keeping the executive sponsor fully informed, and CTO to all of his Directors played a major leadership role
with adequate visibility into the process initiative was in getting us to our goals. The CLS SEPG members
not only required but was essential to the success of contributed over a long period of time to pull the process
the endeavor. together and get us through the assessment. Numerous
people from the Wolters Kluwer team including Chris
Layer, Dan Focazio, and Mike Antico provided essential
6. Thoughts on Going Forward assistance. Our outside team of consultants including
Mike D’Ambrosa of BAE Systems and Tom Cagley of
Now that we have reached our first major goal of bringing the David Consulting Group guided us throughout this
two companies up to Level 2 we are looking beyond to work. Finally, process adopters in the organization made
new goals and better ways to reach them. The first the process come to life and are thanked for their dutiful
principle we often repeated comes from Vince Lombardi efforts to make this real.
who explained his strategy for winning football games as
“three yards and a cloud of dust.” By this he meant that if 9. References
the team gained three yards for each of the four allowed
attempts and did this consistently they would always end [1] Chrissis, Mary Beth, Konrad, Mike, Shrum, Sandy,
up in the end zone. We like to repeat this phrase to remind CMMI : Guidelines for Process Integration and
ourselves that tactics lead to the realization of strategy. Product Improvement, Addison-Wesley Professional;
Staying focused on the next 3 yards can win the game. 1st edition, February 24, 2003.
[2] Ahren, D., et. al., CMMI(R) SCAMPI Distilled :
The next three yards will focus on the maintenance of the Appraisals for Process Improvement, Addison-Wesley
SDP (our process), refining and optimizing it, staying on Professional, March 2, 2005.
top of process change requests, and constantly evolving
the process. We need to be acutely aware that refinement
and optimization are always necessary. The next thread of
execution will be to work with the one organization that
dropped out of the Level 2 assessment and enable them to
reach Maturity Level 2. Next, we are developing a plan to
attain Level 3 for our current Level 2 organizations.
Additionally, we will work with the several organizations
in our business unit that are at a lower level of maturity
and help them carefully pick the right facets of our
software development process that will yield the most
value to their smaller yet fast growing businesses. Finally,
we plan to keep promoting process and creating a vehicle
for exchanging best practices across organizations within
Wolters Kluwer. This will be based on need and “bang for
the buck,” again, with a cloud of dust.

7. Conclusions
Process improvement, when done well, brings a variety of
benefits to an organization. We have seen improved
clarity around project execution, standardization of work
products, and a common language and consistency within
multiple organizations. We have had some stumbles along
the way but we have done an equal number of activities
effectively enough to reach our major goals. In sharing
both our wins and losses we hope that others will benefit
by perhaps advancing with less friction.

Das könnte Ihnen auch gefallen