Beruflich Dokumente
Kultur Dokumente
James Duggan
Thomas Murphy
This presentation, including any supporting materials, is owned by Gartner, Inc. and/or its affiliates and is for the sole use of the
intended Gartner audience or other authorized recipients. This presentation may contain information that is confidential,
proprietary or otherwise legally protected, and it may not be further copied, distributed or publicly displayed without the express
written permission of Gartner, Inc. or its affiliates.
2011 Gartner, Inc. and/or its affiliates. All rights reserved.
Page 1
In 2011,
2011 PaaS is the least
least-developed
developed and least
least-understood
understood layer in the cloud computing architecture
architecture, compared with
system infrastructure services (infrastructure as a service [IaaS]) and application services (software as a service [SaaS]). It
is also the fastest growing in terms of the pace of innovation and new vendor investments. Most PaaS offerings are on the
left side of the Hype Cycle, along the Technology Trigger and the Peak of Inflated Expectations. Gartner has initiated its
Hype Cycle coverage of the PaaS market at its early stage and plans to track the evolution of PaaS offerings toward
maturity and mainstream productivity.
The general notion of PaaS is often applied to any stand-alone middleware functionality (messaging, integration,
application server, DBMS) offered as a service without discriminating between types and subtypes of PaaS offerings.
We often hear the general term "PaaS" incorrectly associated with just the subtype offerings of aPaaS (for example,
salesforce.com's Force.com or Google App Engine). For some users and vendors, PaaS equates to aPaaS. Gartner
differentiates the functional types of PaaS offerings. However, we also track the general acceptance of the notion of PaaS,
compared with the other core layers of cloud architecture: SaaS and IaaS. In mid-2011, the general notion of PaaS and the
more specific aPaaS are near the Peak of Inflated Expectations, often confused and substituted for each other. Meanwhile,
the important emerging PaaS suite, integration PaaS (iPaaS) is midway to its peak of popularity (and hype), and cloud
g g services are just
j beginning
g
g to be recognized.
g
messaging
We expect fast development of the market, with some of the key PaaS offerings progressing toward the Plateau of
Productivity (and mainstream acceptance) over the next three to five years as vendor investments and user success stories
make PaaS and PaaS-based application services a common practice in the hybrid environment of enterprise IT.
This presentation, including any supporting materials, is owned by Gartner, Inc. and/or its affiliates and is for the sole use of the
intended Gartner audience or other authorized recipients. This presentation may contain information that is confidential,
proprietary or otherwise legally protected, and it may not be further copied, distributed or publicly displayed without the express
written permission of Gartner, Inc. or its affiliates.
2011 Gartner, Inc. and/or its affiliates. All rights reserved.
Page 2
This presentation, including any supporting materials, is owned by Gartner, Inc. and/or its affiliates and is for the sole use of the
intended Gartner audience or other authorized recipients. This presentation may contain information that is confidential,
proprietary or otherwise legally protected, and it may not be further copied, distributed or publicly displayed without the express
written permission of Gartner, Inc. or its affiliates.
2011 Gartner, Inc. and/or its affiliates. All rights reserved.
Page 3
Key Issue: How can you utilize cloud solutions to drive quality?
As organizations seek to go faster there are many places where cloud options come into play. Options include:
Self-service provisioning of Dev/Test lab infrastructure
Cloud delivered devices virtual users for load, handsets, tablets
SaaS delivered Tools ease provisioning of tools
Emerging platforms Extend from SaaS to create integration ability to integrate into solution and delivery
platform
Many organizations have been working with various elements and we expect fragmented approaches and a
fragmented provider landscape. The key drivers come from the desire to deliver faster often with a move to
agile while at the same time seeing more complex application architectures.
DevOps: IT Service Delivery approach rooted in agile philosophy with an emphasis on business outcomes, not
business orthodoxy
orthodoxy.
This presentation, including any supporting materials, is owned by Gartner, Inc. and/or its affiliates and is for the sole use of the
intended Gartner audience or other authorized recipients. This presentation may contain information that is confidential,
proprietary or otherwise legally protected, and it may not be further copied, distributed or publicly displayed without the express
written permission of Gartner, Inc. or its affiliates.
2011 Gartner, Inc. and/or its affiliates. All rights reserved.
Page 4
Key Issue: How can you utilize cloud solutions to drive quality?
Private cloud infrastructures provide greater flexibility to IT organizations and can help answer the "how many
environments" questions for modern applications.
Private cloud infrastructures provide improved opportunities to testing organizations to more accurately and completely
test systems.
Cloud technology platforms are still emergent, as is managing private clouds, but the use of private clouds for
development and testing is a safe starting point.
When development groups gain access to self-provisioned compute resources, their demand and utilization tends to
increase.
Investigate centralization of test labs and creating a center of excellence (COE) for lab management.
Fill in tool gaps for data and build management to automate the build and deploy process.
Risk-averse organizations should rely on major vendors, but recognize that emergent vendors offer stronger solutions at
this point.
Create policies and procedures to limit the excessive use of compute resources, so that developers do not spin up an
unnecessary amount of virtual machines, needlessly tying up machines.
Identify
Id tif the
th systems
t
that
th t are difficult
diffi lt to
t replicate
li t in
i virtual
i t l machines,
hi
suchh as legacy
l
mainframes
i f
andd external
t
l Web
W b
services, and develop a plan of attack for either stubbing out or simulating their interfaces.
This presentation, including any supporting materials, is owned by Gartner, Inc. and/or its affiliates and is for the sole use of the
intended Gartner audience or other authorized recipients. This presentation may contain information that is confidential,
proprietary or otherwise legally protected, and it may not be further copied, distributed or publicly displayed without the express
written permission of Gartner, Inc. or its affiliates.
2011 Gartner, Inc. and/or its affiliates. All rights reserved.
Page 5
Key Issue: How can you utilize cloud solutions to drive quality?
Continuous integration is a key process in keeping the entire organization on the same page and capturing issues as soon
as possible. A key challenge with CI is developing a toolset to create builds, as well as a set of governance policies
regarding software standards and build process. This may include check-in gates, such as unit tests that pass, static
analysis rules or peer review. The organization may also have different types of continuous builds or may determine that
"continuous" means daily; however, it has been shown that teams that push toward more-frequent builds find software
issues faster and reduce the impact cost of those issues.
Continuous integration can require a number of machine to support properly when builds get complex. Solutions in the
cloud are still very early and there are questions about the right way to make use of machines for achieving scale yet not
losing out to network latency. We expect that most teams using the cloud for build related tasks will be smaller teams that
need a painless way to setup and try the concepts but that as CI becomes ingrained it will generally move to internally
managed machines for the next 3-5 years.
However, project management, reporting, collaboration, these are all tasks that work well in cloud deployments and we
expect that the number of tools that are offered first as SaaS and evolve (because of extensibility) to being more platform
like will expand. Much of this will also happen in the open source market in the area of testing where basic test platforms
will be extended to support new devices, platforms, and to push areas of automation.
This presentation, including any supporting materials, is owned by Gartner, Inc. and/or its affiliates and is for the sole use of the
intended Gartner audience or other authorized recipients. This presentation may contain information that is confidential,
proprietary or otherwise legally protected, and it may not be further copied, distributed or publicly displayed without the express
written permission of Gartner, Inc. or its affiliates.
2011 Gartner, Inc. and/or its affiliates. All rights reserved.
Page 6
Key
y Issue: How can y
you utilize cloud solutions to drive q
quality?
y
Many tools have entered the market to enable use of resources in the cloud adding the testing of software. This includes virtualization
of the application stack and enables reduction of friction in the development process enabling testing earlier and more frequently.
These services are at varying levels of maturity and we expect acquisitions to drive changes in the market.
Utilizing the public cloud for load and performance testing has rapidly moved to the mainstream. Vendors in this space typically
have load generation to one or more public cloud labs or build their own labs. Users gain advantage of a SaaS model to only pay for
load based on use and the ability to generate a load that better matches reality. This comes from 3 elements: scalability; load is
created from outside your network; potentially with a mix of browsers, connection speeds. This market started with new independent
companies but we are starting to see traditional vendors add the ability to drive load from cloud providers such as Amazon EC2 (both
HP and Micro Focus support this). Beyond the variations in location, browser, network the big difference in tools is the level of
analytics available to identify why the system doesn't perform.
Mobile computing also provides a great opportunity to make use of the cloud with the rapid growth in the number of devices and
a lack of tools for testing a number of companies have arisen providing clouds of devices that are remotely accessible. These support
manual and sometimes automated testing. We believe there will be many acquisitions and changes in this market as device
computing rises in importance.
Cloud services for server components has been a slower to evolve but important area. The first area to develop was self-service
provisioning test labs closely followed by the ability to use virtualized server and application components. These are quick ways to
drive productivity and reduce costs.
This presentation, including any supporting materials, is owned by Gartner, Inc. and/or its affiliates and is for the sole use of the
intended Gartner audience or other authorized recipients. This presentation may contain information that is confidential,
proprietary or otherwise legally protected, and it may not be further copied, distributed or publicly displayed without the express
written permission of Gartner, Inc. or its affiliates.
2011 Gartner, Inc. and/or its affiliates. All rights reserved.
Page 7
Key Issue: How can you utilize cloud solutions to drive quality?
There are many ways to virtualize pieces of the system. This enables labs to better match reality for more
accurate and frequent testing.
Service virtualization is an outgrowth of SOA testing tools these enable testing before the complete system
is created, testing when the service isn't available due to cost or scheduling difficulties
Network virtualization is particularly important for mobile application testing enabling more accurate load
tests by emulating network carrier performance
Data virtualization is less prevalent at this point but enables cost savings in database licenses, storage, and
servers and also saves time over provisioning and loading test data systems, however it may require active data
masking during dev/test and also doesn't provide for loading specific test case directed data
This presentation, including any supporting materials, is owned by Gartner, Inc. and/or its affiliates and is for the sole use of the
intended Gartner audience or other authorized recipients. This presentation may contain information that is confidential,
proprietary or otherwise legally protected, and it may not be further copied, distributed or publicly displayed without the express
written permission of Gartner, Inc. or its affiliates.
2011 Gartner, Inc. and/or its affiliates. All rights reserved.
Page 8
This presentation, including any supporting materials, is owned by Gartner, Inc. and/or its affiliates and is for the sole use of the
intended Gartner audience or other authorized recipients. This presentation may contain information that is confidential,
proprietary or otherwise legally protected, and it may not be further copied, distributed or publicly displayed without the express
written permission of Gartner, Inc. or its affiliates.
2011 Gartner, Inc. and/or its affiliates. All rights reserved.
Page 9
This presentation, including any supporting materials, is owned by Gartner, Inc. and/or its affiliates and is for the sole use of the
intended Gartner audience or other authorized recipients. This presentation may contain information that is confidential,
proprietary or otherwise legally protected, and it may not be further copied, distributed or publicly displayed without the express
written permission of Gartner, Inc. or its affiliates.
2011 Gartner, Inc. and/or its affiliates. All rights reserved.
Page 10
This presentation, including any supporting materials, is owned by Gartner, Inc. and/or its affiliates and is for the sole use of the
intended Gartner audience or other authorized recipients. This presentation may contain information that is confidential,
proprietary or otherwise legally protected, and it may not be further copied, distributed or publicly displayed without the express
written permission of Gartner, Inc. or its affiliates.
2011 Gartner, Inc. and/or its affiliates. All rights reserved.
Page 11
Page 12
This presentation, including any supporting materials, is owned by Gartner, Inc. and/or its affiliates and is for the sole use of the
intended Gartner audience or other authorized recipients. This presentation may contain information that is confidential,
proprietary or otherwise legally protected, and it may not be further copied, distributed or publicly displayed without the express
written permission of Gartner, Inc. or its affiliates.
2011 Gartner, Inc. and/or its affiliates. All rights reserved.
Page 13
Key Issue: What are the key selection criteria in cloud AD?
As platforms shift to the cloud, the shift the development landscape. Platforms vary between those designed
for a specific task, those that are oriented around a specific development model or problem set. This is creating
many new entrants to the development tool market and which will drive a great deal of partnering and
acquisition.
This presentation, including any supporting materials, is owned by Gartner, Inc. and/or its affiliates and is for the sole use of the
intended Gartner audience or other authorized recipients. This presentation may contain information that is confidential,
proprietary or otherwise legally protected, and it may not be further copied, distributed or publicly displayed without the express
written permission of Gartner, Inc. or its affiliates.
2011 Gartner, Inc. and/or its affiliates. All rights reserved.
Page 14
Key Issue: What are the key selection criteria in cloud AD?
ALM PaaS is really only relevant to the traditional IT developer where teams are involved, consistency is
demanded and the gate for quality is set high. This is part of the difference we will see in AD PaaS needs
between emerging Citizen Developers who value time to solution and work in more constrained problem
spaces that are often data oriented. In these situation tools that are easy to use, that mask as much code as
possible, and make it easy through templating mechanisms to produce applications quickly. Speed here is
about getting to the end results.
For the IT developer ALM PaaS is more required as projects tend to involve teams, longer development cycles,
and the focus of speed is on responsive tools that don't diminish the development experience. In addition
developers have a stronger demand for open platforms that enable them to integrate different tools as well as
providing choice of language, and UI design.
The intersection between is Opportunistic solutions delivered quickly by Citizen Developers and Systematic
solutions that are engineered by traditional development teams. The greatest challenge will be how to
transition applications from one side to the other.
This presentation, including any supporting materials, is owned by Gartner, Inc. and/or its affiliates and is for the sole use of the
intended Gartner audience or other authorized recipients. This presentation may contain information that is confidential,
proprietary or otherwise legally protected, and it may not be further copied, distributed or publicly displayed without the express
written permission of Gartner, Inc. or its affiliates.
2011 Gartner, Inc. and/or its affiliates. All rights reserved.
Page 15
Key Issue: What are the key selection criteria in cloud AD?
The cloud offers great opportunities as the next citizen developer platform. Client/server tools and early Web
implementations suffered from scalability and consistency. Cloud platforms provide the scale and templates
provide greater level of consistency. Generally these environments work in constrained solutions spaces: data
presentation and manipulation, social computing, but via extensibility and Web services a relatively wide set of
capabilities may be exposed. These environments provide a nice "agile" development flow and because of the
component nature control the amount of testing required.
This presentation, including any supporting materials, is owned by Gartner, Inc. and/or its affiliates and is for the sole use of the
intended Gartner audience or other authorized recipients. This presentation may contain information that is confidential,
proprietary or otherwise legally protected, and it may not be further copied, distributed or publicly displayed without the express
written permission of Gartner, Inc. or its affiliates.
2011 Gartner, Inc. and/or its affiliates. All rights reserved.
Page 16
Key Issue: What are the key selection criteria in cloud AD?
Initial Cloud services are oriented toward offline storage facilities and tend to be closed boxes rather than
extensible platforms. This is especially true in device applications which are designed often to provide a
"direct" non-browser accessed application and provide disconnected use. But as platforms evolve they are
gaining extensibility mechanisms. Apples iCloud is a good example with the potential to create a new
marketplace for iCloud Services created by third parties. This will enable organizations to push compute
intensive tasks off the device and into the cloud, provide access to large data volumes enabling more complex
search and processing as well as the creation of real-time services that can then be hooked into by developers.
This will make it easier for third party services to get connected into applications such as payment, ticketing
and simplify multi-user applications such as gaming and collaboration which are difficult to create at this
point.
This presentation, including any supporting materials, is owned by Gartner, Inc. and/or its affiliates and is for the sole use of the
intended Gartner audience or other authorized recipients. This presentation may contain information that is confidential,
proprietary or otherwise legally protected, and it may not be further copied, distributed or publicly displayed without the express
written permission of Gartner, Inc. or its affiliates.
2011 Gartner, Inc. and/or its affiliates. All rights reserved.
Page 17
This presentation, including any supporting materials, is owned by Gartner, Inc. and/or its affiliates and is for the sole use of the
intended Gartner audience or other authorized recipients. This presentation may contain information that is confidential,
proprietary or otherwise legally protected, and it may not be further copied, distributed or publicly displayed without the express
written permission of Gartner, Inc. or its affiliates.
2011 Gartner, Inc. and/or its affiliates. All rights reserved.
Page 18
This presentation, including any supporting materials, is owned by Gartner, Inc. and/or its affiliates and is for the sole use of the
intended Gartner audience or other authorized recipients. This presentation may contain information that is confidential,
proprietary or otherwise legally protected, and it may not be further copied, distributed or publicly displayed without the express
written permission of Gartner, Inc. or its affiliates.
2011 Gartner, Inc. and/or its affiliates. All rights reserved.
Page 19