Beruflich Dokumente
Kultur Dokumente
Copyright 2011 The Taneja Group, Inc. All Rights Reserved. 87 Elm Street, Suite 900 Hopkinton, MA 01748 T: 508.435.2556 F: 508.435.2557
1 of 21 www.tanejagroup.com
Summary of Findings
We scored each competitive vendor on a 5-point scale measuring technology platform features, operations management capabilities, and virtual infrastructure focus and expertise (0 to 4, see Appendix A for details). A summary score was then generated for each vendor solution, in which a score of 0-1 indicates that the solution is not suitable today as a VIOM platform; 1-2 indicates limited suitability as a VIOM platform, or a point solution; 2-3 indicates a good starting point for a VIOM platform, with some advanced features; and 3-4 indicates a strong VIOM platform, with many advanced capabilities.
Figure 1: Competitive vendor solutions: technology platform and operations management factor scores Solarwinds vCOps Enterprise vCOps Advanced vCOps Standard Netuitive VKernel
Xangati
Zenoss
Veeam
Quest
3 4 2 2 2 4 1 3 1 1 3 1 0 4 4 4 4 0 0 0 4 0 2 0 0 0 4 3 4 4 3 2 3 3 2 2 3 1 1 3 3 2 2 4 2 4 2 1 0 1 3 4 3 0 3 0 0 1 3 1 3 4 3 0 2 0 0 1 2
Operations Management Features: Diagnosis & 3 4 3 Troubleshooting Capacity Mgmt. 4 4 4 & Planning Configuration & 4 4 1 Compliance Virtualization Focus / Expertise:
4 1 4 4 4 1 4 2 4 3 1 4 1
SUMMARY SCORES
3 3 3 2 2 2 2 2 2 1 1 1 1
3.7 3.4 3.1 2.7 2.6 2.4 2.3 2.3 2.0 1.7 1.3 1.3 1.0
SOURCE: TANEJA GROUP
Copyright 2011 The Taneja Group, Inc. All Rights Reserved. 87 Elm Street, Suite 900 Hopkinton, MA 01748 T: 508.435.2556 F: 508.435.2557
2 of 21 www.tanejagroup.com
Cirba
BMC
CA
VMware continues to build out the vCenter suite with added-value management solutions augmenting vCenter Server via acquisition and in-house development, and is a top competitor across all VIOM functional categories. With vCenter Operations (VCOps), VMware has made a strong entry into the VIOM market.
In short, VMware is not only the virtualization platform leader, but a key management innovator. VCOps is a bold move, and in our view customers will benefit from evaluating it in the context of both existing and emerging competitive solutions.
Copyright 2011 The Taneja Group, Inc. All Rights Reserved. 87 Elm Street, Suite 900 Hopkinton, MA 01748 T: 508.435.2556 F: 508.435.2557
VIRTUAL INFRASTRUCTURE OPERATIONS MANAGEMENT: DRIVERS AND REQUIREMENTS Why Explore Virtual Infrastructure Operations Management?
Four years ago, Taneja Group began tracking the emerging class of solutions designed to simplify management and optimization of virtual infrastructures. Our focus then was on solutions that helped customers virtualize more workloads, faster, and with more confidence. At that time, the primary drivers for virtualization were capital and operating expense (CapEx & OpEx) savings through workload consolidation, mobility, and higher availability. Soon, we expect nearly half of all enterprise workloads to be virtualized. This means that the lowhanging fruitthe less-critical workloadshave already been virtualized, and many enterprises are now virtualizing business-critical, Tier-1 applications. These applications demand much greater operational oversight and control, and generate a host of performance metrics from across the physical and virtual IT stack. Collecting and processing all of these metrics quickly becomes overwhelming for any human to manage manually, leading first to a data problem (Figure 2). And, this in turn demands more from VMware administrators: much faster and more automated performance troubleshooting, diagnosis, planning, and remediationin short, an operations problem. The goal must now be to solve both of these problems through automation: automated data analysis to pinpoint the sources of performance problems sooner, and automated operations to fix them faster (Figure 3). Taneja Group tracks solutions that address these problems under the Virtual Infrastructure Operations Management (VIOM) umbrella, indicating the rising importance of end-to-end infrastructure performance and operations management for business-critical virtualized workloads. In sum, business-critical virtualization requires greater operations maturity. And, as virtualization is an essential enabling technology for cloud computing (both private and public), companies must establish rock-solid VIOM capabilities before they can hope to efficiently manage critical workloads running in the cloud.
Figure 2: Dynamic and growing virtual environments generate large amounts of performance data, which is typically analyzed and processed manually via multiple management tools, interfaces, and scripts.
Copyright 2011 The Taneja Group, Inc. All Rights Reserved. 87 Elm Street, Suite 900 Hopkinton, MA 01748 T: 508.435.2556 F: 508.435.2557
4 of 21 www.tanejagroup.com
Figure 3: The goal of virtual infrastructure operations management solutions: automation of performance data collection and analysis, plus automation of the operations management lifecycle.
Copyright 2011 The Taneja Group, Inc. All Rights Reserved. 87 Elm Street, Suite 900 Hopkinton, MA 01748 T: 508.435.2556 F: 508.435.2557
5 of 21 www.tanejagroup.com
Mobility creates complexity: Before we can hope to diagnose a performance problem, we have to know where each resource is, and why it moved. Performance management tools must track these mobility events and correlate them to performance problems.
In the virtual infrastructure, change is the only constant. It's not very useful, now, to measure how many IOPS a particular array can deliver, or the CPU utilization on a single vSphere host, or the bandwidth utilized on one vSwitch, etc., as independent data points. They each change too often, and none provides enough information to understand how the broader virtual infrastructure is responding to load.
In addition to these factors, we also reviewed each vendors focus on and proven capabilities for management of highly virtualized infrastructures, solution packaging and pricing options, and overall product and solution maturity.
Copyright 2011 The Taneja Group, Inc. All Rights Reserved. 87 Elm Street, Suite 900 Hopkinton, MA 01748 T: 508.435.2556 F: 508.435.2557 6 of 21 www.tanejagroup.com
Note: we included BMC and CA, two of the big 4 enterprise management systems vendors, because they have focused strongly on crafting solutions targeted specifically at VMware virtual infrastructures and compete more directly in the VMware management space than IBM or HP. We also excluded IBM and HP to limit project scope.
VMWARE VCOPS STANDARD AND ADVANCED VCOps Standard and Advanced are automated operations management solutions that integrate performance and capacity data and management operations for VMware-virtualized infrastructures. VCOps Standard edition includes all vSphere metrics, analytics, health models, and an operations GUI, for VMware installations of up to 1500 VMs. The Advanced edition adds capacity planning by bundling VMwares vCenter CapacityIQ product, and is well-suited for small to medium-sized and growing environments. Both editions include: Patented self-learning performance analytics: VCOps collects over 250 metrics for every single object via the vCenter API (the largest set of metrics in our survey), providing a rich data set of utilization, capacity and configuration data. The analytics engine automatically establishes normal behavior baselines through self-learning mathematics, sets up dynamic thresholds (smart alerts), and then tracks how performance data is trending relative to these baselines. VCOps also calculates and presents high-level health, workload, and utilization scoresthis can dramatically reduce the amount of data the operations team must sort through themselves in order to identify current or emerging performance problems. Graphically-rich performance dashboard: A next-generation graphically-rich GUI presents health scores at any level in the infrastructure, allowing for rapid drill-down into underlying root causes quickly. Dashboards, which are customizable, gather a broad array of data on a single screen, organized in an intuitive, easy-to-navigate structure. Problem resources are shown in relation to their parents, peers, and children, making root-cause and impact analysis faster and more accurate. Capacity planning designed for virtual infrastructures: VCOps CapacityIQ module supports capacity analysis, forecasting and planning for virtual resources, including available capacity, in-use, needed, and time-to-full. Dashboards provide at-a-glance charts and graphs for rapid analysis; customizable rules and alerts provide automated notification of threshold breaches. On-going capacity optimization is supported via a complete set of detailed reports including recommendations for right-sizing or decommissioning. Interactive what-if modeling allows multiple scenarios to be tested easily and as required.
QUEST VFOGLIGHT VFoglight uses widgets, charts, and graphic overlays effectively to present a broad range of performance metrics, but includes no predictive, self-learning, or other mathematical analysis to spot emerging performance problems outside predefined thresholds. vFoglight includes capacity planning features, but falls short of CapacityIQ when it comes to optimizing VM density (CapacityIQ more accurately determines available capacity by taking into account the impact of reservations for High Availability, for example). vFoglight does include extensive remediation capabilities via an included Workflow Studio and 50 predefined Action Packs, which are designed specifically to automatically resize and/or reconfigure the virtual infrastructure in response to an alarm or alert. No compliance management is included in vFoglight (Quests Foglight offers compliance management). In sum, vFoglight excels at supporting VMware admins in the way they work today: flooded with metrics, the admin sets thresholds and alerts, identifies problems, and can automatically fix many of them. At scale, this approach can become operationally overwhelming, so we expect Quest customers to request enhanced performance analytics as the VMware environments they support (and the metrics they must monitor) continue to grow.
Copyright 2011 The Taneja Group, Inc. All Rights Reserved. 87 Elm Street, Suite 900 Hopkinton, MA 01748 T: 508.435.2556 F: 508.435.2557
8 of 21 www.tanejagroup.com
SOLARWINDS VIRTUALIZATION MANAGER Virtualization Manager stands out for two reasons: a unique search-based interface to performance data, and a focus on configuration management. Virtualization Manager is a monitoring solution, not a performance management platform, lacking any predictive performance root-cause or impact analytics. Raw and correlated metrics are presented to the admin in an attractive and highly customizable widget-based dashboard, but alerts are static (prepackaged and customizable). Solarwinds stresses community in Virtualization Manager, and encourages users to share useful alerts and queries with other admins. No predictive analytics are provided. Virtualization Manager is essentially a search-driven dashboard for analysis of vCenter metrics, with configuration and storage visibility that help it stand out from the other VMware monitors we reviewed. We like the search-driven interface, but relying solely on search limits the products chances of evolving to be a more complete operations management platform. VKERNEL VOPERATIONS SUITE VKernel is a vCenter monitor and capacity planning tool, and lacks any behavioral or predictive performance analytics. No configuration or compliance management features are included. A relatively small set of vCenter metrics are collected and presented in very simple charts and report views; from these, the admin can investigate performance problems. Alerting relies on vCenter alarms primarily, but users can also set thresholds and run trend analysis manually to identify emerging problems. The recently-released Performance Analyzer has a simplistic GUI, relying on Excel-style sheet views and a navigation tree that echoes vCenter. VEEAM ONE Veeam One is not a performance management solution, nor is it sold as one. The product offers very basic and limited vSphere monitoring features, and no performance visibility beyond simple correlations. No performance analytics are provided, and capacity trending is rudimentary. No configuration or compliance management is provided. In our view, Veeam One is essentially a charting, reporting and documentation tool for VMware environments that have no other tools except vCenter. Indeed, Veeam calls the product a better vCenter than vCenter, which is appropriate, and we expect to see little uptake outside of the SMB market. CIRBA DATA CENTER INTELLIGENCE Cirbas Data Center Intelligence is essentially a data warehouse and data mining solution for largescale IT migration and refresh projects. As such, it is not a VIOM solution as weve defined it: it lacks run-time performance monitoring, alerting, or analytics designed to identify performance impact or root causes. It has no run-time operations dashboard. Its capacity optimization and configuration features are limited to what-if analysis for planning purposes, and in our view are primarily suited only to planning for large-scale technology refreshes, migrations, or cloud deployments. Cirba offers no configuration management or compliance features beyond business rules that govern where in a physical infrastructure virtual workloads can and should be placed.
Zenoss offers a commercial open-source performance data warehouse, well-suited for troubleshooting performance problems after they occur, but is not sold as a complete operations platform for virtual infrastructures. Xangati and CA (Virtual Assurance) are both network monitors and performance analyzers. For network-sensitive applications (such as virtual desktop environments or particularly latency-sensitive applications), both might play a role as effective add-ons to a broader VIOM platform solution. VMWARE VCOPS (ALL EDITIONS) The core of all VCOps editions is technology from VMwares acquisition of Integrien in 2010. VMware has augmented Integriens self-learning analytics with additional vSphere metrics, best practices, and in-depth vSphere operational knowledge to create industry-first, virtualization-specific infrastructure health models for VMware infrastructure. NETUITIVE Netuitive is the strongest of the general-purpose event correlation and analysis (ECA) engines we reviewed, but as with the other ECA-only solutions, is not a standalone VIPM solution. Netuitive does include predictive performance analysis, based on a patented behavioral learning engine and multivariate regression analysis. For VMware operations teams, Netuitive lags VMware in the domainspecific knowledge contained in VCOps. VCOps combines behavioral learning via mathematical analysis plus expert knowledge of hundreds of vCenter metrics; together, these yield the VCOps health model, which identifies important patterns emerging in vCenter metrics. In other words, Netuitives pure-math approach might be comparable VCOps, but VCOps brings more domain knowledge to bear on whether a performance anomaly is important at a given time to a VMware operations team. Netuitive is not a VIPM platform as we have defined it (nor is it sold as one), lacking capacity planning, configuration or compliance remediation. BMC PROACTIVENET & CAPACITY MANAGEMENT We did not identify any strongly differentiating features in ProactiveNet or Capacity Management that clearly place them ahead of or behind VCOps. That said, ProactiveNet offered the most featurerich self-learning analytics engine of the VCOps competitors we reviewed. Customers evaluating BMC relative to VCOps in terms of predictive analytics are encouraged to pilot both in a real-world situation. Neptunys Caplan product (which became part of the broader BMC Capacity Management suite) had very limited uptake before it was acquired, and the companys revenue was heavily servicesweighted, leading us to believe that significant integration work still needs to be done by BMC to expose the Caplan functionality in Capacity Management. XANGATI VI & VDI DASHBOARDS Xangati provides a very narrowly-focused view of virtual infrastructure performance, based on deeppacket inspection and impact analysis. The vCenter metrics included in Xangatis performance dashboards are minimal (CPU, disk, memory, etc.), so it will not identify emerging problems deep in the infrastructure; its strength lies in user response-time monitoring and troubleshooting. Xangati does provide self-learning analytics, but in a traditional ECA sense: the goal is to solve network performance problems. The live performance charts, again, are suited to NOC-style operationsthey are of less value in the general case of VIOM. Xangati focuses on use cases that show off its differentiators, primarily VDI deployments where display protocol performance and user response times are the critical measures of performance. No capacity or configuration management features are offered. Xangati is a low-cost add-on for specific use cases, in our view.
Copyright 2011 The Taneja Group, Inc. All Rights Reserved. 87 Elm Street, Suite 900 Hopkinton, MA 01748 T: 508.435.2556 F: 508.435.2557
10 of 21 www.tanejagroup.com
CA VIRTUAL ASSURANCE CA offers a broad set of IT management bundles that address all major IT management disciplines. Since mid-2010, CA has attempted to package some of its component modules specifically for virtual infrastructure, in order to appeal directly to virtualization managers and administrators, but in our view the vendor still has considerable work to do. Virtual Assurance is an adequate event correlation and analysis engine, based primarily on identifying problems based on user/service response-time degradation, but it does not provide predictive performance analytics for early warning of performance problems within the virtual infrastructure itself. ZENOSS Zenoss provides a general-purpose, commercial open source monitoring and data analysis tool, but does not provide predictive performance analysis via advanced algorithms or deep visibility into the virtual infrastructure. The data warehouse supports performance data mining after the fact, but does not provide early notification of problems based on self-learning analytics. Alert storms are reduced via filtering, but all intelligence is contained in policies, which must be defined by the user in advance. While there is a large community of admins providing open-source adapters and policies, Zenoss is dependent on them to increase the value of their product in enterprise environments. As a VIOM platform, Zenoss falls short due to lack of any virtual infrastructure-focused capacity planning, configuration management, or compliance remediation. In our view, Zenoss is suited as an add-on performance analysis tool only, and could possibly be deployed as a data source for VCOps as opposed to a competitive platform.
11 of 21 www.tanejagroup.com
CA TECHNOLOGIES CA Virtual Configuration competes favorably with the vCenter Configuration Manager component of VCOps Enterprise; a deeper competitive analysis will require testing each product against a specific set of customer requirements, however. CA is still struggling to shed its image as a mainframe tools supplier to legacy customers, which can put it in a defensive position in sales situations. CA offers a bewildering array of IT management tool suites, which can make it difficult for prospective users to evaluate and understand which solution works best. Since many of the CA management products have not yet been adapted for virtual environments, a new customer deployment can require a significant investment in professional services to actually implement. BMC SOFTWARE BMC draws on its considerable experience in business service management for large enterprises as it adds virtualization-targeted features to its solution portfolio. BMC does not have an identifiable product strategy focused on virtualization. Instead, the company is working to adapt many of its other management tools to virtualization, as they were not originally built for this purpose. While the company attempts to sell these physical infrastructure management solutions into virtualized environments today, the deployment often requires a considerable professional services investment on the part of the customer to successfully implement. In addition, BMC lags VCOps significantly when it comes to configuration management for virtual machines, lacking automated remediation and compliance templates built for virtualized servers. Finally, a medium-to-large installation of BMC ProactiveNet Enterprise plus one companion offering can cost a customer in the mid-six figures for product licenses, and often another six-figure investment in professional services.
NOTICE: THE INFORMATION CONTAINED HEREIN HAS BEEN OBTAINED FROM SOURCES BELIEVED TO BE ACCURATE AND RELIABLE, AND INCLUDES PERSONAL OPINIONS THAT ARE SUBJECT TO CHANGE WITHOUT NOTICE. TANEJA GROUP DISCLAIMS ALL WARRANTIES AS TO THE ACCURACY OF SUCH INFORMATION AND ASSUMES NO RESPONSIBILITY OR LIABILITY FOR ERRORS OR FOR YOUR USE OF, OR RELIANCE UPON, SUCH INFORMATION. COMPANY, BRAND AND PRODUCT NAMES REFERENCED HEREIN MAY BE TRADEMARKS OF THEIR RESPECTIVE OWNERS.
Copyright 2011 The Taneja Group, Inc. All Rights Reserved. 87 Elm Street, Suite 900 Hopkinton, MA 01748 T: 508.435.2556 F: 508.435.2557
12 of 21 www.tanejagroup.com
EVALUATION FACTORS
Technology Platform Features
Feature Group Monitoring Analytics Evaluation Factors Data sources (vCenter, guest, host, cluster; physical host, network, storage); type of metrics collected and breadth; collection methods supported; collection frequency; adapters shipped; adapter interfaces Type of database(s) utilized; baseline (normal) determination (self-learning, packaged, thresholds, userdefined, best practices); KPI establishment; KPI correlations; derived health scores (metrics included); historical performance data retention; search capabilities; impact and root-cause analysis support. Current performance display (dashboards, widgets, sorted lists, top-N views, heat maps, topology maps, score badges, traffic light, charts, graphs); integration of multiple element types; expansion & drilldown; GUI density; navigation styles. Root-cause investigation; troubleshooting; exploration.
Visualization
Planning
Remediation
Copyright 2011 The Taneja Group, Inc. All Rights Reserved. 87 Elm Street, Suite 900 Hopkinton, MA 01748 T: 508.435.2556 F: 508.435.2557
13 of 21 www.tanejagroup.com
SCORING KEY
We established a 5-point scoring system for each factor, where 0 = no capability and 4 = a featurerich, innovative and/or mature solution. Representative criteria: Technology Platform Features
Feature Group Monitoring Evaluation Factors 1 = basic metrics sourced from vCenter 2 = deeper metrics sourced from vCenter 3 = metrics sourced from vCenter and some physical infrastructure 4 = broad and deep metrics sourced from vCenter and physical infrastructure 1 = metric monitoring and collection only; limited correlation 2 = adequate metrics correlation/trending 3 = advanced analytics, self-learning behavioral performance modeling 4 = advanced, self-learning analytics plus vSphere-specific health models 1 = basic metric views (sorted lists, top-N) 2 = correlated views/charts/graphs, good use of color/charts/navigation 3 = advanced navigation/charts/graphs; multi-dimensional dashboards 4 = rich, dense multi-dimensional dashboards, advanced navigation Evaluation Factors 1 = basic performance visibility; limited diagnostic support 2 = adequate, maturing diagnostic and troubleshooting features 3 = advanced diagnostic and troubleshooting features 4 = leading diagnostic and troubleshooting features 1 = capacity visibility only 2 = adequate capacity planning and modeling features 3 = advanced capacity planning and modeling features 4 = leading capacity planning and modeling features 1 = configuration/change visibility only 2 = some integration with configuration lifecycle operations 3 = broad configuration management features 4 = full-cycle configuration management plus continuous compliance
Analytics
Visualization
Planning
Remediation
Copyright 2011 The Taneja Group, Inc. All Rights Reserved. 87 Elm Street, Suite 900 Hopkinton, MA 01748 T: 508.435.2556 F: 508.435.2557
14 of 21 www.tanejagroup.com
Technology Platform
Resource and availability metrics are collected every 2 minutes via vCenter API (and Hyper-V via WMI) and averaged hourly, with raw data retained indefinitely for historical performance queries. Metrics are collected in an embedded or external SQL database. Abnormal performance is identified via 60+ pre-packaged alarms, based on historical trending and thresholds, which are static, predefined, and user-customizable. The performance GUI is rich and utilizes graphics, charts, and animation effectively, but does not provide higher-order calculated health scores to reduce the amount of data an operator must manage. Widget-based dashboards are customizable via drag-and-drop. Home dashboards are pre-built and roll up CPU, network, memory and disk utilization at the vCenter, datacenter, cluster, host, resource pool, datastore, and VM level.
Operations Management
Historical performance diagnosis is supported by selecting calendar ranges, which then apply to all widget displays on screen and across tabs. Any widget displaying historic performance metrics can be exported and shared across teams as PDF or Excel. Capacity planning features include right-sizing dashboards and trend analysis over any time horizon. Capacity modeling and what-if analysis is also included. The most recent vFoglight version (6.5) included new support for Microsoft Hyper-V and automated remediation features. Any type of script (PowerShell being the most common) can be attached to an alarm. The Workflow Studio is also included for designing custom workflows, with 50 different Action Packs predefined for VMware environments. Workflows integrate with BMC Remedy for help desk process automation.
SOLARWINDS
Hyper9, founded in 2007, began shipping its Virtualization Optimization Suite in 2008. The company was acquired by Solarwinds in early 2011 and the product was renamed Virtualization Manager. Virtualization Manager is packaged as a single virtual appliance. Pricing is per-powered-on virtual machines, starting at $2995 for 50 VMs.
Technology Platform
Virtualization Manager collects configuration, performance and state information from vCenter, from unmanaged ESX/ESXi hosts, and from guests directly via WMI. Collection interval defaults to 10 min for performance and state data and 12 hours for configuration data (adjustable). Correlated raw performance data (for VMs, hosts, datastores, clusters, and applications) is retained as long as configured, and averaged into hourly rollups. No additional analytics beyond simple correlations are proCopyright 2011 The Taneja Group, Inc. All Rights Reserved. 87 Elm Street, Suite 900 Hopkinton, MA 01748 T: 508.435.2556 F: 508.435.2557 15 of 21 www.tanejagroup.com
vided. A proprietary database in the virtual appliance is accessed solely via a search interface. The GUI ships with 20+ preconfigured dashboards made up of a set of Flex widgets (alert monitor, consumption, content, fitment, notes, Top N, trend, etc.). Each widget displays ranked results of a query.
Operations Management
Virtualization Manager ships with 40+ pre-packaged alerts to identify and highlight common problems in virtual infrastructures. Alerts can be modified and new alerts created on any resource set via a custom query. Performance chart widgets can overlay any set of metrics for visual correlation. Capacity planning is via a collection of widgets that model resource containers and resource profiles; historic queries establish container utilization trends and predict capacity events (time to full, room for additional, what-if, N-1 analysis, etc.) given resources of a certain profile. Basic consumption widgets graph remaining virtualization resources based on default usage profiles and container settings for CPU, IOPS, Memory, Network, and Space. Configuration data for any VM, guest OS, or application (if collected) can be compared to a reference standard, to the VM itself over time. A recent enhancement is called Time Travel, which maps dependencies between VMs, hosts, datastores, clusters, and vApps visually and historically for forensic analysis. Remediation is not a focus of Virtualization Manager, but scripts can be tied to an alert.
VKERNEL
VKernel was founded and began shipping virtual infrastructure (VI) performance and capacity management software in 2007. In Spring of 2011, VKernel repackaged its solutions into a single VKernel vOperations Suite (called vOPS), including four preexisting products: Performance Analyzer, Capacity Manager, Optimizer, and Reporting & Chargeback. vOPS is delivered as a single virtual appliance (289MB) containing all four products; 30-day trials are available for each. Several free VM tools are offered as well. vOPS is priced per socket and per module: 1 module for $299, 2 for $499, 3 for $599, all 4 for $649. VKernel claims 700 customers.
Technology Platform
vOPS has a single data collection point, the vCenter API, from which it collects metrics (70-80) and vCenter alerts. Metrics are collected every 30 minutes by default and vCenter is scanned for new alarms every 2 minutes. Analytics are provided via the underlying Capacity Analytics Engine, which has been extended for Performance Analyzer to include abnormal trends, root cause, and impact analysis. These terms are used liberally by VKernel, but the product includes no event correlation or analysis analytics, no predictive performance algorithms, and limited impact analysis. The data model does include recommendations for resolution (hot-add memory to a VM, for example).
Operations Management
VKernel does filter vCenter alerts to identify root causethe underlying VM metrics of most interestreducing what the vendor calls alert storms and presenting a short description and recommendation for remediation, if available. Performance impact analysis screens present metric and alarm histories alongside lists of impacted VMs and datastores. Trend alarms can be configured manually, but are based on user-defined thresholds, not on any algorithms provided by VKernel. Capacity planning is the most mature capability in the VKernel suite. Enhanced capacity availability maps and reservations management have recently been added and compete favorably with the CapacityIQ component of VCOps. A limited set of remediation suggestions (based on VKernel-defined best practices) can be executed via the vCenter API with a single click from the Performance Analyzer interface.
Copyright 2011 The Taneja Group, Inc. All Rights Reserved. 87 Elm Street, Suite 900 Hopkinton, MA 01748 T: 508.435.2556 F: 508.435.2557 16 of 21 www.tanejagroup.com
VEEAM
Veeam was founded in 2006 and is best known for its popular Backup & Replication product for VMware. Veeam acquired nworks in 2008, gaining management packs/plugins that provide VMware metrics to Microsoft System Center and HP Operations Manager. Veeam ONE is a VMware monitoring and reporting suite that includes three bundled products: Monitor, Reporter, Business View. Veeam claims 25,000 customers (adding 700+ per month), of which between 4000 and 5000 have bought Veeam ONE (roughly 20% of total). Pricing is per socket.
Technology Platform
Veeam Monitor is a Windows application deployed against an SQL database; the Reporter module is an MS SQL Reporting Services app installed separately. All metrics are collected via vCenter APIs. Veeam claims to monitor elements vCenter doesnt (snapshot size, for example), and supports 100+ new vSphere 4.1 performance metrics in Monitor 5.0. No advanced analytics or health scores are included. A full suite of management dashboards and performance charts are included, driven by 125 pre-defined alarms and thresholds defined in the Monitor knowledge base (predefined by Veeam based on years of customer feedback) and including possible causes of each alarm, suggested resolution, and links to external documentation.
Operations Management
Veeam One is not a performance diagnosis/troubleshooting, capacity optimization, or configuration/compliance solution. Veeam focuses on monitoring and visibility only. Recent enhancements include deeper virtual disk & snapshot monitoring, additional canned metric historical reports (including business and infrastructure tree views), and the ability to identify configuration events on historical performance charts. Capacity planning is rudimentary, and designed as a starting point for VMware admins who have no other capacity planning tools.
CIRBA
Cirbas Data Center Intelligence (DCI) is an analytics software package that seeks to optimize resource utilization through efficient placement of application workloads on physical and virtual infrastructures. Founded in 1999, Cirba has focused on the virtualization market since 2007. The DCI solution is sold primarily through systems integrators and used to support datacenter transformation planning initiatives, but is also available direct from Cirba. The vendor claims 200+ customers and prices per engagement. Most recently, Cirba has focused on helping large customers plan for cloud migration projects
Technology Platform
DCI collects configuration data from physical and virtual infrastructure, via one-time or automated imports, in order to populate a policy-based rules engine. This repository is described as being analogous to a business intelligence data warehouse for IT planning. Sources of configuration data and resource utilization can include vCenter, a CMDB, management platforms (Tivoli, OpenView, BMC), or manual import. Existing technology and/or business policies governing workload placement and constraints, if available, can also be imported, or users can leverage 90 prepackaged rule sets covering most major server and virtualization platforms. Policy rules describe what systems can run together, and what systems should run together. DCI then applies proprietary contention probability and other algorithms to determine the most efficient placement of workloads across physical and virtual infrastructure to maximize consolidation ratios and utilization rates within business constraints.
Copyright 2011 The Taneja Group, Inc. All Rights Reserved. 87 Elm Street, Suite 900 Hopkinton, MA 01748 T: 508.435.2556 F: 508.435.2557 17 of 21 www.tanejagroup.com
Operations Management
The primary interface to Cirba is via reports and dashboards recommending optimal placement of workloads across various resources, in a color-coded heatmap-style matrix. The heatmap indicates workloads that should be moved, servers that can be further consolidated, etc., depending on the environment and the types of business rules that have been implemented (physical location and security constraints, for example). Historical utilization data can also be fed into Cirba to further strengthen the model with capacity trending (CPU, memory). Cirba does not consider the DCI solution capacity planning as the term is typically used by server administrators, because they do not stress VM or host capacity managementthe focus is on the most efficient placement of workloads.
NETUITIVE
Netuitive was originally founded in the 1990s, and in 2002 incorporated in its current form. Its predictive analytics technology has been applied specifically to performance management of virtual infrastructures since 2007. Netuitive claims 40 enterprise customers & 270+ OEM customers, including 8 of the top 10 global banks. Netuitives solution is built around its patented Behavioral Learning Engine, based on predictive analytics.
Technology Platform
Data is collected at varying frequencies (5-15 minutes, typically) from the vCenter API and dozens of other widely-deployed systems monitoring and management solutions. Netuitive then applies both expert knowledge and statistical techniques (cross-correlation and patented multivariate regression analysis) to determine which metrics best characterize behaviors of managed elements. Best practices are packaged as templates, including pre-defined sets of KPIs which the Behavioral Learning Engine uses to generate health indicators (scores) and trusted alarms. Users can build customized templates. The state of each managed element is determined through 5 automatically calculated indices: health, capacity, workload, alarm, and availability. An additional performance management database (PMDB) was added in 2010 to support historical queries against the time-series performance data. The PMDB stores the analytical results used by the Netuitive GUI, reports, dashboards and search engine. Netuitive goes beyond simple linear regression and correlation and has been proven in the market to assist customers in identifying emerging performance problems fasterprimarily in financial services.
Operations Management
Users interface with Netuitive via a single GUI, which includes performance dashboards, discovery and topology mapping (with CMDB auto-sync), drill-down root-cause diagnosis (including overlays of configuration events, component attributes and related components that are also alarming), trending, alarms, and historical analysis (search and reporting). Netuitive is not sold as a performance management platform in and of itself, but as an add-on analyzer whose alerts and recommendations can feed downstream management platforms such as HP Operations Manager, IBM Tivoli Management, BMC Patrol, Microsoft Operations Manager, NetIQ, and others.
ZENOSS
Zenoss started in 2006 as an open source element management vendor providing an alternative to traditional Big 4 enterprise systems management frameworks. In 2007 Zenoss released its first commercial open source product, Zenoss Enterprise. In March of 2011, Zenoss announced Datacenter Insight, which adds unified analytics on top of monitoring data collected from the datacenter inCopyright 2011 The Taneja Group, Inc. All Rights Reserved. 87 Elm Street, Suite 900 Hopkinton, MA 01748 T: 508.435.2556 F: 508.435.2557 18 of 21 www.tanejagroup.com
frastructure (physical, virtual, network, storage, and more). The vendor claims 350+ commercial customers and 100,000 community members, and sells via subscription (platinum, gold, silver offerings).
Technology Platform
Zenoss gathers data from both physical and virtual environments and correlates performance and availability metrics. Virtual infrastructure components are automatically categorized and discovered, including VMs, hosts, clusters, and datastores. Zenoss tracks all managed elements in a real-time service model a service topology map from which users can drill down to explore fault details and perform impact analysis. Zenoss Enterprise creates a central data warehouse of all collected metrics to support service impact analysis, root cause analysis, and service assurance. Impact policies are defined via Policy Gates, which define normal behavior baselines from which trend reports and emerging problems can be identified primarily via reports.
Operations Management
The primary interface to Zenoss is a performance dashboard based on a service map, which the tool discovers automatically. Zenoss also includes a service designer, where users create new services that can be made up of any mix of web and database servers, physical and virtual infrastructure, storage and network, or other IT resources. Dynamic service views provide real-time discovery of available services and live topology maps, as well as logical and physical mappings between business systems, locations, and people. The service model can also be augmented via manual input, import and export, Web services API, etc.
XANGATI
Xangati was founded in 2006 and originally provided network infrastructure monitoring for telco service providers. Building on a deep network visibility and real-time analytics baseline, Xangati repackaged the solution as a virtual appliance and rebranded it as VI Dashboard, launched in March 2010. Xangati claims a couple of hundred paying customers and thousands of downloads of its free product: a single-ESX/ESXi insight dashboard. Current paid products include Xangati for ESX (for unmanaged ESX hosts), and Xangati VI and VDI Dashboards. Entry pricing for VDI Dashboard is $25/VM for 100 VDI desktops ($2500). Xangati VI Dashboard is priced at $300/socket.
Technology Platform
The Xangati virtual appliance collects metrics directly from the vSwitch to allow real-time monitoring of the virtual infrastructure from a network vantage point. 150 network metrics are collected across a range of managed objects, which include VMs, hosts, applications, groups, interfaces, etc. vCenter data is integrated to correlate additional metrics, including VM CPU, memory, and network and storage I/O. A self-learning in-memory analytics engine determines normal behavior (via flash profiling), tracks anomalies, and yields an overall health index. Individual metrics by object are displayed in a series of prebuilt widgets in a cockpit-style dashboard view with real-time charts, sorted lists, and a set of top-N reports.
Operations Management
Xangatis dashboards are primarily designed for real-time network-layer VI monitoring and problem detection and do not support virtual infrastructure utilization, capacity planning or remediation. The interface will be familiar to NOC teams. Users can spot anomalies, record data during a problem, and quickly drill down into the VMs that make up a problem application, helping to pinpoint the source. The health index (deviation from normal performance) is primarily a measure of network performance and lacks insight into the virtual server and storage tiers.
Copyright 2011 The Taneja Group, Inc. All Rights Reserved. 87 Elm Street, Suite 900 Hopkinton, MA 01748 T: 508.435.2556 F: 508.435.2557 19 of 21 www.tanejagroup.com
CA TECHNOLOGIES
CA Virtual is a family of virtual infrastructure management products. For our assessment, the most relevant products are CA Virtual Assurance (performance monitoring, event correlation and root cause analytics), CA Virtual Assurance for Infrastructure Managers (centralized visibility and management), CA Virtual Configuration (policy-based configuration and change compliance management), and CA Virtual Automation (virtual server provisioning, plus capacity and utilization tracking). CA is also integrating Virtual Assurance with eHealth Performance Manager and the Spectrum Managers. Founded in 1976 and one of the Big 4 systems management vendors, CA is now leveraging its strengths to become a player in the cloud and virtualization management markets. CAs virtual infrastructure management offerings are primarily sold by CAs direct sales force. Though CA mostly sells to enterprises on a per-module or per-suite basis, it has also introduced the CA Virtual Foundation Suite, which combines select virtualization management products at a discounted price.
Technology Platform
Based on NetQoS technology acquired in 2009, CA Virtual Assurance collects vCenter resource utilization data via the vCenter APIs, and also collects application-specific infrastructure response time metrics (derived from deep-packet inspection of all IP traffic) via a virtual collector residing on the vSwitch in each VMware host. Virtual Assurance then correlates these two streams of data to enable virtual administrators to analyze root-cause resource contention issues. The Virtual Assurance console provides real-time views of the physical and virtual network topology, which is continuously updated to show infrastructure changes. These views can be extended to encompass physical, virtual and cloud environments with the use of CA Spectrum Automation manager. CA Virtual Configuration is a standalone configuration management tool for heterogeneous virtual environments. Its discovery capability identifies server and application dependencies, and then inventories that data for configuration baselining and validating configurations.
Operations Management
CA Virtual Assurance sends threshold-based alerts in the event of response time degradation, and the administrator can then drill down to determine root cause and decide what actions to take. CA Virtual Configuration automatically detects VM configuration drift by comparing configuration changes against stored baselines, and then remediates drift by enforcing configuration policies. The products virtualization dashboards facilitate change tracking and review, by first checking compliance for audits and then reporting the environments status. Depending on how it is deployed, the add-on CA Spectrum Automation product can dynamically remediate problems based on user-specified policies, by automatically responding to changes in resource utilization, configuration, and application performance across virtual and physical environments.
BMC SOFTWARE
BMC ProactiveNet is a predictive and proactive application performance management solution. The product consists of two components: BMC ProactiveNet Performance Management, and BMC End User Experience Management. The ProactiveNet product suite is integrated and can be used with several other BMC product suites, including BMC Service Level Management, Atrium Discovery and Dependency Mapping, and Atrium CMDB. The product also integrates with BMC Capacity Management, based on technology acquired from Neptuny in 2010. BMC Capacity Management is a generalpurpose capacity planning and management tool family, and recent Neptuny-based enhancements have extended its capabilities into virtual environments.
Copyright 2011 The Taneja Group, Inc. All Rights Reserved. 87 Elm Street, Suite 900 Hopkinton, MA 01748 T: 508.435.2556 F: 508.435.2557 20 of 21 www.tanejagroup.com
Founded in 1980 and the smallest of the Big 4 systems management vendors (with revenues just under $2B/year), BMC develops and sells IT service management software to some of the worlds largest companies. BMC is currently leveraging its core strengths in service desk, change and configuration management, and service automation to enter the markets for virtualization and cloud management. List pricing for BMC ProactiveNet Enterprise and similar BMC suites runs in the mid-six figures, meaning that larger customer installations can cost well over $1 million. Today, BMCs virtualization management offerings are largely platform agnostic, enabling them to address the needs of heterogeneous physical/virtual environments in large enterprises, and particularly those running multiple hypervisors. BMC has also focused on managing converged infrastructure platforms (e.g. Cisco UCS, VCE Vblock), potentially leading to a jack of all trades, master of none situation.
Technology Platform
BMC ProactiveNet Performance Management (BPPM) monitors virtualized environments in real time and collects operating and performance metrics from multiple data sources on a continuous, realtime basis. The product leverages insight drawn from BMCs Performance Management Database (PMDB, based on Neptuny technology) and its own behavioral learning, to determine normal operating levels for a broad range of service components and performance metrics on an ongoing basis. The product can actually predict potential problems before they occur, using built-in analytics. The BMC End-User Experience Management (BEEM) module captures end-user behavioral information on an ongoing basis, such as conversion/abandonment rates, time spent per page, completed vs. abandoned transactions, etc. BEEM then correlates this data with BPPM-generated application performance metrics to determine how and when poor application performance might be negatively impacting the end-user experience. We did not evaluate BEEM for this study, as user-experience monitoring was outside out scope, but BEEM may be part of a solution suite BMC proposes to virtual infrastructure operations teams. BMC Capacity Management collects performance data (without the use of agents) across server, storage and network resources, and then stores these in the PMDB. The product has out-of-the-box adapters for third party monitoring tools from BMC, HP, IBM and Microsoft.
Operations Management
When BPPM detects deviations from normal operating levels, often across a combination of metrics, it alerts IT operations staff or takes automated action to remediate application performance issues. The product can actually predict potential problems before they occur, using built-in analytics. BPPM automates the prioritization of events, based on predictive service impact analysis, so that IT staff can focus on the most critical problems first. The product can help IT personnel to predict root cause through its continuous capture of deep-dive application diagnostics and behavioral learning capabilities. BMC Capacity Management uses the vast set of collected data in the PMDB to make better informed capacity planning and management decisions. For example, time-forecasting and extrapolation analysis modules are used to predict capacity shortfalls. The product includes modeling or what if scenario analysis to simulate infrastructure and workload changes, and predict their impact on server, storage and network resource utilization and response times. With the additional of the Neptuny PMDB, BMC Capacity Management has additional virtual capacity metrics to feed capacity modeling, which brings it on par (not beyond) the features of the vCenter CapacityIQ component of VCOps Enterprise.
Copyright 2011 The Taneja Group, Inc. All Rights Reserved. 87 Elm Street, Suite 900 Hopkinton, MA 01748 T: 508.435.2556 F: 508.435.2557
21 of 21 www.tanejagroup.com