KVM,

 OpenStack,  
and  the  Open  Cloud  
Adam  Jollans,  IBM  &  Mike  Kadera,  Intel  
CloudOpen  Europe  -­‐  October  13,  2014  

13Oct14   Open  VirtualizaGon  Alliance   1  

 Agenda  
•  A  Brief  History  of  VirtualizaGon  
•  KVM  Architecture  
•  Building  Open  Clouds  
•  OpenStack  Architecture  
•  KVM  and  OpenStack  
•  Case  Study  of  OpenStack  &  KVM  Cloud  –  Intel  IT  
•  Futures  
•  AddiGonal  Sessions  and  Resources  

13Oct14   Open  VirtualizaGon  Alliance   2  

 A  Brief  History  of  VirtualizaGon  
LXC / Docker

KVM hypervisor

x86 hardware virtualization

Xen hypervisor for x86

VMware hypervisor for x86

Virtualization on Unix systems

Virtualization on mainframes

1960s 1980s 1990s 2000s 2010s 2014

13Oct14   Open  VirtualizaGon  Alliance   3  
 Conceptual  Framework  
User Interface Applications

Management Tools

Storage Compute Networking

13Oct14   Open  VirtualizaGon  Alliance   4  
 IntroducGon  to  KVM    
User Interface Applications

Management Tools
oVirt
Kimchi
libvirt
KVM

Storage Compute Networking

13Oct14   Open  VirtualizaGon  Alliance   5  
 KVM  Architecture  
Virtual
Open source hypervisor based on Linux
Virtual
Machine Machine
KVM
Linux Windows • Kernel module that turns Linux into a Virtual
Applications Applications Machine Monitor
• Merged into the Linux kernel
Linux Windows
Guest OS Guest OS
Linux QEMU
QEMU QEMU Applications
• Emulator used for I/O device virtualization
KVM Linux
x86 virtualization extensions
• Intel VT-x
x86 with virtualization extensions • AMD (AMD-V)

13Oct14   Open  VirtualizaGon  Alliance   6  

 KVM  Performance  

Source: SPECvirt_2013 Published Results - http://www.spec.org/virt_sc2013/results/specvirt_sc2013_perf.html

13Oct14   Open  VirtualizaGon  Alliance   7  
 KVM  Security  
SELinux
Virtual Virtual • Mandatory Access Control (MAC)
Machine Machine integrated into Linux
• Provides “need to know” security
Linux Windows between processes
Applications Applications

Linux Windows
sVirt
Guest OS Guest OS • Combines SELinux and KVM
Linux
Applications • Delivers “need to know” security
QEMU QEMU
between virtual machines
KVM Linux
Certifications
• EAL4+ certification for KVM in RHEL 6
x86 with virtualization extensions and SLES 11 SP 2 on various x86 64-bit
Intel and AMD64-based hardware from
Dell, HP, IBM and SGI
13Oct14   Open  VirtualizaGon  Alliance   8  
 KVM  Management  -­‐  libvirt  
User Interface

Remote Library
Management • Open Source project
Command
Line • Manages multiple hypervisors

Command Line
• Powerful
libvirt Network
Library • Complex to use
Daemon
Network Daemon
KVM • Enables remote management
Xen
LXC Base for other management tools
• virt-manager, Kimchi, oVirt
….
• OpenStack
Compute
13Oct14   Open  VirtualizaGon  Alliance   9  
 KVM  Management  -­‐  Kimchi  
User Interface
Kimchi
• Open Source project
HTML5 • Manages KVM on x86, Power
Web
Browser
User Interface
• Easy to use
Daemon • Access from HTML5 web browser
Kimchi
libvirt Servers managed
• Single digits
KVM

Compute
13Oct14   Open  VirtualizaGon  Alliance   10  
 KVM  Management  -­‐  oVirt  
User Interface oVirt
• Open Source project
Web
• Manages KVM on x86
Command
Portals
Line
User Interface
• Web portals
• Command line, API
oVirt Engine oVirt Node
oVirt
oVirt Engine
VDSM + libvirt • Manages VMs
• Configures storage, network
KVM
oVirt Nodes
• Run virtual machines

Storage Compute Servers managed

• Tens to hundreds
13Oct14   Open  VirtualizaGon  Alliance   11  
 Building  Open  Clouds  
•  Security  
•  Resilience  
•  Performance  
•  Scalability  –  thousands  of  nodes  
•  Heterogeneity  
•  Interoperability  
13Oct14   Open  VirtualizaGon  Alliance   12  
 IntroducGon  to  OpenStack  
User Interface Applications

Command
Horizon Line

Management Tools
Open Ceilometer Keystone Heat
Stack
Cinder Swift Glance Nova Neutron

Choice Choice Choice

of of of
storage hyper- network
visor

Storage Compute Networking

13Oct14   Open  VirtualizaGon  Alliance   13  
 OpenStack  Design  Principles  
•  Open  
–  Open  Development  Model  
–  Open  Design  Process  
–  Open  Community  
•  General  Purpose  
–  Balancing  Compute,  Storage,  Network  
•  Massively  Scalable  
•  MulG-­‐site  
•  Resilient  and  recoverable  
13Oct14   Open  VirtualizaGon  Alliance   14  
 Nova  –  Compute  Service  
Manages VM lifecycle
• Starting and stopping VMs
• Scheduling and monitoring VMs
Command
Horizon Line
Key Components
• API
• Database
Keystone • Scheduler
Swift Glance Nova • Compute node and plug-ins

Authentication
VM Choice
Images of
• Keystone
hyper-
visor Access to VM images
• Glance
Storage Compute • Swift

13Oct14   Open  VirtualizaGon  Alliance   15  

 OpenStack  and  Hypervisor  Usage  

Source: OpenStack User Survey May2014 - http://www.slideshare.net/ryan-lane/openstack-atlanta-user-survey

13Oct14   Open  VirtualizaGon  Alliance   16  
 Keystone  –  AuthenGcaGon  Service  
Manages security
• Service for all other modules
• Authentication
Command • Authorization
Horizon Line

Key components
• API
Keystone • Backends
• Token
• Catalog
• Policy
• Identity

13Oct14   Open  VirtualizaGon  Alliance   17  

 Cinder  –  Block  Storage  Service  
Manages persistent block storage
• Provides volumes to running instances
• Pluggable driver architecture
Command • High Availability
Horizon Line

Key components
• API
Keystone • Queue
Cinder • Database
• Scheduler
• Storage plug-ins
Choice
of Block
Storage Authentication
• Keystone

Storage
13Oct14   Open  VirtualizaGon  Alliance   18  
 Neutron  –  Networking  Service  
Manages networking connectivity
• Provides volumes to running instances
• Pluggable driver architecture
Command • Support for range of networking technologies
Horizon Line

Key components
• API
Keystone • Queue
Neutron • Database
• Scheduler
• Agent
Choice
• Networking plug-ins
of
Network
Authentication
• Keystone
Networking
13Oct14   Open  VirtualizaGon  Alliance   19  
 Glance  –  Image  Service  
Manages VM images
• Catalog of images
• Search and registration
Command • Fetch and delivery
Horizon Line

Key components
• API
Keystone • Registry
Swift Glance • Database

Authentication
VM
Images
• Keystone

Storage of VM images
• Swift
Storage • Local file system

13Oct14   Open  VirtualizaGon  Alliance   20  

 Swi\  –  Object  Storage  Service  
Manages unstructured object storage
• Highly scalable
• Durable – three times replication
Command • Distributed
Horizon Line

Key components
• Proxy / API
Keystone • Rings
Swift • Accounts
• Containers
• Objects
Object
Storage
• Data stores

Authentication
• Keystone
Storage
13Oct14   Open  VirtualizaGon  Alliance   21  
 Provisioning  a  VM  
User Interface Applications

Command
Horizon Line

Management Tools
1
2, 10
Keystone
4
Cinder Swift Glance Nova Neutron
9 8
7 6 3 5

Storage Compute Networking

13Oct14   Open  VirtualizaGon  Alliance   22  
 KVM  and  OpenStack  
•  KVM  excels  at  choice  criteria  for  Hypervisor  
–  Cost  
–  Scale  &  Performance  
–  Security  
–  Interoperability  
•  Development  Affinity  
–  Both  open  source  projects  
–  KVM  is  default  hypervisor  for  OpenStack  development  
•  Deployment  Affinity  
–  KVM  is  best  supported,  easiest  to  deploy,  with  most  full-­‐featured  driver  
13Oct14   Open  VirtualizaGon  Alliance   23  
Intel IT’s Cloud Goals
80% Effective •  Pervasive Virtualization (75%)
•  Enterprise App Virtualization
Utilization •  Secure Virtualization
•  Larger Pools in Fewer Data Centers
Efficiency through Federation

Velocity Increase • 
• 
On-Demand Self Service the Norm
Provision VMs within minutes
Agility through Automation & Self •  Innovative Idea to Production <day
Service •  External Cloud for Burst Demand

•  Reduce MTTR
Zero Business Impact •  App Design for Failure
•  Increase Availability
 Intel IT & OpenStack/KVM
Deployment History

Public

Public

2013 - Present
Initial Deployment – 2012

•  OpenStack  Essex   •  OpenStack  Grizzly  

•  ~1000  virtual  instances  for   •  ~3500  instances  for  mulGple  
external  services   services  (~40:1,  ~100  vCPU)  
•  qemu-­‐system-­‐x86_64  1.0   •  qemu-­‐system-­‐x86_64  1.4.2    
 Intel IT & OpenStack/KVM
KVM  Benefits  
Performance   Stability  
•  2012  Study  on  ‘standard’  cloud  workloads  (database)   •  Open  Source,  Gght  OpenStack  and  Linux  kernel  integraGon  
•  Par  or  beker  vs.  marketplace   •  Hypervisor  efficiency  
•  HV  realm  is  seemingly  near-­‐stable  on  straight  performance   •  Drinking  our  own  champagne  -­‐  we’ve  got  a  few  KVM  devs  :-­‐)  

KVM  Lessons  Learned  

Performance   Stability  
• Check  flags  –  lots  of  features/opGons   • Oversubscribing  &  big  mulG-­‐vCPU  instances  
• Windows  guest  updates   • Windows  guest  can  be  sensiGve  IO  interrupGons  
• Keep  your  images  current  
 Intel  &  OpenStack/KVM  
Future  DirecGon  
IT  
–  It’s  not  just  the  hypervisor…  it’s  how  they  are  managed  within  the  stack  
–  OpenStack  enabled  Single  Control  Plane  to  simplify  hosGng  mulGple  
environments  

Intel  in  the  community  

–  Expose  opGmized  hardware  features  to  KVM  and  OpenStack  schedulers  
–  EG:  Cache  QoS  monitoring,  chipset  features  (AVX2,  Intel®  AES-­‐NI,  etc.),  VMCS  
Shadowing,  APIC  virtualizaGon  

See  how  you  can  accelerate  your  applicaGons  with  features  like  Intel®  AVX  in  your  OpenStack  
VMs  at  our  booth  (#19  -­‐  #21)  
 KVM  Futures  
•  Heterogeneous  processor  support  
–  ARM  
–  POWER  
–  System  z  
–  GPUs  
•  Network  FuncGon  VirtualizaGon  
•  AddiGonal  Performance  Improvements  
–  Minimizing  locks  
–  MulG-­‐threaded  device  model  
•  Nested  VirtualizaGon  
13Oct14   Open  VirtualizaGon  Alliance   28  
 OpenStack  Futures  –  Juno  
•  Keystone  
–  LDAP  IntegraGon  
•  Heat  
–  Templates  
•  Nova  
–  Network  FuncGon  VirtualizaGon  
•  Glance  
–  AddiGonal  arGfacts  beyond  just  images  
•  Marconi  
–  Messaging  and  Queuing  System  
13Oct14   Open  VirtualizaGon  Alliance   29  
 AddiGonal  Resources  
•  LinuxCon  Europe  
–  “Linux:  Where  are  we  Going”    
•  Weds  15Oct14,  9:40am    
–  “What’s  Coming  up  in  OpenStack  Juno”  
•  Weds  15Oct14,  4:30pm  
•  KVM  Forum  
–  Tues-­‐Thurs  14-­‐16Oct14  
•  OpenStack  Summit,  Paris  
–  Mon-­‐Fri  3-­‐7Nov14  
•  Open  VirtualizaGon  Alliance  
–  hkps://openvirtualizaGonalliance.org  
•  Forthcoming  IDC  White  Paper    
–  “KVM  –  Open  Source  VirtualizaGon  for  the  Enterprise  and  Open  Stack  Clouds”  
•  New  Linux  FoundaGon  Training  Course  
–  LFS540  –  “Linux  KVM  VirtualizaGon”  
13Oct14   Open  VirtualizaGon  Alliance   30