You are on page 1of 48

Cloud Computing

OpenStack
VNG Infrastructure platform
Tran Anh Nhan IRD department head
Pham Tran Kim Chi Lead System Engineer
May 2014
Cloud Computing - OpenStack - VNG - IRD
Agenda
VNG - IRD
What is Cloud Computing?
OpenStack Architecture
OpenStack Networking
Deployment Model
Ceilometer

Cloud Computing - OpenStack - VNG - IRD
New Section
VNG Corp introduction
Cloud Computing - OpenStack - VNG - IRD
VNG Corporation
Game publisher/developer (VLTK, VLCM,
Gunny, Boom, Khu vuon tren may,
ZingPlay )
Online music/media (ZingMP3, ZingTV)
Social network (Zing Me, Zalo)
E-commerce (123mua.vn, 123pay.vn)

Cloud Computing - OpenStack - VNG - IRD
IRD Department
Research and build the infrastructure platform for
VNG to enhance business, optimize quality and cost,
meet the new technology.
Content Delivery Network (CDN) system is used
by all VNG products that want to optimize static
bandwidth.
Live-streaming system is a streaming platform for
Zing events, Talk TV.
OpenStack provides servers and networks for
some products with a small scale (in pilot phase.
Project Team is receiving feedback for further
enhancement).
Object storage (in POC phase).

Cloud Computing - OpenStack - VNG - IRD
New Section
What is Cloud Computing?
Cloud Computing - OpenStack - VNG - IRD
References
Gartner
Synergy research
The National Institute of Standards and
Technology (NIST)
Cloud computing today
451 Research

Cloud Computing - OpenStack - VNG - IRD
Number & trend
Cloud Computing - OpenStack - VNG - IRD
Number & trend
Cloud Computing - OpenStack - VNG - IRD
What is Cloud computing?
Cloud Computing - OpenStack - VNG - IRD
What is Cloud computing?
Cloud Computing - OpenStack - VNG - IRD
What is Cloud computing?
Cloud Computing - OpenStack - VNG - IRD
Cloud Services
Cloud Computing - OpenStack - VNG - IRD
Cloud Services
AWS #1 of cloud services provider - What services
AWS provide?
Amazon Web Services (AWS) continues to dominate
the IaaS and PaaS space in terms of revenue. AWS:
3.8$B revenue (2013)
Compute & Networking (Amazon EC2, Auto Scaling,
Elastic Load Balancing, Route 53 ,..)
Storage & CDN (Amazon S3, Amazon Glacier a low
cost storage for backup, Amazon EBS, Cloud
Front/CDN)
DB Cache: RDS (MySQL, Oracle, SQL Server, and
PostgreSQL), DynamoDB (NoSQL data store),
ElastiCache (In-Memory Caching Service), Redshift
(Data Warehouse Service)
Application services: Elastic Transcoder,..

Cloud Computing - OpenStack - VNG - IRD
Cloud Orchestration Framework
Cloud Computing - OpenStack - VNG - IRD
New Section
OpenStack Architecture
Cloud Computing - OpenStack - VNG - IRD
History
OpenStack is an open source IaaS
initiative for managing and creating huge
groups of virtual private servers in a cloud
computing environment. It was initially
developed by Rackspace and NASA.

Cloud Computing - OpenStack - VNG - IRD
Cloud Computing - OpenStack - VNG - IRD
Nowadays
Cloud Computing - OpenStack - VNG - IRD
Servers Storage
Network switch Network switch Network switch
Virtualization Solution (VMWare VCenter,
Citrix XEN Server, Ovirt, Proxmox.)
Hypervisor (VMWARE, XEN, QEMU, KVM, Hyper-V)
Cloud Computing - OpenStack - VNG - IRD
Cloud Infrastructure
Modular architecture
Designed to easily scale out
Based on set of core services
Cloud Computing - OpenStack - VNG - IRD
OpenStack Platform
Servers Storage
Network switch Network switch Network switch
Hypervisor (VMWARE, XEN, QEMU, KVM, Hyper-V)
Cloud Computing - OpenStack - VNG - IRD
Infrastructure As A Service Overview
Cloud Computing - OpenStack - VNG - IRD
Infrastructure As A Service roles
Cloud Ops: monitor/add/remove physical
compute nodes, storage nodes, controller
nodes, network nodes.
App Owner: add/remove/upgrade cloud
services, check billing status.
Dev Ops: launch/ terminate/ scale instances,
storage. Register/ unregister new image.
Backup/ restore instances/ storage. These
tasks can be done via dashboard or API.
App Devs: call the dev ops tasks inside
application logical flow.



Cloud Computing - OpenStack - VNG - IRD
OpenStack Architecture
Cloud Computing - OpenStack - VNG - IRD
OpenStack Architecture
On-Demand Self-Services
Resource
pooling
Broad
Network
Access
Mesearued
services
Cloud Computing - OpenStack - VNG - IRD
OpenStack Architecture
Hypervisor
Server
Storage Network
Nova compute Cinder Neutron
Cloud Computing - OpenStack - VNG - IRD
Cloud Computing - OpenStack - VNG - IRD
New Section
OpenStack Networking
Cloud Computing - OpenStack - VNG - IRD
OpenStack Networking
Cloud Computing - OpenStack - VNG - IRD
Network Node Compute Node
phy-
br-
em2
phy-
br-
em2
em1: 172.16.0.2 em1: 172.16.0.3
em2: no ip address
em2: no ip address
Nova API
ovs/ br-int
dnsmasq
dchp agent
IP name space
Nova Compute
tap-xx
qvo-xx
int-br-
em2
tap-xx qvb-xx
Linux bridge
qbr-xxxxx
Instance
eth0
ovs/ br-int
qvo-xx
int-br-
em2
veth
Neutron API
0.0.0.0:9696
management network
dedicated physical VLAN for neutron trafc between nodes
neutron ovs plugin
veth
Cloud Computing - OpenStack - VNG - IRD
Cloud Computing - OpenStack - VNG - IRD
New Section
Deployment Model
Cloud Computing - OpenStack - VNG - IRD
Cinder
API
COROSYNC + HAProxy
Controller 01 Controller 02
Rabbit
MQ
Keyston
e
Glance
API
Nova
API
PACEMAK
ER
Compute node 1
Compute node n
Ceph node 1
Ceph node n
Q
E
M
U

D
r
i
v
e
r
Ceph node 2
Compute node 2
RBD Driver
Cloud Computing - OpenStack - VNG - IRD
OpenStack Networking
Neutron Server
Switch Interface
Driver
Physical switch
Controller Node
OVS Plugin
OVS Plugin
Openvswitch
Instances
Compute Node
Neutron OVS agent
DHCP
Instances Instances
OVS Plugin
Openvswitch
Instances
Compute Node
Neutron OVS agent
Instances Instances
L3 Agent DHCP L3 Agent
Cloud Computing - OpenStack - VNG - IRD
Feature
Launch instance
Snapshot/ restore instance
Attach device to instance
Snapshot/ restore attach device
Scale up instance
Internal network for instances
Provide instances with VLAN as product
requires.
Instances are stored totally in Ceph Storage.
Cloud Computing - OpenStack - VNG - IRD
DEMO

Cloud Computing - OpenStack - VNG - IRD
New Section
Ceilometer
Cloud Computing - OpenStack - VNG - IRD
OpenStack Architecture
On-Demand Self-Services
Resource
pooling
Broad
Network
Access
Mesearued
services
Cloud Computing - OpenStack - VNG - IRD
Monitoring
Monitor physical host by cacti, graphite,
zabbix.
Monitor instances status by ceilometer.
Monitor OpenStack statistics by
ceilometer.

Cloud Computing - OpenStack - VNG - IRD
Ceilometer
Objectives
Ceilometer component
Ceilometer collect data
Access collected data

Objectives
Provide a infrastructure to collect
any information in OPS.
Publish information for other
monitoring.
Integrate with Heat for trigger auto
scale.
Celiometer - OpenStack - VNG - IRD
Ceilometer collect data
Bus listener
Polling agent
Push agents

Celiometer - OpenStack - VNG - IRD
Cloud Computing - OpenStack - VNG - IRD
Ceilometer
Cloud Computing - OpenStack - VNG - IRD
Process meter
Access collected data
Via API
Via Ceilometer command
Celiometer - OpenStack - VNG - IRD
Cloud Computing - OpenStack - VNG - IRD
DEMO

Cloud Computing - OpenStack - VNG - IRD
Q & A