Microsoft Cloud Platform

David Chou
architect microsoft

What is Cloud Computing?

Use (services, information, etc.) Build (applications, data, etc.) Host (software, database, etc.)
Your Own Data Center Someone Elses Data Center

What is Cloud Computing?

Service Categories

Software (as-a-service) Platform (as-a-service) Infrastructure (as-a-service)

Community Dedicated

Hybrid Cloud

Private
Cloud

Public
Cloud

Cloud Types

What is Cloud Computing?

Service Categories Infrastructure
(as a Service) Applications You manage Data Runtime Middleware O/S Virtualization Servers Storage Networking Managed by vendor You manage (On-Premise) Applications Data Runtime You manage Middleware O/S Virtualization Servers Storage Networking (as a Service) Applications Data Runtime Middleware O/S Virtualization Servers Storage Networking Managed by vendor

Platform

(as a Service) Applications Data Runtime Middleware O/S Virtualization Servers Storage Networking Managed by vendor

Software

Microsoft Cloud Strategy

A Hybrid World

Consistency & Control

On-Premise

Scalability & Availability

Public Cloud

Manageability Security & Privacy Customizability Dedicated Resources Heterogeneity

Redundancy & Resiliency Global Reach Ease of Provisioning Abstract/Shared Resources Homogeneity

Microsoft Cloud Strategy

Platform of Choice

Microsoft Cloud Strategy

History in the Cloud

(15years) 450M+ activeusers

(13years) 550M users/mth

(11years) 320M+ (12years) active Largestnon users ICP/IPcloud service x100Musers

(11years) 2B queries/mth

(15years) 450M+ activeusers

(7years) 5B conf min/yr

(6years) 4B emails/day

Microsoft Cloud Strategy

Generalized Application Model

Service-Oriented Scale-Out

Always Available Model-Driven Staged Production

Self-Service Failure Resilient Federated Elastic Multi-Tenant

The Microsoft Cloud

Data Center Infrastructure
> Purpose-built data center to host containers at large scale
Cost $500 million, 100,000 square foot facility (10 football fields)

> 40 foot shipping containers can house as many as 2,500 servers

Density of 10 times amount of compute in equivalent space in traditional data center

> Deliver an average PUE of 1.22

Power Usage Effectiveness benchmark from The Green Grid consortium on energy efficiency

The Microsoft Cloud

Data Center Infrastructure

The Microsoft Cloud

Server Container Deployment

The Microsoft Cloud

Server Container Deployment

The Microsoft Cloud

Server Container Deployment

The Microsoft Cloud

Server Container Deployment

The Microsoft Cloud

Server Container Deployment

The Microsoft Cloud

Server Container Deployment

The Microsoft Cloud

Server Container Deployment

The Microsoft Cloud

~100 Globally Distributed Data Centers

Quincy,WA

Chicago,IL

SanAntonio,TX

Dublin,Ireland

Generation4DCs

The Microsoft Cloud

Highly available, scalable, and consistent application fabric environment

The Microsoft Cloud

Categories of Services

Application Services Software Services

Platform Services

Infrastructure Services

Windows Azure Platform

Application Services Frameworks Security Connectivity Data Compute Storage
Dynamic Tabular Data Blobs Message Queues Relational Database Secure Token Service Personal Data Repository Services Hosting Declarative Policies Service Bus ADO.NET, ODBC, PHP Application Marketplace Workflow Hosting Claims-Based Identity Registry Information Marketplace Distributed Cache Federated Identities On-Premise Bridging Data

Transact-SQL

Synchronization

C/C++
Distributed File System

Win32

VHD

Content Distribution

Windows Azure Platform

Application Services Frameworks Security Connectivity Data Compute Storage
Table Storage Blob Storage Queue Drive
Content Delivery Network

Dublin

Velocity

Access Control Service Bus

Geneva Project Sydney SQL Azure Data Sync

Windows Azure
Operating system as an online service; with automated provisioning and services management
>Development, service hosting, & management environment
.NET, Java PHP, Python, Ruby, native code (C/C++, Win32, etc.)

ASP.NET providers, FastCGI, memcached, MySQL, Tomcat Full-trust supports standard languages and APIs Secure certificate store Management APIs, and logging and diagnostics systems

Compute instance types: Web Role & Worker Role. Windows Azure applications are built with web role instances, worker role instances, or a combination of both.

>Multiple roles Web, Worker, Virtual Machine (VHD) >Multiple VM sizes

1.6 GHz CPU x64, 1.75GB RAM, 100Mbps network, 250GB volatile storage Small (1X), Medium (2X), Large (4X), X-Large (8X)

>In-place rolling upgrades, organized by upgrade domains

Walk each upgrade domain one at a time Each instance runs on its own VM (virtual machine), replicated as needed

Maintenance OS Host VM Guest VM 1 Host VM

Guest VM 3 Guest VM 2 Guest VM 1 Host VM

The Fabric Controller communicates with every server within the Fabric. It manages Windows Azure, monitors every application, decides where new applications should run optimizing hardware utilization.

SQL Azure
Highly available, scalable, and consistent distributed relational database service; with geo-replication and geo-location of data
SQL Azure database provisioning (databases, accounts, roles, , metering, and billing)
VM 4
SQL Server
User DB1 User DB2

VM 5
SQL Server
User DB4 User DB1 User DB2

VM 6
SQL Server
User DB4 User DB1 User DB2

SQL DB

User DB3

SQL DB

User DB3

SQL DB

User DB3

User DB4

Scalability and Availability: fabric, failover, replication, and load balancing

DBA role places more focus on policy/logical management

> Shared infrastructure at SQL database and below

Each user database is replicated to one or more servers (configurable based on SLA) Client requests are routed to current primary server for read and write operations (based on SQL session) Security, lockdown and isolation enforced in SQL tier

> Security Model

Uses regular SQL security model
Authenticate logins, map to users and roles Authorize users and roles to SQL objects Logins are username + password strings Service enforces use of SSL to secure credentials Upcoming support for AD Federation, WLID, etc.

Supports standard SQL logins

> Highly scalable and state-of-the-art HA technology

> Connectivity Model Automatic failure detection; client request re-routed to new primary on failure Connect using common client libraries ADO.NET, OLE DB, ODBC, etc. High SLA guarantee using logical replication (hot standby replicas) Clients connect to a database directly Automatic management, self-healing and load balancing Cannot hop across DBs across shared resource pool

Windows Azure platform AppFabric

Internet-scoped overlay-network bridging across IP NATs and firewalls with federated access control > Service Bus
Expose RESTful or SOAP services over the internet through firewall and NAT boundaries Communicate bi-directionally between apps and services in an interoperable manner Choose relays, queues, routers, and other message patterns and types Scale out naturally and reliably as apps and services grow

> Access Control

Integrate authorization into apps to control what users are allowed to do Federate with multiple identity systems across organizations and ID providers Easily apply fine-grained access control rules Secure Service Bus communications Scale out naturally and reliably as apps and services grow

http://www.azure.com
Sign up at the Windows Azure Platform developers portal
Windows Azure access Developer tools White papers Sample applications

Plan pilot applications, proofs of concept, and architectural design sessions with Windows Azure partners

.NET in Windows Azure

Web Role and Work Role

Service Instance

default.aspx

IIS

Web Role
bindport(x) http://instance:y http://instance:x SQL Database

RoleEntry Point

Worker Role Service Instance

Service Bus

Access Control

http://app:80

Load Balancer

Fabric Controller

Table Storage

Blob Storage

Queue

PHP in Windows Azure

Web Role and IIS/FastCGI with Native Runtime

Service Instance

index.php

php -cgi

FastCGI IIS

Web Role
bindport(x) http://instance:y http://instance:x SQL Database

Service Instance

Service Bus

Access Control

http://app:80

Load Balancer

Fabric Controller

Table Storage

Blob Storage

Queue

Java and Tomcat in Windows Azure

Worker Role and Sub-Process Invoking Native Code

Service Instance
listenport(x)

index.jsp

JVM

Catalina

server.xml Sub-Process

Tomcat

newProcess() RoleEntry Point bindport(x) get runtime info

Worker Role Service Instance

http://instance:y

http://instance:x

SQL Database

Service Bus

Access Control

http://app:80

Load Balancer

Fabric Controller

Table Storage

Blob Storage

Queue

3 Key Takeaways > Platform-as-a-service fabric cloud > Hybrid on-premise software and cloud services platform > Consistent programming model and tools

Thank you!
david.chou@microsoft.com blogs.msdn.com/dachou

2010 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Pricing
CONSUMPTION
Pay as you go and grow Available at launch
Low barrier to entry and flexibility Optimized for cloud elasticity

SUBSCRIPTION
Value for a commitment Select offers Announced
Discounts for commitment Plans for payment predictability

VOLUME LICENSING
Coordinated purchasing Planned for FY11
Unified purchasing through EA Introduction to volume discounts

Compute
$0.12 / CPU hour

Web Edition (1GB)

$9.99 / month

Service Bus
$0.15 / 100k messages

Storage
$0.15 / GB / month $0.01 / 10k txn / month

Business Edition (10GB)

$99.99 / month

Access Control
$0.15 / 100k tokens

Bandwidth
$0.10 in / GB $0.15 out / GB

Bandwidth
$0.10 in / GB $0.15 out / GB

Bandwidth
$0.10 in / GB $0.15 out / GB

Offers & Promotions

Introductory Free Offer
No-cost developer starter offer. Provides no-cost allocation to run a cloud service. Available to all partner/customers Limit of one per customer Overage at Standard Consumption rates

Development Accelerator
Designed to accelerate cloud app development. Flexible (on/off) consumption for scaling. Predictable payment and discounted price.

MSDN Premium

Mobilize committed .NET developer base. Enable them to build, deploy, manage multiple cloud projects w/in MSDN subscription. Available to MSDN Premium subscribers with limit of one per subscription (one per Windows Live ID) 12-month term Overage at partner Consumption rates Limited time to sign up (thru 6/30/10) After 6/30/10 quantities may be reduced

6 month subscription (38%-45% discount) Offered as a unit (can order multiple units) Cancel first 30 days; anytime after first 6 months Overage at Standard Consumption rates

NO-COST
Windows Azure Compute 25 Hrs/month Storage 0.5 GB/month Bandwidth 0.5 GB/month Storage Transactions 10K/month SQL Azure 1 Web Edition DB (1GB DB) 90 day trial Service Bus and Access Control Service Messages 100K/mo

CORE ($59.95/month)
Amount Included in Base Compute 750 hrs/mo Storage 10 GB/mo Storage Transactions 1M/mo NET - Messages 1M/mo Data Transfers 7 GB In / 14 GB Out

NO-COST
Windows Azure Compute 750 hrs Storage 10 GB Storage Transaction 1M SQL Azure - 3 Web DB (1 GB) Service Bus and Access Control Service Messages 1 Million Data Transfer 7GB In/14GB Out

EXTENDED ($109.95/month)
Amount Included in Base Same as Core except also includes 1 SQL Azure Business Edition DB (10 GB)

Application Models
Web Hosting
Massive scale infrastructure Burst & overflow capacity Temporary, ad-hoc sites

High Performance Computing

Parallel & distributed processing Massive modeling & simulation Advanced analytics

Application Hosting
Hybrid applications Composite applications Automated agents / jobs

Information Sharing
Reference data Common data repositories Knowledge discovery & mgmt

Media Hosting & Processing

CGI rendering Content transcoding Media streaming

Collaborative Processes
Multi-enterprise integration B2B & e-commerce Supply chain management Health & life sciences Domain-specific services

Distributed Storage
External backup and storage

Case Study
About
kbb.com, established 1995; vehicle data aggregation and publication service provider 14M UU/month Multiple physical data centers

Solution
Cloud-based overflow capacity Windows Azure Web Role SQL Azure database

Benefits
~$100,000 savings / year in hosting costs alone Retire failover data center (27 Web servers & 9 SQL Servers) <1% code changes needed for application compatibility 6 weeks down to 6 minutes to add server capacity

Case Study
About
Legacy call-center application for order processing and fulfillment On-premise systems integration with ERP and master data management

Solution
Cloud-based Web-enablement of on-premise assets Windows Azure Web Role Web services integration via onpremise ESB endpoints

Benefits
In a matter of weeks, we were able to see the fruits of our efforts very rapidly. Kevin Flowers, Dir. Enabling Technologies The resilience and reliability of this platform is some of the benefits that we are seeing. Esat Sezer, SVP & CIO

Case Study
About
Complex Monte Carlo simulations to calculate financial risks Daily risk analysis load equivalent to processing 4 trillion US Stocks Existing on-premise HPC implementation

Solution
Massively scalable compute leveraging cloud capacity Deployed on 2K Windows Azure instances; 10K+ in 2010 Windows Azure Worker Role Windows Azure Blob and Queue AppFabric Service Bus

Benefits
Elastic scaling to effectively meet customer demands Turning elements of its peak load infrastructure from a fixed cost to a variable cost

Case Study
About
Web-based ERP and accounting software to help mid-sized businesses automate customized business processes Business needs:
Launch a SaaS offering which includes on demand infrastructure and billing Maintain a 24/7 production environment Minimize development efforts for both on-premise and SaaS offerings

Solution
Cloud-based SaaS deployment Windows Azure SQL Azure

Benefits
Application migration completed in 3 weeks with 2 developers Customers can implement solution without investing in onpremise infrastructure; can save ~$8,000 for startup costs

Technical implementation
Web IIS 7, ASP.NET 3.5 Server SQL Server 2005/2008, Windows Server 2003/2008 Tools Visual Studio 2008, .NET Framework 3.5

Case Study
About
Online service providing productivity tools to help students conduct research, write better papers, and get help on-demand Technical implementation
Client Windows Mobile 6 Web IIS 6, ASP.NET 3.5 Server Windows Server 2003, SQL Server 2005 Services Bing Search, Windows Live Messenger Web Toolkit Tools Visual Studio 2008, .NET Framework 3.5, .NET Compact Framework 3.5

Solution
Hybrid cloud application Cloud-based extensions and services mash-ups with onpremise implementation Windows Azure application .NET Services service bus, access control, & workflows

Benefits
$500,000 savings in dev. costs 40% faster time-to-market More effective development Cost-effective scalability and enhanced availability

Windows Azure Compute

> Development, service hosting, & management environment
.NET, Java PHP, Python, Ruby, native code (C/C++, Win32, etc.) ASP.NET providers, FastCGI, memcached, MySQL, Tomcat Full-trust supports standard languages and APIs Secure certificate store Management APIs, and logging and diagnostics systems

> Multiple roles Web, Worker, Virtual Machine (VHD) > Multiple VM sizes
1.6 GHz CPU x64, 1.75GB RAM, 100Mbps network, 250GB volatile storage Small (1X), Medium (2X), Large (4X), X-Large (8X)

> In-place rolling upgrades, organized by upgrade domains

Walk each upgrade domain one at a time

Compute

Windows Azure Diagnostics

> Configurable trace, performance counter, Windows event log, IIS log & file buffering
Local data buffering quota management Query & modify from the cloud and from the desktop per role instance Transfer to storage scheduled & on-demand Filter by data type, verbosity & time range

Compute

Windows Azure Storage

> Rich data abstractions tables, blobs, queues, drives, CDN
Capacity (100TB), throughput (100MB/sec), transactions (1K req/sec)

> High accessibility

Supports geo-location Language & platform agnostic REST APIs URL: http://<account>.<store>.core.windows.net Client libraries for .NET, Java, PHP, etc.

> High durability data is replicated 3 times within a cluster, and (Feb 2010) across datacenters > High scalability data is automatically partitioned and load balanced across servers

Storage

Windows Azure Table Storage

> Designed for structured data, not relational data > Data definition is part of the application
A Table is a set of Entities (records) An Entity is a set of Properties (fields)

> No fixed schema

Each property is stored as a <name, typed value> pair Two entities within the same table can have different properties No schema is enforced

Table Storage

Windows Azure Blob Storage

> Storage for large, named files plus their metadata > Block Blob
Targeted at streaming workloads Each blob consists of a sequence of blocks Each block is identified by a Block ID Size limit 200GB per blob

> Page Blob

Targeted at random read/write workloads Each blob consists of an array of pages Each page is identified by its offset from the start of the blob Size limit 1TB per blob

Blob Storage

Windows Azure Queue

> Performance efficient, highly available and provide reliable message delivery > Asynchronous work dispatch
Inter-role communication Polling based model; best-effort FIFO data structure

> Queue operations

Create Queue Delete Queue List Queues Get/Set Queue Metadata

> Message operations

Add Message Get Message(s) Peek Message(s) Delete Message

Queue

Windows Azure Drive

> Provides a durable NTFS volume for Windows Azure applications to use
Use existing NTFS APIs to access a durable drive Durability and survival of data on application failover Enables migrating existing NTFS applications to the cloud Drives can be up to 1TB; a VM can dynamically mount up to 8 drives

> A Windows Azure Drive is a Page Blob

Example, mount Page Blob as X:\ http://<account>.blob.core.windows.net/<container>/<blob> All writes to drive are made durable to the Page Blob Drive made durable through standard Page Blob replication

Drive

Windows Azure Content Delivery Network

> Provides high-bandwidth global blob content delivery
18 locations globally (US, Europe, Asia, Australia and South America), and growing

> Blob service URL vs. CDN URL

Blob URL: http://<account>.blob.core.windows.net/ CDN URL: http://<guid>.vo.msecnd.net/ Support for custom domain names

> Access details

Blobs are cached in CDN until the TTL passes Use per-blob HTTP Cache-Control policy for TTL (new) CDN provides only anonymous HTTP access

Content Delivery Network

SQL Azure
> Highly available, scalable, and consistent distributed relational database; geo-replication and geo-location of data > Relational database, provided as a service
Highly symmetrical development and tooling experience (use TDS protocol and T-SQL) Highly scaled out, on commodity hardware Built on the SQL Server technology foundation

> Editions: Web (1GB), Business (10GB)

Data

SQL Azure Data Sync

> Tools for data synchronization with SQL Azure
Connect on-premises apps with the cloud Create cached-mode clients

> Built on Microsoft Sync Framework and ADO.NET Sync Services

SQL Azure Data Sync

AppFabric Service Bus

> Securely connect applications
Over the internet Across any network topology Across organizational boundaries

> Primary application patterns

Eventing notify applications and/or devices Service Remoting securely project on-premises services out to the cloud Tunneling app-to-app communication with NAT/Firewall traversal

Connectivity

Service Bus

AppFabric Access Control

> Provides outsourcing of claimsbased access control for REST web services > Key capabilities:
Usable from any platform

Security

Low friction way to onboard new clients Access Control Integrates with ADFS v2 Supports OAuth WRAP / SWT Enables simple delegation

> Used today by Service Bus and Dallas

Geneva
> Next generation identity and access management platform
Claims-based access and single sign-on for on-premise and cloud-based applications in the enterprise, across organizations, and on the Web

> Geneva Framework (Windows Identity Foundation)

Provides .NET development tools, which includes pre-built, user-access logic that externalizes authentication from applications. It helps developers build claims-aware .NET applications, plus build custom security token services (STS) Geneva

> Geneva Server

An STS for IT that issues and transforms claims and other tokens, manages user access and enables federation and access management for simplified single sign-on

> CardSpace Geneva

For helping users navigate between multiple logons for simplified single sign-on while providing complete user control and transparency for how personal information is shared

Velocity
> Distributed in-memory cache platform for developing scalable, available, and highly-performance applications
Caches any serializable CLR object and provides access through simple cache APIs Supports enterprise scale: tens to hundreds of computers Configurable to run as a service accessed over the network Supports dynamic scaling and automatic load balancing Supports continuous availability of cached data by storing copies on separate cache hosts Integration with administration and monitoring tools such as Event Tracing for Windows (ETW) and System Center. Velocity

Dublin
> Evolution of WAS/IIS and Windows App Server role to run and manage WF and WCF services
Enhances the hosting of Windows Communication Foundation (WCF) and Windows Workflow (WF) in the Windows Process Activation Service (WAS) Simplified deployment and management of WCF and WF services hosted in WAS Configuration of persistence for durable workflows Customizable tracking profiles with dedicated, queryable storage for tracked data Customizable monitoring of hosted services Dublin

Dallas

> Information-as-a-service > Discover, acquire, and consume structured, blob, and real-time data to power any application on any platform and any screen size > Brokerage Business partner driven ecosystem and global reach to deliver data and functionality to developers and information workers > Analytics and Reporting single click analysis to augment private data with public data > Built on Windows Azure and SQL Azure