Beruflich Dokumente
Kultur Dokumente
Communities
Architectures
Ian Flint
November 9, 2007
1
Agenda
2
What makes Yahoo! Yahoo!?
3
What makes Yahoo! Yahoo!?
5
Hardware Infrastructure
Common Platform
6
Hardware Infrastructure
• Shared Components
– Network, Data Center, NAS
– Centrally managed by infrastructure
team
• Load Balancing
– DSR is preferred model
– Proxy load balancing only where
necessary
7
Hardware Infrastructure
8
Hardware Infrastructure Example
• Layered Infrastructure
The Internet
• Hosts distributed
across multiple racks Router
redundancy at the
Balancer
9
Software Infrastructure
Shared Repository
10
Software Infrastructure
• Installable components
– Managed through yinst package
manager
– Stored on common distribution server
– Examples: yapache, yts, yfor, ymon,
yiv, vespa
12
Software Infrastructure
13
Software Infrastructure
The Internet
Akamai Akamai
(CDN) (CDN)
YTS YTS
(Reverse Proxy) (Reverse Proxy)
Primary Colo
Backup Colo
Yfor Yfor
(failover resolver) (failover resolver)
15
Software Infrastructure - Bix
16
Software Infrastructure - Bix
Services
Static
• Static files served from Files
disk
• Fairly standard Java Tomcat
environment (Spring,
Bix Application
Spring Hibernate
Lucene ehcache
Hibernate, ehcache, c3po, Hessian
log4j
c3po
MySQL Connector
log4j, etc.)
17
Software Infrastructure - Groups
19
Operational Infrastructure
Managing the Platform
20
Operational Infrastructure
21
Operational Infrastructure
– Rollup Monitoring
• Clusters rolled up to centralized monitoring console
• Prioritization and correlation of events
– Internal Site QOS Monitoring
• QOS monitoring for sites
• Response time and availability
– “The OC”
• 24x7, worldwide operations center
• Provides tier 1 and 2 support
– Centralized CMDB
• Configuration Management DB – manages every device
• Contact info, escalations, and runbooks included
22
Operational Infrastructure Example
• Application Servers
Media
perform checks which Media
Media
Servers
Servers
Web
Web Servers
WebServers
Servers
Web
DB Servers
Web
Servers
Servers Servers
are registered by
Nagios as passive
checks ymon server
SNMP-Based Checks
• Metrics are ymond
aggregated by metrics
23
Processes and Standards
Keeping it sane
24
Process and Standards
26