Peter Marek Senior Director, x86 Solutions Advantech Networks & Communications Group

Aviv Miller Product Line Manager, ATCA Telco Systems

Agenda

Inside the Mind of an ATCA System Architect

Introduction Choice of ATCA Building Blocks Telecom

3G/LTE Topology Redundancy & High Availability Unified IP System Management

Datacom & Security

High-End DPI Topology 160G Packet Processing blade Load Balancing Ensuring QoS

Next Generation Architectures

eATCA

Slide 2

ATCA Systems Extending Network Platform Reach

eATCA

Wide Choice of ATCA Hardware Building Blocks

MIC-5333
Two Intel Xeon E5-2600 Processors with QuickAssist Accel. Quad 40G to FI

X86

DSPA-8901
20 Texas Instruments TMS320C6678 DSPs

DSP

ATCA-7310
Dual Cavium Octeon II CN6880 1.0 GHz with 32 MIPS II processor cores & 40G Switch

NPU

T-ATCA404 ATCA-9112
40GbE switch blades - 10/40GbE switching for up to 14 slot systems

Switch

Integration + customization services

Slide 4

ATCA Telecom Applications Special Requirements

www.telco.com

Switch Software at the heart of Carrier Grade Apps

Services Resiliency OAM Management Load Balance QOS
E-Line, E-LAN, E-Tree, E-Access (MEF 6.1, MEF 9, MEF 10.1, MEF 14), CE 2.0 certified

Resilient Links, Port Trunking/Link Aggregation, MSTP (<50ms), G.8031/G.8032, MPLS FRR, Secondary PW, etc. IEEE 802.3ah (EFM), IEEE 802.1ag (CFM), ITU-T Y.1731, IETF MPLS Ping & TraceRoute, IETF VCCV (PW OAM), IETF Throughput/Test-Head (RFC2544), Network Performance (Y.1564) CLI, Telnet, SSH, FTP/TFTP/SFTP, RMON, Java-GUI, SNMP v1/v2c/v3, DHCP Server & CLIENT, etc.

Load balance 5 to 8 tuple with dynamic matrix and flexible hashing method. Includes parsing, classification and management VPT/DSCP mapping/remarking, Rate limiting, ingress/egress shaping/queuing, Multi-level hierarchy (Hierarchical QoS) OAM
RSVP-TE (FRR 1:1 and FRR 1:N), LDP, T-LDP, VPLS VPWS, VPLS, HVPLS (both PE-rs and MTU-s) IEEE802.1ad, VLANs, STP, RSTP, MSTP, LACP, IGMPv3, etc. RIP, OSPF (TE), IS-IS (TE), BGP, VRRP, PIM, VRF, etc. CES, SyncE and 1588v2 ACL, RADIUS, SSHv2, 802.1x, SNMPv3, SFTP, etc.
Quality of service Multiplatform Security Resiliency

MPLS Ethernet

Carrier Service
Scalability

Routing
Synchronization

Security

www.telco.com

Poll 1

What networking capabilities are essential for your

system/solution performance (multiple selection) 1. Load balancing 2. OAM 3. Resiliency 4. Switch redundancy 5. One IP per system 6. Layer 3 features (OSPF, IS-IS, BGP, etc.)

Slide 7

3G/LTE System Topology

Carrier Grade Switching
Hub blade
Switch Management T-ATCA401 (LMP)

Legacy Interfaces

Control & Application Blade

General purpose CPU blade MIC-53xx CPU CPU Intel Dual Xeon Blade
10GE MAC

Security and Packet Processing

NPU blade
NPU

Transcoding

Carrier Grade Switching

Hub blade
Switch Management T-ATCA401 (LMP) Hub 10GE
10GEBlade GbE SW SW

AMC Carrier blade AMC Carrier + LMP Legacy AMCs

GbE SW

DSP blade
DSP DSP DSP DSP DSP DSPA-8901 DSP LMP DSP Blade
xGE SW SRIO SW

10GE Hub Blade 10GE GbE

SW

ATCA-7410 NPU Blade LMP

GbE SW

NPU

SW

xGE SW

GbE MAC

10GE SW

GbE SW

ShMC GbE
GbE used as Base Interface for Management and control plane Dual star topology

ShMC SYNC
Synchronization interface based on 3 redundant clock pairs. Bussed topology

10GE
10GE used as fabric interface for data and user plane Dual star topology

IPMB
Low level management interface based on2 redundant IPMB busses. Bussed or radial (star) topology

P P

3G-LTE System Architecture

System level availability Five 9s Blade level redundancy inside the

ATCA chassis Active & Standby

HA in Telecom Resiliency and Redundancy ATCABased Platform

Switching blades

Define the threshold of amount of failures port level of Front I/O or backplane I/O BI&FI for switching between active & standby Active & standby continuously synch using the BI to reduce switching time Failure is identified using event propagation

Active-Active or Multi-blade LAG

Using LAG all information goes to both switch blades on FI and BI front and rear ports In case of failure it will only affect the amount of over available bandwidth
www.telco.com

Switching blades

X
I I

HA in Telecom Resiliency and Redundancy

Network level resiliency protocols between the elements in the network
MPLS Fast Re-Route (FRR) Ethernet / ring protection switching (G.8031 / G.8032v2) sub 50ms convergence time Network-wide resiliency using RSTP/MSTP Link aggregation including LACP Dual homing-dual chassis LAG sub 50ms

10

FTTx ONT
Metro Network
Secondary Path and FRR

www.telco.com

11

Unified IP per ATCA System

Requirement: ATCA Integrated system including all its blades should appear as a single IP address towards the cloud and the rest of the network
Easy to discovered by other network elements Easy to manage using external Layer 3 OSS/network managements Fits LTE architecture of All IP simple network architecture to all EPC elements using Layer 3 as transport technology Switch redundancy is transparent to the network which is not affected by switchover as no change in the IP layer Flows are routed/switched inside the chassis using load balancing or Layer 2 protocols (e.g.: Q-in-Q) 192.0.0.1

Evolve Packet Core (EPC)

www.telco.com

The Shelf Manager Maintaining System Integrity & More

Many different requirements between Datacom and Telecom More Flexibility required to adapt to different market approaches More headroom needed for value added services and prepare for NFV SHM-5060 ATCA compliant Shelf Management based on Advantech IPMI core
ARM9 based BMC runs basic Shelf Management application Integrated x86 management node based on single/dual core CPU Optional LCM for status display, parameter entry (system mount) with LCD4Linux API for LCM support System logging to SDHC cards & improved system event log sync between SHMs on Xover Ethernet NTP based system time synchronization (NTP Server) SNMP Improved MIBs

Security - Radius / TACACS / TACACS+ Authentification SSL, IPSec for outbound management traffic (QuickAssist offload) Serial console server Boot server for all nodes in the system

Ethernet OAM
Transport/link OAM
Point-to-point link monitoring IEEE 802.3ah

13

Connectivity OAM
Continuous connectivity verification (end-to-end/per domain) IEEE 802.1ag for end-to-end connectivity verification

Service layer OAM

Continuous SLA verification (end-to-end) Performance monitoring using Y.1731 RFC 2544 embedded test-head Y.1564 service activation support
Service Domain Operator Domain

1
Test Head
A

2 B

3 C

4
D Test Test Loopback Loopback

Demarcation

Mobile core

Demarcation

www.telco.com

14

Network, Service & Element Network Management

Chassis based monitoring and configuring End-to-end service provisioning

Review service layout

Granular management per blade, port, service, flow

Review transport tunnels

www.telco.com

Designing for Datacom & Network Security Whats the challenge ?

Example: 400Gbps bump In the wire equipment

400Gbps system throughput = 800Gbps IO ports

How to load balance that traffic inside the system ? Switching capacity:
~600gbps per 40G switch blade 2 switches = 1.2Tbps 800Gbps of that consumed by IO traffic Leaves 400Gbps for internal traffic = 1 extra hop for each packet

Processing power
Need top notch CPU blades Need application specific acceleration or IO or both

Slide 15

High End DPI System Example

40GE Switching rule based load balancing
Hub blade (prim.)
Switch Management T-ATCA404 (LMP) 40GE Hub Blade
xGE SW

Additional switching capacity using dual dual star

Hub blade (sec.) T-ATCA404 Management (LMP)Hub 40GE Blade xGE
SW

High Level Flow Pro. and DPI

General purpose CPU blade 40GE Dual Xeon Blade xGE GbE
MAC
CPU CPU MIC-5333

Low Level Flow Processing

NPU blade
NPU NPU

Additional switching capacity using dual dual star

Hub blade (sec.) T-ATCA404 Management (LMP) 40GE Hub Blade xGE GbE
SW

40GE Switching rule based load balancing

Hub blade (prim.) T-ATCA404 Management (LMP)Hub 40GE Blade xGE GbE
SW

Switch

GbE SW

GbE SW

ATCA-7410 Dual NPU LMP Blade

xGE SW

Switch

Switch

xGE MAC MAC

GbE SW

SW

SW

GbE

ShMC

Secondary 40GE
40GE fabric used as fabric interface for data and user plane. Dual star topology

ShMC

GbE used as Base Interface for Management and control plane Dual star topology

Primary 40GE
40GE used as fabric interface for data and user plane Dual star topology

IPMB
Low level management interface based on2 redundant IPMB busses. Bussed or radial (star) topology

Building a 160G IA Blade using dual-dual star

Advantech MIC-5333 Blade

4x 40G per IA Blade using Fabric Mezzanine Modules (FMMs) P

Embedded Load Balance in ATCA Switch

Remove the cost of separate load balancer Maximize bandwidth/HW utilization Use as HA and redundancy mechanism How does it work?
ATCABased Platform Switching blades

18

Multi-source traffic getting into switching blade L2-L4 traffic encapsulated VPNs parsing (eg: GRE, GTP, IPSEC, MPLS) Traffic filtering Hashing Dynamic flow management and remarking On-going Bucket matrix update Cloud, Data The result Center Load balance across blades, chassis, applications
www.telco.com

Metro Network
I

19

Flat QoS vs. Hierarchial QoS Service Level

Flat QoS
Customer 1 Customer 2 Customer 3

Hierarchical QoS
Single CoS
Voice

Single CoS Single CoS

User 1
VLAN/LSP 1

Video Data Voice Video Data

User 2

Or
Voice

Voice
VLAN/LSP 2

User 3

Customer 1
VLAN/LSP 1

Video Data Voice Video Data

Video Data

User 4

www.telco.com

Future 100G DPI System Example

100GE Switching rule based load balancing
Hub blade (prim.) 100GE Hub Blade
xGE SW

Additional switching capacity using dual dual star

Hub blade (sec.)
Switch THUBX Management (LMP) Hub 100GE

High Level Flow Pro. and DPI

General purpose CPU blade 100GE Dual Xeon Blade xGE GbE
MAC
CPU CPU MIC-5XXX

Low Level Flow Processing

NPU blade
NPU NPU

Additional switching capacity using dual dual star

Hub blade (sec.) T-ATCA404 Management (LMP) Hub 100GE Blade xGE GbE
SW

100GE Switching rule based load balancing

Hub blade (prim.) T-ATCA404 Management (LMP) Hub 100GE Blade xGE GbE
SW

Switch Management THUBX (LMP) GbE SW

Blade xGE
SW

GbE SW

ATCA-7410 Dual NPU LMP Blade

xGE SW

Switch

Switch

xGE MAC MAC

GbE SW

SW

SW

10GbE

ShMC

Secondary 100GE
100GE fabric used as fabric interface for data and user plane. Dual star topology

ShMC

10 GbE used as Base Interface for Management and control plane Dual star topology

Primary 100GE
100GE used as fabric interface for data and user plane Dual star topology

IPMB
Low level management interface based on2 redundant IPMB busses. Bussed or radial (star) topology

Poll 2

What kind of ATCA based application are you designing

or going to design (multiple selection)
A B C D E F Networking/Telecom Data center DPI or security Mobile Military Other

Slide 21

eATCA for Higher-end Networking Equipment

Terabits of switching capacity Terabits of I/O connectivity

Support for x86, NPU, DSP, hybrid architectures

Can match other & custom system architectures

Terabytes of storage

Scales from 2+2 to 14+14 slots

Open standards based & ATCA compliant

Managed like a big appliance

Off the shelf building blocks

Application: Extension of Product Line at High end

12 2U appliances + 2 1U switches

Consolidated into 14U rack space

NEW eRTMs with NMCs / IOs / In-line accelerators

Same COTS Dual Intel Xeon blades with optional look aside accelerators

12x

Consolidate appliances & switches into an eATCA platform

Greater density & gain in scalability Re-use appliance I/O Fault tolerance and serviceability (hot swap) NEBS ready platform with N+1 redundant PSUs Upgradeability No need to change appliance s/w framework

Same COTS Hub blades for control and / or data plane and external uplinks

2x

Application: Very High End Networking Gear

Up to 4 hub blades + eRTMs

> 2 Tbit backplane switching capacity eRTMs with system IO plus fan out switches / Traffic managers / Load balancing / Secret sauce
eRTMs with storage and accelerators Dual Intel Xeon blades with optional look aside accelerators

Up to 12x

Up to 12 node blades
Dual Xeon x86 with optional storage, accelerators or IO Dual NPUs or special purpose blades with Custom / specific IOs on eRTMs
eRTMs with system IO ports and Traffic Managers Hub blades for control and / or data plane

Up to 4x

Highest performance COTS platform

Blades are Commercial Off The Shelf eRTMs are Customized Off The Shelf
Application/customer specific IOs & logic Keep the secret sauce secret

eRTMs with custom / application specific IOs and logic

NPU blades or special purpose blades optional

eATCA Anatomy 2-slot Platform eATCA Anatomy 2-slot Platform

Extended Rear Transition Module eRTM. Example shown is a Network Mezzanine Card (NMC) Carrier. NMCs for I/O, Offload & Acceleration on eRTM

Standard Commercial ATCA Blade. Example shown is MIC-5333 dual Intel Xeon E5 Series processors blade.

Fabric Mezzanine Modules (FMMs) for I/O, Fabric Connectivity, Offload & Acceleration on ATCA Blade

Shelf Manager

2-slot eATCA Chassis

Poll 3
Which of the following best describes your ATCA System requirements? 1. 2. 3. 4. 5. Dual-star 10G is enough for me now and the near future I need 40G now or within the next 2 years I need 160G per blade in a dual dual-Star 40G topology I will skip 40G and go straight to 100G I need an architecture like eATCA

Slide 26

27

Summary Switching Blades at the Heart of ATCA

40GE ATCA product line responds to new telecom challenges. Rapid time-to-market can be achieved only with true telco grade switching OS deployment in ATCA pre-integrated system Integrated carrier grade switch OS to insure system reliability/scalability QoS, HQoS and integrated wire speed OAM mechanisms Embedded load balancing Built in redundancy HW OAM Security In-chassis and multi-chassis network management and configuration ATCA platform based on telco grade OS, removing the need for proprietary box per application All-in-One

ATCA switching solutions Manageable, Flexible, Feature Rich, High Capacity

www.telco.com

Summary: ATCA Now and Beyond

Theoretical shelf capacity to 2.5Tb/s Scalable system availability to 99.999% Multi-protocol support for interfaces up to 40 Gb/s Robust power infrastructure Modularity and configurability Ease of integration of multiple functions and new features Large pools of DSPs, NPs, x86 processors and storage Advanced s/w infrastructure providing APIs and OAM&P High security and regulatory conformance Supports 2-14 slots shelves in 19 cabinet Large enough board for low cost Reliable, full redundancy support Reliable mechanics (serviceability, shock and vibration) Hardware management interface

Proven & Deployed. Mature Ecosystem.

Accelerating Platform Evolution NOW!

Fabric Mezzanine Modules for greater modularity and configurability Greater ShM adapability needed for non-Telco markets Advanced Load Balancing techniques for finer grain workload distribution & failover

The Next Generation

40G Dual-dual star for 160G aggregate bandwidth per x86 node blade

eATCA extends ATCA into the datacenter &responds to the growing needs for extra capacity and offload
Flexible ShM h/w & platform management framework with dynamic blade reconfiguration for workload optimization Leverage FMMs, NMCs & eRTMs for a smoother transition from proprietary platforms to C2OTS 100G in the wings

Slide 28

Q & A Session

Peter Marek Senior Director, x86 Solutions Advantech Networks & Communications Group

Aviv Miller Product Line Manager, ATCA Telco Systems

Slide 29

Thank you for listening! View Archive at: ecast.opensystemsmedia.com

Slide 30

Useful links for further information

Advantech

ATCA Systems Brochure

http://www.advantech.com.tw/catalogs/pdf/2012/2012ATCA_brochure.pdf

eATCA Information
www.advantech.com.tw/nc/newsletter/eDM/eATCA

Telco System ATCA product line

http://www.telco.com/index.php?page=atca-solutions Telco Systems blog

http://www.telco.com/blog

To contact the panelists:

peter.marek@advantech.eu avivm@telco.com www.advantech.com/nc www.telco.com

Slide 31