Sie sind auf Seite 1von 27

Switch Fabric Architecture

Jack Regula January 12, 2001

PLX Switch Fabric Architecture


Agenda
Communications Infrastructure Trends What Is a Switch Fabric? How Does it Work? The Compelling Nature of Switch Fabric Platform Segmentation Architecture Overview

Communication Infrastructure Trends


Access
Wireless Tower

Laptop

Switch

Edge
Switch

Wireless LAN Gateway Router

Client

DSL

Base Station Controller

Core
Add/Drop MUX Add/Drop MUX

Client

Ethernet Switch

DSLAM

ATM Switch DWDM DWDM Enterprise Storage Switch Cable Modem

Remote Access Concentrator (RAC) Terabit Switch Router Media Gateway Digital Set Top Box
Digital Phones

Terabit Switch Router

v.90

IP Fax

Increasing Bandwidth
Access
Wireless Tower

Laptop

Switch

Edge
Switch

Wireless LAN Gateway Router

Client

DSL

OC-3 Base Station OController Core C-12 OC-4 8 O C-19 Add/Drop MUX 2
DSLAM ATM Switch DWDM

Client

Add/Drop MUX

et 10G EN

G ENet

Ethernet 100 10/Switch

DWDM Enterprise Storage Switch Cable Modem

Remote Access Concentrator (RAC) Terabit Switch Router Media Gateway Digital Set Top Box
Digital Phones

Terabit Switch Router

v.90

IP Fax

What is a Switch Fabric?


An interconnected network of switching devices
The fabric contains many input and output ports The fabric transports the data from inputs to outputs

A fast, concurrent & transparent mechanism to transfer data


High-speed, point-to-point links connecting switching devices Many switching devices working in parallel Sophisticated protocols to ensure reliable, ordered delivery of data in accordance with QOS

A highly-available network
Switch Fabric
Error detection mechanisms with correction via retry Fabric redundancy for fault tolerance Hot swap/live maintenance and expansion

Fundamental Building Block for Networking Equipment

What is a Switch Fabric Controller?

Switch Fabric

To another switching device

Fabric interface

Switching Device
Bus interface

Fabric interface

To another switching device

To CPU or I/O

A chip with fabric I/F and bus I/F Connects to other switching devices to form a switch fabric Connects a CPU or I/O subsystem into the fabric Implements the switch fabric protocols

Why Switch Fabric is Compelling


Equipment Vendors
q q q q q

Higher BW More ports/slots Higher-availability Longer distance Time-to-Market

Corporations
q q q q

More BW for employees Connect remote/mobile users Gain new subscribers E-commerce!

Silicon Vendors

Switch Fabric

q q

Logical extension of PCI roadmap New revenue streams Higher ASP

Enables Next-Generation Equipment and End-Users

Switch Fabrics in Current Platforms


Nortel Versalar Switch Router 2500
This high performance forwarding is achieved with a scalable, non-blocking switch fabric

Cisco MGX8260 Media Gateway


The system also provide additional scaling through the use of interchangeable switch fabrics growing the capacities from 5 Gbps to 15 Gbps

Lucent CBX500 WAN Switch


The CBX500 Multiservice WAN Switch is a high performance cell switch based on crosspoint technology as its core switch fabric

Lucent NX64000 Multi-Terabit Switch/Router


The NX6400 innovative switch fabric delivers 6.4 Tbps switch capacity per chassis.

Next-Generation Platforms Demand More Complex Switch Fabrics

Evaluating a Switch Fabric


s s

Sufficient Non-blocking Throughput and Port Count ? Is It a Complete Solution for High Availability?
x x x x Transparent fault and error recovery Line card hot swap Live fabric expansion and maintenance Fabric redundancy

Does it Preserve Transaction Order?


x Producer-consumer model x Cells/transactions delivered in order, one time only, even if fault or transient error

Legacy Support:
x Can you use same PCI cards and packaging x Does your software require modification or augmentation?

s s s

Is it transparent?
x Boot, configuration, operation, fault recovery

How far does it get you?


x Chip to chip, board to board, shelf to shelf, box to box

Is it available?

Conceptual Switch Fabric Model


Switching Devices

CPU I/O I/O

Switch Fabric ASIC Switch Fabric ASIC

Bus transactions exchange of switch fabric cells

Switch Fabric ASIC Switch Fabric ASIC

CPU I/O I/O

Switch Fabric ASIC

Switch Fabric ASIC

1. Transports data from multiple sources to multiple destinations 2. Increases scalability (bandwidth, I/O ports, distance) 3. Improves reliability/availability (self-healing, fail-over)

Conceptual Model 2: Virtual PCI-PCI Bridges

SECONDARY

SECONDARY

PRIMARY

PRIMARY

HOST PCI PRI

Switch Fabric Controller

SEC

VIRTUAL PCI

PRI

Switch Fabric Controller

SUBORDINATE PCI

o. sn . bu eg r

SEC SUB

PLX Switch Fabric Architecture


PCI

Layered Architecture
Fabric Interface
cPCI

15 feet distance

PCI PCI PCI

PCI Local Bus

Cell Processing Engine

Dual -Counter Rotating Rings

cPCI

PCI PCI

Bus Interface
cPCI

PCI

PCI Local Bus PCI v2.2 Interface 32-bit, 33/66MHz

Performance
Bandwidth of Link = L, N=Number of Nodes
GBP
B P

Worst Case BW = 4L Uniform Traffic Distribution: BW =8L (6.4 GB/sec; 51.2 Gbps)
GBP GBP

G
G BP

B
GBP

Best Case BW = 2LN

PLX Switch Fabric Controller Architecture

Application: Embedded PCI / cPCI


PCI PCI PCI

PCI

PCI

PCI

CPU
Host MEM Bridge
PCI

PCI

PCI

PCI

PCI

PCI

PCI

16-slot, 6U CompactPCI Fabric


J5 J4 J3 J2 J1
Low Profile 32-bit PCI to SF Bridge Low Profile 32-bit PCI to SF Bridge Low Profile 32-bit PCI to SF Bridge Low Profile 32-bit PCI to SF Bridge

User I/O Connectors

Application #2: CompactPCI Expansion

cPCI

Host Br. CPU

cPCI

cPCI

cPCI

cPCI

cPCI

cPCI

PCI

cPCI

cPCI

cPCI

cPCI

cPCI

Dual Host Solution


PCI PCI

Domain A
PCI PCI

Domain B

CPU Host
MEM

PCI

PCI

CPU Host
MEM

PCI

PCI

Bridge
PCI

Bridge
PCI

Edge & Access Equipment


Data Control

PCI

Edge & Access Equipment


Control

Data

Short Design Cycle Short Design Cycle Investment Preservation Investment Preservation Compatibility Compatibility

PLX Switch Fabric

Performance (10x bandwidth) Performance (10x bandwidth) Scalability (100x) Scalability (100x) High Availability High Availability

Application Example

Media Gateway
Control Module Control Module
MultiChannel Voice MultiChannel Voice MultiChannel Voice

STM-1 STM-1
Gig Ethernet Gig Ethernet

Chip to Chip

MultiChannel Voice MultiChannel Voice

Backplane PLX Switch Fabric

Flexibility to Expand

Shelf to Shelf

PLX Switch Fabric Architecture Summary


s

Bandwidth and Scalability


x 51.2 Gbps x 224 PCI Bus Segments at 32/64 bits, 33/66 MHz x 15 foot maximum distance for chassis to chassis

A Complete Solution for High Availability!


x x x x Transparent fault and error recovery Line card and fabric hot swap Integrated fabric redundancy Multi-host support with fail-over

Transaction Order Fully Preserved!


x Producer-consumer model x Cells/transactions delivered in order, x Transactions complete exactly once; even if fault or transient error

Complete Legacy Support!


x 100% compatible with all PCI specifications x Use same PCI cards, packaging and software x Fully Transparent: boot, configuration, operation, fault recovery

Scalability and High-Availability on PCI

PLX Switch Fabric Architecture Summary


Scalability
224 PCI bus segments 51.2 Gbps aggregate bandwidth 15 feet distance chassis-to-chassis

High Availability
Self-healing via retries & redirection Live node insertion Multi-host fail-over via SW

PCI Compatibility
100% compatible with all PCI Specifications 33MHz or 66MHz PCI interface Auxiliary Signal support for 4 PCI devices External EEPROM for config and BIOS

Electrical/Mechanical/Thermal
IBM 0.25u CMOS 2.5Vcc supply, 5V/3.3V tolerant I/o 388-ball PBGA, 27mmx27mm

Scalability and High-Availability on PCI

PLX Switch Fabric Architecture Schedule


Chips & Tools Availability
Samples Q1 01 Rapid Development Kit (RDK) Q2 01 Rapid Development System (RDS) Q2 01

The Leading Supplier of High Speed Interconnect Silicon and Software to the Networking and Communication Industry

PLX Switch Fabric Architecture Live Demonstration at Bus&Board


Demonstration of switching capabilities, throughput Suite 327 Monday 5:00-8:00 p.m. Tuesday noon-5:00 p.m.