You are on page 1of 216

Introduction to Atlas (MX960)

- Steven Wong (JTAC)

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

Agenda

Hardware Overview
NPEZ
Ichip
Layer 3 Forwarding
Layer 2 Forwarding
IRB Interface
Tunnel Interface
Exception Traffic
Reference
Q&A

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

Hardware Overview
lab@atlas-re0> show chassis hardware
Hardware inventory:
Item
Version Part number
Chassis
Midplane
REV 02
710-013698
FPM Board
REV 02
710-014974
PDM
Rev 02
740-013110
PEM 0
Rev 03
740-013682
PEM 1
Rev 03
740-013682
PEM 2
Rev 03
740-013682
Routing Engine 0 REV 06
740-013063
Routing Engine 1 REV 06
740-013063
CB 0
REV 05
710-013385
CB 1
REV 05
710-013385
.....

Copyright 2007 Juniper Networks, Inc.

Serial number
JN1086183AFA
TR0021
JY4616
QCS1046500X
QCS1101403H
QCS1101400D
QCS1101402R
1000683109
1000683100
JY4763
JS9788

Proprietary and Confidential

Description
MX960
MX960 Backplane
MX960 Front Panel Display
Power Distribution Module
PS 1.7kW; 200-240VAC in
PS 1.7kW; 200-240VAC in
PS 1.7kW; 200-240VAC in
RE-S-2000
RE-S-2000
MX SCB
MX SCB

www.juniper.net

Hardware Overview
(cont....)
FPC 2
CPU
PIC 0
Xcvr 0
PIC 1
Xcvr 0
Xcvr 1
PIC 2
Xcvr 0
PIC 3
Xcvr 0
FPC 9
CPU
PIC 0
Xcvr 0
PIC 1
PIC 2
Xcvr 0
PIC 3
Fan Tray 0
Fan Tray 1

REV 06
REV 05
REV 01
REV 01
REV 01
REV 01
REV 01
REV 06
REV 05

REV 01
REV 01

710-013699
710-013713
BUILTIN
740-011613
BUILTIN
740-008169
740-008169
BUILTIN
740-011782
BUILTIN
740-011782
710-014219
710-013713
BUILTIN
NON-JNPR
BUILTIN
BUILTIN
NON-JNPR
BUILTIN
740-014971
740-014971

JY4830
JY4706
BUILTIN
5XJ010A00091
BUILTIN
3ZTY39T00015
39D918R00002
BUILTIN
P862V82
BUILTIN
PAB06XN
JY4699
JY4467
BUILTIN
K8E01JZ
BUILTIN
BUILTIN
C618XF03W
BUILTIN
TP0051
TP0109

DPC 40GE
DPC PMB
10x 1GE
SFP-SX
10x 1GE
SFP-LH
SFP-LH
10x 1GE
SFP-SX
10x 1GE
SFP-SX
DPC 4 XGE
DPC PMB
1x 10GE(LAN/WAN)
XFP-10G-LR
1x 10GE(LAN/WAN)
1x 10GE(LAN/WAN)
XFP-10G-SR
1x 10GE(LAN/WAN)
Fan Tray
Fan Tray

lab@atlas-re0>

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

Hardware Overview Chassis


Control
Panel
Upper
Fantray
DPC
SCB
SCB/DPC
dual slot

RE

Cable
Management

Lower
Fantray
Air
Intake
Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

Hardware Overview Chassis


14 Slot Chassis
480Gbps Throughput
Physical size
Height: 16RU, Depth: 23.5

Power and cooling


Front-to-back cooling with separate push-pull fan
assemblies
System power: 5100W
Supports 3+1 AC/2+2 DC system configurations

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

Hardware Overview PEM


Total system power 5100W
Power design system supports 2+2 DC or 3+1 AC
DC Configuration

Atlas chassis is split into two zones, each zone requires one PEM

The DC power supplies in slots PEM0 and PEM2 provide power to the
lower fan tray, DPC slots 6 through 11, and SCB slots 1 and 2.
The DC power supplies in slots PEM1 and PEM3 provide power to the
upper fan tray, DPC slots 0 through 5, and SCB slot 0.

For redundancy a second PEM per zone is required


DC configuration supports -48V
DC circuit breaker rated 80A.
DC lugs are plugged into DC PEM
Microcontroller to monitor and control PEM

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

Hardware Overview PEM


AC Configuration

AC power supplies share load


3 AC power supplies needed for non redundant configuration
For redundancy a fourth power supply is required.
AC power supply supports 200V 240V AC
Cables are plugged into Atlas Chassis
Microcontroller to monitor and control power supply

DC

Copyright 2007 Juniper Networks, Inc.

AC

Proprietary and Confidential

www.juniper.net

Hardware Overview Front Panel Display


Power Supply Indications
Fan Tray Indications
Routing Engine 0 Indications
Routing Engine 1 Indications
Yellow
Alarm
LED

Red
Alarm
LED

Alarm
Cutoff

Alarm
Relays

Slot Online/Offline Buttons

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

Hardware Overview Routing Engine


A-RE1300 (Bronze RE)

- 1.3 GHz Celeron-M CPU processor


- 2 GB DDR2-400 SDRAM
- 1 GB interval compact flash
- 40 GB hard drive
- USB interface

A-RE2000 (Gold RE)

- 2 GHz Pentium-M CPU processor


- 4 GB DDR2-400 SDRAM
- 1 GB internal compact flash
- 40 GB hard drive
- USB interface

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

10

Hardware Overview Routing Engine


lab@atlas-re0> show system boot-messages | match "ad0:|ad2:|cpu"
CPU: Intel(R) Pentium(R) M processor 2.00GHz (1995.01-MHz 686-class CPU)
ad0: 999MB <SILICONSYSTEMS INC 1GB> [2030/16/63] at ata0-master WDMA2
ad2: 38154MB <HTE541040G9SA00> [77520/16/63] at ata1-master UDMA100
lab@atlas-re0> show chassis routing-engine
Routing Engine status:
Slot 0:
Current state
Master
Election priority
Master (default)
Temperature
52 degrees C / 125 degrees F
CPU temperature
75 degrees C / 167 degrees F
DRAM
3584 MB
Memory utilization
10 percent
CPU utilization:
User
0 percent
Background
0 percent
Kernel
5 percent
Interrupt
0 percent
Idle
95 percent
Model
RE-S-2000
Serial ID
1000683109
.....
Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

11

Hardware Overview Routing Engine


GE internal interfaces
lab@atlas-re0> show tnp addresses
Name
TNPaddr MAC address
master
1
02:00:00:00:00:04
master
1
02:00:01:00:00:04
re0
4
02:00:00:00:00:04
re0
4
02:00:01:00:00:04
re1
5
02:01:00:00:00:05
backup
6
02:01:00:00:00:05
fpc2
18
02:00:00:00:00:12
fpc9
25
02:00:00:00:00:19
bcast
255
ff:ff:ff:ff:ff:ff
bcast
255
ff:ff:ff:ff:ff:ff

Copyright 2007 Juniper Networks, Inc.

IF
em0
em1
em0
em1
em1
em1
em0
em0
em0
em1

MTU
1500
1500
1500
1500
1500
1500
1500
1500
1500
1500

Proprietary and Confidential

Expire
0
0
0
0
3
3
5
5
0
0

Hopcount
1
1
0
1
0
0
0
0
0
1

Rev
2
2
2
2
2
2
2
2
2
2

www.juniper.net

12

Hardware Overview Routing Engine


lab@atlas-re0> show interfaces em0 extensive
Physical interface: em0, Enabled, Physical link is Up
Interface index: 8, SNMP ifIndex: 17, Generation: 2
Type: Ethernet, Link-level type: Ethernet, MTU: 1514, Clocking: Unspecified, Speed:
1000mbps
Device flags
: Present Running
Interface flags: SNMP-Traps
Link type
: Full-Duplex
Physical info : Unspecified
Hold-times
: Up 0 ms, Down 0 ms
Current address: 02:00:00:00:00:04, Hardware address: 02:00:00:00:00:04
Alternate link address: Unspecified
Last flapped
: Never
Statistics last cleared: Never
Traffic statistics:
Input bytes :
492421870
Output bytes :
492809310
Input packets:
4754993
Output packets:
4302842
.....

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

13

Hardware Overview A-SCB


Atlas Switch and Control Board (ASCB) is the PFE control board
Routing Engine Carrier
ACBC FPGA
2 x SF ASIC per A-SCB (HSL2)
GE Switch

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

14

Hardware Overview A-SCB


root@atlas-re0% cbc -a
0x0000:

INT_SRC: 0x00280039

0x0004:

INT_EN: 0x01070000

0x0008:

LED_RESET_TIMER: 0x00000000

0x000c:

TIMER_CNT: 0x00000000

0x0010:

I2C_SEL: 0x00000008

0x0014:

CH_PRS: 0xe8320437

0x0018:

RTL_REVISION: 0x00000101

0x001c:

PWR_STATUS: 0x000033f8

0x0020:

I2CS_INT: 0x00000000

0x0024:

I2CS_INT_EN: 0x0000b204

0x0028:

FAN_CTRL_STATUS: 0x000bb000

0x002c:

TACH_CNT: 0x00000000

0x0030:

FAN (0-3) THRESHOLD: 0x00000000

0x0034:

FAN_(4-7) THRESHOLD: 0x00000000

.....
0x00cc:

RE_HALT: 0x00000000

0x00d0:

LIU_CTL: 0x1111112b

root@atlas-re0%
Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

15

Hardware Overview A-SCB


A redundancy A-SCB can
be inserted into slot 8.
No Routing Engine can
boot up from that A-SCB
slot
Provide Fabric plane
redundancy
No DPC is allowed on this
slot if Bellini DPC is
installed (A/C system)

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

16

Hardware Overview A-SCB


lab@atlas-re0> show chassis fabric plane-location
------------Fabric Plane Locations------------Plane 0

Control Board 0

Plane 1

Control Board 0

Plane 2

Control Board 1

Plane 3

Control Board 1

Plane 4

Control Board 2

Plane 5

Control Board 2

lab@atlas-re0>

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

17

Hardware Overview A-SCB


lab@atlas-re0> show chassis fabric plane
Fabric management PLANE state
Plane 0
Plane state: ACTIVE
FPC 2
PFE 0 :Links ok
PFE 1 :Links ok
PFE 2 :Links ok
PFE 3 :Links ok
FPC 9
PFE 0 :Links ok
PFE 1 :Links ok
PFE 2 :Links ok
PFE 3 :Links ok
.....

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

18

Hardware Overview 40-port GE DPC

40 x GE ports with SFP


4 x PFE (4 x I3.0 ASIC)
2 x A-IA FPGA
CPU/Memory complex
(1200Mhz MPC 8548
processor, 1024MB memory,
512KB flash)

A-DPM-Mezzanine
Each carries 20 GE ports

PM8363 (4) and PM8373 (6) to


provide PHY for the 10 GE
ports on each PFE

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

19

Hardware Overview 4-port XGE DPC


4 x 10GE ports with SFP
4 x PFE (4 x I3.0 ASIC)
2 x A-IA FPGA
CPU/Memory complex
(1200Mhz MPC 8548 processor,
1024MB memory, 512KB flash)

XG2013 provides the PHY for the


10GE port

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

20

Hardware Overview Types of DPC


Port indexing follows the existing platform

Ports under DPC0 PFE0 is ge-0/0/[0-9] / xe-0/0/0


Ports under DPC0 PFE1 is ge-0/1/[0-9] / xe-0/1/0
Ports under DPC0 PFE2 is ge-0/2/[0-9] / xe-0/2/0
Ports under DPC0 PFE3 is ge-0/3/[0-9] / xe-0/3/0

However, there is no PIC concept on the DPC and


PIC offline wont work in Atlas.

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

21

Hardware Overview Types of DPC


DPC[E] 40x 1GE {R/X} [EQ]
| |______| |
|
|
|
|
+----- Enchanged Queuing (Bellini)
|
|
|
|
|
+---------- R=Atlas, X=Athena/Triton
|
|
|
+---------------- (no of ports)x (port type)
|
+---------------------- RevB EZ Based DPC
e.g.
"DPCE 40x 1GE R EQ" == RevB EZ Based 40x1GE Atlas Bellini DPC
"DPC 4x 10GE R"
== RevA EZ Based 4x10GE Atlas DPC.
PIC descriptions are changed to following,
- "1x 10GE(LAN/WAN)"
- "1x 10GE(LAN/WAN) EQ" (Bellini)
- "10x 1GE(LAN)"
- "10x 1GE(LAN) EQ"
(Bellini)

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

22

Hardware Overview Types of DPC


[edit]
lab@atlas-re0# set chassis network-services ?
Possible completions:
ethernet
Ethernet network services
ip
IP network services
[edit]
lab@atlas-re0#

Ethernet Services

IP Services

Both Atlas DPCs and Triton DPCs to run Layer 2.5


functions. It is required to boot up Triton DPC.
Only Atlas DPCs to provide all functions

Per system configuration

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

23

Hardware Overview Types of DPC


Functions NOT covered under Layer 2.5

All BGP NLRI except L2VPN


uRPF
SCU/DCU
No more than 64k firewall terms

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

24

Hardware Overview DPC

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

25

Agenda

Hardware Overview
NPEZ
Ichip
Layer 3 Forwarding
Layer 2 Forwarding
IRB Interface
Tunnel Interface
Exception Traffic
Reference
Q&A

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

26

NPEZ Overview
The same Network Processor we have used on
IQ2 PIC (NP-2) running at 240MHz
However, the Traffic Management (TM) is only
available on Bellini (Q-DPC)
Interact with the GE PHY (pm8363, pm8373,
xg2013)
Build-in MAC function

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

27

NPEZ Overview
40 ports GE DPC
ADPC2(atlas-re1 vty)# show npez 0 sys-cfg
System Configuration parameters
Structure version is: Default is used
PCI base address: 0xC8000000.
Chip type is NP-2.
Chip mode is NP-2.
Interface A type is SPI-A.
Interface B type is RGMII.
TMa is in bypass mode.
TMb is in bypass mode.
Number of RX subinterfaces at side A: 12.
Number of TX subinterfaces at side A: 1.
Number of RX subinterfaces at side B: 10.
Number of TX subinterfaces at side B: 10.
External CAM is disabled.
Host RGMII port 0 is disabled.
Host RGMII port 1 is disabled.
System clock frequency in MHz 240.
ADPC2(atlas-re1 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

28

NPEZ Overview
4 ports XGE DPC
ADPC9(Atlas_re0 vty)# show npez 0 sys-cfg
System Configuration parameters
Structure version is: Default is used
PCI base address: 0xC8000000.
Chip type is NP-2.
Chip mode is NP-2.
Interface A type is SPI-A.
Interface B type is XGMII.
TMa is in bypass mode.
TMb is in bypass mode.
Number of RX subinterfaces at side A: 2.
Number of TX subinterfaces at side A: 1.
Number of RX subinterfaces at side B: 1.
Number of TX subinterfaces at side B: 1.
External CAM is disabled.
Host RGMII port 0 is disabled.
Host RGMII port 1 is disabled.
System clock frequency in MHz 240.
ADPC9(Atlas_re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

29

NPEZ Overview
ADPC2(atlas-re0 vty)# show npez 0 ext-mem-cfg
External memory configuration parameters:
Structure version is: Default is used
External search memory type is EZapiChannel_ExtMemType_RLDRAM_II_18bit_288mb.
External search memory size in MByte 128.
External search memory clock frequency in MHz 233.
External search memory use ECC is Enabled.
TM control memory type is EZapiChannel_ExtMemType_INACTIVE.
TM control memory size in MBytes 0.
TM control memory group 0 is not active.
TM control memory group 1 is not active.
TM control memory clock frequency in MHz 0.
TM control memory use ECC is Disbaled.
TM frame memory type is EZapiChannel_ExtMemType_INACTIVE.
TM frame memory size in MBytes 0.
TM frame memory group 0 is not active.
TM frame memory group 1 is not active.
TM frame memory clock frequency in MHz 0.
TM frame memory us ECC is Disbaled.
Statistic memory type is EZapiChannel_ExtStatMemType_2x9bit.
Statistic memory clock frequency in MHz 233.
Statistic memory size in mega counters 2.
Statistic memory use ECC is Disbaled.
Statistic memory use parity is Disbaled.
Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

30

NPEZ Overview
40 ports GE DPC
ADPC2(atlas-re0 vty)# show pm8363 summary
ID PM8363 name

FPC PIC MAC Link 0


Link 1
Link 2
Link 3
Ptr
ifd
ifd
ifd
ifd
------------------------------------------------------------------------1 .pm8363.2.0.0.
2
0
0 ge-2/0/0 ge-2/0/1 ge-2/0/2 ge-2/0/3 0x49c807cc
2 .pm8363.2.1.0.
2
1
0 ge-2/1/0 ge-2/1/1 ge-2/1/2 ge-2/1/3 0x4a208a98
3 .pm8363.2.2.0.
2
2
0 ge-2/2/0 ge-2/2/1 ge-2/2/2 ge-2/2/3 0x4a792024
4 .pm8363.2.3.0.
2
3
0 ge-2/3/0 ge-2/3/1 ge-2/3/2 ge-2/3/3 0x4ad1c798
ADPC2(atlas-re0 vty)# show pm8373 summary
ID PM8373 name

FPC PIC MAC Link 0


Link 1
Link 2
Link 3
Ptr
ifd
ifd
ifd
ifd
------------------------------------------------------------------------0 .pm8373.2.0.1.
2
0
1 ge-2/0/4 ge-2/0/5 ge-2/0/6 ge-2/0/7 0x49c80858
1 .pm8373.2.1.1.
2
1
1 ge-2/1/4 ge-2/1/5 ge-2/1/6 ge-2/1/7 0x4a208b24
2 .pm8373.2.2.1.
2
2
1 ge-2/2/4 ge-2/2/5 ge-2/2/6 ge-2/2/7 0x4a7920b0
3 .pm8373.2.3.1.
2
3
1 ge-2/3/4 ge-2/3/5 ge-2/3/6 ge-2/3/7 0x4ad1c824
ADPC2(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

31

NPEZ Overview
ADPC2(atlas-re0 vty)# show pm8373 an
FPC PIC Link ifd_name GMII_CTRL
GMII_STATUS
AN_ADV
LP_ADV
---------------------------------------------------------------------2
0
0
ge-2/0/4
0x1140
0x0149
0x01a0
0x0000
2
0
1
ge-2/0/5
0x1140
0x0149
0x01a0
0x0000
2
0
2
ge-2/0/6
0x1140
0x0149
0x01a0
0x0000
2
0
3
ge-2/0/7
0x1140
0x0149
0x01a0
0x0000
2
0
4
ge-2/0/8
0x1140
0x0149
0x01a0
0x0000
2
0
5
ge-2/0/9
0x1140
0x0149
0x01a0
0x0000
2
1
0
ge-2/1/4
0x1140
0x0149
0x01a0
0x0000
2
1
1
ge-2/1/5
0x1140
0x0149
0x01a0
0x0000
2
1
2
ge-2/1/6
0x1140
0x0149
0x01a0
0x0000
2
1
3
ge-2/1/7
0x1140
0x0149
0x01a0
0x0000
2
1
4
ge-2/1/8
0x1140
0x0149
0x01a0
0x0000
2
1
5
ge-2/1/9
0x1140
0x0149
0x01a0
0x0000
2
2
0
ge-2/2/4
0x1140
0x0149
0x01a0
0x0000
2
2
1
ge-2/2/5
0x1140
0x0149
0x01a0
0x0000
2
2
2
ge-2/2/6
0x1140
0x0149
0x01a0
0x0000
2
2
3
ge-2/2/7
0x1140
0x0149
0x01a0
0x0000
2
2
4
ge-2/2/8
0x1140
0x0149
0x01a0
0x0000
2
2
5
ge-2/2/9
0x1140
0x0149
0x01a0
0x0000
2
3
0
ge-2/3/4
0x1140
0x0149
0x01a0
0x0000
2
3
1
ge-2/3/5
0x1140
0x0149
0x01a0
0x0000
.....
Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

32

NPEZ Overview
4 ports XGE DPC
ADPC9(atlas-re0 vty)# show xg2013
<number>
PHY index
ADPC9(atlas-re0 vty)# show xg2013 0 hw-status
pcs:
status register: 3.0x820a: 0x0005
defects: block_lock, no hi_ber
wis:
status register: 2.0x810a: 0x8000
section: no los, no lof, no sef
line
: no lrdi, no lais
path
: no lcd, no lop, no pais, no plm
serdes:
status register: 3.0x8127: 0x0000
defects: no los, tx_clk_lock, rx_clk_lock
ADPC9(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

33

Agenda

Hardware Overview
NPEZ
Ichip
Layer 3 Forwarding
Layer 2 Forwarding
IRB Interface
Tunnel Interface
Exception Traffic
Reference
Q&A

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

34

Ichip Overview I3.0


10Gbps PFE design
Lookup Memory
32MB RLDRAM

IIF/Wo Memory
32MB RLDRAM

Packet Memory and


Notification Memory
1GB DDR2

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

35

Ichip Overview I3.0


I3.0 is being used (Reno use I2.0)
ADPC2(atlas-re0 vty)# show ichip 0 internal
(0x4b2321c8)

ichip : 0x4092f390

(0x4092f390)

which_ichip : 0

(0x4092f394)

version : 3

(0x4092f3bc)

debug_flags : 0x00000000

(0x4092f3cc)

ichip_initialized : TRUE

(0x4092f3d0)

ichip_real : TRUE

(0x4092f3d4)

run_periodics : TRUE

(0x4092f930)
(0x4092f3b0)

pio_base : 0xc0000000
pic_count : 1

Both use the same packet forwarding logic

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

36

Ichip Overview I3.0


I3.0 supports 48 fabric destinations instead of
16 in I2.0
Narrower and faster HSL2 (3.7Gbps vs.
3.11Gbps)
WRR behavior difference in bonus region

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

37

Ichip Overview I3.0

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

38

Ichip Overview I3.0


Ifi (Fabric Input)
This block receives the cells from the fabric, put them into
correct order and send them to Iwi for further processing.
Iwi (Wan Input)
This block receives the frames from the Wan interface
(NPEZ) and the cells from the Ifi, phrase them correctly,
perform the cellification and pass the cells to the Ipktwr
block.
Ipktwr (Packet Writer)
This block receives the cells from the Iwi block, write them
into the data packet memory via Im, create the indirect cell
if needed and construct a notification cell to Iiif

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

39

Ichip Overview I3.0


Iiif (IIF index lookup)
This is a new functional block on our routing platform.
Instead of using channel lookup to determine the IIF, we
have used a compressed JTREE for IIF lookup. The table is
stored on a RLDRAM which is accessible via Isr block.
After the IIF has been determined, the complete notification
is formed and it will be forwarded to the next block (Irlkp).
Isr (Route / IIF lookup Memory Access)
This is a block being used to access the RLDRAM on the
chip. The RLDRAM has been used to store the routing
table, interface lookup table, nexthop database and
accounting.
Irlp (Route Lookup)
This is where we perform route lookup. Also, this is where
we perform the BA and MF classification (except fixed
forwarding class assignment which is provided by Iiif).
Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

40

Ichip Overview I3.0


Im (Packet Data and Notification Memory Buffer)
This block is used to access the data packet and
notification memory.
Ip (Host Packet)
This is the block to handle the host traffic. It works with
Atlas Ichip Assistant (A-IA) FPGA for host bound packets.
Imq (Scheduling and Queuing)
This is where we performs the packet scheduling,
queuing and RED drop on the PFE.

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

41

Ichip Overview I3.0


Ipktrd (Packet Reader)
This block is used to extract the cells back from the Im.
Iwo (Wan Output)
This block is where we reassemble the packet from the
data cells and perform the L2 and L3 header
manipulations. It will need to access the RLDRAM via the
Isr for the nexthop extraction and accounting.
Ifo (Fabric Output)
This is the block to send out the cells towards the egress
PFE via 4 fabric planes.

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

42

Ichip Overview I3.0


A-DPC-40GE-SFP

A-DPC-4XGE-XFP

PIC #

PFE #

PIC #

PFE #

2
3

1
3

2
3

2
3

This mapping only applies to the Ichip and NPEZ indexing. The
PFE index and the xeth PIC index would not be changed
For example, the second PIC slot on the DPC 40GE in FPC slot
2 (ge-2/1/X) is still PFE index 0x09 and xeth PIC 1 on the DPC
(not PFE 0x0a and xeth PIC 2). However, the Ichip and NPEZ
index within this DPC is 2.

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

43

Agenda

Hardware Overview
EZchip
Ichip
Layer 3 Forwarding
Layer 2 Forwarding
IRB Interface
Tunnel Interface
Exception Traffic
Reference
Q&A

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

44

Layer 3 Forwarding

VLAN id lookup on Ezchip (L2 service number)


Cellification from Ipktwr
IIF lookup from Ichip (IIF index)
Route lookup on Ichip
Egress queue on Imq
Packet reassemble and L23 hdr construction on Iwo
Egress cookie tagged with L2 service number
Service table lookup on Ezchip

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

45

Layer 3 Forwarding NPEZ


Ethernet frame would be handled by the build-in MAC
chip on Ezchip
VC lookup is done on the NPEZ
VLAN id is the key to determine the L2 service number
(l2sn)
The port number and service number would be used by
the Ichip (Iiif block) to determine the IIF index

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

46

Layer 3 Forwarding NPEZ


# set interfaces ge-0/0/0 unit 0 vlan-?
Possible completions:
vlan-id
Virtual LAN identifier value for 802.1q VLAN tags
vlan-id-range
Virtual LAN identifier range of form vid1-vid2
> vlan-tags
IEEE 802.1q tags
# set interfaces ge-0/0/0 unit 0 vlan-tags inner?
Possible completions:
inner-range
[tpid.]vid1-vid2, tpid format is 0xNNNN and is optional

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

47

Layer 3 Forwarding NPEZ


Dual tagged with inner-vlan-range
ge-2/0/7 {
stacked-vlan-tagging;
encapsulation extended-vlan-ccc;
unit 100 {
vlan-tags outer 100 inner-range 1-4094;
family ccc;
}
}
port
ovlan
ivlan
<--------Key-------->
0x000007 0x0064 0x0400
0xffffff 0xffff 0xfc00
0x000007 0x0064 0x0200
0xffffff 0xffff 0xfe00
0x000007 0x0064 0x0100
0xffffff 0xffff 0xff00
0x000007 0x0064 0x0080
0xffffff 0xffff 0xff80
0x000007 0x0064 0x0040
0xffffff 0xffff 0xffc0
.....
Copyright 2007 Juniper Networks, Inc.

ctrl
cond fc
bd
l2st l2sn l2iif
stp_idx
<-----------------Result------------------------------->
0x0b00 0x04 0x00 0x0007 0x07 0x0002 0x000000 0x0000
<-- 1024 to 2047
0x0b00 0x04 0x00 0x0007 0x07 0x0002 0x000000 0x0000
<-- 512 to 1023
0x0b00 0x04 0x00 0x0007 0x07 0x0002 0x000000 0x0000
<-- 256 to 511
0x0b00 0x04 0x00 0x0007 0x07 0x0002 0x000000 0x0000
<-- 128 to 255
0x0b00 0x04 0x00 0x0007 0x07 0x0002 0x000000 0x0000
<-- 64 to 127
Proprietary and Confidential

www.juniper.net

48

Layer 3 Forwarding NPEZ


Dual tagged
Logical interface ge-2/1/0.100 (Index 142) (SNMP ifIndex 180) (Generation 498)
Flags: SNMP-Traps 0x4000 VLAN-Tag [ 0x8100.200 0x8100.100 ] In(pop) Out(push
0x8100.200) Encapsulation: Extended-VLAN-VPLS
Logical interface ge-2/1/0.101 (Index 149) (SNMP ifIndex 181) (Generation 499)
Flags: SNMP-Traps 0x4000 VLAN-Tag [ 0x8100.200 0x8100.101 ] In(pop) Out(push
0x8100.200) Encapsulation: Extended-VLAN-VPLS
ADPC2(atlas-re0 vty)# show npez 2 vc-mt
port
ovlan
ivlan
ctrl
cond fc
bd
l2st l2sn l2iif
stp_idx
<--------Key-------->
<-----------------Result------------------------------->
0x000000 0x00c8 0x0064
0x3302 0x24 0x34 0x0014 0x03 0x0008 0x0000bc 0x0001
0xffffff 0xffff 0xffff
0x000000 0x00c8 0x0065
0x3302 0x24 0x34 0x0015 0x03 0x0009 0x0000bd 0x0001
0xffffff 0xffff 0xffff
ADPC2(atlas-re0 vty)# show npez 2 vc-ht
port epoch ovlan ivlan
ctrl cond
fc
bd
l2st l2sn l2iif
stp_idx
<-----------Key----------> <------------------------------Result------------------->
0
0
0x00c8 0x0064
0x3302 0x24 0x34 0x0014 0x03 0x0008 0x0000bc 0x0001
0
0
0x00c8 0x0065
0x3302 0x24 0x34 0x0015 0x03 0x0009 0x0000bd 0x0001
.....

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

49

Layer 3 Forwarding NPEZ


Single tagged
lab@atlas-re0> show interfaces ge-2/2/0
.....
Logical interface ge-2/2/0.100 (Index
Flags: SNMP-Traps 0x4000 VLAN-Tag [
.....
Logical interface ge-2/2/0.101 (Index
Flags: SNMP-Traps 0x4000 VLAN-Tag [

extensive
154) (SNMP ifIndex 188) (Generation 490)
0x8100.100 ] Encapsulation: ENET2
155) (SNMP ifIndex 189) (Generation 491)
0x8100.101 ] Encapsulation: ENET2

ADPC2(atlas-re0 vty)# show npez 1 vc-dt


total number of entries: 12
port
vlan
<-----Key---->
0
0x0064
0
0x0065
.....

ctrl
cond
fc
bd
l2st l2sn l2iif
stp_idx
<------------------------------Result-------------------->
0x0b00 0x04 0x15
0x0000 0x03 0x000a 0x000000 0x0000
0x0b00 0x04 0x15
0x0000 0x03 0x000b 0x000000 0x0000

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

50

Layer 3 Forwarding NPEZ


MAC Statistics
ADPC2(atlas-re0 vty)# show xeth-pic 1 port 0 stats
Stats for ifd : ge-2/1/0
Description
Rx Stats
Packet
446407
Reject
31
Reject DA
0
Reject SA
0
TX Pad
0
Packet Error
0
Octets
34351612
Packets
446407
Unicasts
399073
Broadcasts
46
Multicasts
47288
CRC/Align Errros
0
Undersize Pkts
0
Oversize Pkts
0
64 Octets Pkts
0
65-127 Octets Pkts
444984
128-255 Octets Pkts
1172
256-511 Octets Pkts
1
512-1023 Octets Pkts
0
1024-1518 Octets Pkts
187

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

Tx Stats
480497
0
0
0
0
0
36662411
480497
437037
86
43374
0
0
0
0
0
0
0
0
0

www.juniper.net

51

Layer 3 Forwarding NPEZ


(cont...)
1024-1518 Octets Pkts
MAC Control Frames
Unsupported Opcode
Pause Frames
OK Frames
OK Octets
In Range Length Errors
Out of Range Length Field
Code Violations
VLAN Tagged Frames
Ether Fragments
Jabber
Fifo Underrun
Packets
Bytes
Multicast Packets
Packet Rate
Byte Rate
Error
Replicated multicast pkts
Replicated multicast bytes
Replicated multicast pkts rate
Replicated multicast bytes rate
ADPC2(atlas-re0 vty)#
Copyright 2007 Juniper Networks, Inc.

187
0
0
0
446407
34351612
0
0
0
0
0
0
0
446407
34351612
47288
19
1495
0
46084
4428391
1
87
Proprietary and Confidential

0
0
0
0
0
0
0
0
0
0
0
0
0
480497
36662411
43374
24
2095
0
0
0
0
0
www.juniper.net

52

Layer 3 Forwarding Iwi


Packet with the NPEZ
RX cookie would be
sent to the Iwi block
8 x l23 ucode engine
for Wan and 8 x l23
ucode engine for
Fabric
Iwi (Wan Input)
This block receives the
frames from the Wan
interface (NPEZ) and the
cells from the Ifi, phrase them
correctly, perform the
cellification and pass the cells
to the Ipktwr block.
Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

53

Layer 3 Forwarding Iwi


In Atlas, one single WAN Ichip stream would be used to
handle all ingress traffic.
On the egress direction, each IFD (or GE port) would
have its own WAN stream for QoS purpose.

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

54

Layer 3 Forwarding Iwi


ADPC2(atlas-re0 vty)# show ichip 1 ifd
ICHIP 1:
Initialized, Version 3,
STREAM 32 (wan stream 0) has 11 IFDs.
IFD 154: ge-2/2/0
IFD 155: ge-2/2/1
IFD 156: ge-2/2/2
IFD 157: ge-2/2/3
IFD 158: ge-2/2/4
IFD 159: ge-2/2/5
IFD 160: ge-2/2/6
IFD 161: ge-2/2/7
IFD 162: ge-2/2/8
IFD 163: ge-2/2/9
IFD 164: lc-2/2/0
.....

Ingress

(cont.....)
STREAM 33 (wan stream

1) has 2 IFDs.

IFD 154: ge-2/2/0


IFD 164: lc-2/2/0
STREAM 34 (wan stream

2) has 1 IFDs.

IFD 155: ge-2/2/1


STREAM 35 (wan stream

3) has 1 IFDs.

IFD 156: ge-2/2/2


STREAM 36 (wan stream

4) has 1 IFDs.

IFD 157: ge-2/2/3


STREAM 37 (wan stream
IFD 158: ge-2/2/4
STREAM 38 (wan stream

5) has 1 IFDs.

Egress
6) has 1 IFDs.

IFD 159: ge-2/2/5


ADPC0(calypso-re0 vty)# show ichip 0 ifd
ICHIP 0:
Initialized, Version 3,
STREAM 32 (wan stream 0) has 2 IFDs.
IFD 129: xe-0/0/0
IFD 130: lc-0/0/0
ADPC0(calypso-re0 vty)#
Copyright 2007 Juniper Networks, Inc.

STREAM 39 (wan stream

7) has 1 IFDs.

IFD 160: ge-2/2/6


STREAM 40 (wan stream

8) has 1 IFDs.

IFD 161: ge-2/2/7


STREAM 41 (wan stream

9) has 1 IFDs.

IFD 162: ge-2/2/8


STREAM 42 (wan stream 10) has 1 IFDs.
IFD 163: ge-2/2/9

Proprietary and Confidential

www.juniper.net

55

Layer 3 Forwarding Iwi


Key Extraction
FTTL Check and initialization
Cellification

Iwi does not add overhead to the


cell data.The notification and the
cell data are sent out on
separate ports to packet writer

Adding 2 bytes CRC

if the LC size is <= 62 bytes

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

56

Layer 3 Forwarding Iwi


Per stream statistics (WAN)
ADPC2(atlas-re0 vty)# show ichip 1 wi winq statistics 0
Counter Name
Total
Rate
Peak Rate
---------------------- ---------------- -------------- -------------WINQ Counter
582219
25
45
(BYTE)
48360659
2088
14283
ADPC2(atlas-re0 vty)# show ichip 1 wi winq errors 0
Counter Name
Total
---------------------- ---------------Drop
0
Drop Error
0
Abort
0
Abort Error
0

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

57

Layer 3 Forwarding Iwi


Per stream statistics (WAN)
ADPC2(atlas-re0 vty)# show ichip 1 wi seg errors wan_stream 0
Counter Name
Total
---------------------- ---------------Timeout
0
Packet Header
0
Ucode Discard
0
TTL
20079
Checksum
0
Packet Len
0
Giant
0
ADPC2(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

58

Layer 3 Forwarding Ipktwr


Packet Writer block
Write cells received
from Iwi into the data
packet memory via Im
block

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

59

Layer 3 Forwarding Ipktwr


Construct a notification cell to Iiif block
Receive data from Iwi and Ip blocks (Host packet)
Spray the cells across the 12 memory bank via Im
block (768MB data memory buffer)
Create the indirect cell if needed (>= 6 cells)

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

60

Layer 3 Forwarding Ipktwr


ADPC2(atlas-re0 vty)# show ichip 1 ipktwr statistics
Pktwr counters:
Counter Name
Total
Rate
Peak Rate
---------------------- ---------------- -------------- -------------pkt_drop
0
0
0
General Counters
----------------Counter Name
Total
---------------------- ---------------off_ovf
0
ntfq_drop
0
ntfb_drop
0
icellq_drop
0
icellb_drop
0
dcellq_drop
0
dcellb_drop
0
.....

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

61

Layer 3 Forwarding Ipktwr


ADPC2(atlas-re0 vty)# show ichip 1 ipktwr statistics bank
Bank Counter
-----------Counter Name
Total
Rate
Peak Rate
---------------------- ---------------- -------------- -------------bank[00] dc_wr_req
207556
7
42
bank[00] ic_wr_req
43
0
1
......
bank[10] dc_wr_req
207557
7
42
bank[10] ic_wr_req
41
0
1
bank[11] dc_wr_req
207558
7
41
bank[11] ic_wr_req
40
0
1
bank[12] dc_wr_req
0
0
0
bank[12] ic_wr_req
0
0
0
bank[13] dc_wr_req
0
0
0
bank[13] ic_wr_req
0
0
0
bank[14] dc_wr_req
0
0
0
bank[14] ic_wr_req
0
0
0
bank[15] dc_wr_req
0
0
0
bank[15] ic_wr_req
0
0
0
ADPC2(atlas-re0 vty)#
Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

62

Layer 3 Forwarding Im
Mange the packet and
notification memory
4 DIMMs (16 banks) of
memory
12 banks are used for
data storage
4 banks are used for
notification cell storage
(DRAMQ)

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

63

Layer 3 Forwarding Im
ADPC2(atlas-re0 vty)# show ichip 1 m dimm_presence
dimm0 size 256 MBytes
dimm1 size 256 MBytes
dimm2 size 256 MBytes
dimm3 size 256 MBytes
sdram device size 512 Mbit
sdram device type DDR-II
ADPC2(atlas-re0 vty)# show ichip 1 m errors dimm
<number>
select dimm number
ADPC2(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

64

Layer 3 Forwarding Im
ADPC2(atlas-re0 vty)# show ichip 1 m errors dimm 0
Error interrupts : dimm 0
hbit_err_e
0
hbit_err_o
0
ecc_err
0
unknown
0
ECC error status bits detected by polling: dimm 0
uncorrectabl err bit set 0 times
correctable err bit set 0 times
Memory errors: dimm 0
ECC uncorr. error count
ECC corr. error count
ECC currnet error status:
ECC syndrome
ECC err address
ECC err data_63_32
ECC err data_31_0
Heart beat:
err hbit_cnt_sel
err hbit_cnt_val
Copyright 2007 Juniper Networks, Inc.

0
0
none
0x00000000
0x00000000 (bank 0 cell 0)
0x00000000
0x00000000
0x00000000
0
Proprietary and Confidential

www.juniper.net

65

Layer 3 Forwarding Iiif


iif indexes are stored in
a Compressed JTREE
format.
The lookup table is
stored in the RLDRAM
via Isr block
iif index lookup would
be performed like route
lookup
No more channel
lookup limitation we
have on Martini and
Gimlet chipsets.

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

66

Layer 3 Forwarding Iiif


Incoming notif from Ipktwr
is divided into 3 parts
IIF key data is used for IIF
lookup
Keepalive Q is for the Host
injected packets with KA
flag
No_IIF Q is for the packets
from the Ifi or no IIF lookup
is required
Result is combined with the
original Notif hdr data and
Route lookup key data
Perform fixed classification

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

67

Layer 3 Forwarding Iiif


Per-stream configuration
ADPC2(atlas-re0 vty)# show ichip 1 iif wan_stream 0
Stream 32
====================
stream type: wan
initialized: yes
sst register
:0xa000006c 0x00000000 0x00080080
(in-core shadow:0xa000006c 0x00000000 0x00080080)
enable: yes tt: 0 aen: 1 srw: 0 l30w_sel: 0 l30w_en: 0 l30w: 0
default_iif: 108 (0x6c)
qs: 0 qs_sel: 0 dp: 0 dp_sel: 0 smp: 0 smp_sel: 0 pm: 0 pm_sel: 0
st_inst_ptr: 0x000100 (byte-offset 0x00000100)
bits: 0 op: branch bit_offset: 0
iif overwrite disable (0x00000000): no
.....
ADPC2(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

68

Layer 3 Forwarding Iiif


Per ifl accounting
IFD
154

ge-2/2/0

Ethernet

0x0000000000008000

2 Up

IFL
145
146
156

ge-2/2/0.100
ge-2/2/0.101
ge-2/2/0.32767

VLAN Tagged
VLAN Tagged
VLAN Tagged

Ethernet
Ethernet
Ethernet

0x000000000000c000
0x000000000000c000
0x000000000000c000

ADPC2(atlas-re0 vty)# show iif ifd 154


ge-2/2/0, stream 0, chip 1, lookup idx 2
Stream default 0xa000006c, srw 0x00000000, iif 108
Lookup tree:
idx chan_type key_len level tree_type stream refcnt
----- ------------- ------------2
8
3
1
1
0
0
Chan1 Chan2
iif
Pkt_cnt
pkt_rate
byte_cnt
continue
------ ------ ----- ------------- -------- ------------- -------0x0
n/a
156
0
0
0 0x40db17d0
0xa
n/a
145
14420
1
1145617
0xb
n/a
146
203052
23
15153259

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

69

Layer 3 Forwarding Iiif


Fixed classification
ge-2/2/0 {
unit 101 {
forwarding-class assured-forwarding;
}
}
ADPC2(atlas-re0 vty)# show iif ifd 154 stat
ge-2/2/0, stream 0, chip 1, lookup idx 2
Stream default 0xa000006c, srw 0x00000000, iif 108
Lookup tree:
idx chan_type key_len level tree_type stream
----- ------------- --------2
8
3
1
1
0
Chan1 Chan2
iif
enable
QN
cnt_addr
------ ------ ----- ------ ---- ----------0x0
n/a
156
yes
dis 0x4af218e0
0xa
n/a
145
yes
dis 0x4af218b8
0xb
n/a
146
yes
2
0x4af21908
total channel entries entries 3

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

refcnt
----0

www.juniper.net

70

Layer 3 Forwarding Iiif


iif lookup
Using the Layer 2 Service Number (l2sn) within the EZchip RX
cookie bytes as a key.
145
146

ge-2/2/0.100
ge-2/2/0.101

VLAN Tagged
VLAN Tagged

Ethernet
Ethernet

0x000000000000c000
0x000000000000c000

ADPC2(atlas-re0 vty)# show npez 1 vc-dt port 0


total number of entries: 3
port
vlan
<-----Key---->
0
0x0064
0
0x0065
0
0x1001

ctrl
cond
fc
bd
l2st l2sn l2iif
stp_idx
<------------------------------Result-------------------->
0x0b00 0x04 0x15
0x0000 0x03 0x000a 0x000000 0x0000
0x0b00 0x04 0x15
0x0000 0x03 0x000b 0x000000 0x0000
0x0b00 0x00 0x00
0x0000 0x00 0x0000 0x000000 0x0000

ADPC2(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

71

Layer 3 Forwarding Iiif


iif lookup
ADPC2(atlas-re0 vty)# show ichip 1 iif sram_decoded wan_stream 0
start decoding with search start instruction
=============================================
>> search start instruction :00080080 key_pointer:0 bits
br_base:word offset 0x200, 256-way br, bit offset:0
depth 1 branch idx 0, word_offset 0x000200:0003f994
key_pointer:0 bits
br_base:word offset 0xfe, 2-way br, bit offset:20
depth 2 branch idx 0, word_offset 0x0000fe:000de718
key_pointer:0 bits
act_base:word offset 0x378) r/c/p:111 bit offset:24
prefix length 24 bits
1 prefix words 0x00000000
key pointer move: 3 bytes
continuation instruction: 0x00040080
frw: b000009c ena:1 tt:0 aen:1 iif:156
srw: 00000000
instruction : 0x00040080 key_pointer:24 bits
br_base:word offset 0x100, 256-way br, bit offset:0
stop decoding at lookup depth 3
.....
Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

72

Layer 3 Forwarding Iiif


(cont...)
depth 2 branch idx 1, word_offset 0x0000ff:00021197
key_pointer:0 bits
br_base:word offset 0x84, 2-way br, bit offset:23
depth 3 branch idx 0, word_offset 0x000084:000c0518
key_pointer:0 bits
act_base:word offset 0x300) r/c/p:101 bit offset:24
prefix length 24 bits
1 prefix words 0x00000a00
key pointer move: 3 bytes
frw: b0000091 ena:1 tt:0 aen:1 iif:145
srw: 00000000
repeat until mismatch or no bits in key buffer
depth 3 branch idx 1, word_offset 0x000085:000c2518
key_pointer:0 bits
act_base:word offset 0x308) r/c/p:101 bit offset:24
prefix length 24 bits
1 prefix words 0x00000b00
key pointer move: 3 bytes
frw: b0000092 ena:1 tt:0 aen:1 iif:146
srw: 00000000
repeat until mismatch or no bits in key buffer
Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

73

Layer 3 Forwarding Iiif


Per-stream Lookup Statistics
ADPC2(atlas-re0 vty)# show ichip 1 iif statistics wan_stream 0
Traffic stats:
Counter Name
Total
Rate
Peak Rate
---------------------- ---------------- -------------- -------------wan_strm[00] total
724289
25
45
(BYTE)
54309380
1917
13980
wan_strm[00] default
0
0
0
(BYTE)
0
0
0
Error counters:
Counter Name
Total
Rate
Peak Rate
---------------------- ---------------- -------------- -------------wan_strm[00] uaiif
0
0
0
wan_strm[00] tmo
0
0
0

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

74

Layer 3 Forwarding Iiif


Global Lookup Statistics
ADPC2(atlas-re0 vty)# show ichip 1 iif statistics
Traffic stats:
Counter Name
Total
Rate
Peak Rate
---------------------- ---------------- -------------- -------------GFAB_BCNTR
27223571
960
16375
KA_PCNTR
300547
10
16
KA_BCNTR
29769716
1019
1822
Discard counters:
Counter Name
Total
Rate
Peak Rate
---------------------- ---------------- -------------- -------------WAN_DROP_CNTR
0
0
0
FAB_DROP_CNTR
0
0
0
KA_DROP_CNTR
0
0
0
HOST_DROP_CNTR
0
0
0
ADPC2(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

75

Layer 3 Forwarding Irlkp


13 Key Engines
Perform BA table lookup
and MF classification
Perform route lookup
Jtree are stored on the
RLDRAM via Isr block
Host packet notification
would be sent to Ip block
Transit traffic notification
is queued in Imq block

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

76

Layer 3 Forwarding Irlkp


Segment 0 is for Routes 16MB
Segment 1 is for filters/policers 16MB
Cannot be shared.
ADPC2(atlas-re0 vty)# show jtree 1 memory
Jtree memory segment 0 (Context: 0x453cd18c)

(cont...)

-------------------------------------------

Jtree memory segment 1 (Context: 0x4544ed8c)

Memory Statistics:

-------------------------------------------

16777216 bytes total

Memory Statistics:

1373904 bytes used


15396976 bytes available (15395840 bytes from free pages)
6048 bytes wasted
288 bytes unusable
32768 pages total
2692 pages used (2586 pages used in page alloc)
6 pages partially used
30070 pages free (max contiguous = 30070)
.....

16777216 bytes total


4457064 bytes used
12319112 bytes available (12317696 bytes from free pages)
1008 bytes wasted
32 bytes unusable
32768 pages total
8706 pages used (8706 pages used in page alloc)
4 pages partially used
24058 pages free (max contiguous = 24058)
Context: 0x433c311c
ADPC2(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

77

Layer 3 Forwarding Irlkp


Ir block statistics
ADPC2(atlas-re0 vty)# show ichip 1 r counters
Traffic stats:
Counter Name

Total

Rate

Peak Rate

---------------------- ---------------- -------------- -------------rcp_input_ucast

1404078

45

64

(BYTE)

111884214

3630

15621

rcp_output_ucast

1335194

43

61

(BYTE)

106668714

3503

15202

rcp_input_mcast

92378

54

(BYTE)

8592088

303

15973

rcp_output_mcast

92378

54

(BYTE)

8592088

303

15973

.....

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

78

Layer 3 Forwarding Irlkp


(cont...)
Discarded Packets:
Counter Name

Total

Rate

Peak Rate

---------------------- ---------------- -------------- -------------JTREE_TRUNC_KEY

NEXHOP_TRUNC_KEY

ITABLE_TRUNC_KEY

TIMEOUT

IIF_CHECK

12

SRAM_PAR_ERR

EXEC_STACK_OFLOW

SID_ZERO

85

FW_DROP

POLICER_DROP

INDEX_NBITS

FW_ILLEGAL_INSTR

RCP_INPUT_MCAST_DROP

RCP_UBR_CNTR

.....

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

79

Layer 3 Forwarding Irlkp


(Cont...)
HNP discards:
Counter Name

Total

Rate

Peak Rate

---------------------- ---------------- -------------- -------------Q0_DCS_CNTR

Q1_DCS_CNTR

Q2_DCS_CNTR

Q3_DCS_CNTR

Q4_DCS_CNTR

Q5_DCS_CNTR

Q6_DCS_CNTR

Q7_DCS_CNTR

.....

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

80

Layer 3 Forwarding Irlkp


(Cont...)
HNP ages:
Counter Name

Total

Rate

Peak Rate

---------------------- ---------------- -------------- -------------Q0_AGE_CNTR

Q1_AGE_CNTR

Q2_AGE_CNTR

Q3_AGE_CNTR

Q4_AGE_CNTR

Q5_AGE_CNTR

Q6_AGE_CNTR

Q7_AGE_CNTR

ADPC2(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

81

Layer 3 Forwarding Irlkp


Ir block error statistics
ADPC2(atlas-re0 vty)# show ichip 1 r errors
MLP errors:
0 Parity Errors For Port0
0 Parity Errors For Port1
0 Data Buffer Overflow
0 Data Buffer Underflow
0 Mcast List Request Buffer Overflow
0 Indir Mcast List Request Buffer Overflow
0 Mcast Indirect Errors
ADPC2(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

82

Layer 3 Forwarding Irlkp


Ir block Hash key configuration
ADPC2(atlas-re0 vty)# show ichip 1 r configuration ricp keyhash wan proto
<number>

show r ricp key hash wan configuration proto (0 ..7)

ADPC2(atlas-re0 vty)# show ichip 1 r configuration ricp keyhash wan proto 0


Ir Hash Byte Count: 17
Ir Hash Byte Selection:
Hash Word

Source Byte

Nibble Mask

----------

-----------

-----------

0x88090a10

himask

0x88090a10

nomask

0x88090a10

10

nomask

0x88090a10

16

nomask

0x11121314

17

nomask

ADPC2(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

83

Layer 3 Forwarding Irlkp


Ir block Hash key configuration
* Field Name

Bit Range

Summary

* mask 0

31:30

nibble mask for select 0

* select0

29:24

source byte select 0

* mask 1

23:22

nibble mask for select 1

* select1

21:16

source byte select 1

* mask 2

15:14

nibble mask for select 2

* select2

13:8

source byte select 2

* mask 3

7:6

nibble mask for select 3

* select3

5:0

source byte select 3

typedef enum nibble_mask_def {


NIBBLE_MASK_DEF_NOMASK = 0,
NIBBLE_MASK_DEF_LOMASK = 1, (Mask bit [3:0] of byte to zero)
NIBBLE_MASK_DEF_HIMASK = 2, (Mask bit [7:4] of byte to zero)
NIBBLE_MASK_DEF_ALLMASK = 3 (Mask all bits in byte to zero)
} nibble_mask_def;

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

84

Layer 3 Forwarding Irlkp


Ir block Hash key configuration
Ir Hash Byte Selection:
Hash Word

Source Byte

Nibble Mask

----------

-----------

-----------

0x88090a0d

himask = b'(10)(001000) (00)(001001)

0x88090a0d

nomask

0x88090a0d

10

nomask

(00)(001010) (00)(001101)

|---------------------------------------------------------------|
|

rewrite 0

rewrite 1

rewrite 2

rewrite 3

|[0-31]

|---------------------------------------------------------------|
|

|pol|

|L|

|sample sn[7:0] |res| DP|

QS |3|

L3OW

|1:0|1:0|[2:0]|N|

[5:0]

|E|C|

|T|O|rewr |

|C|E| PT

|E|P| ite |[32-63]

|T| |[2:0]| | | X

|---------------------------------------------------------------|
|

iif[19:0]

| pkt_len[15:8] |

|---------------------------------------------------------------|

8th to 10th bytes

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

85

Layer 3 Forwarding Isr


This Block is a memory
controller for the RLDRAM
4 x 288Mbit RLDRAM part
(128MB in total)
JTREE data structure is
replicated to two RLDRAM
parts for higher performance
Effective memory size is
32MB for Ir, 8MB for Iiif and
24MB for Iwo

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

86

Layer 3 Forwarding Isr


RLDRAM Partition
ADPC2(atlas-re0 vty)# show ichip
sr partition information:
r partition size
0x02000000
r partition base
0x30000000
iif partition size 0x00800000
iif partition base 0x18000000
wo partition size 0x01800000
wo partition base 0x18800000

2 isr partition
12MB
8MB
24MB

WO sram block partition (offset to start of WO sram)


mit/mcast base
0x00000000
l2desc base
0x00800000
ADPC2(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

87

Layer 3 Forwarding Isr


RLDRAM Access Statistics
ADPC2(atlas-re0 vty)# show ichip 2 isr stats
RLDRAM accessing statistics
Counter Name

Total

Rate

Peak Rate

---------------------- ---------------- -------------- -------------R1_PLC_WR

R1_PLC_RD

R1_ACC_WR

1516564

32937

R1_ACC_RD

288358

533

R1_SRM_RD

34947733

4400

R2_PIO_WR

1511661

32937

R2_PIO_RD

R2_SRM_RD

329708

166

MLP_SRM_RD

374083

333

IIFWO1_ACC_WR

286596

433

IIFWO1_ACC_RD

1474386

1085

IIFWO1_SRM_RD

1456130

342

IIFWO2_PIO_WR

6398

397

IIFWO2_PIO_RD

IIFWO2_SRM_RD

16297605

2342

ADPC2(atlas-re0 vty)#
Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

88

Layer 3 Forwarding Isr


RLDRAM Replication

R1 part is used to store the firewall counters / policer counters


JTREE is replicated in both R1 and R2 parts
JTREE lookup can be done in either R1 and R2 parts
Firewall / policer counters would only be updated in R1 part
Similar on IIFWO1 and IIFWO2 parts. (Iiif / nexthop stats,
compressed JTREE for iif lookup and L2_des)

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

89

Layer 3 Forwarding Isr


RLDRAM Error Statistics
ADPC2(atlas-re0 vty)# show ichip 2 isr errors
0 rkp_acc_err
0 r1_par_cnt
0 r1_par_adr
0 r2_par_cnt
0 r2_par_adr
0 iifwo_acc_err
0 iifwo1_par_cnt
0x00000000 iifwo1_par_adr (hashed 0x00000000)
0 iifwo2_par_cnt
0x00000000 iifwo2_par_adr (hashed 0x00000000)

ADPC2(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

90

Layer 3 Forwarding Imq


Queuing the notification for
both Wan and Fabric traffic
Both Head and Tail RED are
available
One cell can store 3
notifications
Maximum 32 Wan streams
Maximum 48 Fabric streams
8 queues per Wan stream
2 queues per Fabric stream
4 Priority, 4 DPs
Per DP counter
128 32-bit RED drop profiles

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

91

Layer 3 Forwarding Imq


8 Priority Levels

4 in positive credit regions (High, Medium-High, Medium-Low, Low)


4 in negative credit regions (High, Medium-High, Medium-Low, Low)

WRR behavior in bonus region I3.0


Mas size follows WRR rate in order to avoid packet aging
issue Does not follow buffer size configuration
DRAMQ size follows BUF allocation in order to control the
latency indirectly
Mad is supported

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

92

Layer 3 Forwarding Imq


Mas and DRAMQ size Assignment
schedulers {
be {
transmit-rate percent 40;
buffer-size percent 25;
}
ef {
transmit-rate percent 30;
buffer-size percent 25;
}
af {
transmit-rate percent 20;
buffer-size percent 25;
}
nc {
transmit-rate percent 10;
buffer-size percent 25;
priority high;
}

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

93

Layer 3 Forwarding Imq


ADPC9(atlas-re0 vty)# show ichip 0 imq config wan queue
Stream 32:

queue
queue
queue
queue
queue
queue
queue
queue

0
1
2
3
4
5
6
7

prv_mode
-------2
2
2
2
2
2
2
2

rate_ctrl
--------false
false
false
false
false
false
false
false

bo_prio
------0
0
0
3
0
0
0
0

dq_prio
------0
0
0
3
0
0
0
0

dis_dq
-----false
false
false
false
false
false
false
false

weight
-------26337
19753
13168
6585
0
0
0
0

clamp
-------105348
79012
52672
26340
0
0
0
0

mas
-------628166
471236
314306
157376
444
444
444
444

tx_rate(%) delay_bw(%)
--------- ----------40
25
30
25
20
25
10
25
0
0
0
0
0
0
0
0

ADPC9(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

94

Layer 3 Forwarding Imq


ADPC9(atlas-re0 vty)# show ichip 0 imq config stream wan_stream 0 mem
stream 32
queue
queue
queue
queue
queue
queue
queue
queue

0
1
2
3
4
5
6
7

HNQ range(size)
------------------0x0600:06bf(0x00c0)
0x06c0:077f(0x00c0)
0x0780:083f(0x00c0)
0x0840:08ff(0x00c0)
0x0900:09bf(0x00c0)
0x09c0:0a7f(0x00c0)
0x0a80:0b3f(0x00c0)
0x0b40:0bff(0x00c0)

RAMQ range(size)
----------------------0x380000:39ff6b(0x01ff6c)
0x39ff6c:3bfed7(0x01ff6c)
0x3bfed8:3dfe43(0x01ff6c)
0x3dfe44:3ffdaf(0x01ff6c)
0x3ffdb0:3ffe43(0x000094)
0x3ffe44:3ffed7(0x000094)
0x3ffed8:3fff6b(0x000094)
0x3fff6c:3fffff(0x000094)

mas
-------628166
471236
314306
157376
444
444
444
444

ADPC9(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

95

Layer 3 Forwarding Imq


Queue Utilization (Mu/Mad)
ADPC9(atlas-re0 vty)# show ichip 0 imq config stream wan_stream 0 mu_mad
Stream 32 mas/mu/mad/hnq_ptr info:
queue

mas

mu

mad

--------

--------

hnq_ptr(0x)

-------

--------

---------------

628166

00064a:00064a

471236

0006c0:0006c0

314306

000780:000780

157376

000864:000864

444

000900:000900

444

0009c0:0009c0

444

000a80:000a80

444

000b40:000b40

ADPC9(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

96

Layer 3 Forwarding Imq


Queue Utilization
ADPC9(atlas-re0 vty)# show ichip 0 imq config stream wan_stream 0 empty

stream 32

TNQ empty

HNQ empty

DRAMQ empty

---------

---------

-----------

queue

true

true

true

queue

true

true

true

queue

true

true

true

queue

true

true

true

queue

true

true

true

queue

true

true

true

queue

true

true

true

queue

true

true

true

ADPC9(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

97

Layer 3 Forwarding Imq


RED Profile
ADPC9(atlas-re0 vty)# show ichip 0 imq config red profile 0
COS profile ID: 65534
RED physical profile id: 0, profile data(in HEX):
0x0000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
0x0010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ff
ADPC9(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

98

Layer 3 Forwarding Imq


Imq Global Statistics
ADPC9(atlas-re0 vty)# show ichip 0 imq stats
Imq global stats:
Counter Name
Total
Rate
Peak Rate
---------------------- ---------------- -------------- -------------OUT_PKT_TOTAL_WAN
1210187
24
37
(BYTE)
65673855
1316
13724
OUT_PKT_TOTAL_FAB
4
0
0
(BYTE)
312
0
21
RDROP_WAN_PKT
0
0
0
RDROP_FAB_PKT
0
0
0

ADPC9(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

99

Layer 3 Forwarding Imq


Per stream statistics
ADPC2(Atlas-RE0 vty)# show ichip 0 imq stats wan_stream 1
Stream 33 IN_OFFLOAD_PKT_BYTE_CNT:
Counter Name
Total
Rate
Peak Rate
---------------------- ---------------- -------------- -------------queue 0
0
0
0
(BYTE)
0
0
0
queue 1
0
0
0
(BYTE)
0
0
0
queue 2
0
0
0
(BYTE)
0
0
0
queue 3
0
0
0
(BYTE)
0
0
0
queue 4
0
0
0
(BYTE)
0
0
0
queue 5
0
0
0
(BYTE)
0
0
0
queue 6
0
0
0
(BYTE)
0
0
0
queue 7
0
0
0
(BYTE)
0
0
0
.....

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

100

Layer 3 Forwarding Imq


Per stream statistics
(Cont...)
stream 33 OUT_PKT_Q:
Counter Name
Total
Rate
Peak Rate
---------------------- ---------------- -------------- -------------queue 0
0
0
0
(BYTE)
0
0
0
queue 1
0
0
0
(BYTE)
0
0
0
queue 2
0
0
0
(BYTE)
0
0
0
queue 3
0
0
0
(BYTE)
0
0
0
queue 4
0
0
0
(BYTE)
0
0
0
queue 5
0
0
0
(BYTE)
0
0
0
queue 6
0
0
0
(BYTE)
0
0
0
queue 7
0
0
0
(BYTE)
0
0
0
ADPC2(Atlas-RE0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

101

Layer 3 Forwarding Imq


Per queue statistics
ADPC2(atlas-re0 vty)# show ichip 2 imq stats wan_stream 0 queue 0
physical queue 0:
Counter Name

Total

Rate

Peak Rate

---------------------- ---------------- -------------- -------------OFFLOAD_PKT_BYTE

(BYTE)

OUT_PKT_Q

(BYTE)

TD_PKT_BYTE non-red

(BYTE)

TD_PKT_BYTE red dp00

(BYTE)

TD_PKT_BYTE red dp01

(BYTE)

TD_PKT_BYTE red dp10

(BYTE)

TD_PKT_BYTE red dp11

(BYTE)

.......

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

102

Layer 3 Forwarding Imq


Per queue counter
(cont.....)
RDROP_PKT_Q DP00

(BYTE)

RDROP_PKT_Q DP01

(BYTE)

RDROP_PKT_Q DP10

(BYTE)

RDROP_PKT_Q DP11

(BYTE)

ECN_MARKED_PKT_Q DP00

ECN_MARKED_PKT_Q DP01

ECN_MARKED_PKT_Q DP10

ECN_MARKED_PKT_Q DP11

Age status: no age


ADPC2(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

103

Layer 3 Forwarding Imq


Priority Mapping

48 PFE destinations x 2 priority levels = 96 queues


ADPC2(atlas-re0 vty)# show ichip 2 imq config fab sid_qs
FAB qs sid/qs mapping table:
input SID output SID
--------- ---------64
64
65
65
66
66
67
67
.............
107
107
108
108
109
109
110
110
111
111

priority mapping (q0..q7)


------------------------lo lo lo lo lo lo lo lo
lo lo lo lo lo lo lo lo
lo lo lo lo lo lo lo lo
lo lo lo lo lo lo lo lo
lo
lo
lo
lo
lo

lo
lo
lo
lo
lo

lo
lo
lo
lo
lo

lo
lo
lo
lo
lo

lo
lo
lo
lo
lo

lo
lo
lo
lo
lo

lo
lo
lo
lo
lo

lo
lo
lo
lo
lo

fab stream(lo/hi)
----------------0/1
2/3
4/5
6/7
86/87
88/89
90/91
92/93
94/95

ADPC2(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

104

Layer 3 Forwarding Ipktrd


Packet Reader block
Retrieve data back from the
Im block according to the
notification received from the
Imq / Ip block
Data goes to either Iwo (Wan)
or Ifo (Fabric)
Send cell buffer reservation
request to Ifo for fabric data
Back pressure to Imq if the
stream is congested

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

105

Layer 3 Forwarding Ipktrd


Per data bank statistics
ADPC2(atlas-re0 vty)# show ichip 2 ipktrd statistics bank
<carriage return>

Completes command

<number>

bank number (0 to 11)

ADPC2(atlas-re0 vty)# show ichip 2 ipktrd statistics bank 0


Bank Statistics
Counter Name

Total

Rate

Peak Rate

---------------------- ---------------- -------------- -------------wan_bank[00] icrd

11

hnf_bank[00] icrd

20

wan_bank[00] dcrd

122612

31

hnf_bank[00] dcrd

124782

37

ADPC2(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

106

Layer 3 Forwarding Ipktrd


Per stream error statistics
ADPC2(atlas-re0 vty)# show ichip 2 ipktrd errors
all

show all stream error counters

fab_stream

show fab stream error counters

hst_stream

show host stream error counters

wan_stream

show wan stream error counters

ADPC2(atlas-re0 vty)# show ichip 2 ipktrd errors wan_stream


<number>

wan stream 0..31

ADPC2(atlas-re0 vty)# show ichip 2 ipktrd errors fab_stream


<number>

Copyright 2007 Juniper Networks, Inc.

fab stream 0..31 or 95

Proprietary and Confidential

www.juniper.net

107

Layer 3 Forwarding Ipktrd


Per stream error statistics
ADPC2(atlas-re0 vty)# show ichip 2 ipktrd errors wan_stream 0
Cell-error Counters:
Counter Name

Total

Rate

Peak Rate

---------------------- ---------------- -------------- -------------wan_strm[00] ecc

wan_strm[00] err

wan_strm[00] nt_age

wan_strm[00] ic_age

wan_strm[00] dc_age

General error Counters:


Counter Name

Total

---------------------- ---------------wan_strm[00] byc_oe

wan_strm[00] byc_ue

wan_strm[00] prq_oe

wan_strm[00] crq_oe

wan_strm[00] icb_oe

ADPC2(atlas-re0 vty)#
Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

108

Layer 3 Forwarding Ipktrd


Per stream status
ADPC2(atlas-re0 vty)# show ichip 2 ipktrd qstatus
WAN Queue Status
WAN_PRQ_MPTY -

0xffffffff

WAN_ICB_MPTY -

0xffffffff

WAN_PRD_DONE -

0xffffffff

FABRIC Queue Status


FAB_PRQ_MPTY[0] -

0xffffffff

FAB_PRQ_MPTY[1] -

0xffffffff

FAB_PRQ_MPTY[2] -

0xffffffff

FAB_ICB_MPTY[0] -

0xffffffff

FAB_ICB_MPTY[1] -

0xffffffff

FAB_ICB_MPTY[2] -

0xffffffff

FAB_PRD_DONE[0] -

0xffffffff

FAB_PRD_DONE[1] -

0xffffffff

FAB_PRD_DONE[2] -

0xffffffff

ADPC2(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

109

Layer 3 Forwarding Iwo


Receive notification from
Ipktrd and data cells from Im
L23 ucode engine performs
IPv4 fragmentation and
redirect check
Byte and packet counts per
descriptor
Build L2/L3 header
Packet CRC check

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

110

Layer 3 Forwarding Iwo


16MB RLDRAM allocated for L2_desc
ADPC2(atlas-re0 vty)# show ichip 2 wo configuration desrd
mit/mt desc base : 0x00800000
l2/tag desc base : 0x01000000
l2/tag QW mode
: false

The maximum size of the L2 descriptor data is 16 words


ADPC2(atlas-re0 vty)# show nhdb id 831 extensive
ID
Type
Interface
Next Hop Addr
Protocol
----- -------- ------------- --------------- ---------831
Unicast ge-2/2/0.100
IPv4->MPLS
.....
L2 Program:
Address: 0x00250030
L2 microcode: iwo_l2_common_encap_hdlr
Template size: 1 word
.....
Tag Descriptor (0x00000118):
.....
Tag Labels:
0x1bd901ff: Label 114064, TTL 255
L2 Descriptor (0x00000270):
Raw format: 0x583011a0
Accounting: Disabled
L2 words: 6

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

Encap
-----------Ethernet

MTU
---4512

www.juniper.net

111

Layer 3 Forwarding Iwo


Global Statistics
ADPC2(atlas-re0 vty)# show ichip 2 wo statistics
Iwo Statistics:
Summary

Total

Rate

Peak Rate

---------------------- ---------------- -------------- -------------input packets

1174507

34

70

output packets

615431

17

44

output bytes

58442506

1716

16617

total drops

559076

16

25

ADPC2(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

112

Layer 3 Forwarding Iwo


Similar to Lchip
Notification and first
one/two cells go thru the
DESRD and HDRF blocks
Data goes to the Data
Buffer block

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

113

Layer 3 Forwarding Iwo


Per functional block statistics
ADPC2(atlas-re0 vty)# show ichip 2 wo statistics ip
Iwo Input Processor Statistics:
Summary
Total
Rate
Peak Rate
---------------------- ---------------- -------------- -------------input packets
1174899
34
70
output packets
1174899
34
70
total drops
0
0
0
ADPC2(atlas-re0 vty)# show ichip 2 wo statistics desrd
Iwo Descriptor Reader Statistics:
Summary
Total
Rate
Peak Rate
---------------------- ---------------- -------------- -------------input packets
1174641
37
70
output packets
1174641
37
70
total drops
0
0
0
ADPC2(atlas-re0 vty)# show ichip 2 wo statistics hdrf
Iwo Header Fifo Statistics:
Summary
Total
Rate
Peak Rate
---------------------- ---------------- -------------- -------------output packets
615567
18
44
output bytes
58455523
1746
16617
total drops
559203
17
25
Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

114

Layer 3 Forwarding Iwo


Per Wan stream statistics
ADPC2(atlas-re0 vty)# show ichip 2 wo statistics wan_stream 1
Iwo Statistics:
Summary

Total

Rate

Peak Rate

---------------------- ---------------- -------------- -------------global drops

565214

17

25

input packets

622188

19

43

output packets

56974

17

output bytes

6445344

206

9884

total drops

Stream(1):

ADPC2(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

115

Layer 3 Forwarding Iwo


Per Wan stream statistics
ADPC2(atlas_re0 vty)# show ichip 2 wo statistics ip wan_stream 0
Iwo Input Processor Statistics:
Counter Name
Total
Rate
Peak Rate
---------------------- ---------------- -------------- -------------Stream(0):
input packets
0
0
0
output packets
0
0
0
ssmcst packets
0
0
0
fragmented packets
0
0
0
input drops
0
0
0
output drops
0
0
0
> 2 cell crc drops
0
0
0
<= 2 cell crc drops
0
0
0
ADPC2(atlas_re0 vty)#

if (log_errors && is_crcerr) {


syslog(LOG_ERR, "ICHIP(%u): New crc errors in WO IP stream_id %u, "
"%s\n", ichip->which_ichip, stream_id, __FUNCTION__);

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

116

Layer 3 Forwarding Iwo


SPI interface statistics
ADPC9(atlas_re0 vty)# show ichip 0 spi4 status
I-Chip Spi4 Link Status:
Sink(Rx):
status

: up

pll lock

: locked

training state : trained


dip4 status

: passing

total errors

: 0

Source(Tx):
status

: up

training state : trained


dip2 status

: passing

total errors

: 0

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

117

Layer 3 Forwarding Iwo


SPI interface statistics
ADPC9(atlas_re0 vty)# show ichip 0 spi4 errors
I-Chip Spi4 Polling Period with Errors:
Sink(Rx):
dip4 errors
: 0
loss of sync
: 0
sop min drop
: 0
filter eop drop
: 0
filter dip drop
: 0
filter mtu drop
: 0
filter ovr drop
: 0
unpkr fifo ovr
: 0
unpkr non mod16
: 0
unpkr fifo limit
: 0
bad ctx
: 0
payload ctl
: 0
eop ctl
: 0
filter sop drop
: 0
....

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

118

Layer 3 Forwarding Iwo


SPI interface statistics
(Cont.....)

Source(Tx):
dip2 errors
framing errors
unexpected 11 errors
loss of sync
client fifo ovr
pkr fifo ovr
fifo underun

:
:
:
:
:
:
:

0
0
0
0
0
0
0

ADPC9(atlas_re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

119

Layer 3 Forwarding Iwo


L2 Descriptor can be shared
Reduce the L2 descriptor usage
Per TAG descriptor statistics can be maintained

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

120

Layer 3 Forwarding Iwo


TAG descriptor with statistics enabled
ADPC2(atlas-re0 vty)# show nhdb id 831 extensive
ID
Type
Interface
Next Hop Addr
Protocol
----- -------- ------------- --------------- ---------831
Unicast ge-2/2/0.100
IPv4->MPLS
.....
Tag Descriptor (0x00000118):
Raw format: 0x8cc00138 (No swap, TTL copy)
Accounting: Enabled
Packet count
: 0
HW Byte count
: 0
Adjusted Byte count: 0
Number of tags: 1
L2 des ptr: 0x00400270
Tag Labels:
0x1bd901ff: Label 114064, TTL 255
.....
L2 des ptr: 0x00400270
Tag Labels:
0x1bd901ff: Label 114064, TTL 255
L2 Descriptor (0x00000270):
Raw format: 0x583011a0
Accounting: Disabled
.....
NOTE: This is shared L2 descriptor (ref_count: 4)
Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

Encap
-----------Ethernet

MTU
---4512

www.juniper.net

121

Layer 3 Forwarding Iwo


ADPC2(atlas-re0 vty)# show nhdb id 835 extensive
ID
Type
Interface
Next Hop Addr
Protocol
----- -------- ------------- --------------- ---------835
Unicast ge-2/2/0.100
IPv4->MPLS
.....
Tag Descriptor (0x00000148):
Raw format: 0x8cc00138 (No swap, TTL copy)
Accounting: Enabled
.....
Packet count
: 0
HW Byte count
: 0
Adjusted Byte count: 0
Number of tags: 1
L2 des ptr: 0x00400270
Tag Labels:
0x1bda01ff: Label 114080, TTL 255
L2 Descriptor (0x00000270):
Raw format: 0x583011a0
Accounting: Disabled
.....
NOTE: This is shared L2 descriptor (ref_count: 4)

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

Encap
-----------Ethernet

MTU
---4512

www.juniper.net

122

Layer 3 Forwarding Iwo


ADPC2(atlas-re0 vty)# show topology route ip ifl 91
.....
Topology: ge-2/2/0.100
Flavor: oh-iff (5), Refcount 5, Flags 0x1
Addr: 0x4aea9248, Next: 0x4099ecd8, Context 0x4a7c539c
Link 0: 00000000:00000000, Offset 16, Next: 00000000:00000000
Link 1: 00000000:00000000, Offset 16, Next: 00000000:00000000
Link 2: 00000000:00000000, Offset 16, Next: 00000000:00000000
Link 3: 00000000:00000000, Offset 16, Next: 00000000:00000000
Topology Neighbors:
nh(Unicast,835)-> ge-2/2/0.100-> o-root(IPv4)
nh(Unicast,831)-+
nh(Unicast,799)-+
nh(Unicast,795)-+
nh(Unicast,745)-+
ADPC2(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

123

Layer 3 Forwarding Iwo


ADPC2(atlas-re0 vty)# show l2rw share_l2_des
Chip 0:
Total shared L2 des count:0
Chip 1:
[0] L2 des: chip:1, L2 des addr:0x400270, chunk:4, type:shared,
ref_count:4
Key: L2 des info:0x583011a0, ifl:91, tunnel_id:805306372
L2 des data: 2.640002a.906920.3bf08100.648847.c6.0.0.0.0.0.0.0.
Tag des data: 0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.
NH prefix: a.1.1.2.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.
Linked list (Tag des addr): 0x40016c, 0x400166, 0x400118, 0x400148,
List count: actual:4, traversed items:4

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

124

Layer 3 Forwarding NPEZ


According to the L2_desc, the corresponding service number
would be included on the TX cookie to NPEZ
Egress function can be 802.1p rewrite, vlan-tag rewrite..etc
ADPC9(Atlas_re0 vty)# show nhdb id 542 extensive
ID

Type

Interface

Next Hop Addr

Protocol

Encap

MTU

-----

--------

-------------

---------------

----------

------------

----

542

Unicast

xe-9/2/0.53

216.246.102.102

IPv4

Ethernet

9194

.....
L2 Descriptor (0x000001d4):
Raw format: 0x5a2023ea
Accounting: Enabled
Packet count

: 0

HW Byte count

: 0

Adjusted Byte count: 0


L2 words: 6
Template ID: 32
L2 MTU: 9194
Rewrite word 1: 0x00000005
.....
Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

125

Layer 3 Forwarding NPEZ


ADPC9(Atlas_re0 vty)# show npez 2 servid-tbl serv-id 0x5 port 0
--- Service id table entry --Key Parameters
service id

port num

Result Parameters
dot1p table index

stp index

native inner vlan

native inner tpid

native inner vlan present

native outer vlan present

valid vlan range min

53

valid vlan range max

53

inner vlan range check

outer vlan range check

iif type

policing enable

tm profile id

dmac lookup enable

send to host

stats index

0x7ffe4000

token bucket index

0x00000000

port mac index

First TM scheduler number

Second TM scheduler number

QN bits table

0x00000000

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

126

Layer 3 Forwarding Ifo


Include Stream Flow
Engine(SFE), Fabric Transmit
Logic(FTX) and HST macros
SFE handles most of the Ifo
functions
FTX generates the HSL2 cells
HST manages the HST
interfaces

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

127

Layer 3 Forwarding Ifo

SFE sends the cell buffer reservation grant to Ipktrd, Ipktrd sends
the cell read request to Im
Data cells would come from the Im

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

128

Layer 3 Forwarding Ifo


SFE does the cell reordering
Insert the notification data (12B) back to the first data
cell.
Generate 2 bytes CRC if it doesnt generate an extra cell

Packet CRC check before sending the cells over the


fabric planes. Flag the LC_E if the check is failed.

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

129

Layer 3 Forwarding Ifo


Per fabric stream statistics
ADPC2(atlas-re0 vty)# show ichip 2 f statistics fab_stream 0
Traffic stats:
Counter Name
Total
Rate
Peak Rate
---------------------- ---------------- -------------- -------------fi_burst_cnt_rcv[00]
0
0
0
fi_rord_cnt_shift[00]
0
fi_rord_timeout[00]
0
fi_rord_cnt_apdone[00]
0
fi_rord_cnt_rstall[00]
0
fo_good_pkts[00]
0
0
0
fo_cells_tx[00]
0
0
0
fo_err_pkts[00]
0
ADPC2(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

130

Layer 3 Forwarding Ifi


Ifi (Fabric Input)
Receiving side for the Ifo
This block receives the cells
from the fabric, put them into
correct order and send them
to Iwi for further processing
It also performs packet CRC
check

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

131

Layer 3 Forwarding Ifi


Ifi block will flag the last cell as LC_E for CRC error
packet and indicate that this packet is bad
ADPC2(Atlas.RE1 vty)# show ichip 0 registers fi pkt_chksm
FI_PKT_CHKSM Registers:
(0xc0202010)
fi.pkt_chksm.dis: 0x00000000
ADPC2(Atlas.RE1 vty)#

Packet would be dropped in Ipktwr block


ADPC2(Atlas.RE1 vty)# show ichip 0 ipktwr statistics
Pktwr counters:
Counter Name
Total
Rate
Peak Rate
---------------------- ---------------- -------------- -------------pkt_drop
0
0
0

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

132

Layer 3 Forwarding Ifi


CRC check helps finding the faulty module

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

133

Layer 3 Forwarding Ifi


Per stream statistics (Fabric)
ADPC2(atlas-re0 vty)# show ichip 1 f statistics fab_stream 16
Traffic stats:
Counter Name
Total
Rate
Peak Rate
---------------------- ---------------- -------------- -------------fi_burst_cnt_rcv[16]
40570
1
125
fi_rord_cnt_shift[16]
0
fi_rord_timeout[16]
0
fi_rord_cnt_apdone[16]
0
fi_rord_cnt_rstall[16]
0
fo_good_pkts[16]
0
0
0
fo_cells_tx[16]
0
0
0
fo_err_pkts[16]
0
ADPC2(atlas-re0 vty)# show ichip 1 wi finq statistics 16
Counter Name
Total
Rate
Peak Rate
---------------------- ---------------- -------------- -------------FINQ Counter
19371
0
26
(BYTE)
2014643
82
7920

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

134

Layer 3 Forwarding Ifi


Statistics summary (Fabric)
ADPC2(re0.xr1.ord1 vty)# show ichip 0 f statistics
Discard counters:
Counter Name
Total
Rate
Peak Rate
---------------------- ---------------- -------------- -------------FI_BURST_CNT_FC_DROP
0
0
0
FI_BURST_CNT_NFC_DROP
0
0
0
FI_RORD_CNT_FC_DROP
0
0
0
FI_RORD_CNT_NFC_DROP
0
0
0
ADPC2(re0.xr1.ord1 vty)#

Fabric Drop
cell_stats->fabric_drops
cell_stats->fabric_drops
cell_stats->fabric_drops
cell_stats->fabric_drops

Copyright 2007 Juniper Networks, Inc.

+=
+=
+=
+=

f_stats->fi_cell_fc_drop.total;
f_stats->fi_cell_nfc_drop.total;
f_stats->fi_rord_fc_drop.total;
f_stats->fi_rord_nfc_drop.total;

Proprietary and Confidential

www.juniper.net

135

Layer 3 Forwarding Statistics Collection


Useful commands to collect the info for a specific
wan/fabric stream (From Iwi to Iwo)
# show ichip 0 statistics
# show ichip 0 statistics fab_stream 0
# show ichip 0 statistics wan_stream 0

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

136

Layer 3 Forwarding Statistics Collection


ADPC2(atlas_re0 vty)# show ichip 0 statistics wan_stream 0
Counters for stream 32 of ichip 0
Iwi:
----------Counter Name

Total

Rate

Peak Rate

---------------------- ---------------- -------------- -------------WINQ Counter

(BYTE)

Counter Name

Total

Rate

Peak Rate

Iiif BLOCK:
----------Traffic stats:
---------------------- ---------------- -------------- -------------wan_strm[00] total

(BYTE)

wan_strm[00] default

(BYTE)

Counter Name

Total

Rate

Peak Rate

Error counters:
---------------------- ---------------- -------------- -------------wan_strm[00] uaiif

wan_strm[00] tmo

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

137

Layer 3 Forwarding Statistics Collection


(cont...)
Imq Block:
--------Stream 32 IN_OFFLOAD_PKT_BYTE_CNT:
Counter Name

Total

Rate

Peak Rate

---------------------- ---------------- -------------- -------------queue 0

(BYTE)

queue 1

(BYTE)

queue 2

(BYTE)

queue 3

(BYTE)

queue 4

(BYTE)

queue 5

(BYTE)

......

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

138

Layer 3 Forwarding Statistics Collection


(cont...)
queue 6

(BYTE)

queue 7

(BYTE)

Total

Rate

Peak Rate

stream 32 OUT_PKT_Q:
Counter Name

---------------------- ---------------- -------------- --------------

Copyright 2007 Juniper Networks, Inc.

queue 0

(BYTE)

queue 1

(BYTE)

queue 2

(BYTE)

queue 3

(BYTE)

queue 4

(BYTE)

queue 5

(BYTE)

Proprietary and Confidential

www.juniper.net

139

Layer 3 Forwarding Statistics Collection


(cont...)
queue 6

(BYTE)

queue 7

(BYTE)

Total

Rate

Peak Rate

Ipkt BLOCK:
--------Cell-error Counters:
Counter Name

---------------------- ---------------- -------------- -------------wan_strm[00] ecc

wan_strm[00] err

wan_strm[00] nt_age

wan_strm[00] ic_age

wan_strm[00] dc_age

.....

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

140

Layer 3 Forwarding Statistics Collection


(cont...)
General error Counters:
Counter Name

Total

---------------------- ---------------wan_strm[00] byc_oe

wan_strm[00] byc_ue

wan_strm[00] prq_oe

wan_strm[00] crq_oe

wan_strm[00] icb_oe

Iwo:
----------Iwo Statistics:
Summary

Total

Rate

Peak Rate

---------------------- ---------------- -------------- -------------global drops

input packets

output packets

output bytes

total drops

Stream(0):

ADPC2(atlas_re0 vty)#
Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

141

Agenda

Hardware Overview
NPEZ
Ichip
Layer 3 Forwarding
Layer 2 Forwarding
IRB Interface
Tunnel Interface
Exception Traffic
Reference
Q&A

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

142

Layer 2 Forwarding
MAC learning
L2 Learning daemon on RE
(l2ald)
L2 manager on PFE (l2alm)
lc- control interface to
receive / send the MAC
Learning Packet (MLP)
between NPEZs

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

143

Layer 2 Forwarding
L2ALD
lab@Atlas_re0> show l2-learning debug-statistics ?
Possible completions:
ipc
Show interprocess-communication statistics
mac-events
Show media access control event statistics
mac-messages
Show media access control message statistics
mac-processing
Show MAC address processing statistics
performance-counters Show Layer 2 MAC-learning performance counters
rtsock
Show routing socket message statistics

L2ALM
ADPC9(Atlas_re0 vty)# show l2 manager statistics ?
<carriage return>
Completes command
event-queue
L2 manager event queue statistics
hal
show l2 manager hal related stats statistics
ipc
L2 manager mac processing debug counter
ipc-queue
L2 manager async message queue statistics
mac-events
L2 manager mac event debug counter
mac-msgs
L2 manager mac msg debug counter
mac-processing
L2 manager mac processing debug counter
mem_allocations
L2 manager memory allocation stats
performance
show l2 manager performance counters
pfe
show l2 manager pfe statistics
timer-table
Shows statistics related to timer ack mechanism
Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

144

Layer 2 Forwarding
Workstation A sends a frame to workstation B

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

145

Layer 2 Forwarding
Bridge Domain identification

Bridge domain
Flood token
MAC learning mode
VLAN tag manipulation
...etc

Source MAC lookup


Drop action
Static MAC configuration
...etc

Destination MAC lookup

MAC forwarding token


Mcast / Bcast frame identification
Routed / Bridged packet classification
...etc

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

146

Layer 2 Forwarding
Bridge Domain can be configured in one of
following modes
VLAN none: Normalize the packets so that there is no VLAN. What this will
achieve is that packets going from a CE side to the core-side will go untagged. It
also expects packets to arrive untagged from the core side
VLAN all: Normalize the number of tags in the packets so that the vlan in the
packet (or inner vlan in the case of dual tagged packet) is switched across the
network. [Qualified Learning Mode]
VLAN <vid>: Normalize the packet so that there is a single vlan-id <vid> in the
packet. What this will achieve is that packets going from a CE side to the coreside will go with the specified vlan-id. It also expects packets to arrive with the
vlan-id from the core side
VLAN <dual-tags>: Normalize the packets so the specified vlan-tags are in the
packet. What this will achieve is that packets going from a CE side to the coreside will go with the specified vlan-tags. It also expects packets to arrive with the
vlan-tags from the core side

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

147

Layer 2 Forwarding
Bridging group configuration
[edit]
lab@atlas-re1# show routing-instances
sw {
instance-type virtual-switch;
bridge-domains {
bd1 {
domain-type bridge;
vlan-id 100;
interface ge-2/1/1.100;
interface xe-9/0/0.100;
}
}
}
[edit]
lab@atlas-re1#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

148

What if validation fails on RE?

L2ALM
Validate M1
Send to L2ALD
Wait for ACK.

DPC0 SW

Search Queue
L2ALM HW Independent
M
S IFL5
4
M5 D
X
M
2
M
1

D
S

IFL6
L2ALM - HW
Dependent
IFL1
Time
for MAC
ACKout
received
M1.
Delete
M1 in
from
RE, accept
hardware
local MAC M1

Local
MAC M1
received
from RE

PFE Manager

Internal
Switch

L2ALM
Wait for M1
ACK from DPC1 SW
L2ALD

Remote
MAC M1
received
from RE

L2ALM HW Independent
Search Queue
M
1

Data Packet
SRC MAC: M1
DEST MAC:
M2 RE1 - Slave

I Chip

MLP Packet
M2 known
Learn MAC:
Send packet
M1
to DPC1

I Chip

Data Packet
SRC MAC: M1
DEST MAC:
M2
ACK from DPC2 SW
L2ALD

Remote
MAC M1
received
from RE

L2ALD Daemon

L2ALM HW Independent
Search Queue
M
4
M

Repository

SF Chip

IFL5

D IFL1
1
L2ALM - HW Dependent
Time
out for MAC
ACK received
M1.
M1 in
fromDelete
RE, accept
hardware
remote MAC M1
DPC2 HW

PFE Manager

Send M1 to
L2 Kernel Repository backup RE and
all PFEs

Ext. NPU

MLP Packet
LearnL2ALM
MAC:
M1 Wait for M1

MAC M1
received from
master RE
Ksynd
Daem
on

RE1 - Master
L2ALD
Validate M1
Send to kernel
if accepted

SF Chip

SF Chip

IFL1

L2ALM - HW Dependent
Time
out for MAC
ACK received
M1.
Delete
M1 in
from
RE, accept
hardware
remote MAC M1
DPC1 HW

PFE Manager

DPC0 HW
Ext. NPU

I Chip

Ext. NPU

MLP Packet
Learn MAC:
M1

From Engineerings TOI presentation


Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

149

Layer 2 Forwarding
Layer 2 Forwarding includes VPLS and Bridging
When running Layer 2 forwarding mode, lookup
is done in two parts
NPEZ does the MAC lookup
Ichip does the token lookup

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

150

Layer 2 Forwarding
Bridge domain and l2iif identification
SA MAC Lookup
DA MAC Lookup
Ichip Token Lookup
Egress service table

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

151

Layer 2 Forwarding
Bridge domain and l2iif identification
The result determines:

If learning is enabled on the interface


Whats the flood token if the DMAC is unknown
If this is received from a PE or CE ...etc
ADPC2(atlas-re0 vty)# show ifl brief
Index Name
Type
----- -------------------- ------------74 ge-2/1/1.100
VLAN Tagged
0x000000002000c000
77 ge-2/1/1.101
VLAN Tagged
0x000000002000c000
ADPC2(atlas-re0
total number of
port
vlan
<-----Key---->
1
0x0064
1
0x0065
1
0x1001
ADPC2(atlas-re0
Copyright 2007 Juniper Networks, Inc.

Encapsulation
Flags
-------------- -----Extended VLAN/VPLS
Extended VLAN/VPLS

vty)# show npez 2 vc-dt port 1


entries: 3
ctrl
cond
fc
bd
l2st l2sn l2iif
stp_idx
<------------------------------Result-------------------->
0x3302 0x24 0x30
0x000d 0x03 0x0002 0x00004a 0x003f
0x3302 0x24 0x30
0x000e 0x03 0x0003 0x00004d 0x003f
0x0b00 0x00 0x00
0x0000 0x00 0x0000 0x000000 0x0000
vty)#
Proprietary and Confidential

www.juniper.net

152

Layer 2 Forwarding
Example
ADPC2(atlas-re0 vty)# show npez 2 vc-dt port 1 vlan 0x64
--- VC table entry --Key Parameters
tbl bitmap
1
port vsi label
0
epoch
0
outer vlan
100
inner vlan
0
Result Parameters
iif type
1
learn enable
1
iif counter enable
0
mac counter enable
1
smac lookup enable
0
mac learn limit hit
0
mac learn limit drop
0
.....

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

153

Layer 2 Forwarding
(Cont....)
mac learn limit drop
iif type PE
no local switching
policing enable
learn vlan select
bridging domain
learn vlan
l2 token
learn flood token
data pkt flood token
stp idx
l2 iif
service type
service number
native/vlan map vlan
native/vlan map tpid
native otpid
vlan map ovlan rw rls
vlan map ovlan v
vlan map ovlan p
vlan map ivlan rw rls
vlan map ivlan v
vlan map ivlan p
....
Copyright 2007 Juniper Networks, Inc.

0
0
0
0
1
13
0
52
60
59 ( = 0x3b )
47
64
3
2
33024
0
33024
0
0
0
0
0
0

Proprietary and Confidential

www.juniper.net

154

Layer 2 Forwarding
(Cont....)
tm profile id
qualified learn
num tags present
dme ifl epoch
priority tagged
insert native ovlan
insert native ivlan
filter control
strip hdr
use inner 1p
no dual vlan
no single vlan
stats index
token bucket index
vc extn table present
vc extn table index
skip vlan op
no vlan write op

0
0
1
0
0
0
0
0x20
0
0
0
0
0x00000000
0x00000000
1
0
1
1

ADPC2(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

155

Layer 2 Forwarding
SA MAC Lookup
The result determines
If the source MAC has been learnt before
If this frame should be dropped...etc
ADPC2(atlas-re0 vty)# show npez 2 sa-mac bridge bd 0xd
total number of entries: 2
bd

lvlan

mac

ctrl cond tok-bkt-idx l2iif epoch

stp l2tok

pfe

<--------------Key-------------> <---------------Result------------------------------>
0x000d 0x0000 00:05:85:73:5f:d0

0x8302 0x00 0x034012 0x000000 0x00 0x00 0x0000 0x00

0x000d 0x0000 00:05:85:73:59:75

0x0300 0x00 0x040003 0x00004a 0x01 0x3f 0x0034 0x09

ADPC2(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

156

Layer 2 Forwarding
ADPC2(atlas-re0 vty)# show npez 2 sa-mac bridge bd 0x8 lvlan 0x0 mac 00:05:85:73:5f:c1
--- SA MAC table entry --Key Parameters
bridging domain
0x0008
learn vlan
0x0000
mac address
00:05:85:73:5f:c1
Result Parameters
Control
static
0
sme ifl seq num
0
iif type PE
0
policing enabled
0
filter_en
0
drop
0
router mac
0
Condition
policing enabled
0
State0
clear cntrs
0
pfe number
9
token bucket index
0x40016
l2 token
58
epoch
1
l2_iif
83
stp index
256
tm profile id
0
stats index
0x5402c

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

157

Layer 2 Forwarding
SA MAC entry from the L2ALM
ADPC2(atlas-re1 vty)# show l2 manager mac-table detail
.........
mac counters
maximum
current
local src
remote src unknown dest
5120
1
1
0
0
mac address
00:05:85:73:59:75
learn vlan
0
FwdEntry Addr
0x40af9c24
entry flags
0x14
entry ifl
ge-2/1/1.100
entry hw ifl
ge-2/1/1.100
entry seq number
14
entry epoch
0
hardware information
-------------------install count
1
pfe id 0
install information
-pfe id 1
install information
Spfe id 2
install information
-pfe id 3
install information
-Copyright 2007 Juniper Networks, Inc.

src
src
src
src

Proprietary and Confidential

unknown dest
ge-2/1/1.100
unknown dest
unknown dest

unknown
dest unknown
unknown
unknown
www.juniper.net

158

Layer 2 Forwarding
SA MAC on the local PFE becomes DA MAC on the remote PFE
ADPC9(atlas-re0 vty)# show npez 0 da-mac bridge bd 0xd
total number of entries: 28
bd
lvlan
mac
ctrl cond tok-bkt-idx l2iif epoch stp l2tok pfe
<--------------Key-------------> <---------------Result------------------------------>
0x000d 0x0000 00:05:85:73:59:75 0x0302 0x00 0x040007 0x00004a 0x01 0x30 0x0034 0x09
.....
mac address
00:05:85:73:59:75
learn vlan
0
FwdEntry Addr
0x40af9c24
entry flags
0x14
entry ifl
ge-2/1/1.100
entry hw ifl
ge-2/1/1.100
entry seq number
14
entry epoch
0
hardware information
-------------------install count
1
pfe id 0
install information
-D
pfe id 1
install information
-pfe id 2
install information
-pfe id 3
install information
-Copyright 2007 Juniper Networks, Inc.

src
src
src
src

Proprietary and Confidential

unknown
unknown
unknown
unknown

dest
dest
dest
dest

ge-2/1/1.100
unknown
unknown
unknown
www.juniper.net

159

Layer 2 Forwarding
DA MAC Lookup

The result determines:


Whats the token we should use to forward the frame
Where is this MAC being learnt from
ADPC2(atlas-re0 vty)# show npez 2 da-mac bridge bd 0xd
total number of entries: 28
bd
lvlan
mac
ctrl cond tok-bkt-idx l2iif epoch stp l2tok pfe
<--------------Key-------------> <---------------Result------------------------------>
0x000d 0x0000 00:05:85:73:59:9e 0x0302 0x00 0x040007 0x00004f 0x01 0x30 0x0041 0x24
.....

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

160

Layer 2 Forwarding
ADPC2(atlas-re0 vty)# show npez 2 da-mac bridge bd 0x8 lvlan 0x0 mac 00:05:85:73:5d:cd
--- DA MAC table entry --Key Parameters
bridging domain
0x0008
learn vlan
0x0000
mac address
00:05:85:73:5d:cd
Result Parameters
Control
router_mac
0
mcast mac
0
use dmac fld tkn
0
iif type PE
1
drop
0
mcast token
0
policing enabled
0
static
0
dme ifl seq num
0
send route
0
send bridge
1
Condition
bum bits
0
routable mac
0
my mac
0
policing enabled
0

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

161

Layer 2 Forwarding
(cont....)
State0
clear cntrs
pfe number
token bucket index
l2 token
epoch
l2 oif
stp index
tm profile id
stats index

Copyright 2007 Juniper Networks, Inc.

0
37
0x40014
60
0
129
0
0
0x54028

Proprietary and Confidential

www.juniper.net

162

Layer 2 Forwarding
DA MAC from the L2ALM
ADPC2(atlas-re1 vty)# show l2 manager mac-table detail
.........
mac counters
maximum
current
local src
remote src unknown dest
5120
1
1
1
0
mac address
00:05:85:73:59:9e
learn vlan
0
FwdEntry Addr
0x4a565088
entry flags
0x14
need sync flag
False
In ifl list In bd list
entry ifl
xe-9/0/0.100
entry hw ifl
xe-9/0/0.100
entry seq number
0
entry epoch
3
hardware information
-------------------install count
1
pfe id 2
install information
-pfe id 1
install information
-D
pfe id 2
install information
-pfe id 3
install information
-Copyright 2007 Juniper Networks, Inc.

src
src
src
src

Proprietary and Confidential

unknown
unknown
unknown
unknown

dest
dest
dest
dest

unknown
xe-9/0/0.100
unknown
unknown
www.juniper.net

163

Layer 2 Forwarding
Forwarding Token
NPEZ will pass the frame up to the Ichip with the token found.
ADPC2(atlas-re0 vty)# show route bridge table index 0xd
BRIDGE Route Table 13, __sw+bd1__.13, 0x2:
Destination
NH Type
NH ID Interface
------------- ----------- --------00:05:85:73:59:75:00:00/64
00:05:85:73:59:9e:00:00/64
00:34:00/17
Unicast
477 ge-2/1/1.100
00:34:80/17
Flood
429
00:3b/16
Flood
429
00:41:00/17
Unicast
426 xe-9/0/0.100
00:41:80/17
Flood
429
ADPC2(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

164

Layer 2 Forwarding
Flood Nexthop for boardcast-unknown-mulitcast (BUM)
traffic
ADPC2(atlas-re0 vty)# show bd 0xd
RTT index

: 13

IRB ifl index: 72


# of L2 iffs : 2
Index

Name

------------------------------------74

ge-2/1/1.100

79

xe-9/0/0.100

CE flood token : 0x3b (59) Flood token for the frame from CE intf
VE flood token : 0x37 (55) Flood token for the frame from PE intf (vpls)
VLAN : 0x8100.100 0x8100.4095
MLP flood token: 0x3c (60)
.....

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

165

Layer 2 Forwarding
Forwarding Token

The token would be the Flood token if the DMAC is not found on
the DA-MAC table
ADPC2(atlas-re0 vty)# show nhdb id 429 extensive
ID
Type
Interface
Next Hop Addr
Protocol
----- -------- ------------- --------------- ---------429
Flood BRIDGE

Encap
------------

MTU
---0

Nexthop Status:
Index: 429 (0x1ad), Slot: Unspecified
Destination (0x200): Multicast Chip9
Topo link: 0x00000000:0x1431a702 0x00000000:0x14319f02 0x00000000:0x14317702
0x00000000:0x14303702
Refcount: 3, Interface: 0, Nexthop Flags: 0x0
Flood NH; 2 fwding unicast NHs
Forwarding target NH Ids: 426 477
Original NH Ids: 426 477
00:34:00/17
00:41:00/17
Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

Unicast
Unicast

477
426

ge-2/1/1.100
xe-9/0/0.100
www.juniper.net

166

Layer 2 Forwarding
Egress service table

The L2_desc on the nexthop includes a PFE index,


service table index and a port number
ADPC9(atlas-re0 vty)# show nhdb id 426 extensive
ID
Type
Interface
Next Hop Addr
Protocol
----- -------- ------------- --------------- ---------426
Unicast xe-9/0/0.100
BRIDGE

Encap
MTU
------------ ---Extended VLAN/VPLS

4526

Nexthop Status:
Index: 66 (0x42), Slot: 9
Destination (0x1): Chip0
Topo link: 0x00000000:0x14bea720 0x00000000:0x14be5f20 0x00000000:0x14be4f20
0x00000000:0x14bf8f20
Refcount: 2, Interface: 79, Nexthop Flags: 0x0
Rewrite Status:
L2 Data (8 bytes): 00:00:00:02:06:40:00:08:

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

167

Layer 2 Forwarding
Egress service table
802.1p rewrite / vlan operation happens here
ADPC9(atlas-re0 vty)# show npez 0 servid-tbl port 0
total number of entries: 5
serv port
ctrl cond dot stp-idx tok-bkt-idx vlan vlan
port- sched
-id
-1p
-min -max mac-idx -num
<----Key---> <---------------------------------Result----------------------->
0x0000 0x00 0x0300 0x00 0x00 0x0000 0x00000000 0x0000 0x0000 0x00 0x000
0x0002 0x00 0x0304 0x00 0x00 0x0030 0x00000000 0x6400 0x6400 0x00 0x000
0x0003 0x00 0x0304 0x00 0x00 0x0030 0x00000000 0x6500 0x6500 0x00 0x000
0x1002 0x00 0x0304 0x00 0x00 0x0030 0x00000000 0x6400 0x6400 0x0f 0x000
0x1003 0x00 0x0304 0x00 0x00 0x0030 0x00000000 0x6500 0x6500 0x0f 0x000
ADPC9(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

168

Layer 2 Forwarding
MAC Table
lab@atlas-re1> show bridge mac-table
MAC flags (S -static MAC, D -dynamic MAC,
SE -Statistics enabled, NM -Non configured MAC)
Routing instance : sw
Bridging domain : bd1, VLAN : 100
Learning MAC
MAC
Logical
VLAN
address
flags
interface
00:05:85:73:59:75
D, SE
ge-2/1/1.100
00:05:85:73:59:9e
D, SE
xe-9/0/0.100

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

169

Layer 2 Forwarding
Interface MAC count
lab@atlas-re1> show l2-learning interface extensive
Information for interface family:
Name: ge-2/1/1.100
Index: 74
Generation: 147
Sequence number: 0
MAC sequence number: 1
Interface index: 129
Routing instance: 13
Logical interface: 74
Address family: 45
MAC limit: 1024
MACs learned: 1
Flags: UP, Entry in IFD, Entry in BD
Name: xe-9/0/0.100
Index: 79
Generation: 148
Sequence number: 0
MAC sequence number: 1
Interface index: 129
Routing instance: 13
Logical interface: 79
Address family: 45
MAC limit: 1024
MACs learned: 1
Flags: UP, Entry in IFD, Entry in BD

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

170

Layer 2 Forwarding
MAC statistics
lab@atlas-re1> show bridge mac-table extensive
MAC address: 00:14:f6:11:c5:7a
Logical router: Default
Bridging domain: bd1
Learning interface: ge-2/0/0.100
Layer 2 flags: accounting
Epoch: 1
Learning mask: 0x2
MAC address used as destination:
Packet count:
21230
MAC address used as source:
Packet count:
20628
....

Copyright 2007 Juniper Networks, Inc.

Routing instance: switch1


Learning VLAN: 0
Sequence number: 7
IPC generation: 0
193

Byte count:

195

Byte count:

Proprietary and Confidential

www.juniper.net

171

Layer 2 Forwarding
Interface L2 forwarding statistics
lab@atlas-re1> show bridge statistics instance sw bridge-domain bd1
Information for routing instance:
Routing Instance Name: sw
Bridging domain name: bd1
Logical router name: Default
Index: 13
Sequence number: 0
MAC limit: 5120
MACs learned: 2
Flags: Bridge instance, VLAN : 100, Statistics enabled
Local interface: ge-2/1/1.100, Index: 74
Broadcast packets:
0
Broadcast bytes :
0
Multicast bytes :
0
Multicast packets:
0
Flooded packets :
1
Flooded bytes
:
103
Unicast packets :
4149
Unicast bytes
:
426213
Current MAC count:
1 (Limit 1024)
.....
Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

172

Agenda

Hardware Overview
NPEZ
Ichip
Layer 3 Forwarding
Layer 2 Forwarding
IRB Interface
Tunnel Interface
Exception Traffic
Reference
Q&A

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

173

IRB Interface
Integrated Routing and Bridging Interface (IRB)
Present the whole bridging domain as one L3 logical interface
merge the layer 2 bridging domain and layer 3 routing domain
[edit]
lab@atlas-re0# show routing-instances vpls1
instance-type vpls;
vlan-id 100;
interface ae0.100;
routing-interface irb.0;
route-distinguisher 1.1.1.1:100;
vrf-target target:100:1;
protocols {
vpls {
site Atlas {
site-identifier 1;
interface ae0.100;
}
}
}

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

174

IRB Interface
lab@atlas-re0> show interfaces irb
Physical interface: irb, Enabled, Physical link is Up
Interface index: 128, SNMP ifIndex: 69
Type: Ethernet, Link-level type: Ethernet, MTU: 1514
Device flags
: Present Running
Interface flags: SNMP-Traps
Link type
: Full-Duplex
Link flags
: None
Current address: 00:05:85:73:5f:f0, Hardware address: 00:05:85:73:5f:f0
root@atlas-re0% sysctl -w debug.irb.dump=73
-> irb.2 L2 RTB_index 14
Linked to VPLS RTB __sw+bd2__
VPLS RTB linked backed to ifl index 73
MTU 4500
1. 00:05:85:73:5f:f0/48 ifstate=0 flags=20<I802FF_DEVICE>
2. 01:00:5e:00:00:01/48 ifstate=0 flags=2<I802FF_MCAST>
3. 01:00:5e:00:00:05/48 ifstate=0 flags=2<I802FF_MCAST>
4. 01:00:5e:00:00:06/48 ifstate=0 flags=2<I802FF_MCAST>
5. 01:80:c2:00:00:14/48 ifstate=0 flags=2<I802FF_MCAST>
6. 01:80:c2:00:00:15/48 ifstate=0 flags=2<I802FF_MCAST>
7. 09:00:2b:00:00:04/48 ifstate=0 flags=2<I802FF_MCAST>
8. 09:00:2b:00:00:05/48 ifstate=0 flags=2<I802FF_MCAST>
9. ff:ff:ff:ff:ff:ff/48 ifstate=0 flags=1<I802FF_BCAST>

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

175

IRB Interface
Frames would be replicated depending on the DA-MAC
table entry.
On the control field, if the send_route bit is set, it
makes a copy of the frame and send it to the Ichip as L3
packet
ADPC9(atlas-re0 vty)# show npez 1 da-mac bridge bd 0x4
total number of entries: 12
bd
lvlan
mac
ctrl cond tok-bkt-idx l2iif epoch stp l2tok pfe
<--------------Key-------------> <---------------Result------------------------------>
0x0004 0x0000 00:05:85:73:5f:f0 0x0311 0x06 0x040000 0x000000 0x00 0x00 0x0035 0x00
0x0004 0x0000 ff:ff:ff:ff:ff:ff 0x4713 0x06 0x04000a 0x000000 0x00 0x00 0x0035 0x00
0x0004 0x0000 01:80:c2:00:00:14 0x4713 0x06 0x040006 0x000000 0x00 0x00 0x0035 0x00
0x0004 0x0000 01:80:c2:00:00:15 0x4713 0x06 0x040007 0x000000 0x00 0x00 0x0035 0x00
0x0004 0x0000 01:00:5e:00:00:16 0x4713 0x06 0x040017 0x000000 0x00 0x00 0x0035 0x00
0x0004 0x0000 01:00:5e:00:00:00 0x4713 0x06 0x040002 0x000000 0x00 0x00 0x0035 0x00
0x0004 0x0000 01:00:5e:00:00:02 0x4713 0x06 0x040016 0x000000 0x00 0x00 0x0035 0x00
0x0004 0x0000 01:00:5e:00:00:06 0x4713 0x06 0x040005 0x000000 0x00 0x00 0x0035 0x00
.......

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

176

IRB Interface
ADPC9(atlas-re0 vty)# show npez 1 da-mac bridge bd 4 lvlan 0x0 mac 00:05:85:73:5f:f0
--- DA MAC table entry --Key Parameters
bridging domain
learn vlan
mac address
Result Parameters
Control
router_mac
mcast mac
use dmac fld tkn
iif type PE
drop
mcast token
policing enabled
static
dme ifl seq num
send route
send bridge
......

Copyright 2007 Juniper Networks, Inc.

0x0004
0x0000
00:05:85:73:5f:f0

0
0
0
0
0
0
0
1
0
1
0

Proprietary and Confidential

www.juniper.net

177

IRB Interface
A new serv-id would be created for the IRB
interface.
ADPC2(atlas-re0 vty)# show npez 2 servid-tbl port 0
total number of entries: 5
serv port
ctrl cond dot stp-idx tok-bkt-idx vlan vlan
port- sched
-id
-1p
-min -max mac-idx -num
<----Key---> <---------------------------------Result----------------------->
0x0000 0x00 0x0300 0x00 0x00 0x0000 0x00000000 0x0000 0x0000 0x00 0x000
0x0002 0x00 0x0302 0x00 0x00 0x0000 0x00000000 0x6400 0x6400 0x00 0x000
0x0003 0x00 0x0302 0x00 0x00 0x0000 0x00000000 0x6500 0x6500 0x00 0x000
0x1002 0x00 0x0302 0x00 0x00 0x0000 0x00000000 0x6400 0x6400 0x0f 0x000
0x1003 0x00 0x0302 0x00 0x00 0x0000 0x00000000 0x6500 0x6500 0x0f 0x000
ADPC2(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

178

IRB Interface
The packet would go thought the routing lookup just
like normal packet
ADPC2(atlas-re0 vty)# show ichip 2 iif sram_decoded wan_stream 0
.....
depth 2 branch idx 1, word_offset 0x000083:0003e997
key_pointer:0 bits
br_base:word offset 0xfa, 2-way br, bit offset:23
depth 3 branch idx 0, word_offset 0x0000fa:000da518
key_pointer:0 bits
act_base:word offset 0x368) r/c/p:101 bit offset:24
prefix length 24 bits
1 prefix words 0x00100200
key pointer move: 3 bytes
frw: b0000048 ena:1 tt:0 aen:1 iif:72
srw: 00000000
repeat until mismatch or no bits in key buffer
depth 3 branch idx 1, word_offset 0x0000fb:000d8518
key_pointer:0 bits
act_base:word offset 0x360) r/c/p:101 bit offset:24
prefix length 24 bits
1 prefix words 0x00100300
key pointer move: 3 bytes
frw: b0000049 ena:1 tt:0 aen:1 iif:73
srw: 00000000
repeat until mismatch or no bits in key buffer
Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

179

IRB Interface
The L3iif would be the irb interface
ADPC2(atlas-re0 vty)# show ifl brief
Index Name
Type
Encapsulation
Flags
----- -------------------- ------------- -------------- -----72 irb.1
Ethernet
Ethernet
0x000000000000c000
73 irb.2
Ethernet
Ethernet
0x000000000000c000
lab@atlas-re0> show ospf neighbor
Address
Interface
1.1.1.1
irb.1
1.1.1.2
irb.1
2.1.1.1
irb.2
2.1.1.2
irb.2

State
Full
Full
Full
Full

ID
1.1.1.1
1.1.1.2
1.1.1.1
1.1.1.2

Pri
128
128
128
128

Dead
32
37
33
31

lab@atlas-re0>

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

180

IRB Interface
If the ingress frame is a routable multicast frame,
NPEZ would make a copy for L3 routing and keep
the original one for L2 multicast within the bridge
domain
The same happens if the frame is L2 a broadcast
frame

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

181

IRB Interface
Send Route makes a copy to the irb intf for routing lookup
Send Bridge makes a copy to the l2iif for bridging lookup
ADPC9(atlas-re0 vty)# ...ac bridge bd 0x4 lvlan 0x0 mac 01:00:5e:00:00:01
--- DA MAC table entry --Key Parameters
bridging domain
learn vlan
mac address
Result Parameters
Control
router_mac
mcast mac
use dmac fld tkn
iif type PE
drop
mcast token
policing enabled
static
dme ifl seq num
send route
send bridge
.....

Copyright 2007 Juniper Networks, Inc.

0x0004
0x0000
01:00:5e:00:00:01

0
1
0
0
0
1
0
1
0
1
1

Proprietary and Confidential

www.juniper.net

182

Agenda

Hardware Overview
NPEZ
Ichip
Layer 3 Forwarding
Layer 2 Forwarding
IRB Interface
Tunnel Interface
Exception Traffic
Reference
Q&A

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

183

Tunnel Interface
No Tunnel PIC for Atlas platform
Tunneling interface might be required (vt- / gr- / ip- /
mt- / lt- / pe- / pd- ...etc)
Convert / create a tunnel interface on the PFE but
looping the packet back from the NPEZ
Two types of tunnel interface - 1Gbps or 10Gbps

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

184

Tunnel Interface
Two types of tunneling interface can be created
(1Gbps vs 10Gbps)
On 40-GE DPC

Considered as port 10 on the PFE.


All 10 ports GE + 1 tunnel interface share the bandwidth
between NPEZ and Ichip
Maximum bandwidth is 1Gbps

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

185

Tunnel Interface
1Gbps Tunnel Interface
[edit]
lab@atlas-re0# show chassis
fpc 2 {
pic 3 {
tunnel-services {
bandwidth 1g;
}
}
}
lab@atlas-re0> show interfaces terse | match 2/3/10
gr-2/3/10
up
up
ip-2/3/10
up
up
lt-2/3/10
up
up
mt-2/3/10
up
up
pd-2/3/10
up
up
pe-2/3/10
up
up
vt-2/3/10
up
up

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

186

Tunnel Interface
On 4-XGE DPC

The XGE port would be changed to tunnel interface


It occupies whole 10Gbps bandwidth between NPEZ and
Ichip
No more XGE port can be used on that PFE

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

187

Tunnel Interface
10Gbps Tunnel Interface
[edit]
lab@atlas-re0# show chassis
fpc 9 {
pic 1 {
tunnel-services {
bandwidth 10g;
}
}
}
lab@atlas-re0> show interfaces terse | match 9/1/0
gr-9/1/0
up
up
ip-9/1/0
up
up
lc-9/1/0
up
up
lc-9/1/0.32769
up
up
vpls
lt-9/1/0
up
up
mt-9/1/0
up
up
pd-9/1/0
up
up
pe-9/1/0
up
up
vt-9/1/0
up
up

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

188

Agenda

Hardware Overview
NPEZ
Ichip
Layer 3 Forwarding
Layer 2 Forwarding
IRB Interface
Tunnel Interface
Exception Traffic
Reference
Q&A

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

189

Exception Traffic
Traffic to / from the PFE interface and need attention
from the PFE PPC / RE
Routing update, ping, telnet, ssh...etc
Traceroute, ICMP frag, ICMP redirect....etc
Notification path: Irlkp <-> Ip <-> A-IA FPGA <-> PFE
PPC <-> RE

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

190

Exception Traffic Ip
Handle Host traffic
Provide 2Gbps bandwidth
between host CPU and Ichip
via A-IA FPGA
Handle interrupts from
different ASICs

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

191

Exception Traffic Ip
Notifications are received from the Irlkp block
ADPC2(atlas-re0 vty)# show ichip 2 p counters
Traffic stats:
Counter Name

Total

Rate

Peak Rate

---------------------- ---------------- -------------- -------------Read Req RX

538120

15

39

Read Resp TX

538120

15

39

Read Resp Segment TX

662584

19

245

Write Req RX

569899

15

27

Write Req Segment RX

1138248

31

115

Write Resp TX

569899

15

27

Write Resp Segment TX

MTU Redirect TX

Age Check TX

Flow Control RX

Flow Control TX

PIO Read RX

176272811

5388

5727

PIO Read TX

176272811

5388

5727

....

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

192

Exception Traffic Ip
(cont....)
Notification Q[0] TX

30504

Notification Q[1] TX

2726

Notification Q[2] TX

102022

16

Notification Q[3] TX

402868

11

14

Notification Q[4] TX

Notification Q[5] TX

Notification Q[6] TX

Notification Q[7] TX

ADPC2(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

193

Exception Traffic Ip
Flow control is being used for the Host packet between Ip and AIA FPGA
FC status of the transmitter on the IA bus (1 means stop sending /
receiving)
ADPC2(atlas-re0 vty)# show ichip 2 registers p
P Registers:
(0xd0c00000)
(0xd0c00008)
(0xd0c00014)
(0xd0c00018)
(0xd0c0001c)
(0xd0c00020)
(0xd0c0002c)
(0xd0c00030)
(0xd0c00034)
Stop TX notif to A-IA when set
(0xd0c00038)
Stop pkt read/write from A-IA
(0xd0c0003c)

Copyright 2007 Juniper Networks, Inc.

p.rev:
p.ctl_to:
p.send_ptype_support:
p.recv_ptype_support:
p.err_check:
p.scratch:
p.err_check_en:
p.link_status:
p.train:

0x01000004
0x00ffffff
0x33f00000
0xc4400000
0xa9400000
0x12345678
0x09400000
0x81000000
0x0f0f0000

p.flow_cont_tx: 0x00000000
p.flow_cont_rx: 0x00000000

Proprietary and Confidential

www.juniper.net

194

Exception Traffic Ip

p.flow_cont_tx: 0x00000000
ia_bus_fc_mtured 12 1'h0 Stop sending MTU/Redirect packets
ia_bus_fc_read_resp 8 1'h0 Stop sending read response packets
ia_bus_fc_notif_q7 7 1'h0 Stop sending notification for queue 7
ia_bus_fc_notif_q6 6 1'h0 Stop sending notification for queue 6
ia_bus_fc_notif_q5 5 1'h0 Stop sending notification for queue 5
ia_bus_fc_notif_q4 4 1'h0 Stop sending notification for queue 4
ia_bus_fc_notif_q3 3 1'h0 Stop sending notification for queue 3
ia_bus_fc_notif_q2 2 1'h0 Stop sending notification for queue 2
ia_bus_fc_notif_q1 1 1'h0 Stop sending notification for queue 1
ia_bus_fc_notif_q0 0 1'h0 Stop sending notification for queue 0

p.flow_cont_rx: 0x00000000
ia_bus_fc_read 10 1'h0 Stop receiving read packets
ia_bus_fc_write 9 1'h0 Stop receiving write packets

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

195

Exception Traffic Ip
When the lookup result is with 1<=SID<=7, HNQ
classification is based on the NH_Type
* catg

queue

type

*
*
*
*
*
*
*
*
*
*
*
*
*
*
*
*
*
*
*
*

0
1
2
2
3
3
0
1
0
4
4
5
7
7
7
7
7
7
7
7

Bypass host notification high


Bypass host notification low
STP high priorirty (send to processor)
STP low priority (send to processor)
IIF mismatch diag notification
Non iif mismatch diag notifcation
Key Lookup host, high priority
Key Lookup host, low priority
HLUP, diagnostics only
Options, high priority
Options, low priority
TTL Exceeded
Sample class 7
Sample class 6
Sample class 5
Sample class 4
Sample class 3
Sample class 2
Sample class 1
Sample class 0

0
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

196

Exception Traffic Ip
When lookup result is with 8<=SID<=15, HNQ classification
is done in SID-to-Queue Table
All goes to HNQ6 now. For example, RNH_REJECT will have SID
8 which goes to HNQ6.
ADPC2(atlas-re0 vty)# show ichip 2 registers r rcp_smp
R rcp smp Registers:
.....
(0xd0570850)
r.rcp_smp.hnq_map.sid_to_hnq: 0x66666666

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

197

Exception Traffic Ip
Aggregate the interrupts and notify the Host
ADPC2(atlas-re0 vty)# show ichip 0 p internal
(

Address)

vector

count

(0x40b960e8)

isr[ICHIP_P] : 0x40211d00

(0x40b960ec)

isr[ICHIP_SR_R] : 0x00000000

(0x40b960f0)

isr[ICHIP_SR_IIF] : 0x00000000

(0x40b960f4)

isr[ICHIP_SR_WO] : 0x00000000

(0x40b960f8)

isr[ICHIP_M] : 0x401e52f8

(0x40b960fc)

isr[ICHIP_MQ] : 0x00000000

(0x40b96100)

isr[ICHIP_BD] : 0x401aae10

(0x40b96104)

isr[ICHIP_WO] : 0x401ada38

(0x40b96108)

isr[ICHIP_IF] : 0x00000000

(0x40b9610c)

isr[ICHIP_FI] : 0x00000000

(0x40b96110)

isr[ICHIP_FO] : 0x00000000

(0x40b96114)

isr[ICHIP_R] : 0x40211bc0

ADPC2(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

198

Exception Traffic A-IA FPGA

Atlas Ichip Assistant ASIC (A-IA)


Communication between ASIC and PFE PPC
Statistics collection (nexthop / fw / intf)
Host bound traffic
Interrupt handling

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

199

Exception Traffic A-IA FPGA


PCI bus to communicate with PPC
IA Bus to communicate with Ichip
One A-IA ASIC serves 2 Ichips
ADPC2(atlas-re0 vty)# show ia map
ia-index

ij-index

pfe-index

--------

--------

---------

---------------------------------

ADPC2(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

200

Exception Traffic A-IA FPGA


Packet to Host

A-IA examines the heads of the notification queues


WRR serves all the queues equally
Packet is extracted from Ipktrd block via Ip
A-IA moves the packet to the free buffer descriptor ring buffer
(FDRB) and mark the buffer is used
Raise polling request for CPU to read the packet

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

201

Exception Traffic A-IA FPGA


Packet from Host

CPU writes the packet into the Write Packet Descriptor Ring
Buffer (WPDRB)
Change the ownership of the buffer to CPU -> FPGA
A-IA polls the top descriptor and read the packet out
Packet is broken down into 64 bytes cells and transmit over
to the Ip block, then to Ipktwr block
Notification are transmitted with the first data cell

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

202

Exception Traffic A-IA FPGA


Flow control status between A-IA and Ip
ADPC2(atlas-re0 vty)# show ia 0 registers rxif 0
rxif IA[0][0]
(0xc3000800)
training_csr
(0xc3000804)
training_wait_thresh
(0xc3000808)
training_seq_thresh
(0xc300080c)
ia_bus_in_data_0
(0xc3000810)
ia_bus_in_data_1
FC received from Ip. Stop packet write to Ip
(0xc3000814)
fc_stat

:
:
:
:
:

ADPC2(atlas-re0 vty)# show ia 0 registers txif 0


txif IA[0][0]
(0xc3000a00)
pio_ctl
(0xc3000a04)
pio_data
(0xc3000a08)
pio_timeout_val
(0xc3000a0c)
pio_page
FC sent to Ip. Stop incoming notif from Ip
(0xc3000a10)
fc_stat

:
:
:
:

Copyright 2007 Juniper Networks, Inc.

0x00000004
0x80008000
0x00000810
0x00005c00
0x00005c00

: 0x00000000

0x00000000
0x00000000
0x000001ff
0x00000020

: 0x00000000

Proprietary and Confidential

www.juniper.net

203

Exception Traffic A-IA FPGA


Requests to IA FPGA would be under throttling protection
ADPC2(atlas-re0 vty)# show throttle
Throttle Statistics:
ID

Epoch(ms)

E/D(ms)

State

Name

--

----------

-----------

--------

----

12

4/8

Enabled

IA 0 Notif Q 0

12

4/8

Enabled

IA 0 Notif Q 1

12

4/8

Enabled

IA 0 Notif Q 2

12

4/8

Enabled

IA 0 Notif Q 3

12

4/8

Enabled

IA 0 Notif Q 4

12

4/8

Enabled

IA 0 Notif Q 5

12

4/8

Enabled

IA 0 Notif Q 6

12

4/8

Enabled

IA 0 Notif Q 7

12

4/8

Enabled

IA 0 Notif Q 8

12

4/8

Enabled

IA 1 Notif Q 0

10

12

4/8

Enabled

IA 1 Notif Q 1

11

12

4/8

Enabled

IA 1 Notif Q 2

.....

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

204

Exception Traffic A-IA FPGA


Statistics collection
ADPC2(atlas-re0 vty)# show ia 0 statistics applications
IA Stats Appl Info:
Num

Stats Appl

---

----------

nh

iif

dfw

ADPC2(atlas-re0 vty)# show nhdb id 831 extensive


ID

Type

Interface

Next Hop Addr

Protocol

Encap

MTU

-----

--------

-------------

---------------

----------

------------

----

831

Unicast

ge-2/2/0.100

IPv4->MPLS

Ethernet

4512

.....
IA Counter Address: 0x4a8ceb70

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

205

Exception Traffic A-IA FPGA


NH statistics collection
ADPC2(atlas-re0 vty)# show ia 0 statistics counter 0x4a8ceb70
IA Stats Acct Entry Info:
Index

Packets

Bytes

Diff Packets

Diff Bytes

-----

--------------

------------------

--------------

------------------

19

Error Count: 0
Counter Type: acct_entry_with_opt_counter
Sram Address: 0x09000468
ADPC2(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

206

Exception Traffic A-IA FPGA


IIF Statistics collection
ADPC2(atlas-re0 vty)# show ia 0 statistics acctentry 1 0
IA Stats Acct Entry Info:
Index Packets
Bytes
Diff Packets
----- -------------- ------------------ -------------0
0
0
0
1
0
0
0
2
0
0
0
3
0
0
0
4
0
0
0
5
0
0
0
6
0
0
0
7
0
0
0
8
0
0
0
9
0
0
0
10
0
0
0
11
0
0
0
12
0
0
0
13
0
0
0
14
6
654
0
15
939288
58929129
31
16
5
500
0
17
91913
8086664
6

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

Diff Bytes
-----------------0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1929
0
568

www.juniper.net

207

Exception Traffic A-IA FPGA


Interrupt management
ADPC2(atlas-re0 vty)# show fpc interrupts
V En Lv Src
Count Handler
Arg
-- -- -- ---- ---------- -------- -------0 Y 6 I/00
0 40037200 00000000
2 Y 7 E/10
11468141 40036e78 00000000
3 Y 6 I/03
0 40037cc4 00000000
4 Y 5 I/26
58259 4002d80c 00000000
5 Y 2 I/13
1550502 40161ae0 40a9e8a4
6 Y 2 I/14
1678903 40161b0c 40a9e8a4
7 Y 2 I/18
0 40161b38 40a9e8a4
11 Y 2 I/15
56842 40161ae0 40aa0958
12 Y 2 I/16
170211 40161b0c 40aa0958
13 Y 2 I/17
0 40161b38 40aa0958
19 Y 1 E/03
400341 404fb020 00000000
20 Y 1 E/04
1935277 404fb020 00000001
21 Y 1 E/05
1 404fb04c 00000000
22 Y 1 E/06
5 404fb04c 00000001
23 Y 1 E/07
159 404fb04c 00000002
24 Y 1 E/08
1 404fb04c 00000003

Copyright 2007 Juniper Networks, Inc.

Stack
-------409123dc
409a4640
409a8ea0
409a6e80
40aa4610
40aa4610
40aa4610
40aa4610
40aa4610
40aa4610
40b55780
40b55780
40b55780
40b55780
40b55780
40b55780

Proprietary and Confidential

Flags
----E0
L0
L1C
L1
L1
L1
L1
L1
L1
L1
L0
L0
L0
L0
L0
L0

Name
----------Unsupported
Clock Tick
Errors
Console
TSEC0/TX
TSEC0/RX
TSEC0/ERR
TSEC1/TX
TSEC1/RX
TSEC1/ERR
ia0
ia1
pfe0
pfe1
pfe2
pfe3

www.juniper.net

208

Exception Traffic A-IA FPGA

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

209

Exception Traffic A-IA FPGA


PIO path for the PPC to ASIC
ADPC2(atlas-re0 vty)# show ia 0 pio status
IA_0: IJ 0 pio timeout

FALSE

IA_0: IJ 0 pio in progress FALSE


IA_0: IJ 0 pio indirect

FALSE

IA_0: IJ 1 pio timeout

FALSE

IA_0: IJ 1 pio in progress FALSE


IA_0: IJ 1 pio indirect

FALSE

ADPC2(atlas-re0 vty)#

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

210

Agenda

Hardware Overview
NPEZ
Ichip
Layer 3 Forwarding
Layer 2 Forwarding
IRB Interface
Tunnel Interface
Exception Traffic
Reference
Q&A

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

211

http://cvs.juniper.net/cgi-bin/viewcvs.cgi/sw-project
s/platform/atlas/serviceability/atlas-serviceability.
txt
http://cvs.juniper.net/cgi-bin/viewcvs.cgi/sw-pro
jects/platform/reno/reno_func/reno_show_comand.tx
t
http://www-in.jnpr.net/~swong/atlas.doc Introduction to Atlas (MX960)
http://www-in.jnpr.net/~swong/reno.doc Introduction to Reno (M120)
Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

212

Agenda

Hardware Overview
NPEZ
Ichip
Layer 3 Forwarding
Layer 2 Forwarding
IRB Interface
Tunnel Interface
Exception Traffic
Reference
Q&A

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

213

Questions ?

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

214

Thank You !!!

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

215

Copyright 2007 Juniper Networks, Inc.

Proprietary and Confidential

www.juniper.net

216