Beruflich Dokumente
Kultur Dokumente
Service Provider
Programmable SDN
Solution for the Metro
Fabric, powered by
Segment Routing and EVPN
Jiri Chaloupka - Technical Marketing Engineer
Software-Defined (SDN) and Intent-Based Networking
Agenda Cisco Service Provider SDN
• Segment Routing (SR) Programmable Transport
• MPLS – Data Plane
• IPv6 – Data Plane
• Fast Convergence - Topology Independent LFA
• Traffic Engineering - SRTE
• Transport Simplification
+ Seamless Integration with existing Solution!
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 3
Unified MPLS Transport Model Baseline – Reminder
eBGP eBGP
IPv4+label IPv4+label CSG
MTG
FAN
iBGP
iBGP AGN-RR CN-RR AGN-RR IPv4+label
IPv4+label
RR RR RR
iBGP iBGP CSG
IPv4+label iBGP
FAN IPv4+label IPv4+label
MTG
CSG
AGN-SE
FAN
iBGP Hierarchical LSP eBGP LSP iBGP Hierarchical LSP eBGP LSP iBGP Hierarchical LSP
LDP LSP LDP LSP LDP LSP LDP LSP LDP LSP
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 4
Service Provider Network - Simplification Journey
Compass
Unified MPLS EPN 5.0 Metro Fabric
Provisioning NETCONF NETCONF
YANG YANG
Programmability
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 5
Intra-Domain Transport -
Segment Routing MPLS
Service Provider Network - Simplification Journey
Intra-Domain Simplification by Segment Routing
Compass
Unified MPLS EPN 5.0 Metro Fabric
Provisioning NETCONF NETCONF
YANG YANG
Programmability
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 7
The 2 faces
Why Segment Routing - MPLS of segment
routing
An LS IGP protocol extension
An IP/MPLS architecture
bringing network
designed with SDN in mind
simplification/optimization
• No LDP
• Lighter protocol suite • Right balance between
• Less adjacencies, less states to distributed intelligence and
maintain centralized optimization and
• No IGP to LDP synchronization programming
• Eliminates delays in activating a path • SR-TE
• Topology independent fast reroute using • Wide applications
post convergence back up path • (SP, OTT/Web, GET) across
• 50 ms protection (WAN, Metro/Agg, DC)
• no microloops • MPLS and IPv6 dataplanes
• 100% coverage of network topologies • SDN controller
Easy troubleshooting
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 8
Segment Routing
Segment(s) Data
Data Plane
MPLS IPv6
(segment labels) (+ SR extension header)
1 2 Control Plane
Paths options
3 4 Dynamic
(STP computation)
Explicit
(expressed in the packet)
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 9
IGP Prefix Segment Example 1: Best Path
16005
• Signaled by ISIS/OSPF 1.1.1.5/32
• Minor extensions to existing link-
state routing protocols 1 2 16005
• Shortest-path to IGP prefix 16005
• Equal Cost MultiPath (ECMP)-aware 16005
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 10
IGP Prefix Segment Example 2: ECMP
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 11
IGP Adjacency Segment
Adj to 5
24024
Local significance
•
5
• Automatically allocated by router
3 4
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 12
Combining IGP Segments 16004
24045
• Signaled by ISIS/OSPF Packet to 5
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 13
MPLS Data Plane Operations
IPv4: 1.1.1.4/32
or
Segment 16004 IPv6: 2001::0101:0104/128
Prefix-SID 16004
1 2 3 4
Push Swap Pop -
16004 16004
Payload Payload Payload Payload
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 14
SR Segments
SRGB: Segment Routing Global Block:
default [16000 – 23999]
• Signaled by ISIS/OSPF
12
IGP Prefix
• 2 4
routing protocols (OSPF and IS-IS) 1
7
13 16005
• Shortest-path to the IGP prefix
3 6 5
• Global in SR domain 11
12 124
• Signaled by ISIS/OSPF 10
2 4
Segment
6 5
• Forward on the IGP adjacency 3
11
• Local 14
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 15
Metro Fabric Transport Configuration
IGP with Segment Routing + TI-LFA
+
TI-LFA
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 16
Service Provider Network - Simplification Journey
Intra-Domain Simplification by Segment Routing
Compass
Unified MPLS EPN 5.0 Metro Fabric
Provisioning NETCONF NETCONF
YANG YANG
Programmability
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 17
TI-LFA – zero-segment example
prefix-SID(Z) A Z
Packet to Z
Q-space
Default metric: 10
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 18
TI-LFA – single-segment example
prefix-SID(Z) A Z
Packet to Z
Packet to Z
1 2
• To steer packets on TI-LFA
backup path: prefix-SID(R4)
prefix-SID(Z) 5
prefix-SID(Z)
Packet to Z
• “forward packet on interface to R5 Packet to Z
Default metric:10
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 19
TI-LFA – double-segment example
A Z
prefix-SID(Z)
Packet to Z Packet to Z
adj-SID(R4-R3)}” 4
R4 3
R3
1000
P-space Q-space
adj-SID(R4-R3)
Default metric: 10
prefix-SID(Z)
Packet to Z
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 20
Metro Fabric Transport Configuration
IGP with Segment Routing + TI-LFA
router isis 1
+ router ospf 1
interface GigabitEthernet0/0/0/2 fast-reroute per-prefix
address-family ipv4 unicast TI-LFA fast-reroute per-prefix ti-lfa
fast-reroute per-prefix
fast-reroute per-prefix ti-lfa
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 21
Service Provider Network - Simplification Journey
Intra-Domain Simplification by Segment Routing
Compass
Unified MPLS EPN 5.0 Metro Fabric
Provisioning NETCONF NETCONF
YANG YANG
Programmability
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 23
Combining IGP Segments – SR Policy
16003 PHP
SID-list 16004
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 24
SR Policy Identification
• Only one SR Policy with a given color C can exist between a given
node pair (head-end (H), end-point (E))
– In other words: each SR Policy triplet (H, C, E) is unique
(1, green, 4) 2 3 4
Low-latency 1.1.1.0/24
2.2.2.0/24
1
(1, blue, 4)
7 6 5
High-BW
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 26
SR Policy – Candidate Paths
• A head-end may be informed about candidate paths for an SR Policy
(color, end-point) by various means including: local configuration (CLI),
netconf, PCEP, or BGP
BGP PCEP
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 27
SR Policy – Candidate Paths
• An SR Policy consists of one or more candidate paths (Cpaths)
SR Policy Cpath1
Cpath2 Candidate
... Paths
Cpathn
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 28
SR Policy – Candidate Path
• A candidate path is a single segment list (SID-list)
or a set of weighted* SID-lists
– Typically, an SR Policy path only contains a single SID-list
• Traffic steered into an SR Policy
SID-list11
Weight11
path is load-shared over all Cpath1 ...
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 29
Active SR Policy – FIB entry
20
2 10GE
3
SID-list:
Selected
SR Policy
Path
<16003, 1 4
16004>
BSID: 40GE
40104 6 5
Default link metric: 10
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 30
Weighted ECMP (WECMP)
• If a set of SID-lists is associated with the selected path of the SR
Policy, then the steering is flow and WECMP-based according to the
relative weight of each SID-list
SID-list1: 1/5
<16003,
16004>
of load 20
2 10GE
3
Weight 1
Selected
SR Policy
Path 1 4
SID-list2: 40GE
<16004> 4/5 6 5
Weight 4 of load
Default link metric: 10
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 31
Active SR Policy – FIB entry – WECMP
SID-list: 20
<16003,
2 10GE
3
16004>
Selected
SR Policy
Path Weight 1 1 4
BSID: SID-list: 40GE
40104 <16004> 6 5
Weight 4 Default link metric: 10
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 33
Service Provider Network - Simplification Journey
Intra-Domain Simplification by Segment Routing
Compass
Unified MPLS EPN 5.0 Metro Fabric
Provisioning NETCONF NETCONF
YANG YANG
Programmability
MP-BGP
• MPLS services
ride on prefix 3 4
segments CE PE PE CE
• Simple, one less 7 1 2 8
protocol to 1.1.1.2/32 10.0.0.0/30
operate (LDP) Prefix-SID 16002 2001::a00:0/126
5 6
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 35
Intra-Domain Transport -
Seamless Integration &
Migration
All nodes: SR + LDP SR LDP
MPLS-to-MPLS and MPLS-to-IP
Prefix-SID
• LDP FEC to 1.1.1.5/32 index 5
1 2 3 4 5
1.1.1.5
local/in lbl out lbl local/in lbl out lbl local/in lbl out lbl local/in lbl out lbl
16000 16000 16000 16000
… … … …
SRGB
… … … …
1048575 1048575 1048575 1048575
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 37
All nodes: SR + LDP SR LDP
MPLS-to-MPLS and MPLS-to-IP
Prefix-SID
• LDP FEC to 1.1.1.5/32 index 5
1 2 3 4 5
1.1.1.5
local/insr-prefer
segment-routing mpls lbl out lbl local/in lbl out lbl local/in lbl out lbl local/in lbl out lbl
16000 16000 16000 16000
… … … …
SRGB
… … … …
1048575 1048575 1048575 1048575
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 38
Metro Fabric Transport Configuration
LDP to SR Migration
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 39
LDP to SR interworking
SR LDP
LDP: LDP:
1.1.1.5/32 1.1.1.5/32 1.1.1.5
lbl 90100 lbl 90007
1 2 3 4 5
SID 16005
local/in lbl out lbl local/in lbl out lbl local/in lbl out lbl local/in lbl out lbl
16000 16000 16000 16000
SRGB
SRGB
… … 16005 16005 16005 pop
… …
copy
23999 23999 Prefix Segment
…
90008 90100 90100 90007 90007 16005
… LDP LSP … … …
1048575 1048575 1048575 1048575
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 40
segment-routing mapping-server
prefix-sid-map ipv4 SR LDP
SR to LDP interworking
1.1.1.5/32 5 range 1
Mapping Server LDP:
1.1.1.5/32
LDP: lbl imp-null
1.1.1.5/32 1.1.1.5
lbl 90100
1 2 3 4 5
local/in lbl out lbl local/in lbl out lbl local/in lbl out lbl local/in lbl out lbl
16000 16000 16000 16000
SRGB
SRGB
SRGB
16005 16005 16005 16005 16005 90090 …
… … …
copy
23999 Prefix Segment 23999 23999
… … … … LDP LSP
1048575 1048575 1048575 1048575
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 41
Binding-SID – Stitching Intra and Inter Domain Feature!
BSID: BSID:
30410 30710
1 2 3 4 5 6 7 8 9 10
16003 16006
14 16004 16004 16007 16007 16009
410 30410 30410 30410 30710 30710 30710 16010 16010
Node 10 Node 10 Node 10 Node 10 Node 10 Node 10 Node 10 Node 10 Node 10
Do You remember? 20
2 10GE
3
SID-list:
Selected
SR Policy
Path
<16003, 1 4
16004>
BSID: 40GE
40104 6 5
Default link metric: 10
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 42
Inter-Domain Transport
Compass Metro Fabric - High-Level Domain View
CO CO CO
Option1: Central Office - Distributed
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 44
Compass Metro Fabric - High-Level Domain View
CO CO CO
CO CO CO
Option3: Central Office - Distributed with Core Domain extension
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 45
Service Provider Network - Simplification Journey
Inter-Domain Simplification by Segment Routing
Compass
Unified MPLS EPN 5.0 Metro Fabric
Provisioning NETCONF NETCONF
YANG YANG
RR
Inline RR Inline RR
next-hop-self next-hop-self
PE3 PE5
A1 Access Core Access A6
PE2 PE4
IGP (ISIS/OSPF) – Intra-Domain LSP IGP (ISIS/OSPF) – Intra-Domain IGP (ISIS/OSPF) – Intra-Domain LSP
LSP
BGP-LU – Inter-Domain LSP
PE2 or PE3 LDP PHP PE4 or PE5 LDP PHP A6 LDP PHP
A6 BGP-LU A6 BGP-LU A6 BGP-LU A6 BGP-LU Service Service
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 47
Reminder: Unified MPLS Design
Segment Routing Introduction => EPN5.0 SolutionBGP-LU Signaling
Segment Routing can be deployed in each IGP domain independently, with all benefits described in previous section
RR
Inline RR Inline RR
next-hop-self next-hop-self
PE3 PE5
A1 Access Core Access A6
PE2 PE4
IGP (ISIS/OSPF) with SR extension– Intra-Domain LSP IGP (ISIS/OSPF) – Intra-Domain IGP (ISIS/OSPF) – Intra-Domain LSP
LSP
BGP-LU – Inter-Domain LSP
TI-LFA
TI-LFA
TI-LFA
PE2 or PE3 SR PHP PE4 or PE5 LDP PHP A6 LDP PHP
A6 BGP-LU A6 BGP-LU A6 BGP-LU A6 BGP-LU Service Service
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 48
Let’s uncover one more Cool Segment Routing Feature
Anycast Prefix Segment (SID)
• Same prefix
advertised by 100
12
multiple nodes 10
2 4
• Traffic forwarded to
one of Anycast 1
7
prefix-SIDs based on 13 16100
best IGP path
3 6 5
• If primary node fails,
traffic is auto re- 11 100
routed to other node 14
DC (BGP-SR) WAN (IGP-SR) PEER
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 49
End-To-End Segment Routing Transport
Segment Routing Policy (SRTE) for Inter-Domain LSP
BGP-LS
RR
PCEP/BGP
Anycast-SID Anycast-SID
PE3 PE5
A1 Access Core Access A6
PE2 PE4
IGP SR (ISIS/OSPF) – Intra-Domain LSP IGP SR (ISIS/OSPF) – Intra-Domain IGP SR (ISIS/OSPF) – Intra-Domain LSP
LSP
MPLS Data-Plane Left-To-Right ->
TI-LFA
TI-LFA End-To-End, Each IGP Domain Independently
TI-LFA
PE2/PE3 SR PHP PE4/PE5 SR PHP A6 SR PHP
PE4/PE5 SR PE4/PE5 SR A6 SR A6 SR Service Service
A6 SR A6 SR Service Service
Service Service
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 50
Segment Routing Policy SRTE
Inter-Domain LSP
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 51
Service Provider Network - Simplification Journey
Inter-Domain Simplification by Segment Routing
Ok, What about PCE?
Compass
Unified MPLS EPN 5.0 Metro Fabric
Provisioning NETCONF NETCONF
YANG YANG
Inter-Domain CP X
BGP-LU
X
BGP-LU
FRR or TE X
RSVP
IGP with SR
Intra-Domain CP
X
LDP IGP with SR
IGP
Single / Native SR
REST API algorithms
Multi-Domain
Topology
Solution
Multi-Domain SRTE Visibility Topo
Centralized SR-PCE for Multi-Domain Topology view Compute
DB
SR-PCE runs on
virtual or physical
Integration with Applications IOS-XR node
North-bound APIs for topology/deployment Collect Deploy
Delivers across the unified SR Fabric the SLA requested by PCEP
IGP
the service BGP-LS
BGP
Benefits
Simplicity and Automation Access Metro Core Metro Data Center
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 54
SR Path Computation Element (SR-PCE)
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 55
BGP-LS Overview
Domain 1 Domain 2
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 56
PCEP Architectural Introduction
• Path computation PCE
LSP DB
• Large, multi-domain and multi-layer networks
PCEP TED
• Path computation element (PCE)
• Computes network paths (topology, paths, etc.)
• Stores TE topology database (synchronized with network)
• May initiate path creation
• Stateful - stores path database included resources used PCC
(synchronized with network)
12
10
2 4 Low Lat, Low
BW
1
7
13
3 6 5
11
14
DC (BGP-SR) WAN (IGP-SR) PEER
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 58
NSO Main Features
Applications Engineers
REST, NETCONF, Java, Python, Erlang, CLI, Web UI • Logically centralized network
services
Service
Service Manager Model • Data models for data
structures
Device
• Structured representations
Device Manager
Model of:
• Service instances
Network Element Drivers (NEDs) • Network configuration
and state
NETCONF, REST, SNMP, CLI, etc • Mapping service operations
to network configuration
• VNFM changes
• Controller Apps • Transactional integrity
• EMS and NMS • Multiprotocol and multivendor
Physical Networks Virtual Networks Network Apps support
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 59
Path Computation Engine – Workflow
Delegated Computation to SR-PCE
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 60
Transport Programmability – SRTE Policy
BGP-LS
RR
PCEP/BGP
Anycast-SID Anycast-SID
PE3 PE5
A1 Access Core Access A6
PE2 PE4
IGP SR (ISIS/OSPF) – Intra-Domain LSP IGP SR (ISIS/OSPF) – Intra-Domain IGP SR (ISIS/OSPF) – Intra-Domain LSP
LSP
MPLS Data-Plane Left-To-Right ->
TI-LFA
TI-LFA End-To-End, Each IGP Domain Independently
TI-LFA
PE2/PE3 SR PHP PE4/PE5 SR PHP A6 SR PHP
PE4/PE5 SR PE4/PE5 SR A6 SR A6 SR Service Service
A6 SR A6 SR Service Service
Service Service
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 61
BGP Based Service –
On-Demand Next Hop
Why is BGP so important for
Intent-Based Networking
On-Demand Next-Hop (ODN)
Dynamic VPN instantiation of SRTE policies
• CE21 advertises prefixes to PE
10 11
BGP:
1.1.1.21/32,
3 5
T:30
22 via 21
2 13 14 21
Vrf 7 9 23 Vrf
T:30
BLUE BLUE
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 63
On-Demand Next-Hop (ODN)
Dynamic VPN instantiation of SRTE policies
• CE21 advertises prefixes to PE
• PE22 checks its policy and finds that
1.1.1.21/32 must receive low latency
service MAP: 1.1.1.21/32 in vrf BLUE must
receive low latency service tag
with community (100:777)
10 11
BGP:
1.1.1.21/32,
3 5
T:30
22 via 21
2 13 14 21
Vrf 7 9 23 Vrf
T:30
BLUE BLUE
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 64
On-Demand Next-Hop (ODN)
Dynamic VPN instantiation of SRTE policies
• CE21 advertises prefixes to PE
• PE22 checks its policy and finds that
1.1.1.21/32 must receive low latency
service MAP: 1.1.1.21/32 in vrf BLUE must
receive low latency service tag
• PE22 tags 1.1.1.21/32 with a BGP with community (100:777)
community (e.g. 100:777)
and sends to RR11 10 11
BGP:
1.1.1.21/32,
3 5
T:30
22 via 21
2 13 14 21
Vrf 7 9 23 Vrf
T:30
BLUE BLUE
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 65
On-Demand Next-Hop (ODN)
Dynamic VPN instantiation of SRTE policies
• CE21 advertises prefixes to PE
• PE22 checks its policy and finds that
1.1.1.21/32 must receive low latency
service MAP: 1.1.1.21/32 in vrf BLUE must
receive low latency service tag
• PE22 tags 1.1.1.21/32 with a BGP with community (100:777)
community (e.g. 100:777)
and sends to RR11 10 11
BGP:
• RR11 sends to PE3 1.1.1.21/32,
3 5
T:30
22 via 21
2 13 14 21
Vrf 7 9 23 Vrf
T:30
BLUE BLUE
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 66
On-Demand Next-Hop (ODN)
Dynamic VPN instantiation of SRTE policies
• PE3 requests a path towards PE22
from PCE (10)
COMPUTE: minimize TE Metric to PE22
PCreq 10 11
T:30
3 5 22
2 13 14 21
Vrf 7 9 23 Vrf
T:30
BLUE BLUE
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 67
On-Demand Next-Hop (ODN)
Dynamic VPN instantiation of SRTE policies
• PE3 requests a path towards PE22
from PCE (10)
• PCE computes a dynamic path with COMPUTE: minimize TE Metric to PE22
the required Optimization Objective
and Constraints RESULT: SID list {S5, S14, S22}
• Result: SID list {S5, S14, S22}
SID list: Segment ID list,
• PE3 instantiates SRTE Policy with PCreq/reply
10 11
list of segments
2 13 14 21
Vrf 7 9 23 Vrf
T:30
BLUE BLUE
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 68
On-Demand Next-Hop (ODN)
Dynamic VPN instantiation of SRTE policies
1.1.1.21/32; NH: PE22
BGP
Received VPN label: L_VPN
Community 100:777
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 69
On-Demand Next-Hop (ODN)
Dynamic VPN instantiation of SRTE policies
1.1.1.21/32; NH: PE22
BGP
Received VPN label: L_VPN
Community 100:777
TE
SID List {S0, S1, S2}, OIF 3
Binding Label: 30022
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 70
On-Demand Next-Hop (ODN)
Dynamic VPN instantiation of SRTE policies
1.1.1.21/32; NH: PE22
• TE installs SRTE Policy in FIB:
BGP
Received VPN label: L_VPN
Binding-SID (e.g. 30022):
Community 100:777
• push {label L1, label L2}
TE
SID List {S0, S1, S2}, OIF 3
Binding Label: 30022
FIB
OIF: SRTE; Label stack {L1, L2}
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 71
On-Demand Next-Hop (ODN)
Dynamic VPN instantiation of SRTE policies
1.1.1.21/32; NH: PE22
• TE installs SRTE Policy in FIB:
BGP
Received VPN label: L_VPN
Binding-SID (e.g. 30022):
Community 100:777
• push {label L1, label L2} Binding Label: 30022
• TE provides the
Binding-SID of the SRTE Policy to SRTE Policy to PE22:
TE
BGP SID List {S0, S1, S2}, OIF 3
Binding Label: 30022
FIB
OIF: SRTE; Label stack {L1, L2}
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 72
On-Demand Next-Hop (ODN)
Dynamic VPN instantiation of SRTE policies
1.1.1.21/32; NH: PE22
• BGP installs best-path in FIB:
BGP
Received VPN label: L_VPN
• 1.1.1.21/32 via 30022
Community 100:777
• Push VPN label and steer in SRTE Binding Label: 30022
Policy
TE
SID List {S0, S1, S2}, OIF 3
Binding Label: 30022
1.1.1.21/32; recursion-via-segment
label L_VPN, NH via 30022
FIB
Local label: 30022
OIF: SRTE; Label stack {L1, L2}
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 73
SR MPLS - Performance Monitoring
• Per-Link Delay Delay Measurement
Used as metric for SRTE Policy or Flex-Algo
• BGP-LS: draft-ietf-idr-te-pm-bgp
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 74
SR IGP Flex Algo
• Complements the SRTE solution by adding new Prefix-Segments with
specific optimization objective and constraints
• minimize igp-metric or delay or te-metric
• avoid SRLG or affinity
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 75
Multi-Plane Networks
Powered by SR IGP Flex Algo
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 76
Best-Effort Traffic Algorithm 0: IGP Metric
A3 P3 A5
$ $ $ $ $ $
CE1 A1 Access ABR1 Core ABR2 Access A6 CE2
A2 P2 A4
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 77
Best-Effort Traffic Algorithm 0: IGP Metric
L3VPN - VPNv4 (SLA Best-Effort - BGP community)
A3 P3 A5
$ $ $ $ $ $
CE1 A1 Access ABR1 Core ABR2 Access A6 CE2
A2 P2 A4
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 78
Best-Effort Traffic Algorithm 0: IGP Metric
L3VPN - VPNv4 (SLA Best-Effort - BGP community)
ODN A3 P3 A5
$ $ $ $ $ $
CE1 A1 Access ABR1 Core ABR2 Access A6 CE2
A2 P2 A4
Algorithm 0: ABR1
Label Stack Algorithm 0: ABR2 Algorithm 0: A6
Algorithm 0: ABR2 Algorithm 0: A6 Service
Algorithm 0: A6 Service
Service
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 79
Low-Latency Traffic Flex-Algo128: Delay
L3VPN - VPNv4 (SLA Low-Latency - BGP Community)
A3 P3 A5
$ $ $ $ $ $
CE1 A1 Access ABR1 Core ABR2 Access A6 CE2
A2 P2 A4
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 80
Low-Latency Traffic Flex-Algo128: Delay
L3VPN - VPNv4 (SLA Low-Latency - BGP Community)
ODN A3 P3 A5
$ $ $ $ $ $
CE1 A1 Access ABR1 Core ABR2 Access A6 CE2
A2 P2 A4
Service
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 81
Transport – Segment
Routing IPv6 (SRv6)
Segment Routing and the IPv6 Dataplane - SRv6
SR-IPv6 SR-MPLS
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 83
SRv6 - Segment format
Locator Function
1111 : 2222 : 3333 : 4444 : 5555 : 6666 : 7777 : 8888
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 84
Inter-Domain SRv6 without SRH
default-route ::/0 default-route ::/0 Summary route -> PE Summary route -> AG
or Summary route -> AG or Summary route -> PE
Original Frame/ Original Frame/ Original Frame/ Original Frame/ Original Frame/
packet - VRF100 packet - VRF100 packet - VRF100 packet - VRF100 packet - VRF100
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 85
Inter-Domain SRv6 with SRH
Traffic Steering
default-route ::/0 default-route ::/0 Summary route -> PE Summary route -> AG
or Summary route -> AG or Summary route -> PE
3
Transport: End-To-End Inter-Domain by SRv6 (with SRH)
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 86
BGP Based Services -
EVPN
From Mac Bridging to Mac Routing
Common BGP Control Plane
L3VPN – VPNv4/6, L2/3VPN – EVPN, EVPN-VPWS Overlay
Evolution:
Underlay
IP, MPLS IP,MPLS,VXLAN IP,MPLS,VXLAN
Leaf
VM
PE1 DCI1
Spine Spine
Leaf
VM
A1 Access WAN/Core
Leaf
PE2 DCI2 VM
IP, IGP, MPLS (LDP), RSVP-TE, BGP-LU IP, MPLS, L2 L2, STP, VLAN Underlay
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 88
Next-Generation Solutions for L2VPN
Solving VPLS challenges for per-flow Redundancy
M1 M2
CE1 PE1 PE3 CE2
• Existing VPLS solutions do not offer an Echo !
All-Active per-flow redundancy PE2 PE4
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 89
EVPN
Next generation network services
Not technical benefit to replace them with EVPN L3!!
E2E control and automation across
Single service for any application
domains
DC
ELINE ELAN ETREE DCI L3VPN EVPN
Fabric
SR SR-TE MPLS VXLAN
P2MP VPLS / L3
VPWS VPLS VXLAN RFC2547
VPLS VPN
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 90
EVPN Advantages:
Integrated • Integrated Layer 2 and Layer 3 VPN services
Services • L3VPN-like principles and operational experience for scalability and control
• All-active Multi-homing & PE load-balancing (ECMP)
Investment • Fully support IPv4 and IPv6 in the data plane and control plane
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 91
EVPN vs VPNv4/6 or BGP Control Plane?
• BGP integrates services with programmable SR transport
• Common across L2 / L3 services
• Services Control Plane is BGP with different AF / SAFI
• Single Service Control Plane is easy to manage and troubleshoot
• Not technical benefit to replace them with EVPN L3!!
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 92
EVPN Flavors
• Multi-Homed All-Active Ethernet Access
• Replacement of: mLACP, STP, T-LDP, BGP-AD, etc.
• Standards-based Multi-chassis / Cluster Control Plane
• Replacement of: vPC, VSS, nVCluster, etc.
• Replacement of: HSRP, VRRP, etc.
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 93
MPLS Transport & BGP Service
BGP L3VPN BGP EVPN
BGP Signaling BGP Signaling BGP Signaling BGP Signaling
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 94
What is EVPN?
RFC 7432
EVPN family introduces next EVPN
generation solutions for Ethernet
services
P2P Multipoint
• BGP control-plane for Ethernet Segment
and MAC distribution learning over MPLS
and VXLAN data-plane
• Same principles and operational EVPN-VPWS
experience as in IP VPNs
RFC 8214
No use of Pseudowires
Multi-vendor solutions EVPN-IRB
RFC 7432
EVPN
Cisco leader in industry
standardization efforts (RFCs/Drafts) draft-ietf-bess-evpn-inter-subnet-forwarding
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 95
Concepts
EVPN Instance (EVI) Ethernet Segment BGP Routes BGP Route Attributes
PE2
ESI2 [4] Ethernet Segment Route Default Gateway
PE
[5] IP Prefix Advertisement Route Encapsulation
• EVI identifies a VPN in the • Represents a ‘site’ • New SAFI [70] • New BGP extended
network connected to one or more • Routes serve control communities defined
• Encompass one or more PEs plane purposes, • Expand information
bridge-domains, • Uniquely identified by a including: carried in BGP routes,
depending on service 10-byte global Ethernet MAC address reachability including:
interface type Segment Identifier (ESI) MAC mass withdrawal MAC address moves
Port-based • Could be a single device Split-Horizon label adv. Redundancy mode
VLAN-based (shown above) or an entire network Aliasing MAC / IP bindings of a GW
VLAN-bundling Single-Homed Device (SHD) Multicast endpoint discovery Split-horizon label encoding
Multi-Homed Device (MHD) Redundancy group discovery Data plane Encapsulation
Single-Homed Network (SHN) Designated forwarder election
Multi-Homed Network (MHN) IP address reachability
L2/L3 Integration
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 96
EVPN - Ethernet VPN
• Concepts are same!!! Pick your side!
C1 C2
VM VM VM VM
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 97
EVPN - Ethernet VPN
• Leafs run Multi-Protocol BGP to advertise & learn MAC/IP addresses over the
Network Fabric
• MAC/IP addresses are advertised to rest of Leafs
SP1 SP2
L1 L2 L3 L4
Data Plane learning
from the hosts
All Active multi-homing
C1 C2 Ethernet Segment
VM VM VM VM
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 98
EVPN - Ethernet-Segment for Multi-Homing
L1 L2 L3 L4
VM VM VM VM
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 99
EVPN - load-balancing modes
All-Active Single-Active Port-Active
(per flow) (per VLAN) (per port)
V1 V1 V1 V2 V1, V2
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 100
EVPN – Designated Forwarder (DF)
Challenge:
How to prevent duplicate copies of flooded traffic from being delivered to a multi-homed
Ethernet Segment?
SP1 SP2
L1 L2 L3 L4
NDF DF
C1 Duplicate C2
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 101
EVPN – Split Horizon
Challenge:
How to prevent flooded traffic from echoing back to a multi-homed Ethernet Segment?
Transport
BUM Label Label
SP1 SP2
SH Label
L1 L2
Echo !
C1
VM VM
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 102
EVPN – MAC Mass-Withdraw
Challenge:
How to inform other Leafs of a failure affecting many MAC addresses quickly while the
control-plane re-converges?
L1 L2 L3 L4
MAC1 can NOT be
reached via ESI1
C1 C2
VM VM VM VM
ESI1 MAC1
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 103
EVPN – BUM Ingress Replication
SP1 SP2
L1 L2 L3 L4
C1 C2
VM VM VM VM
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 104
EVPN – Aliasing
Challenge:
How to load-balance traffic towards a multi-homed device across multiple Leafs when
MAC addresses are learnt by only a single Leaf?
L1 L2 L1 L2
MAC1 can be
reached via ESI1
C1 C2
VM VM VM VM
ESI1 MAC1
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 105
EVPN – MAC Mobility
Challenge:
How to detect the correct location of MAC after the movement of host from one Ethernet
Segment to another also called “MAC move”?
C1 C2
VM
Host move
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 106
EVPN – Distributed Anycast Gateway
Purpose:
Optimal intra and inter-subnet connectivity with seamless workload mobility
L1 L2 L3 L4
All the BVIs perform active forwarding
in contrast to active/standby like First-
hop routing protocol
C1 C2 C3 C4
VM VM VM VM
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 107
EVPN – IRB in Network Fabric
Intra-subnet
Forwarding
Inter-subnet
Forwarding
SP1 SP2
L1 L2 L3 L4
C1 C2 C3 C4
VM VM VM VM
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 108
BGP Based Services –
EVPN & L3VPN Interconnect
EVPN and VPNv4/6 Interconnect
• DCI/BL provides EVPN to VPNv4/6 stitching
• DCI/BL participates in L3 Routing not in L2 Bridging
• DCI/BL is mandatory, because of summarization!!!
A3 P3 SP2 L2
A2 P2 SP1 L1
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 110
EVPN and VPNv4/6 Interconnect
• DCI/BL provides EVPN to VPNv4/6 stitching Interconnect
• DCI/BL participates in L3 Routing not in L2 Bridging
• DCI/BL is mandatory, because of summarization!!!
A3 P3 SP2 L2
A2 P2 SP1 L1
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 111
EVPN and VPNv4/6 Interconnect
RT5 Prefix = prefix-CE2/24 RT: VRF A RT5 Prefix = prefix-CE2/24 RT: VRF A Stitching
RT5 Prefix = prefix-CE1/24 RT: VRF A RT5 Prefix = prefix-CE1/24 RT: VRF A Stitching
VRF A
RD DCI:0
RT import/export: VRF A Stitching
RT import/export: VRF A
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 112
Low-Latency Traffic Flex-Algo128: Delay
L2/L3VPN - EVPN (SLA Low-Latency -
BGP Community)
A3 P3 SP2 L2
$ $ $ $
A2 P2 SP1 L1
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 113
Low-Latency Traffic Flex-Algo128: Delay
L3VPN - VPNv4 (SLA Low-Latency - BGP Community) L2/L3VPN - EVPN (SLA Low-Latency -
BGP Community)
A3 P3 SP2 L2
$ $ $ $
A2 P2 SP1 L1
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 114
Low-Latency Traffic Flex-Algo128: Delay
L3VPN - VPNv4 (SLA Low-Latency - BGP Community) L2/L3VPN - EVPN (SLA Low-Latency -
BGP Community)
ODN A3 P3 SP2 L2
$ $ $ $
A2 P2 SP1 L1
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 115
EVPN-VPWS
• Benefits of EVPN applied to point-to-point services
• No signaling of PWs. Instead signals MP2P LSPs instead
(ala L3VPN)
• All-active CE multi-homing (per-flow LB) PE2 PE4
• Single-active CE multi-homing (per-service LB)
CE1 MPLS CE2
• Relies on a sub-set of EVPN routes to advertise
Ethernet Segment and AC reachability PE1 PE3
• PE discovery & signaling via a single protocol – BGP
• Per-EVI Ethernet Auto-Discovery route
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 116
BGP Based Services
EVPN - Legacy L2 and
VPLS Interconnect
EVPN L2 Interconnect – Let’s connect everything together
Everything in one Bridge Domain
• Legacy L2: REP, G8032, STP, etc.
LACP
• VPLS VPWS
• EVPN-VXLAN/EVPN-MPLS CE A3
• EoMPLS(PW)
• Ethernet – MultiHomed, SingleHomed
Leaf
VM
A2
Spine Spine
DCI/BL DCI/BL
PE1
Leaf
VM
STP/REP/ MPLS MPLS Core
A1 G.8032…. Core
Leaf
VM DCI/BL DCI/BL
PE2
A2 EVPN - VXLAN
EVPN-MPLS
EVPN - MPLS
A1 A2
VPLS
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 118
Anycast-PW access to EVPN
Anycast-SID Anycast-SID
PE1 PE3
CE A1 EVPN A3 CE
Anycast-PW All-Active Anycast-PW
PE2 PE4
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 119
EVPN Headend (PWHE + EVPN)
PWHE PWHE
A1 PE1 PE3 A3
Multi/Single-Homed Multi/Single-Homed Multi/Single-Homed
CE All/Single-Active Single-Active All/Single-Active CE
EVPN-VPWS EVPN EVPN-VPWS
A2 PE2 PE4 A4
PWHE PWHE
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 120
EVPN – Service Layering Access Aggregation Core
A AG PE P PE
Multicast CE
FXC
EVPN-HE
E-TREE A AG PE P PE
P2P
L2 Bridging
L3 Routing BL BL
IRB
SP SP
SP SP
SP SP
SP SP
L L
L
L
L L “Shared or single tenant”
L L L
L L L L
L L L L
L L L L
C C CE CE
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 121
Intent-Based End-To-
End Service Provider
Network Design
Flexible BGP Based Services
End-To-End
A AG PE PE AG A
Access Aggregation Core Aggregation Access
A AG PE PE AG A
CO CO CO
Distributed CO - service termination
Centralized CO - service termination
Access-To-Access - service termination
MP-BGP L3VPN
EVPN
EVPN-VPWS
Legacy EoMPLS PW - Static
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 123
Segment Routing and BGP Based Network Design
Transport: End-To-End Segment Routinng: TI-LFA FRR, SRTE Inter-Domain LSP
BGP-LS
RR
PCEP/BGP
Anycast-SID Anycast-SID
PE3 PE5
A1 Access Core Access A6
PE2 PE4
Services: End-To-End/Hierarchical: BGP-based (L3VPN, EVPN(L2/L3)), Legacy EoMPLS PW for P2P, AnycastPW to EVPN for Multipoint
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 124
Segment Routing and BGP Based Network Design
Transport: End-To-End Segment Routinng: TI-LFA FRR, Anycast-SID for ABR HA/FRR, SRTE Inter-Domain LSP
PCEP
BGP-LS
RR RR RR
CO CO CO
BGP-based services
S-RR S-RR S-RR
Services: End-To-End/Hierarchical: BGP-based (L3VPN, EVPN(L2/L3)), Legacy EoMPLS PW for P2P, AnycastPW to EVPN for Multipoint
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 125
Conclusion
• Transport/Services Simplification
Easy to Manage/Provision and Automate
• Segment Routing Transport Programmability with BGP Based Services (VPNv4/6,
EVPN)
On-Demand Next Hop (ODN)
• SR-PCE - PCE integrated in IOS-XR
• Unified Control Plane and Data Plane Across SP Network
• Network Design Simplification
NETCONF
Provisioning YANG
Programmability
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 126
Segment Routing - Stay up to date
ask-segment-routing@cisco.com
amzn.com/B01I58LSUO
segment-routing.net
linkedin.com/groups/8266623
twitter.com/SegmentRouting
facebook.com/SegmentRouting/
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 127
EVPN - Stay Up-To-Date
• https://e-vpn.io/
• Upcoming Conferences: https://e-vpn.io/conferences/
• Cisco Live Barcelona 2019
• BRKSPG-2322 Service Provider Network Fabric: How to bring Access Services using EVPN
• Patrice Brissette, Principal Engineer
• BRKSPG-2518 Service Provider Programmable SDN solution for the Metro Fabric, powered by Segment Routing and EVPN
• Jiri Chaloupka, Technical Marketing Engineer
• BRKSPG-3965 EVPN Deep Dive with IOS-XR Configuration examples for Service Provider Metro and Data Center
• Jiri Chaloupka, Technical Marketing Engineer
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 128
Cisco Webex Teams
Questions?
Use Cisco Webex Teams (formerly Cisco Spark)
to chat with the speaker after the session
How
1 Find this session in the Cisco Events Mobile App
2 Click “Join the Discussion”
3 Install Webex Teams or go directly to the team space
4 Enter messages/questions in the team space
cs.co/ciscolivebot#BRKSPG-2518
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 129
Complete your online
session survey
• Please complete your Online Session
Survey after each session
• Complete 4 Session Surveys & the Overall
Conference Survey (available from
Thursday) to receive your Cisco Live T-
shirt
• All surveys can be completed via the Cisco
Events Mobile App or the Communication
Stations
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 130
Continue Your Education
BRKSPG-2518 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 131
Thank you