Differential protection communication

over MPLS networks

Norbert Schuster
Andrej Grbing
Siemens AG
10-5-2011 aandeelhouders met effect 1
Summary
Requirements for the differential protection
Alcatel Lucent / Creos / Siemens Test
Cisco / Siemens / TenneT Lab Trial
Agenda
Existing an future configurations
Questions for discussion
Digital communication networks based on SDH technology will be
replaced in future by packet oriented (e.g. MPLS based) networks
Are this networks suitable for the transmission of time critical data
of the differential protection ?
Evaluation in pilot projects together with customers and network equipment manufactures
Motivation for the pilot projects
Wide area-
communication network
based on SDH
FO
820 nm,
max. 1.5 km
Sync. HDLC
E
O
FO
820 nm,
max. 1.5 km
G703.1
X21
G703.6 / E1
O
E
Configuration using SDH - networks
Electrical interfaces for the connection to the communication network
Converter
7XV5662
FO
820 nm,
max. 1.5 km
FO
820 nm,
max.1.5 km
Connection to SDH based communication
networks
Converter
7XV5662
G703.1
X21
G703.6 / E1
Standard Interface with
IEEE C37.94 (optical 2 Mbit/s)
IEEE C37.94 (optical 2 Mbit/s)
Option:
True time over
GPS with a pulse
per second (PPS)
Differential
protection
Differential
protection
Configuration using SDH - networks
Optical interface for the connection to the communication network over IEEE C37.94
Wide area-
communication network
based on SDH
FO
820 nm,
max. 1.5 km
Sync. HDLC
E
O
FO
820 nm,
max. 1.5 km
G703.6 / E1
O
E
Configuration using IP networks
Using the G703.6 (E1) interface over an external converter from Siemens
Converter
7XV5662-0AD00
FO
820 nm,
max. 1.5 km
FO
820 nm,
max.1.5 km
Connection to MPLS based communicati on
networks using exi sting devices and i nterfaces
Converter
7XV5662-0AD00
G703.6 / E1
IEEE C37.94 (optical 2 Mbit/s)
Wide area
communication network
using IP - MPLS
Wide area
communication network
using IP MPLS
Test configuration at TenneT TSO (Cisco) and Creos (Alcatel Lucent) together with 7SD52
Test configuration at Creos (Alcatel Lucent) together with 7SD52
Configuration using IP networks
Optical interface for the connection to the communication network using IEEE C37.94
Standard Interface with
IEEE C37.94 (optical 2 Mbit/s)
Differential
protection
Differential
protection
Future connection to MPLS networks via integrated Ethernet interface
Ethernet
1300 nm
100 MBit/s
Optical Ethernet
Ethernet
1300 nm
100 MBit/s
Optical Ethernet
Ethernet connection to MPLS networks via a pilot converter from Siemens
FO
820 nm,
max. 1.5 km
Sync. HDLC
O
O
Pilot - converter
Serial <->Ethernet
FO
820 nm,
max.1.5 km
O
O
Ethernet
1300 nm
100 MBit/s
Optical Ethernet
Ethernet
1300 nm
100 MBit/s
Optical Ethernet
Pilot - converter
Ethernet <->Serial
Future connecti on to MPLS networks via
Ethernet interfaces
Test configuration at TenneT TSO (Cisco) together with 7SD52 with connection to Ethernet over a pilot converter
Ethernet interface integrated into the protection device without external converter (planned for the future)
Differential
protection
Differential
protection
Wide area
communication network
using IP - MPLS
Wide area
communication network
using IP - MPLS
Prototype converter with differenti al protection
device 7SD523
Wide area power supply
CB202
Serial double module:
USART-AE-2FO Prototype
Ethernet
converter
820 nm FO - connection
with 512 kBit/s
(synchronous serial HDLC)
Ethernet Module:
ETH-BB-2FO
M
N
1300 nm FO - connection
100 MBit/s Ethernet
Layer 2 (Ethertype)
Wide area-
network
IP - MPLS based
Protection interface 2 (PI2) to port E
Protection interface 1 (PI1) to port D
7SD523 Multiterminal-
differential protection device
Ethernet connection for PI1
Ethernet connection for PI2
Ethernet operation interface
Summary
Requirements for the differential protection
Alcatel Lucent / Creos / Siemens Test
Cisco / Siemens / TenneT Lab Trial
Agenda
Existing an future configurations
Questions for discussion
Requirements for data transmi ssion of
differential protection
Undisturbed and errorless telegram transmission through data link and
data conversion
Disturbances are supervised by the differential relays (percentage
error/minute or error/hour). Alarm indication if error rate is too high.
Total transmission delay over the wide area network <5 ms
Average delay time will be measured by the differential relay
Transmission delay increases the tripping time
Equal transmission delay in receive and transmit direction
Asymmetrical delay lead to a differential current
Asymmetrical delay forces a higher differential set point
Use of external GPS-synchronization in case of permanent asymmetry in
the communication network is undesired due to high effort and cost
Telegram reception with constant time difference
Required max. 300 s ->Higher value lead to Delay time jump
indication in the operational log
Due to delay time jitter the differential protection becomes insensitive
through it s internal adaptive self restraint algorithm
Distance for the communication link max. 500 km (311 miles)
FO cable (single mode) and max. 15 network router between
Keep total delay time <5 ms for such a connection
Requirements for data transmi ssion of
differential protection
Summary
Requirements for the differential protection
Alcatel Lucent / Creos / Siemens Test
Cisco / Siemens / TenneT Lab Trial
Agenda
Existing an future configurations
Questions for discussion
Cisco / Siemens / TenneT Lab Trial
Differential protection over IP-MPLS (2012 / 2013)
Equipment
Siemens 7SD523 differential protection relays
Cisco ASR901 and ASR903 routers
Siemens HDLC-E1 converters 7XV5662-0AD00
Siemens HDLC-Ethernet converters (prototypes)
Cisco ME 3600X routers used as load generators
SpectracomGPS clock
Cisco ASR903 router
Device configuration i n the test racks
ASR 901
R12
Lastgenerator
ME3600X Test
Prot.devices
7SD523
#1 und #2
Prot.devices
7SD523
#3 und #4
E1 -converter
#1a
E1-converter
#3a
Ethernet-converter
#1b #2a
Ethernet-
converter
#2b #4b
#4a #3b
Current-
injection
Current
injection
ASR 903
R1,
ASR 901
R14
ASR 901
R12
ASR 903
R11
ASR 903
R2
Network load-
generator
ME3600X Test
Grandmaster
Time Sync.
ASR 903
R13
Direct connection over singl e mode FO-l ink via
HDLC-Ethernet converters
Direct fiber optical connection over Ethernet. Use EN100-modules with
single mode fiber optical transceiver/receiver
Conversion from HDLC (serial) to Ethernet inside the Ethernet converter
J itter buffer and telegram fragmentation in the Ethernet converter
Connection over HDLC-E1 converters and
pseudo wire channel over MPLS
HDLC <->E1 converters between protection relays and routers
Pseudo wire connection with highest priority between R11 und R13
J itter buffer set to 5 ms to compensate delay time jitter from the network
Delay time measurement through
protecti on device #1
#R1 <-> #R3 #R1 <-> #R2
Connection over HDLC-Ethernet converters with
optical 100 Mbps interface to the routers
Optical1300 nm 100 Mbps interface to router R13 and R14
Pseudo wire connection with highest priority between R13 and R14
Differential protection system works in a chain topology ->Diff. active
Optical 1300 nm 100 Mbps interface to router R12 and R14
Pseudo wire connection with highest priority between R12 und R14
Differential protection system works in a ring topology
Connection over HDLC-Ethernet converters with
optical 100 Mbps interface to the routers
#R4 <-> #R3 #R4 <-> #R2
Delay time measurement through
protecti on device #4
Tests for reduction of the delay time on the E1 -
connection
The jitter buffer is required to compensate delay time changes caused by
the Ethernet network through stored and forwarded telegrams.
Max. buffer time is a setting for the E1 interface of the router
Default value 5 ms cause a delay time of 3,1 ms
Successive reduction from 5 ms to 1 ms (minimal setting in the router)
Protection device indicate no delay time jumps (precondition)
Delay time reduced from 3,1 ms to 1,85 ms
Change from PWE
1)
method SAToP
2)
to CESoPSN
3)
Delay time reduced from 1,8 ms to1,4 ms
Bandwidth reduction inside MPLS from 2 Mbps ->500 kbps
for the high priority pseudo wire connection with QoS
1)
PWE Pseudo Wire Emulation
2)
SAToP Structure Agnostic TDM over Packet
3)
CESoPSN Circuit Emulation Service over Packet Switched Networks
MPLS traffi c overload with load generators
Injection of overload to check the stability of the pseudo wire connections
Injection of >1 Gbps with traffic generators to overload the routers
On prioritized pseudo wire connections no telegram errors and significant
delay time changes are registered by the protection devices
Negative test: Incorrect QoS assignment
Protection device indicates telegram errors and delay time changes
Switching from ring to chain topology (connection losses)
Differential protection not active for short time
No stable connections can be established
No trip due to this stress situation (with current injection into the devices)
Switching of the E1 communicati on connection to
a redundant path due to link fail ure
Investigation of path rerouting under following aspects:
Delay time measured for the redundant path
Interruption time of the differential protection
Stability of the differential protection ->Different delay time in transmit and
receive direction under transient path switching conditions
Short interruptions of the connections are indicated by the devices
(approx. 50 ms)
Ring topology was broken and chain topology established
Interruption of the differential protection (diff. active) for approx. 100 ms
Max. 3 sec after rerouting inside the network the ring topology was
established again
No trip of differential protection occurs
Current phasors indicate 180 degree phase shift and the differential
currents were not increased
Changes of delay time have been observed (e.g. from 3,05 ms to 2,6 ms)
although two additional routers become connected into communication
path
Switching of the E1 communicati on path to
a redundant path due to link fail ure
Summary
Requirements for the differential protection
Alcatel Lucent / Creos / Siemens Test
Cisco / Siemens / TenneT Lab Trial
Agenda
Existing an future configurations
Questions for discussion
Differential protecti on test with Creos (Luxemburg)
and Alcatel Lucent MPLS network (Nov. 2012)
Differential protecti on test with Creos (Luxemburg)
and Alcatel Lucent MPLS network (Nov. 2012)
Differential protecti on test with Creos (Luxemburg)
and Alcatel Lucent MPLS network (Nov. 2012)
Summary
Requirements for the differential protection
Alcatel Lucent / Creos / Siemens Test
Cisco / Siemens / TenneT Lab Trial
Agenda
Existing an future configurations
Questions for discussion
Summary
Packet oriented IP/MPLS-networks are suitable for the transmission of time
critical data of the differential protection and also for teleprotection
Detailed planning and configuration of pseudo wire connections is required
(e.g. QoS Quality of Service for the links; VLAN-setting..)
Use of existing differential protection devices through E1 interface with a
converter or IEEE C37.94 interface
In future direct connection with optical Ethernet interfaces
The pilot project with TenneT and Cisco in Bayreuth has been finished
successfully in October 2013
Project with Creos and Alcatel-Lucent in Luxemburg operates since
11/2012
Summary
Requirements for the differential protection
Alcatel Lucent / Creos / Siemens Test
Cisco / Siemens / TenneT Lab Trial
Agenda
Existing an future configurations
Questions for discussion
What is your understanding about the time frame of migration from SDH
based to packet oriented networks in the power utility domain ?
What are from your perspective the main challenges during introduction of
packet oriented networks ?
Do you see MPLS as the technological base for transmission of time critical
data for differential protection and teleprotection ?
Do you like to stay with the legacy serial interfaces (HDLC, C37.94) in the
differential protection relays or do you require Ethernet interfaces for native
communication via MPLS networks ?
Questions for Discussi on
Contact
Answers for infrastructure and cities.
Andrej Grbing
Communication Solutions Architect
IC SG EA PRO D 5 1
Wernerwerkdamm 5
D-13629 Berlin
Tel.: +49 (30) 386-22932
Fax: +49 (30) 386-25158
E-Mail:
andrej.goerbing@siemens.com