Ethernet Switch with Digital Diagnostics

Overview:

Ethernet networks are the transport mechanism for Internet Protocol (IP) communications.

Although Ethernet has been around since 1973 when the original concept was tested at Xeroxs even more recently in CCTV applications. The invention and development of better switching and transportation systems.

Palo Alto Labs, it has just in the last few years become viable in control system applications and technology has made Ethernet networks more applicable to control system networks, such as traffic

We have enhanced Ethernet switches by adding a Digital Diagnostics & Monitoring function to the fiber optic ports of the switch. This function allows a user to measure optical parameters at a specific switch and determine performance levels of not only the switch but the optical fiber plant from the comfort of the management center, rather than rolling a truck to various cabinets. Technology media, wire, fiber optics and wireless, the electrical characteristics and the addressing scheme for an Ethernet network. Ethernet is a technology that is defined by IEEE 802.3 standard. This standard defines the types of

as well. This is an indispensible tool when used to trouble shoot fiber optic cable plant anomalies

communications. The rules concerning Ethernet communications assumes every machine is

Ethernet is a packet communications technology, designed for computer to computer

connected to the same piece of wire, much like a meeting of a group of people in one room. If a machine wants to communicate (talk) it listens and if there is nothing on the wire it talks. If two machines talk at the same time they hear each other so they back off and wait a random time period then try again.

Todays Ethernet networks use switches to create a network and every device is communicating on never two machines sending at the same time, on the same piece of wire. This changes the before the development of switches.

a full duplex connection, over Twisted pair wire, fiber optic cable or wireless channels, so there are dynamic of how the network operates and allows Ethernet networks to go where they could not go

Page 1 of 9

www.etherwan.com

Ethernet Switch with Digital Diagnostics

Every Ethernet interface device is assigned a unique hardware address when it is manufactured.

This address is used by switches to determine how to connect machines to each other. You can go to the following URL and lookup a MAC address if you want to know who manufactured a product. http://standards.ieee.org/regauth/oui/index.shtml

Ethernet Packet
101010? . (7 Octets) 10101011 Preamble SFD Destination Source Length or Type (2 Octets) VLAN Tag ID (4 Octets) Len VLAN Data Pad

CRC Error Checking (4 Octets) FCS

Source Address (6 Octets) Destination Address (6 Octets)

Used to make Frame >= 64 Octets Data Package

When a machine sends information via Ethernet it sends a packet of bits with the sending

switch is to create a reference table that cross references a machines MAC address and the Port

machines MAC address and the destination machines MAC address. The main job of an Ethernet

where that machine is connected. When a packet enters an Ethernet switch the switch looks at the that machine is connected. If there is not a match in the table then it forwards that packet to all ports at the same time. destination MAC address finds the match in its table and forwards that packet to the port where

As switching technology has improved Ethernet has become a viable network technology for use in real time control networks, such as traffic signals. Since, by nature, traffic signals are geographically separated from each other a system that networks traffic cabinets to a central optic cable. This can present a new set of challenges in insuring good network integrity and troubleshooting techniques.

location is comprised of switches that are separated by distance and generally connected by fiber

Page 2 of 9

www.etherwan.com

Ethernet Switch with Digital Diagnostics

Challenges

Distributed networks, such as Traffic Signal Networks or Highway Management Networks present a special challenge because the location of Ethernet switches is sometimes miles apart from each other and miles from the central control center. When a network uses fiber optic cable the connectivity generally follows the concept shown below.

Distributed Network

Patch Panel

Patch Panel

Patch Panel To Other Locations

Switch

Switch

Switch Patch Cables

The fiber optic cable plant is vulnerable to disconnects and damage from various sources. There are patch panels and patch cables that can be connected with the wrong type of fiber and/or misconnected and there are splices that can become faulty. Then there is always the possible of backhoe fade when a new dig simply cuts through the fiber optic cable. Trouble shooting the the source of a problem that may be causing light attenuation. Solution EX74000 Series Switch fiber optic cable plant can be challenging and require specialized equipment and expertise to find

EtherWAN Systems has developed a NEMA TS2 hardened Ethernet switch with optical diagnostics built in, called Digital Diagnostics Monitoring (DDM) / Digital Optical Monitoring (DOM). Using connectivity issues. DDM/DOM a user can use the Ethernet switch management functions to trouble shoot fiber optic

Page 3 of 9

www.etherwan.com

Ethernet Switch with Digital Diagnostics

The DDM/DOM subsystem is available through the switch management screens. Whether using a web browser, telnet or the console port, a user can access this information for any switch in the network from any location on the network.

DDM/DOM Screen

The DDM/DOM screen is part of the port status screen. It shows the status of the SFP port(s), in

module in port 8. DDM/DOM measures and monitors the operating parameters of the SFP module, including the optical characteristics and displays a set of parameters that allow users to determine the health of the Laser as well as the performance of the fiber optic cable plant.

the screen shown above this switch does not have a module plugged into port 7 but does have a

The screen, shown above, shows the characteristics of an SFP module using DDM/DOM. Notice the particular device shown transmits at 1310nm and is designed for a maximum of 10km. The following parameters are measured by the DDM/DOM subsystem: Temperature inside the SFP Module. Vcc Voltage supply to the SFP.

Tx Bias Current to the Laser Diode Transmitter.

Page 4 of 9

www.etherwan.com

Ethernet Switch with Digital Diagnostics

Tx Power The amount of light being transmitted into the fiber optic cable. This is a measured value but it may not reflect the actual power entering the cable, it doesnt monitor the health of the laser. consider the condition of the actual cable. This number can be used as a reference to Rx Power The amount of light being received from the fiber optic cable. The main parameters of interest are Tx Bias, Tx Power and Rx Power. By tracking Tx Bias a user

can know how the Laser component is aging, especially compared to others in the network. This cable one can look at the switch where that fiber is connected and know the Rx power there and

allows users to perform preventative maintenance. Knowing the Tx power at one end of the fiber measure the attenuation between them. This allow users to determine whether the cable plant is measurements also allows the user to know if the optical interfaces are deteriorating or if the

performing as expected or if there are anomalies in the optical path. Knowing and tracking these optical path is deteriorating. Since these measurements can be taken from the comfort of the

control room, on a live network it more likely that users will monitor these parameters on a period basis and perform preventative maintenance rather than fire fighting after a failure has occurred.

Results

Example of a live network between two switches: Switch 1 Screen

Page 5 of 9

www.etherwan.com

Ethernet Switch with Digital Diagnostics

Switch 2 Screen

Notice the power levels between the switches. Switch 1 TX power is -8.392 dBm and Switch 2 RX

power is -8.389 dBm. Switch 2 TX power = -5.616 dBm and Switch 1 RX = -5.017 dBm. There is a small loss of power when connected with a short jumper cable. We focus on these two parameters because these are the most useful in trouble shooting problems with the fiber optic plant. See the screens below for an example of what happens when one of the fiber optic connectors is not seated completely.

Page 6 of 9

www.etherwan.com

Ethernet Switch with Digital Diagnostics

What happens if one of the connectors is not seated correctly? The two pictures below show the physical difference between an LC connector that is seated correctly and one that has not been pressed in until the lock clicks in place.

Correctly Seated

Not Seated

There is not much physical difference, it would certainly be difficult to catch this anomaly during a routine physical inspection. However, as the screen below shows the difference in receive power from the normal SW 2 screen, shown above. The RX power level went from -8.389 dBm to -22.366 dBm or 13.977 dB loss of optical power. The network is working fine, this anomaly would not be discovered using a normal set of equipment without the DDM feature, until one day the weight of the network goes down.

the cable and/or vibration caused the connector to move farther out or disconnect completely and

Page 7 of 9

www.etherwan.com

Ethernet Switch with Digital Diagnostics

Switch 2 Screen with Loose Connector on SW 1

Notice the RX power level at -22.366 dBm, is well below what we would expect so we can level is normal.

immediately look back at the switch that is transmitting to this one and determine if the TX power

Page 8 of 9

www.etherwan.com

Ethernet Switch with Digital Diagnostics

Switch 1 Screen with Loose Rx Connector on Switch 1

Switch 1 has TX power = -8.392 dBm so it is normal. In this case we can assume there is some

anomaly between Switch 1 and Switch 2. Starting with the obvious we check the connections. In this case we find a loose connector on Switch 1 that is transmitting to Switch 2, this connector is not seated correctly. It could have been a bad patch cable or bad connector termination or bad splice. Benefits of DDM/DOM:

Ethernet switches with DDM/DOM allow users of distributed networks that utilize fiber optic cable to be more proactive in maintaining their network using the than standard optical interfaces. The results are fewer truck rolls, less network down time, less investment in equipment and training and smoother operation.

Page 9 of 9

www.etherwan.com