Sie sind auf Seite 1von 71

Na tomto místě bude oficiální zadání vaší práce

Toto zadání je podepsané děkanem a vedoucím katedry,

musíte si ho vyzvednout na studiijním oddělení Katedry počítačů na Karlově náměstí,

v jedné odevzdané práci bude originál tohoto zadání (originál zůstává po obhajobě na katedře),

ve druhé bude na stejném místě neověřená kopie tohoto dokumentu (tato se vám vrátí po obhajobě).

i

ii

Czech Technical University in Prague Faculty of Electrical Engineering Department of Computer Science and Engineering

Engineering Department of Computer Science and Engineering Master’s Thesis Acceleration of 10GbE Network Traffic Bc.

Master’s Thesis

Acceleration of 10GbE Network Traffic

Bc. Michael Rohrbacher

Supervisor: Ing. Jan Kubr

Study Programme: Electrical Engineering and Information Technology

Field of Study: Computer Science and Engineering

December 31, 2012

iv

v

Aknowledgements

I would like to thank my family and my friends for their support during the time I was writing this thesis. Also I would like to thank my supervisor Ing. Jan Kubr for the opportunity to work on this very interesting topic, and Moris Bangoura and Radim Roška for their answers

vi

vii

Declaration

I hereby declare that I have completed this thesis independently and that I have listed all the literature and publications used. I have no objection to usage of this work in compliance with the act §60 Zákon č. 121/2000Sb. (copyright law), and with the rights connected with the copyright act including the changes in the act.

In Klatovy on Dec 31, 2012

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

viii

Abstract

This thesis is about finding the capabilities of WANic 56512 which is a network card with

a packet processor. It researches all the steps that are required to get this card working in our laboratory. A part of this thesis discuss whether WANic 56512 is a suitable candidate for packet generating, receiving and switching. Various benchmarks were performed to get trustworthy results to support the final conclusion. The output of this thesis is an installation guide which speeds up the deployment time

for a future use. Also a set of tests that can be used to measure the performance of the card

is presented. At the end of this thesis there is a comparison between WANic 56512 and the

prototypes made by Radim Roška and Moris Bangoura.

ix

x

Contents

1 Introduction

1

1.1 Motivation and goal

 

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

1

1.2 Structure of the thesis

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

2

2 Related works

3

2.1 Performance evaluation of GNU/Linux network bridge

 

3

2.2 10GbE Routing on PC with GNU/Linux

 

4

3 Theoretical description of WANic 56512

7

3.1 General overview

 

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

7

3.1.1 The MIPS Architecture

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

8

3.1.2 Comparison between the MIPS and x86 architecture

 

10

3.2 Hardware Acceleration Units

 

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

11

3.3 Packet Flow

 

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

11

3.4 Simple Executive

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

13

4 Installation of WANic 56512

 

15

4.1 Description/Specification of the host system

 

15

4.2 Installation procedures

 

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

16

4.2.1 Installation procedure without buying the SDK

 

16

4.2.1.1 Diagnostic mode’s kernel

 

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

16

4.2.1.2 cnusers SDK

 

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

17

4.2.2 Installation procedure with buying the SDK

 

18

4.2.2.1 PCI console .

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

20

4.2.2.2 NIC mode

 

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

22

4.2.2.3 Ethernet PCI mode

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

23

5 Benchmarks for WANic 56512

 

25

5.1 RFC 2544

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

25

5.1.1 Throughput

 

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

25

5.1.2 Frame loss rate

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

25

5.2 Benchmarks for Linux environment .

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

26

5.2.1 iperf

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

26

5.2.2 netperf

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

27

5.2.3 curl-loader

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

27

5.2.4 pktgen

 

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

28

 

xi

xii

CONTENTS

 

5.2.5

bridge-utils

 

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

28

5.3

Benchmarks for the Simple Executive environment

 

29

5.3.1 traffic-gen

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

29

5.3.2 CrossThru

 

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

30

6 Benchmarking

 

35

6.1

iperf

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

35

6.2 netperf

 

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

36

6.3 curl-loader

 

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

36

6.4 pktgen

 

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

36

6.5 bridge-utils

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

37

6.6 traffic-gen

 

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

37

6.7 CrossThru

 

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

38

7 Analysis of the benchmarks

 

39

7.1

iperf

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

39

7.2 netperf

 

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

39

7.3 pktgen

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

40

7.4 bridge-utils

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

40

7.5 traffic-gen

 

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

40

7.6 CrossThru

 

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

40

7.7 Graphs

 

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

41

8 Conclusion

 

47

8.1

Future work

 

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

48

A Scripts

 

51

A.1

iperf

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

51

A.2

netperf

 

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

51

A.3

pktgen

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

52

A.4

traffic-gen

 

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

54

B CD content

 

57

List of Figures

3.1

Block diagram of WANic 56512. Source: [8]

 

8

3.2

Block diagram of OCTEON CN5650. Source: [3]

 

9

3.3

MIPS architecture, pipelined. Source: [17]

 

10

3.4

Packet input. Source: [11]

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

12

3.5

SSO and core processing. Source: [11]

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

13

3.6

Packet output. Source: [11]

 

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

14

4.1

Topology of the lab.

 

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

16

4.2

The needed DIP switch. Source: [5]

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

17

5.1

CrossThru – Flowchart. Source: [2] .

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

31

7.1

TX and RX test - TCP - iperf

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

41

7.2

TX test - UDP - iperf

 

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

42

7.3

TCP_STREAM and TCP_SENDFILE test - netperf

.

.

.

.

.

.

.

.

.

.

.

.

.

42

7.4

UDP_STREAM test - netperf

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

43

7.5

TX test - pktgen

.