[net-perf] Performance test results

Michael Sinatra michael at rancid.berkeley.edu
Thu Jun 16 00:39:08 PDT 2005


Matt was able to install our key into the nms1-losa box as well.  Here
are our results:

UCB -> Abilene LAX 	971 mb/s
Abilene LAX -> UCB	956 mb/s

Note that performance with non-jumbo frames is _significantly_ worse
(only about 270 mb/s UCB -> Abilene LAX).

traceroute to nms1-losa.abilene.ucaid.edu (198.32.8.182), 64 hops max,
44 byte packets
 1  ge-2-1-0.inr-002-reccev.Berkeley.EDU (192.101.42.25)  0.400 ms
0.263 ms  0.236ms
 2  hpr-oak-hpr--ucb-ge.cenic.net (137.164.27.129)  0.651 ms  0.589 ms
0.443 ms
 3  sac-hpr--oak-hpr-10ge.cenic.net (137.164.25.17)  2.278 ms  2.595 ms
 2.439 ms
 4  lax-hpr--sac-hpr-10ge.cenic.net (137.164.25.10)  11.646 ms  11.578
ms  11.560 ms
 5  abilene-LA--hpr-lax-gsr1-10ge.cenic.net (137.164.25.3)  14.519 ms
11.590 ms  11.559 ms
 6  nms1-losa.abilene.ucaid.edu (198.32.8.182)  16.769 ms  16.716 ms
16.682 ms

UCB -> UCLA		632 mb/s
UCLA -> UCB		610 mb/s

traceroute to bwctl-1.border.ucla.net (169.232.34.34), 64 hops max, 44
byte packets
 1  ge-2-1-0.inr-002-reccev.Berkeley.EDU (192.101.42.25)  0.288 ms
0.321 ms  70.650 ms
 2  hpr-oak-hpr--ucb-ge.cenic.net (137.164.27.129)  0.648 ms  0.482 ms
0.441 ms
 3  sac-hpr--oak-hpr-10ge.cenic.net (137.164.25.17)  2.153 ms  2.109 ms
 2.065 ms
 4  lax-hpr--sac-hpr-10ge.cenic.net (137.164.25.10)  11.522 ms  11.603
ms  11.561 ms
 5  137.164.25.5 (137.164.25.5)  15.145 ms  15.101 ms  15.056 ms
 6  ucla--sdsc-hpr-egm.cenic.net (137.164.27.14)  18.895 ms  18.848 ms
18.805 ms
 7  169.232.34.34 (169.232.34.34)  20.017 ms  18.731 ms  18.805 ms


UCB -> nitro.ucsc.edu (NDT)	876 mb/s
nitro.ucsc.edu (NDT) -> UCB	882 mb/s

traceroute to nitro.ucsc.edu (128.114.1.5), 64 hops max, 44 byte packets
 1  ge-2-1-0.inr-002-reccev.Berkeley.EDU (192.101.42.25)  0.431 ms
0.264 ms  0.265ms
 2  hpr-oak-hpr--ucb-ge.cenic.net (137.164.27.129)  0.527 ms  0.498 ms
0.441 ms
 3  hpr-ucsc-egm--oak-hpr.cenic.net (137.164.27.154)  3.533 ms  3.486 ms
 3.436 ms
 4  comm-g-GE3-4.ucsc.edu (128.114.0.65)  3.527 ms  3.498 ms  3.439 ms
 5  nitro.ucsc.edu (128.114.1.5)  3.402 ms  3.376 ms  3.316 ms


This particular system is a 2.8 ghz Xeon with intel gigE interfaces
running freebsd 4-stable with the SACK patch.  The system is
bwctl-002.net.berkeley.edu, which connects to our dark fiber HPR link to
"Oakland."

This system runs bwctld and has the following keys:

ID:
ucla
uci
booloo at ucsc.edu

[courtesy of MVN]

UCSC and UCI, feel free to start testing with our box.  Also I'll be
sending ucb's key in a separate email.  Note also that
bwctl-001.net.berkeley.edu is "coming soon" and will connect to the EGM
link to SFO that routes through Sunnyvale, if I can get the routing right.

michael

RECEIVER START
3327889426.030883: /ami/bin/iperf -B 198.32.8.182 -P 1 -s -f b -m -p
5004 -w 2097152 -t 30 -i 2
------------------------------------------------------------
Server listening on TCP port 5004
Binding to local address 198.32.8.182
TCP window size: 4194304 Byte
------------------------------------------------------------
[ 15] local 198.32.8.182 port 5004 connected with 192.101.42.26 port 5004
[ 15]  0.0- 2.0 sec  234323968 Bytes  937295872 bits/sec
[ 15]  2.0- 4.0 sec  243621888 Bytes  974487552 bits/sec
[ 15]  4.0- 6.0 sec  243875840 Bytes  975503360 bits/sec
[ 15]  6.0- 8.0 sec  244023296 Bytes  976093184 bits/sec
[ 15]  8.0-10.0 sec  244187136 Bytes  976748544 bits/sec
[ 15] 10.0-12.0 sec  242737152 Bytes  970948608 bits/sec
[ 15] 12.0-14.0 sec  243433472 Bytes  973733888 bits/sec
[ 15] 14.0-16.0 sec  243228672 Bytes  972914688 bits/sec
[ 15] 16.0-18.0 sec  243089408 Bytes  972357632 bits/sec
[ 15] 18.0-20.0 sec  243400704 Bytes  973602816 bits/sec
[ 15] 20.0-22.0 sec  243048448 Bytes  972193792 bits/sec
[ 15] 22.0-24.0 sec  243458048 Bytes  973832192 bits/sec
[ 15] 24.0-26.0 sec  243621888 Bytes  974487552 bits/sec
[ 15] 26.0-28.0 sec  243187712 Bytes  972750848 bits/sec
[ 15] 28.0-30.0 sec  243007488 Bytes  972029952 bits/sec
[ 15]  0.0-30.0 sec  3642916864 Bytes  971255232 bits/sec
[ 15] MSS size 8948 bytes (MTU 8988 bytes, unknown interface)
RECEIVER END

RECEIVER START
3327895021.758090: iperf -B 192.101.42.26 -P 1 -s -f b -m -p 5001 -t 30 -i 2
------------------------------------------------------------
Server listening on TCP port 5001
Binding to local address 192.101.42.26
TCP window size: 4194304 Byte (default)
------------------------------------------------------------
[ 16] local 192.101.42.26 port 5001 connected with 198.32.8.182 port 5001
[ 16]  0.0- 2.0 sec  224468368 Bytes  897873472 bits/sec
[ 16]  2.0- 4.0 sec  239743764 Bytes  958975056 bits/sec
[ 16]  4.0- 6.0 sec  239537204 Bytes  958148816 bits/sec
[ 16]  6.0- 8.0 sec  240174024 Bytes  960696096 bits/sec
[ 16]  8.0-10.0 sec  239314260 Bytes  957257040 bits/sec
[ 16] 10.0-12.0 sec  240200112 Bytes  960800448 bits/sec
[ 16] 12.0-14.0 sec  239913776 Bytes  959655104 bits/sec
[ 16] 14.0-16.0 sec  239600596 Bytes  958402384 bits/sec
[ 16] 16.0-18.0 sec  239099508 Bytes  956398032 bits/sec
[ 16] 18.0-20.0 sec  240092736 Bytes  960370944 bits/sec
[ 16] 20.0-22.0 sec  242732396 Bytes  970929584 bits/sec
[ 16] 22.0-24.0 sec  240182216 Bytes  960728864 bits/sec
[ 16] 24.0-26.0 sec  241997904 Bytes  967991616 bits/sec
[ 16] 26.0-28.0 sec  240531944 Bytes  962127776 bits/sec
[ 16] 28.0-30.0 sec  239188988 Bytes  956755952 bits/sec
[ 16]  0.0-30.0 sec  3589660672 Bytes  956455364 bits/sec
[ 16] MSS size 8192 bytes (MTU 8232 bytes, unknown interface)
RECEIVER END

RECEIVER START
3327890872.747434: /usr/local/bin/iperf -B 169.232.34.34 -P 1 -s -f b -m
-p 5004 -w2097152 -t 10 -i 2
------------------------------------------------------------
Server listening on TCP port 5004
Binding to local address 169.232.34.34
TCP window size: 4194304 Byte (WARNING: requested 2097152 Byte)
------------------------------------------------------------
[ 14] local 169.232.34.34 port 5004 connected with 192.101.42.26 port 5004
[ 14]  0.0- 2.0 sec  149536768 Bytes  598147072 bits/sec
[ 14]  2.0- 4.0 sec  160342016 Bytes  641368064 bits/sec
[ 14]  4.0- 6.0 sec  160497664 Bytes  641990656 bits/sec
[ 14]  6.0- 8.0 sec  160382976 Bytes  641531904 bits/sec
[ 14]  8.0-10.0 sec  160260096 Bytes  641040384 bits/sec
[ 14]  0.0-10.0 sec  791592960 Bytes  632816399 bits/sec
[ 14] MSS size 8948 bytes (MTU 8988 bytes, unknown interface)
RECEIVER END

RECEIVER START
3327894962.051719: iperf -B 192.101.42.26 -P 1 -s -f b -m -p 5001 -w
4194304 -t 10 -i 2
------------------------------------------------------------
Server listening on TCP port 5001
Binding to local address 192.101.42.26
TCP window size: 4194304 Byte
------------------------------------------------------------
[ 16] local 192.101.42.26 port 5001 connected with 169.232.34.34 port 5001
[ 16]  0.0- 2.0 sec  115303928 Bytes  461215712 bits/sec
[ 16]  2.0- 4.0 sec  133352044 Bytes  533408176 bits/sec
[ 16]  4.0- 6.0 sec  170826268 Bytes  683305072 bits/sec
[ 16]  6.0- 8.0 sec  165304596 Bytes  661218384 bits/sec
[ 16]  8.0-10.0 sec  177502232 Bytes  710008928 bits/sec
[ 16]  0.0-10.0 sec  766803968 Bytes  610442301 bits/sec
[ 16] MSS size 8192 bytes (MTU 8232 bytes, unknown interface)
RECEIVER END

[nitro.ucsc.edu test follows]

Testing network path for configuration and performance problems
Checking for Middleboxes . . . . . . . . . . . . . . . . . .  Done
running 10s outbound test (client to server) . . . . .  876.09 Mb/s
running 10s inbound test (server to client) . . . . . . 882.15 Mb/s
The slowest link in the end-to-end path is a 1.0 Gbps Gigabit Ethernet
subnet
Packet size is preserved End-to-End
Server IP addresses are preserved End-to-End
Client IP addresses are preserved End-to-End


More information about the Network-performance mailing list