[net-perf] Performance test results

Mark Boolootian booloo at ucsc.edu
Mon Jun 13 13:21:00 PDT 2005


> FWIW, these are typical maximum results I've seen with 9000 and
> 1500 byte MTU's, respectively, when there is no loss and no
> other bottleneck.  (I suspect that with faster CPUs (& buses?)
> the 1500 byte results will get better...)

I thought someone told me (Mike Van Norman?) they had run full rate
gigE with 1500 byte packets.  I haven't seen the CPU running out of
gas with small packets and have puzzled over where the problem is.  You
mention the bus as a possible bottleneck.  32 bit/33MHz PCI can run a 
sustained rate of 115 MBytes/sec, enough to nearly saturate a gigE 
connection.  Where would the bus limitation come from?  

SysKonnect has a white paper at 

  http://www.syskonnect.com/technology/64bit66MHz_Computing.PDF

with a table showing theoretical data rate vs burst length.  Small
burst length can produce much lower throughput, but I don't know
how to interpret this in terms of packet size.  It doesn't look
relevant to me. 

Instead of publically castigating me, mvn missed an opportunity and
rang me up to tell me the numbers I posted weren't different directions,
but were data rates for a single direction as observed at each end.

I've rerun the tests with the following results:

UCSC -> UCLA: 850 Mbit/sec
UCLA -> UCSC: 952 Mbit/sec

UCSC -> UCI: 938 Mbit/sec
UCI -> UCSC: 800 Mbit/sec

---

RECEIVER START
3327680849.846927: /usr/local/bin/iperf -B 169.232.34.50 -P 1 -s -f b -m -p 5004 -w 2097152 -t 10 -i 2
------------------------------------------------------------
Server listening on TCP port 5004
Binding to local address 169.232.34.50
TCP window size: 4194304 Byte (WARNING: requested 2097152 Byte)
------------------------------------------------------------
[ 14] local 169.232.34.50 port 5004 connected with 128.114.1.5 port 32804
[ 14]  0.0- 2.0 sec  203467440 Bytes  813869760 bits/sec
[ 14]  2.0- 4.0 sec  213170320 Bytes  852681280 bits/sec
[ 14]  4.0- 6.0 sec  215791400 Bytes  863165600 bits/sec
[ 14]  6.0- 8.0 sec  214725060 Bytes  858900240 bits/sec
[ 14]  8.0-10.0 sec  216043740 Bytes  864174960 bits/sec
[ 14]  0.0-10.0 sec  1067253760 Bytes  850646344 bits/sec
[ 14] MSS size 8128 bytes (MTU 8168 bytes, unknown interface)
RECEIVER END
SENDER START
3327680851.026396: iperf -c 169.232.34.50 -B 128.114.1.5 -f b -m -p 5004 -w 2097152 -t 10 -i 2
------------------------------------------------------------
Client connecting to 169.232.34.50, TCP port 5004
Binding to local address 128.114.1.5
TCP window size: 4194304 Byte (WARNING: requested 2097152 Byte)
------------------------------------------------------------
[ 13] local 128.114.1.5 port 32804 connected with 169.232.34.50 port 5004
[ ID] Interval       Transfer     Bandwidth
[ 13]  0.0- 2.0 sec  207568896 Bytes  830275584 bits/sec
[ 13]  2.0- 4.0 sec  214188032 Bytes  856752128 bits/sec
[ 13]  4.0- 6.0 sec  214958080 Bytes  859832320 bits/sec
[ 13]  6.0- 8.0 sec  214269952 Bytes  857079808 bits/sec
[ 13]  8.0-10.0 sec  216260608 Bytes  865042432 bits/sec
[ 13]  0.0-10.0 sec  1067253760 Bytes  850163289 bits/sec
[ 13] MSS size 8140 bytes (MTU 8180 bytes, unknown interface)
SENDER END

RECEIVER START
3327680820.489642: iperf -B 128.114.1.5 -P 1 -s -f b -m -p 5001 -w 2097152 -t 10 -i 2
------------------------------------------------------------
Server listening on TCP port 5001
Binding to local address 128.114.1.5
TCP window size: 4194304 Byte (WARNING: requested 2097152 Byte)
------------------------------------------------------------
[ 14] local 128.114.1.5 port 5001 connected with 169.232.34.50 port 5001
[ ID] Interval       Transfer     Bandwidth
[ 14]  0.0- 2.0 sec  203983168 Bytes  815932672 bits/sec
[ 14]  2.0- 4.0 sec  246749724 Bytes  986998896 bits/sec
[ 14]  4.0- 6.0 sec  245852712 Bytes  983410848 bits/sec
[ 14]  6.0- 8.0 sec  246322676 Bytes  985290704 bits/sec
[ 14]  0.0-10.0 sec  1188921344 Bytes  951778479 bits/sec
[ 14] MSS size 8140 bytes (MTU 8180 bytes, unknown interface)
[ 14] Read lengths occurring in more than 5% of reads:
[ 14]  8140 bytes read 143393 times (98.1%)
RECEIVER END
SENDER START
3327680821.624912: /usr/local/bin/iperf -c 128.114.1.5 -B 169.232.34.50 -f b -m -p 5001 -w 2097152 -t 10 -i 2
------------------------------------------------------------
Client connecting to 128.114.1.5, TCP port 5001
Binding to local address 169.232.34.50
TCP window size: 4194304 Byte (WARNING: requested 2097152 Byte)
------------------------------------------------------------
[  7] local 169.232.34.50 port 5001 connected with 128.114.1.5 port 5001
[  7]  0.0- 2.0 sec  204668928 Bytes  818675712 bits/sec
[  7]  2.0- 4.0 sec  246513664 Bytes  986054656 bits/sec
[  7]  4.0- 6.0 sec  244662272 Bytes  978649088 bits/sec
[  7]  6.0- 8.0 sec  246226944 Bytes  984907776 bits/sec
[  7]  8.0-10.0 sec  246841344 Bytes  987365376 bits/sec
[  7]  0.0-10.0 sec  1188921344 Bytes  950729117 bits/sec
[  7] MSS size 8140 bytes (MTU 8180 bytes, unknown interface)
SENDER END

RECEIVER START
3327680760.829067: /usr/local/bin/iperf -B 128.195.120.5 -P 1 -s -f b -m -p 5009 -w 2097152 -t 10 -i 2
------------------------------------------------------------
Server listening on TCP port 5009
Binding to local address 128.195.120.5
TCP window size: 4194304 Byte (WARNING: requested 2097152 Byte)
------------------------------------------------------------
[ 14] local 128.195.120.5 port 5009 connected with 128.114.1.5 port 32794
[ 14]  0.0- 2.0 sec  210329460 Bytes  841317840 bits/sec
[ 14]  2.0- 4.0 sec  240724220 Bytes  962896880 bits/sec
[ 14]  4.0- 6.0 sec  241326580 Bytes  965306320 bits/sec
[ 14]  6.0- 8.0 sec  241261460 Bytes  965045840 bits/sec
[ 14]  8.0-10.0 sec  239417936 Bytes  957671744 bits/sec
[ 14]  0.0-10.1 sec  1179262976 Bytes  938662812 bits/sec
[ 14] MSS size 8128 bytes (MTU 8168 bytes, unknown interface)
RECEIVER END
SENDER START
3327680761.982168: iperf -c 128.195.120.5 -B 128.114.1.5 -f b -m -p 5009 -w 2097152 -t 10 -i 2
------------------------------------------------------------
Client connecting to 128.195.120.5, TCP port 5009
Binding to local address 128.114.1.5
TCP window size: 4194304 Byte (WARNING: requested 2097152 Byte)
------------------------------------------------------------
[ 13] local 128.114.1.5 port 32794 connected with 128.195.120.5 port 5009
[ ID] Interval       Transfer     Bandwidth
[ 13]  0.0- 2.0 sec  215056384 Bytes  860225536 bits/sec
[ 13]  2.0- 4.0 sec  240697344 Bytes  962789376 bits/sec
[ 13]  4.0- 6.0 sec  241426432 Bytes  965705728 bits/sec
[ 13]  6.0- 8.0 sec  241213440 Bytes  964853760 bits/sec
[ 13]  8.0-10.0 sec  240861184 Bytes  963444736 bits/sec
[ 13]  0.0-10.1 sec  1179262976 Bytes  937926326 bits/sec
[ 13] MSS size 8140 bytes (MTU 8180 bytes, unknown interface)
SENDER END

RECEIVER START
3327680789.698347: iperf -B 128.114.1.5 -P 1 -s -f b -m -p 5001 -w 2097152 -t 10 -i 2
------------------------------------------------------------
Server listening on TCP port 5001
Binding to local address 128.114.1.5
TCP window size: 4194304 Byte (WARNING: requested 2097152 Byte)
------------------------------------------------------------
[ 14] local 128.114.1.5 port 5001 connected with 128.195.120.5 port 5001
[ ID] Interval       Transfer     Bandwidth
[ 14]  0.0- 2.0 sec  162692808 Bytes  650771232 bits/sec
[ 14]  2.0- 4.0 sec  203358536 Bytes  813434144 bits/sec
[ 14]  4.0- 6.0 sec  205156004 Bytes  820624016 bits/sec
[ 14]  6.0- 8.0 sec  218968368 Bytes  875873472 bits/sec
[ 14]  0.0-10.0 sec  1000497152 Bytes  800986767 bits/sec
[ 14] MSS size 8140 bytes (MTU 8180 bytes, unknown interface)
[ 14] Read lengths occurring in more than 5% of reads:
[ 14]  8140 bytes read 117727 times (95.8%)
RECEIVER END
SENDER START
3327680790.876672: /usr/local/bin/iperf -c 128.114.1.5 -B 128.195.120.5 -f b -m -p 5001 -w 2097152 -t 10 -i 2
------------------------------------------------------------
Client connecting to 128.114.1.5, TCP port 5001
Binding to local address 128.195.120.5
TCP window size: 4194304 Byte (WARNING: requested 2097152 Byte)
------------------------------------------------------------
[  7] local 128.195.120.5 port 5001 connected with 128.114.1.5 port 5001
[  7]  0.0- 2.0 sec  165208064 Bytes  660832256 bits/sec
[  7]  2.0- 4.0 sec  201170944 Bytes  804683776 bits/sec
[  7]  4.0- 6.0 sec  205529088 Bytes  822116352 bits/sec
[  7]  6.0- 8.0 sec  218308608 Bytes  873234432 bits/sec
[  7]  8.0-10.0 sec  210272256 Bytes  841089024 bits/sec
[  7]  0.0-10.0 sec  1000497152 Bytes  800006758 bits/sec
[  7] MSS size 8140 bytes (MTU 8180 bytes, unknown interface)
SENDER END


More information about the Network-performance mailing list