IPV6 Land Speed Record
CERN & CALTECH

Single Stream IPv6 Class: 6,947 Tbm/s (Friday 2 May 2003)

For Submission to the "Internet2 LSR"
before the next Internet2 Members Meeting

Press Release of June 26, 2003

The following tests have been performed at CERN in the context of the DataTAG project with the collaboration of the following people: Daniel Davids (CERN), Edoardo Martelli (DataTAG / CERN) & Sylvain Ravot (CALTECH).


IPv6 Test Results

The following table gives a resume of the "Single Stream IPv6 Class" results of end-to-end transfers between a workstation in Geneva (Switzerland), which is the source [IPv6 address is "fec0:3::3], and a workstation in Chicago (Illinois/US), which is the destination [IPv6 address is "fec0:1::2]. The application program that is used for the end-to-end transfer and which calculates the results is version 1.7.0 of the "Iperf" program from NLANR [National Laboratory for Applied Network Research].

Test Results when Using an MTU of 9000 Bytes #

[  5]  0.0-3600.2 sec   412   GBytes    983 Mbits/sec
[  5]  0.0-300.1 sec     34.2 GBytes    980 Mbits/sec
Test Results when Using an MTU of 1500 Bytes #

[  5]  0.0-3600.9 sec   385   GBytes    919 Mbits/sec
[  5]  0.0-900.9 sec     96.1 GBytes    917 Mbits/sec
[  5]  0.0-100.9 sec     10.6 GBytes    906 Mbits/sec
# The here mentioned results are each time the last output line of the "iperf" application program when it terminates transferring data end-to-end over the requested time interval. The full output of "iperf" and the command line parameters used for these tests are discussed later on.

In parallel to two of the IPv6 tests, two "TcpDump" trace files have been created using version 3.6.2 of the tcpdump program [see " http://www.tcpdump.org/" for further information]. The first tcpdump trace file is for the 300 seconds with MTU 9000 [file-size: 650MB] test and the second tcpdump trace file is for the 100 seconds with MTU 1500 [file-size: 1130MB] test. Note the importance of these file sizes before downloading them: using a 10Mbps link flat-out, the approximate download time will be respectively 10 minutes and 20 minutes!

In addition, for each of the two tcpdump trace files, two corresponding tcpdump files have been created. The first one is created from the original tcpdump trace file by means of running the "tcpdump -x -c15" command on it. It basically expands the first 15 packets by showing the packet's context minus its link level header in hexadecimal. The second one is a copy of the expanded trace with additional informations I introduced by hand. In particular, I added information on IP & TCP header lengths as well as some of their information fields.

300 seconds with MTU 9000
Full "TcpDump" Trace [file-size: 650MB]
Trace of the 15 First Packets Expanded
Trace File with Additional Informations
100 seconds with MTU 1500
Full "TcpDump" Trace [file-size: 1130MB]
Trace of the 15 First Packets Expanded
Trace File with Additional Informations

Set-Up of the LSR Tests

Additional Information

Routing & Geographical Information

The following links can be identified for Level-3 Routing

  1. From the Workstation "W02GVA" towards the Juniper M10 Router "R05GVA"
    Both are Located in Geneva (Switzerland) [shortest distance is zero]
  2. From the Juniper M10 Router "R05GVA" to the Juniper M10 Router "R05CHI"
    Shortest Distance Geneva (Switzerland) to Chicago (Illinois/US) is 7067 Km
    [Distance is measured according to Zenith Aircraft Company's Virtual GPS]
  3. From the Juniper M10 Router "R05CHI" towards the Workstation "W02CHI"
    Both are Located in Chicago (Illinois/US) [shortest distance is zero]

Single Stream IPv6 Class Record Calculation

Throughput * Distance = 983 Mb/s * 7067 Km = 6,947 Tbm/s

Network Equipment & Data Streams

At CERN in Geneva:

At the PoP in Chicago:

End-to-End Traceroute Information

From Geneva (Switzerland) towards Chicago (Illinois/US)

[root@w02gva]# traceroute6 fec0:1::2
traceroute to fec0:1::2 (fec0:1::2)
  from fec0:3::3, 30 hops max, 16 byte packets
  1  fec0:3::2 (fec0:3::2)  0.355 ms  0.31 ms  0.306 ms
  2  fec0:2::1 (fec0:2::1)  119.112 ms  119.086 ms  119.069 ms
  3  fec0:1::2 (fec0:1::2)  118.902 ms  118.894 ms  118.894 ms

From Chicago (Illinois/US) towards Geneva (Switzerland)

[root@w02chi]# traceroute6 fec0:3::3
traceroute to fec0:3::3 (fec0:3::3)
  from fec0:1::2, 30 hops max, 16 byte packets
  1  fec0:1::1 (fec0:1::1)  0.357 ms  0.264 ms  0.224 ms
  2  fec0:2::2 (fec0:2::2)  119.147 ms  119.141 ms  119.115 ms
  3  fec0:3::3 (fec0:3::3)  119.422 ms  118.891 ms  118.884 ms

OS & Interface Configurations

The following URL gives a more detailed description and explanation of the configuration parameters of the equipment, the operating system and interfaces of the workstations as well as the Juniper router configuration.

In short, the workstation "W02GVA" in Geneva (Switzerland) & the workstation "W02CHI" in Chicago (Illinois/US) are identical and have the following configuration:

The Full Output of the "Iperf" Tests & their Command Line Options

"Iperf" Output for MTUs of 9000 Bytes

"Iperf" Output for MTUs of 1500 Bytes

Major Sponsors

The "European Union" (EU), the US "National Science Foundation" (NSF) through the "Electronic Visualisation Lab" (EVL) at "University of Illinois in Chicago" (UIC) and the US "Department of Energy" (DoE) through the "California Institute of Technology" (CALTECH)

Principal Investigators

CERN
Centre Europeen de la Recherche Nucleaire
Project Leader: Olivier Herve Martin
CALTECH
California Institute of Technology
Project Leader: Harvey Newman

Projects

DataTAG
Research & Technological Development for a TransAtlantic Grid

Partners

CERN
Centre Europeen de la Recherche Nucleaire
CALTECH
California Institute of Technology
StarLight
The Optical STAR TAP

Contact Persons

CERN, Geneva:
Olivier Herve Martin <olivier.martin@cern.ch>
Daniel Davids <daniel.davids@cern.ch>
Paolo Moroni <paolo.moroni@cern.ch>
 
DataTAG/CERN:
Edoardo Martelli <edoardo.martelli@cern.ch>
Jean-Philippe Martin-Flatin <jp.martin-flatin@cern.ch>
 
CALTECH - US:
Harvey Newman <newman@hep.caltech.edu>
Sylvain Ravot <sylvain.ravot@cern.ch>
 

Last Modified by Daniel Davids on Thursday 26 June 2003