Putting It All Together
Follow these steps to help ensure you are getting the best throughput possible:
-
Make sure that the client and server end hosts are properly tuned
-
Determine expected throughput
-
Use the right file transfer tool
The goal is to get data moved quickly and efficiently so that the scientists can get their work done. Many
disciplines have current requirements to move data sets in the range of a few hundred gigabytes to a
few tens of terabytes -- these operations should be possible with current networks, without resorting to
shipping tapes, hard drives or RAID boxes by truck or air. For example,
moving 10TB of data can be accomplished in a week using about 150Mbps, or about ¼ the bandwidth o an
OC12 (622Mbps).
ESnet staff are experienced in solving TCP performance problems, and if a
user or project is having trouble moving the data to or from a DOE site
(especially if they are shipping tapes or disks to move data), they are welcome to contact
trouble@es.net. We will do
whatever we can to help get a data set moved, or provide assistance in setting up long-running data
movement processes.
