fasterdata.es.netfasterdata.es.netESnet Network Performance Knowledge Base

Commercial Tools

Commercial Tools:

There are several commerial tools that are based on UDP instead of TCP. For networks with packet loss issues, these tools often perform much better.

Aspera Aspera FASP is a high-performance reliable transport protocol designed to transfer files and objects
over wide area networks with arbitrarily high speeds of up to 10 Gbps on commodity hardware, independent of round-trip delay and packet loss, using a single transport stream.  FASP includes an adaptive rate control algorithm that provides congestion avoidance, bandwidth fairness to standard TCP, and disk-based congestion avoidance, and also includes on-the-fly encryption and integrity verification.
Data Expedition Data Expedition developed a set of software tools based on their "Multipurpose Transaction Protocol" (MTP/IP), a UDP-based protocol that uses a data-pull model, and works well on congested links, satellite links, as well as high-speed networks.  It is designed to handle files up to 8 exabytes and networks speeds up to 100Gbps and beyond. They also offer SDKs that allow one to integrate MTP-based data transfers into custom applications and some off-the-shelf applications.
Tixel TIXstream from Tixel is another UDP-based solution.

Note that for UDP-based tools such as these, it is very important to follow the UDP tuning suggestions. For example, this aspera command:

numactl -C 4 /opt/aspera/bin/ascp -S "numactl -C 4 /opt/aspera/bin/ascp -b 1024" -i ~/.ssh/id_rsa -Z 8972 -QTl 20G --no-read --no-write /tmp/test.data 192.168.101.9:/tmp/test.file

Acheived 14 Gbps over a 40G nework, compared to only 2Gbps using the default setting for ascp:

ascp -i ~/.ssh/id_rsa  -QTl 20G --no-read --no-write /tmp/test.data 192.168.101.9:/tmp/test.file

This 7x difference in performance is typical of UDP-based tools, and is not unique to Aspera's ascp.