Download SRA data with Aspera command line utility
Aspera connect is NCBI's recommended data transfer client for large datasets >1GB. It uses the FASP protocol, here's a description from the NCBI guide.
"The FASP protocol from Aspera (www.asperasoft.com<http://www.asperasoft.com<UrlBlockedError.aspx>>) uses UDP, eliminating the latency issues seen with TCP, and provides bandwidth up to 1 gigabit per second (Gbps) to transfer data. It has a restart capability if data transfer is interrupted midstream and is well behaved, so if there is other data traffic on your network connections, it will back off in order to avoid starving other protocols. We have seen effective throughput up to 800 megabits per second (Mbps) to a single site.NCBI recommends getting the Aspera transfer plugin for your browser from the website, but this is little help to power users who have large command line/programmatic job queues. You can download the stand-alone Unix utility using the following command (h/t to Matt Shirley @ BioStars).
The fasp protocol uses UDP port 33001-33009 for data transfer and you may need to contact your IT security staff if this port is not open to NCBI through your institutional firewalls.
NCBI is implementing Aspera for two use cases, occasional users who download files for direct use (Aspera Connect), and bulk users who will be downloading large amounts of data (ascp)."
sh <(curl -s http://demo.asperasoft.com/ascp-install-220.127.116.11989-linux-64.sh)Or if that fails
chmod +x ascp-install-18.104.22.168989-linux-64.sh
Here is the usage message:
Usage: ascp [OPTION] SRC... DEST
SRC to DEST, or multiple SRC to DEST dir
SRC, DEST format: [[user@]host:]PATH
Then you can download SRA files with ease using a command such as this
ascp -l 1000m -O 33001 -T -i ~/.aspera/connect/etc/asperaweb_id_dsa.openssh firstname.lastname@example.org:/sra/sra-instant/reads/ByExp/sra/SRX/SRX306/SRX306097/SRR901180/SRR901180.sra /download/SRR901180.sra
-l MAX-RATE Max transfer rate
-O FASP-PORT UDP port used for FASP transportKeep in mind that the Private-key file name may be different on your system.
-T Disable encryption
-i PRIVATE-KEY-FILE Private-key file name (id_rsa)
On my fibre connection, I reached 370 MB/s, which is 20 fold better than my previous implementation of ftp using axel.