LFTP tests

From Lsdf
Revision as of 20:06, 14 August 2016 by Jvw (talk | contribs)
Jump to navigationJump to search
The printable version is no longer supported and may have rendering errors. Please update your browser bookmarks and please use the default browser print function instead.

Tests

TransferMatrix to HPSS FUSE MOUNT
Client OS Direction #of proc/streams #of files lftp(MB/s) sftp(MB/s) scp(MB/s) rsync(MB/s)
LINUX Upload 1 1 76.38 79 77 85
5 5 268
12 15 317
15 15 330
LINUX Download 1 1 68 67 94 95
5 1 213
12 1 176
15 1 301

LFTP intro

LFTP Documentation can be found here http://lftp.yar.ru/

Install lftp using your distribution package management tool (e.g yum)

 yum install lftp
 sudo apt-get install lftp

Log in with your archive account

 lftp -u AAnnnn sftp://archive-sftp.lsdf.kit.edu
 Password:your secret password

Upload a local file(lfile) to a remote file(rfile):

 lftp>put lfile -o rfile

Upload (mirror reverse -R) a local directory(ldir) to a remote directory(rdir) using n processes:

 lftp>mirror -c -R -Pn ldir rdir

Download a remote directory using pget(nn streams) for every single file:

 lftp>mirror -c --use-pget-n=n rdir ldir