BwFileStorage wget

From Lsdf
Jump to navigationJump to search

Using wget from UNIX client

wget is a free utility for non-interactive download of files from the Web. It supports https protocol

For Help:

>man wget
or
>wget --help
...
HTTP options:
 --http-user=ka_xy1234     set http user to USER 
 --http-password='****'     set http password to PASS
...
Recursive download:
-r,  --recursive                    specify recursive download.
-l,  --level=NUMBER             maximum recursion depth (inf or 0 for infinite)
...


Examples:

Retrieve over https protocol of 'https://bwfilestorage.lsdf.kit.edu:/ka/ka_scc/ka_xy1234/myfile', saving it io ./.

>wget --http-user=ka_xy1234 --http-password='****' --secure-protocol=SSLv3 https://bwfilestorage.lsdf.kit.edu:/ka/ka_scc/ka_xy1234/myfile


Retrieve over https protocol first two levels of 'https://bwfilestorage.lsdf.kit.edu:/ka/ka_scc/ka_xy1234/mydir', saving them to ./temp.

>wget -P ./temp  --http-user=ka_xy1234 --http-password='****' -r -l 2 --secure-protocol=SSLv3 https://bwfilestorage.lsdf.kit.edu:/ka/ka_scc/ka_xy1234/mydir


Suppose you were in the middle of downloading, when wget was interrupted. Now you do not want to clobber the files already present. It would be:

>wget -P ./temp --http-user=ka_xy1234 --http-password='****' -nc -r -l 2 --secure-protocol=SSLv3 https://bwfilestorage.lsdf.kit.edu:/ka/ka_scc/ka_xy1234/mydir -o wget.log


If you wish wget to keep a mirror of a page use `--mirror' (`-m'),

>wget -P ./temp  --http-user=ka_xy1234 --http-password='****' -m -l 2 --secure-protocol=SSLv3 https://bwfilestorage.lsdf.kit.edu:/ka/ka_scc/ka_xy1234/mydir -o wget.log