hidden:DCache-to-HPSS: Difference between revisions

From Lsdf
Jump to navigationJump to search
(Created page with "===HOWTO - HPSS FUSE client machine=== * '''1. yum install fuse.x86_64''' * '''2. yum install fuse-libs.x86_64''' * '''3. Install hpss rpm's /*will be put on an exported nfs, ...")
 
No edit summary
 
(21 intermediate revisions by one other user not shown)
Line 2: Line 2:
* '''1. yum install fuse.x86_64'''
* '''1. yum install fuse.x86_64'''
* '''2. yum install fuse-libs.x86_64'''
* '''2. yum install fuse-libs.x86_64'''
* '''3. Install hpss rpm's /*will be put on an exported nfs, now a local copy*/'''
* '''3. Install hpss rpm's'''
**'''cd /root/Software/HPSS-7.4.3p2'''
**'''cd /vo/gridka/install/HPSS7.4.3p2'''
**4. [root@f01-151-104-e HPSS-7.4.3p2]# ls -l
**4. [root@f01-151-104-e HPSS-7.4.3p2]# ls -l hpss*
⚫
**-rw-r--r-- 1 root root 794028 Feb 6 14:26 hpss-clnt-7.4.3.2-0.el6.x86_64.rpm
**total 32000
**-rw-r--r-- 1 root root 845716 Mar 31 15:10 hpss-clnt-7.4.3.2-0.el6.x86_64.rpm
**-rw-r--r-- 1 root root 26077272 Feb 6 14:26 hpss-doc-7.4.3.2-0.el6.x86_64.rpm
**-rw-r--r-- 1 root root 26997776 Mar 31 15:10 hpss-doc-7.4.3.2-0.el6.x86_64.rpm
**-rw-r--r-- 1 root root 118524 Feb 6 14:47 hpssfs-fuse-2.0.1-0.el6.x86_64.rpm
**-rw-r--r-- 1 root root 464200 Mar 31 15:10 hpssfs-fuse-2.0.1-0.for_hpss_7.4.3p3.el6.x86_64.rpm
**-rw-r--r-- 1 root root 3472392 Feb 6 14:26 hpss-lib-7.4.3.2-0.el6.x86_64.rpm
**-rw-r--r-- 1 root root 3614332 Mar 31 15:10 hpss-lib-7.4.3.3-0.el6.x86_64.rpm
**-rw-r--r-- 1 root root 817704 Feb 6 14:26 hpss-lib-devel-7.4.3.2-0.el6.x86_64.rpm

⚫
**-rw-r--r-- 1 root root 834276 Mar 31 15:10 hpss-lib-devel-7.4.3.3-0.el6.x86_64.rpm
**'''rpm -ivh *'''
**'''rpm -ivh *'''
* '''6. ln -s /hpss_src/hpss-7.4.3.2-0.el6 /opt/hpss'''
* '''6. ln -s /hpss_src/hpss-7.4.3.2-0.el6 /opt/hpss'''

* '''NOTE: steps 7, 8, 8.1 only for the first GridKa machine'''
* '''7. Request a service account for GridKa: scc-dcache-0001'''
* '''7. Request a service account for GridKa: scc-dcache-0001'''
* '''8. Define the gridka principal scc-dcache-0001 in HPSS /*done by HPSS administrator*/
* '''8. Define the gridka principal scc-dcache-0001 in HPSS /*done by HPSS administrator*/
Line 18: Line 20:
-uid 220618 -gid 12345 -password XXXXXXXX -unixkeytab /var/hpss/etc/scc-dcache-0001.unix.keytab
-uid 220618 -gid 12345 -password XXXXXXXX -unixkeytab /var/hpss/etc/scc-dcache-0001.unix.keytab
-group "SCC-users-idm" -fullname "dcache-to-hpss"
-group "SCC-users-idm" -fullname "dcache-to-hpss"
* '''8. Update HPSS principal's password'''
* '''8.1 Update HPSS principal's password'''
**[root@hpsscr ~]# /opt/hpss/bin/hpss_unix_keytab -f /var/hpss/etc/scc-dcache-0001.unix.keytab -P update scc-dcache-0001'''
**[root@hpsscr ~]# /opt/hpss/bin/hpss_unix_keytab -f /var/hpss/etc/scc-dcache-0001.unix.keytab -P update scc-dcache-0001'''
*** >>>enter the password
*** >>>enter the password
*'''9. Create the same user account on the client machine'''
*'''9. Create a user on the client machine, user: dcache with the same uid and gid as in hpss'''
** adduser -m -d /home/scc-dcache-0001 -u 220618 -g 12345 -s /bin/bash -p XXXXXXXX -c "dcache-to-hpss" scc-dcache-0001
** adduser -m -d /home/dcache -u 220618 -g 12345 -s /bin/bash -p XXXXXXXX -c "dcache-to-hpss" dcache
** passwd scc-dcache-0001 /*put it encrypted in /etc/shadow*/
** passwd dcache /*put it encrypted in /etc/shadow*/
***>>>enter the password
***>>>enter the password
* '''10. Put the HPSS machines in /etc/hosts /*will be inserted in DNS*/ '''
* '''10. Put the HPSS machines in /etc/hosts /*will be inserted in DNS*/ '''
** # HPSS Hosts, Data Network
**'''#HPSS Hosts, Data Network'''
** 141.52.221.6 hpss.lsdf.kit.edu hpss hpsscr.lsdf.kit.edu hpsscr
**141.52.221.6 hpss.lsdf.kit.edu hpss hpsscr.lsdf.kit.edu hpsscr
** #141.52.221.6 hpss.lsdf.kit.edu hpss
**141.52.221.7 hpsscr01.lsdf.kit.edu hpsscr01 hpsscr01-d
** 141.52.221.7 hpsscr01.lsdf.kit.edu hpsscr01 hpsscr01-d
**141.52.221.8 hpsscr02.lsdf.kit.edu hpsscr02 hpsscr02-d
** 141.52.221.8 hpsscr02.lsdf.kit.edu hpsscr02 hpsscr02-d
**141.52.221.11 hpssmvr01.lsdf.kit.edu hpssmvr01 hpssmvr01-d
** 141.52.221.11 hpssmvr01.lsdf.kit.edu hpssmvr01 hpssmvr01-d
**141.52.221.12 hpssmvr02.lsdf.kit.edu hpssmvr02 hpssmvr02-d
** 141.52.221.12 hpssmvr02.lsdf.kit.edu hpssmvr02 hpssmvr02-d
**141.52.221.13 hpssmvr03.lsdf.kit.edu hpssmvr03 hpssmvr03-d
** 141.52.221.13 hpssmvr03.lsdf.kit.edu hpssmvr03 hpssmvr03-d
**192.108.47.248 hpssmvr04.lsdf.kit.edu hpssmvr04 hpssmvr04-d
** 10.97.202.14 hpssmvr04.lsdf.kit.edu hpssmvr04 hpssmvr04-d
**141.52.221.50 hpsstcr03.lsdf.kit.edu hpsstcr03 hpsstcr03-d
** 141.52.221.50 hpsstcr03.lsdf.kit.edu hpsstcr03 hpsstcr03-d
**141.52.221.51 hpsstmvr.lsdf.kit.edu hpsstmvr hpsstmvr-d
** 141.52.221.51 hpsstmvr.lsdf.kit.edu hpsstmvr hpsstmvr-d
** 10.97.203.15 hpssmvr05-d.lsdf.kit.edu hpssmvr05-d


* '''11. Copy the following files from hpsscr:/var/hpss/etc/ to f0-151-104:/var/hpss/etc/'''
* '''11. Copy the following files from /vo/gridka/install/HPSS7.4.3p2 to f0-151-104:/var/hpss/etc/'''
** core_server env.conf ep.conf ftpaccess ftpbanner ftpusers HPSS.conf ieee_802_addr mover_list site.conf
** auth.conf authz.conf core_server env.conf ep.conf ftpaccess ftpbanner ftpusers HPSS.conf ieee_802_addr mover_list site.conf
*'''12. copy the user key table from hpsscr:/var/hpss/etc/scc-dcache-0001.unix.keytab to f01-151-104:/home/scc-dcache-001/'''
*'''12. copy the user key table from hpsscr:/var/hpss/etc/scc-dcache-0001.unix.keytab to f01-151-104:/home/dcache/'''
*'''13. chown scc-dcache-0001. scc-dcache-0001.unix.keytab; chmod 600 scc-dcache-0001.unix.keytab'''
*'''13. chown dcache. scc-dcache-0001.unix.keytab; chmod 600 scc-dcache-0001.unix.keytab'''
* '''14. Modify /var/hpss/etc/env.conf'''
* '''14. Modify /var/hpss/etc/env.conf'''
** #HPSS_API_HOSTNAME=hpsstcr03.lsdf.kit.edu
** #HPSS_API_HOSTNAME=hpsstcr03.lsdf.kit.edu
** HPSS_API_HOSTNAME=f01-151-104
** HPSS_API_HOSTNAME=f01-151-104-e
** HPSS_PRIMARY_AUTHENTICATOR=auth_keytab:/home/dcache/scc-dcache-0001.unix.keytab
*'''15. mkdir /mnt/hpss; cd /mnt'''
*'''15. mkdir /mnt/hpss; cd /mnt'''
*'''16. chown scc-dcache-0001. hpss'''
*'''16. chown dcache. hpss'''
*'''17. chmod 700 hpss'''
*'''17. chmod 700 hpss'''
*'''18.Mount HPSS
*'''18.Mount HPSS
**add scc-dcache-0001 to the FUSE group /*RedHat peculiarity*/
**add dcache to the FUSE group /*RedHat peculiarity*/
**su - scc-dcache-0001
**su - dcache
**hpssfs -ocos=123,stream=16,princ=scc-dcache-0001,auth=auth_keytab:/home/scc-dcache-0001/scc-dcache-0001.unix.keytab,family=11 /hpss/gridka /mnt/hpss
**hpssfs -ocos=123,stream=16,princ=scc-dcache-0001,auth=auth_keytab:/home/dcache/scc-dcache-0001.unix.keytab,family=11 /hpss/gridka /mnt/hpss
**'''unmount if necessary:'''
**'''unmount if necessary:'''
***fusermount -u /mnt/hpss
***fusermount -u /mnt/hpss
Line 59: Line 60:
** GridKa Firewall Context: permit f01-151-104-e access to 141.52.221.50 /*ip hpss core*/
** GridKa Firewall Context: permit f01-151-104-e access to 141.52.221.50 /*ip hpss core*/
** LSDF Router: permit f01-151-104-e access to 141.52.221.50 /*ip hpss core*/
** LSDF Router: permit f01-151-104-e access to 141.52.221.50 /*ip hpss core*/


----[[ hidden:HPSS|<small>back to HPPS main page</small>]]

Latest revision as of 09:32, 26 July 2017

HOWTO - HPSS FUSE client machine

  • 1. yum install fuse.x86_64
  • 2. yum install fuse-libs.x86_64
  • 3. Install hpss rpm's
    • cd /vo/gridka/install/HPSS7.4.3p2
    • 4. [root@f01-151-104-e HPSS-7.4.3p2]# ls -l hpss*
    • -rw-r--r-- 1 root root 794028 Feb 6 14:26 hpss-clnt-7.4.3.2-0.el6.x86_64.rpm
    • -rw-r--r-- 1 root root 26077272 Feb 6 14:26 hpss-doc-7.4.3.2-0.el6.x86_64.rpm
    • -rw-r--r-- 1 root root 118524 Feb 6 14:47 hpssfs-fuse-2.0.1-0.el6.x86_64.rpm
    • -rw-r--r-- 1 root root 3472392 Feb 6 14:26 hpss-lib-7.4.3.2-0.el6.x86_64.rpm
    • -rw-r--r-- 1 root root 817704 Feb 6 14:26 hpss-lib-devel-7.4.3.2-0.el6.x86_64.rpm
    • rpm -ivh *
  • 6. ln -s /hpss_src/hpss-7.4.3.2-0.el6 /opt/hpss
  • NOTE: steps 7, 8, 8.1 only for the first GridKa machine
  • 7. Request a service account for GridKa: scc-dcache-0001
  • 8. Define the gridka principal scc-dcache-0001 in HPSS /*done by HPSS administrator*/
    /opt/hpss/bin/hpssuser -add scc-dcache-0001 -unix -ftp -home /hpss/gridka -hpsshome /hpss/gridka -shell /sbin/nologin 
    -uid 220618 -gid 12345 -password XXXXXXXX -unixkeytab /var/hpss/etc/scc-dcache-0001.unix.keytab 
    -group "SCC-users-idm" -fullname "dcache-to-hpss"
  • 8.1 Update HPSS principal's password
    • [root@hpsscr ~]# /opt/hpss/bin/hpss_unix_keytab -f /var/hpss/etc/scc-dcache-0001.unix.keytab -P update scc-dcache-0001
      • >>>enter the password
  • 9. Create a user on the client machine, user: dcache with the same uid and gid as in hpss
    • adduser -m -d /home/dcache -u 220618 -g 12345 -s /bin/bash -p XXXXXXXX -c "dcache-to-hpss" dcache
    • passwd dcache /*put it encrypted in /etc/shadow*/
      • >>>enter the password
  • 10. Put the HPSS machines in /etc/hosts /*will be inserted in DNS*/
    • #HPSS Hosts, Data Network
    • 141.52.221.6 hpss.lsdf.kit.edu hpss hpsscr.lsdf.kit.edu hpsscr
    • 141.52.221.7 hpsscr01.lsdf.kit.edu hpsscr01 hpsscr01-d
    • 141.52.221.8 hpsscr02.lsdf.kit.edu hpsscr02 hpsscr02-d
    • 141.52.221.11 hpssmvr01.lsdf.kit.edu hpssmvr01 hpssmvr01-d
    • 141.52.221.12 hpssmvr02.lsdf.kit.edu hpssmvr02 hpssmvr02-d
    • 141.52.221.13 hpssmvr03.lsdf.kit.edu hpssmvr03 hpssmvr03-d
    • 192.108.47.248 hpssmvr04.lsdf.kit.edu hpssmvr04 hpssmvr04-d
    • 141.52.221.50 hpsstcr03.lsdf.kit.edu hpsstcr03 hpsstcr03-d
    • 141.52.221.51 hpsstmvr.lsdf.kit.edu hpsstmvr hpsstmvr-d
  • 11. Copy the following files from /vo/gridka/install/HPSS7.4.3p2 to f0-151-104:/var/hpss/etc/
    • auth.conf authz.conf core_server env.conf ep.conf ftpaccess ftpbanner ftpusers HPSS.conf ieee_802_addr mover_list site.conf
  • 12. copy the user key table from hpsscr:/var/hpss/etc/scc-dcache-0001.unix.keytab to f01-151-104:/home/dcache/
  • 13. chown dcache. scc-dcache-0001.unix.keytab; chmod 600 scc-dcache-0001.unix.keytab
  • 14. Modify /var/hpss/etc/env.conf
    • #HPSS_API_HOSTNAME=hpsstcr03.lsdf.kit.edu
    • HPSS_API_HOSTNAME=f01-151-104-e
    • HPSS_PRIMARY_AUTHENTICATOR=auth_keytab:/home/dcache/scc-dcache-0001.unix.keytab
  • 15. mkdir /mnt/hpss; cd /mnt
  • 16. chown dcache. hpss
  • 17. chmod 700 hpss
  • 18.Mount HPSS
    • add dcache to the FUSE group /*RedHat peculiarity*/
    • su - dcache
    • hpssfs -ocos=123,stream=16,princ=scc-dcache-0001,auth=auth_keytab:/home/dcache/scc-dcache-0001.unix.keytab,family=11 /hpss/gridka /mnt/hpss
    • unmount if necessary:
      • fusermount -u /mnt/hpss
  • 12.Steps to be done on GridKA Firewall and LSDF Router /*done by network compartment*/
    • GridKa Firewall Context: permit f01-151-104-e access to 141.52.221.50 /*ip hpss core*/
    • LSDF Router: permit f01-151-104-e access to 141.52.221.50 /*ip hpss core*/


back to HPPS main page

Retrieved from "https://wiki.scc.kit.edu/lsdf/index.php?title=hidden:DCache-to-HPSS&oldid=4922"