HPSS Frontends setup: Difference between revisions

From Lsdf
Jump to navigationJump to search
(Created page with " == Required Software == Lots of packages can be found in the epel repository. Better to install it. # yum install epel-release For HPSS also needed: # yum install ...")
 
 
(7 intermediate revisions by 2 users not shown)
Line 1: Line 1:
Hosts that will run the hpss client/API must have several packages and files installed.


== Required Software ==
== Required Package ==
Lots of packages can be found in the epel repository. Better to install it.
Lots of packages can be found in the EPEL (Extra Packages for Enterprise Linux) repository. Better to install it.


# yum install epel-release
# yum install epel-release
Line 7: Line 8:
For HPSS also needed:
For HPSS also needed:


# yum install ksh
# yum install libtirpc libtirpc-devel
# yum install libtirpc libtirpc-devel


== HPSS Software download ==
== HPSS Software download ==
Line 14: Line 15:
https://hpss-collaboration.clearlake.ibm.com/adminwiki/doku.php
https://hpss-collaboration.clearlake.ibm.com/adminwiki/doku.php


Path to rpms: HPSS Admin Wiki/docs/rpms/<release>
Path to rpms: HPSS Admin Wiki -> docs -> rpms -> <release>



== Installation ==
== Installation ==
Line 23: Line 23:
Create a hpss group
Create a hpss group


<pre>
# groupadd -g 300 hpss
# groupadd -g 300 hpss
</pre>



Install
Install
Line 43: Line 44:
Configuration files in /var/hpss/etc
Configuration files in /var/hpss/etc


Copy ONLY needed files from CoreServer or other Frontend hosts
Copy ONLY needed files from core server or other frontend/client hosts.


# ls /var/hpss/etc
# ls /var/hpss/etc
Line 50: Line 51:
Adapt /var/hpss/etc/env.conf
Adapt /var/hpss/etc/env.conf


# HPSS_API_HOSTNAME=<hostname of this Frontend host>
# HPSS_API_HOSTNAME=<hostname of this frontend/client host>


The contents of the file HPSS.conf can be used to set options for PFTP and other clients (e.g. scrub). It's a common place for settings that are grouped in stanzas. Setting network params for WAN connections is done here.
TODO:
Check if HPSS.conf is it needed? For my own tests it was not!!
Adapt HPSS.conf the client network options!!!
only to adapt if long distances betweek client and HPSS system


== /etc/hosts ==
User Keytab


Since the HPSS Server Nodes are not in KIT DNS the /etc/hosts file on the Frontend host should be adapted like follows:
A User keytab file must be copied into the User home directory!!!

# HPSS Production Hosts, Data Network
141.52.221.6 hpss.lsdf.kit.edu hpss hpsscr.lsdf.kit.edu hpsscr
141.52.221.7 hpsscr01.lsdf.kit.edu hpsscr01 hpsscr01-d
141.52.221.8 hpsscr02.lsdf.kit.edu hpsscr02 hpsscr02-d
141.52.221.11 hpssmvr01.lsdf.kit.edu hpssmvr01 hpssmvr01-d
141.52.221.12 hpssmvr02.lsdf.kit.edu hpssmvr02 hpssmvr02-d
141.52.221.13 hpssmvr03.lsdf.kit.edu hpssmvr03 hpssmvr03-d
10.97.202.14 hpssmvr04.lsdf.kit.edu hpssmvr04 hpssmvr04-d
# HPSS Test system
141.52.221.50 hpsstcr03.lsdf.kit.edu hpsstcr03 hpsstcr03-d
141.52.221.51 hpsstmvr.lsdf.kit.edu hpsstmvr hpsstmvr-d

== User Keytab ==

A User keytab file must be copied into the user directory and have minimal permissions


# -rw------- 1 <user> <group> <user>.unix.keytab
# -rw------- 1 <user> <group> <user>.unix.keytab

the following global variable can be used to direct clients to the keytab

# export HPSS_UNIX_KEYTAB_FILE=/home/jvw/HPSS/jvw.unix.keytab




TODO:
TODO:
If Fronend outside LSDF-KIT Network, which ports to open to core and movers?
If the frontend/client is outside the LSDF-KIT network, which ports to open to core and movers?

Latest revision as of 10:43, 15 April 2015

Hosts that will run the hpss client/API must have several packages and files installed.

Required Package

Lots of packages can be found in the EPEL (Extra Packages for Enterprise Linux) repository. Better to install it.

   # yum install epel-release

For HPSS also needed:

   # yum install ksh
   # yum install libtirpc libtirpc-devel

HPSS Software download

https://hpss-collaboration.clearlake.ibm.com/adminwiki/doku.php

Path to rpms: HPSS Admin Wiki -> docs -> rpms -> <release>

Installation

Don't update hpss software, to keep old rpms. Always use rpm -i Option and not -U.

Create a hpss group

    # groupadd -g 300 hpss

Install

   # rpm -ivh hpss-lib-7.4.3.1-0.el6.x86_64
   # rpm -ivh hpss-lib-devel-7.4.3.1-0.el6.x86_64
   # rpm -ivh hpss-clnt-7.4.3.1-0.el6.x86_64
   # rpm -ivh hpss-doc-7.4.3.1-0.el6.x86_64

Configuration

Remove old /opt/hpss link if exists

   # rm /opt/hpss

Create new soft link

   # ln -s /hpss_src/hpss-7.4.3.1-0.el6 /opt/hpss

Configuration files in /var/hpss/etc

Copy ONLY needed files from core server or other frontend/client hosts.

   # ls /var/hpss/etc
   auth.conf  authz.conf  env.conf  ep.conf  hpss.unix.keytab  site.conf

Adapt /var/hpss/etc/env.conf

   # HPSS_API_HOSTNAME=<hostname of this frontend/client host>

The contents of the file HPSS.conf can be used to set options for PFTP and other clients (e.g. scrub). It's a common place for settings that are grouped in stanzas. Setting network params for WAN connections is done here.

/etc/hosts

Since the HPSS Server Nodes are not in KIT DNS the /etc/hosts file on the Frontend host should be adapted like follows:

   # HPSS Production Hosts, Data Network
   141.52.221.6    hpss.lsdf.kit.edu hpss hpsscr.lsdf.kit.edu hpsscr
   141.52.221.7    hpsscr01.lsdf.kit.edu hpsscr01 hpsscr01-d
   141.52.221.8    hpsscr02.lsdf.kit.edu hpsscr02 hpsscr02-d
   141.52.221.11   hpssmvr01.lsdf.kit.edu hpssmvr01 hpssmvr01-d
   141.52.221.12   hpssmvr02.lsdf.kit.edu hpssmvr02 hpssmvr02-d
   141.52.221.13   hpssmvr03.lsdf.kit.edu hpssmvr03 hpssmvr03-d
   10.97.202.14    hpssmvr04.lsdf.kit.edu hpssmvr04 hpssmvr04-d 
   # HPSS Test system
   141.52.221.50   hpsstcr03.lsdf.kit.edu hpsstcr03 hpsstcr03-d
   141.52.221.51   hpsstmvr.lsdf.kit.edu hpsstmvr hpsstmvr-d

User Keytab

A User keytab file must be copied into the user directory and have minimal permissions

   # -rw------- 1 <user> <group> <user>.unix.keytab

the following global variable can be used to direct clients to the keytab

   # export HPSS_UNIX_KEYTAB_FILE=/home/jvw/HPSS/jvw.unix.keytab


TODO: If the frontend/client is outside the LSDF-KIT network, which ports to open to core and movers?