Difference between revisions of "MON"

From Gridkaschool
(Created page with "'''Please note that the MonBox is deprecated'''. It is part of the gLite 3.1 release and requires a Scientific Linux 4 (32bit). In gLite 3.2 this service is replaced by the [[Ape…")
 
 
Line 3: Line 3:
 
On the MonBox all jobs are accounted. In the MySQL server information from the batch jobs and the grid jobs are colltected and combined. Finally they are published to a central RGMA server.
 
On the MonBox all jobs are accounted. In the MySQL server information from the batch jobs and the grid jobs are colltected and combined. Finally they are published to a central RGMA server.
   
[[Bild:MON.png]]
+
[[File:MON.png]]
   
 
=Services and Ports=
 
=Services and Ports=

Latest revision as of 17:57, 28 December 2012

Please note that the MonBox is deprecated. It is part of the gLite 3.1 release and requires a Scientific Linux 4 (32bit). In gLite 3.2 this service is replaced by the ApelBox.


On the MonBox all jobs are accounted. In the MySQL server information from the batch jobs and the grid jobs are colltected and combined. Finally they are published to a central RGMA server.

MON.png

Services and Ports

Installation of glite-MON

Repositories

The repositories are placed in directory /etc/yum.repos.d/.

cd /etc/yum.repos.d/
rm -f dag.repo

All yum *.repos are available at http://grid-deployment.web.cern.ch/grid-deployment/glite/repos/

The needed repositories are:

  • dag.repo
  • glite-MON.repo
  • lcg-CA.repo
  • jpackage.repo

Get them with

wget http://grid-deployment.web.cern.ch/grid-deployment/glite/repos/3.1/dag.repo
wget http://grid-deployment.web.cern.ch/grid-deployment/glite/repos/3.1/glite-MON.repo
wget http://grid-deployment.web.cern.ch/grid-deployment/glite/repos/3.1/lcg-CA.repo
wget http://grid-deployment.web.cern.ch/grid-deployment/glite/repos/3.1/jpackage.repo

Installing the packages

Now the software has to be installed.

yum install mysql-server
yum install glite-MON lcg-CA

Configuration

As for most grid services you need a host certificate for the MonBox with the right permissions. You can follow the instructions on this page.

Variables

Before the configuration script can be run the site-info.def has to be adapted. Required Variables are (replace the xxx with the right suffix):

SITE_NAME=GKSxxx                           # xxx = suffix of your site BDII
MON_HOST=gks-0-xxx.$MY_DOMAIN              # The hostname of your MonBox
REG_HOST                                   # leave the default
JAVA_LOCATION="/usr/java/latest"           # java location         
SITE_BDII_HOST=gks-0-xxx.$MY_DOMAIN        # hostname of your site BDII
GRIDICE_SERVER_HOST=$MON_HOST              #
CE_HOST=gks-0-xxx.$MY_DOMAIN               # name of your CE host
APEL_DB_PASSWORD="APELDB_PWD"              # Leave the default
MYSQL_PASSWORD="koala"                     # Choose any password

Functions

The functions used are:

MON_FUNCTIONS="
  config_ldconf
  config_sysconfig_edg
  config_edgusers
  config_glite_env
  config_crl
  config_bdii_only
  config_gip_mon
  config_gip_only
  config_rgma_client
  config_rgma_server
  config_rgma_gin
  config_apel_rgma
"

Configuration with yaim

Now, the configuration is done by yaim:

/opt/glite/yaim/bin/yaim -c -s "site-info.def" -n glite-MON

Tests

RGMA Tests

There are two rgma checks available on the host. To start those tests, some variables have to be set first.

export RGMA_HOME=/opt/glite
export APEL_HOME=$RGMA_HOME
export TRUSTFILE=/opt/glite/etc/rgma/ClientAuthentication.props

Now the tests can be run.

/opt/glite/bin/rgma-server-check
/opt/glite/bin/rgma-client-check

Accounting Test

The mysql table containing the accounting data can be checked. This can be done after submitting a job to your CE and the data was published to your monbox. This publishing is normally a cron-job run on your CE, but can also be run manually. Login to your CE and run:

env RGMA_HOME=/opt/glite APEL_HOME=/opt/glite /opt/glite/bin/apel-pbs-log-parser \
   -f /opt/glite/etc/glite-apel-pbs/parser-config-yaim.xml >> /var/log/apel.log 2>&1  

The publishing logfile is located in /var/log/apel.log Afterwards, it is possible to check the contents of the mysql database on your monbox. Login to your monbox and connect to your database via mysql -p, enter your database password and change the current database:

mysql -p
#enter your password...
use accounting;

The following commands should produce an output containg your job-submission data (this should be at least one dataset):

select TimeStamp, GlobalUserName, JobName from BlahdRecords;

Output:

+---------------------+--------------------------------------------+------------------------------+
| TimeStamp           | GlobalUserName                             | JobName                      |
+---------------------+--------------------------------------------+------------------------------+
| 2008-09-01 13:04:41 | /C=DE/O=GermanGrid/OU=dech-school/CN=gs101 | 1.gks-0-054.fzk.de.gks-0-054 |
| 2008-09-01 13:26:09 | /C=DE/O=GermanGrid/OU=dech-school/CN=gs101 | 2.gks-0-054.fzk.de.gks-0-054 |
| 2008-09-01 13:58:03 | /C=DE/O=GermanGrid/OU=dech-school/CN=gs101 | 3.gks-0-054.fzk.de.gks-0-054 |
+---------------------+--------------------------------------------+------------------------------+
3 rows in set (0.00 sec)

Query:

select SiteName,JobName,StartTime from EventRecords;

Output:

+--------------+--------------------+----------------------+
| SiteName     | JobName            | StartTime            |
+--------------+--------------------+----------------------+
| GKSxxx       | 0.gks-0-054.fzk.de | 2008-09-01T09:23:25Z |
| GKSxxx       | 1.gks-0-054.fzk.de | 2008-09-01T13:04:43Z |
| GKSxxx       | 2.gks-0-054.fzk.de | 2008-09-01T13:26:11Z |
| GKSxxx       | 3.gks-0-054.fzk.de | 2008-09-01T13:58:05Z |
+--------------+--------------------+----------------------+

Go back to gLite Administration Course