hidden:HPSS Configuration: Difference between revisions

From Lsdf
Jump to navigationJump to search
mNo edit summary
mNo edit summary
 
(One intermediate revision by the same user not shown)
Line 1: Line 1:
==Class of service list==
==Class of service (COS) list==
extracted on Mon Nov 14 17:34:43 CET 2016 with hpss_ls -cos
extracted on Mon Nov 14 17:34:43 CET 2016 with hpss_ls -cos


Line 32: Line 32:
E=Enforce Maximum File Size F=Force Selection
E=Enforce Maximum File Size F=Force Selection
S=Auto Stage Retry R=Auto Read Retry T=Truncate Final Segment
S=Auto Stage Retry R=Auto Read Retry T=Truncate Final Segment
</pre>

==Hierarchy list==
extracted on Mon Nov 14 17:34:43 CET 2016 with hpss_ls -hier

<pre>

Hier #
ID Description Lev Storage Class IDs
---- ---------------------------------------- --- --------------------
1 Default - No Storage 1 1
102 GridKa - Medium LTO4 2 12 -> 101
103 GridKa - Large LTO4 2 13 -> 101
112 GridKa - Medium LTO5 2 12 -> 102
113 GridKa - Large LTO5 2 13 -> 102
122 GridKa - Medium T10kD 2 12 -> 103
123 GridKa - Large T10kD 2 13 -> 103
1101 Small 2 21 -> 201
1102 Medium 2 22 -> 204
1103 Large 2 23 -> 204
1201 Small - 2 Copies 3 21 -> 201
-> 202
1202 Medium - 2 Copies 3 22 -> 201
-> 202
1203 Large - 2 Copies 3 23 -> 201
-> 202
1204 L2CTS1140T10KD 3 23 -> 204
-> 205
1205 M2CT10KDTS1140 3 22 -> 204
-> 205
1206 HierBQ 3 21 -> 204
-> 205
1301 Small - 3 Copies 4 21 -> 201
-> 202
-> 203
1302 Medium - 3 Copies 4 22 -> 201
-> 202
-> 203
1303 Large - 3 Copies 4 23 -> 201
-> 202
-> 203
1401 GHI Metadata 3 31 -> 204
-> 205
---- ---------------------------------------- --- --------------------
</pre>

==List of Storage Classes ==
extracted on Mon Nov 14 17:34:43 CET 2016 with hpss_ls -cos

<pre>
- DISK STORAGE CLASS LIST -

SSeg Est Media Threshold Mig Prg
SC Media Size Avg # PV Str Block (volumes) Pol Pol
ID Name Type min/max SSegs Size VVBS Wid Size Wrn/Crt ID ID
------ ----------------------------------- ------------------------- ----- ----- ----- ------ ---------- --- ----- ---- ---- --- ---
1 Default - No Storage Default Disk 4kB 4kB 1 512MB 4kB 1 4kB 80 90 0 0
12 GridKa - Medium Default Disk 1MB 64MB 1 11718818256kB 1MB 1 4kB 80 90 12 12
13 GridKa - Large Default Disk 128MB 4GB 1 11718818256kB 128MB 1 4kB 80 90 13 13
21 Small Default Disk 32kB 1MB 1 11718818256kB 32kB 1 4kB 80 90 21 21
22 Medium Default Disk 1MB 64MB 1 11718818256kB 1MB 1 4kB 80 90 22 22
23 Large Default Disk 128MB 4GB 1 11718818256kB 128MB 1 4kB 80 90 23 23
31 GHI Default Disk 128kB 1GB 1 11718818256kB 128kB 1 4kB 80 90 31 31
------ ----------------------------------- ------------------------- ----- ----- ----- ------ ---------- --- ----- ---- ---- --- ---
VVBS=Virtual Volume Block Size


Opt Stripe Segments
SC Access Stripe Transfer Multiplier in VV
ID Name Size Length VV Size Rate(kB/sec) min/max min/max
------ ----------------------------------- ------- ------- -------- ------------ ----- ----- ----- -----
1 Default - No Storage 0 4kB 512MB 3072 1 1 131072 131072
12 GridKa - Medium 0 1MB 11718818256kB 3072 1 64 178814 11444158
13 GridKa - Large 0 128MB 11718818256kB 3072 1 32 2793 89407
21 Small 0 32kB 11718818256kB 3072 1 32 11444158 366213070
22 Medium 0 1MB 11718818256kB 3072 1 64 178814 11444158
23 Large 0 128MB 11718818256kB 3072 1 32 2793 89407
31 GHI 0 128kB 11718818256kB 3072 1 8192 11175 91553267
------ ----------------------------------- ------- ------- -------- ------------ ----- ----- ----- -----


- TAPE STORAGE CLASS LIST-

Media Est Data Parity Min Num of Threshold Mig
SC Media Block PV Stripe Stripe Write RAIT (volumes) Pol
ID Name Type Size Size Width Width Parity Engines VVBS BBTM Warn Crit ID
------ ----------------------------------- ------------------------- ----- ------ ------ ------ ------- ------- ----- ----- ---- ---- ---
101 GridKa-LTO4 3580 Gen4 Tape 256kB 800GB 1 0 0 0 1MB 21600 1 0 0
102 GridKa-LTO5 3580 Gen5 Tape 256kB 1500GB 1 0 0 0 1MB 25200 1 0 0
103 GridKa-T10kD Titanium 10000D Tape 256kB 8000GB 1 0 0 0 1MB 45720 1 0 0
201 General - Primary Copy 3580 Gen5 Tape 256kB 1500GB 1 0 0 0 1MB 25200 1 0 0
202 General - Second Copy 3580 Gen5 Tape 256kB 1500GB 1 0 0 0 1MB 25200 1 0 0
203 General - Third Copy 3580 Gen5 Tape 256kB 1500GB 1 0 0 0 1MB 25200 1 0 0
204 General - Primary Copy T10KD Titanium 10000D Tape 256kB 8000GB 1 0 0 0 1MB 45720 1 0 0
205 General - Second Copy TS1140 3592 E07 XL Tape 256kB 4000GB 1 0 0 0 1MB 43200 1 0 0
------ ----------------------------------- ------------------------- ----- ------ ------ ------ ------- ------- ----- ----- ---- ---- ---
BBTM=Blocks Between Tape Marks
VVBS=Virtual Volume Block Size


- TAPE STORAGE CLASS LIST cont'd-

Max Avg Stripe Opt Read Mount
SC VVs to VV Latency Stripe Transfer Access Verification Minimum
ID Name Write Size (sec) Length Rate(kB/s) Size SBTM PVs
------ ----------------------------------- --------- ------ ---------- ------- ------------ --------- ---- ------------ -------
101 GridKa-LTO4 1 800GB 20 1MB 122880 0 45 off off
102 GridKa-LTO5 1 1500GB 20 1MB 143360 0 45 off off
103 GridKa-T10kD 1 8000GB 20 1MB 260096 0 45 off off
201 General - Primary Copy 5 1500GB 20 1MB 143360 0 45 off off
202 General - Second Copy 3 1500GB 20 1MB 143360 0 45 off off
203 General - Third Copy 3 1500GB 20 1MB 143360 0 45 off off
204 General - Primary Copy T10KD 5 8000GB 20 1MB 260096 0 45 off off
205 General - Second Copy TS1140 3 4000GB 20 1MB 245760 0 45 off off
------ ----------------------------------- --------- ------ ---------- ------- ------------ --------- ---- ------------ -------
SBTM=Seconds Between Tape Marks

</pre>
</pre>


Latest revision as of 18:41, 14 November 2016

Class of service (COS) list

extracted on Mon Nov 14 17:34:43 CET 2016 with hpss_ls -cos 

COS    COS                                      Hier Stage   File Size    Allocation                     Class
ID     Name                                     ID   Code   (min) (max)   Method                         Flags
------ ---------------------------------------- ---- ---- ------- ------- ------------------------------ ----------
1      Default - No Storage                     1    O          0 0       Variable Length                E---T
102    GridKa - Medium LTO4                     102  O          0 128MB   Variable Length                -FSRT
103    GridKa - Large LTO4                      103  O      128MB 1TB     Variable Length                EFSRT
112    GridKa - Medium LTO5                     112  O          0 128MB   Variable Length                EFSRT
113    GridKa - Large LTO5                      113  O      128MB 1TB     Variable Length                EFSRT
122    GridKa - Medium T10kD                    122  O          0 128MB   Variable Length                EFSRT
123    GridKa - Large T10kD                     123  O      128MB 1TB     Variable Length                EFSRT
1101   Small                                    1101 O          0 1MB     Variable Length                -FSRT
1102   Medium                                   1102 O        1MB 128MB   Variable Length                -FSRT
1103   Large                                    1103 O      128MB 1TB     Variable Length                --S-T
1201   Small - 2 Copies                         1201 O          0 1MB     Variable Length                E-SRT
1202   Medium - 2 Copies                        1202 O        1MB 128MB   Variable Length                E-SRT
1203   Large - 2 Copies                         1203 O      128MB 1TB     Variable Length                E-SRT
1204   L2CTS1140T10KD                           1204 O          0 2TB     Variable Length                E-SRT
1205   M2CT10KDTS1140                           1205 O          0 600GB   Variable Length                E-SRT
1206   COSBQ                                    1206 O          0 10GB    Variable Length                E-SRT
1301   Small - 3 Copies                         1301 O          0 1MB     Variable Length                EFSRT
1302   Medium - 3 Copies                        1302 O        1MB 128MB   Variable Length                EFSRT
1303   Large - 3 Copies                         1303 O      128MB 1TB     Variable Length                EFSRT
1401   GHI Metadata                             1401 O          0 4GB     Variable Length                -FSRT
------ ---------------------------------------- ---- ---- ------- ------- ------------------------------ ----------
SC=Stage Code (N=none, O=on open, A=async, B=background)

Class Flags: EFSRT
E=Enforce Maximum File Size        F=Force Selection
S=Auto Stage Retry   R=Auto Read Retry     T=Truncate Final Segment

Hierarchy list

extracted on Mon Nov 14 17:34:43 CET 2016 with hpss_ls -hier 


Hier                                          #
ID   Description                              Lev Storage Class IDs
---- ---------------------------------------- --- --------------------
1    Default - No Storage                     1     1
102  GridKa - Medium LTO4                     2    12 -> 101
103  GridKa - Large LTO4                      2    13 -> 101
112  GridKa - Medium LTO5                     2    12 -> 102
113  GridKa - Large LTO5                      2    13 -> 102
122  GridKa - Medium T10kD                    2    12 -> 103
123  GridKa - Large T10kD                     2    13 -> 103
1101 Small                                    2    21 -> 201
1102 Medium                                   2    22 -> 204
1103 Large                                    2    23 -> 204
1201 Small - 2 Copies                         3    21 -> 201
                                                      -> 202
1202 Medium - 2 Copies                        3    22 -> 201
                                                      -> 202
1203 Large - 2 Copies                         3    23 -> 201
                                                      -> 202
1204 L2CTS1140T10KD                           3    23 -> 204
                                                      -> 205
1205 M2CT10KDTS1140                           3    22 -> 204
                                                      -> 205
1206 HierBQ                                   3    21 -> 204
                                                      -> 205
1301 Small - 3 Copies                         4    21 -> 201
                                                      -> 202
                                                      -> 203
1302 Medium - 3 Copies                        4    22 -> 201
                                                      -> 202
                                                      -> 203
1303 Large - 3 Copies                         4    23 -> 201
                                                      -> 202
                                                      -> 203
1401 GHI Metadata                             3    31 -> 204
                                                      -> 205
---- ---------------------------------------- --- --------------------

List of Storage Classes

extracted on Mon Nov 14 17:34:43 CET 2016 with hpss_ls -cos 

- DISK STORAGE CLASS LIST  -

                                                                        SSeg           Est                   Media Threshold Mig Prg
SC                                         Media                        Size     Avg # PV                Str Block (volumes) Pol Pol
ID     Name                                Type                        min/max   SSegs Size   VVBS       Wid Size   Wrn/Crt  ID  ID
------ ----------------------------------- ------------------------- ----- ----- ----- ------ ---------- --- ----- ---- ---- --- ---
1      Default - No Storage                Default Disk                4kB 4kB   1     512MB  4kB        1   4kB     80 90   0   0
12     GridKa - Medium                     Default Disk                1MB 64MB  1    11718818256kB  1MB        1   4kB     80 90   12  12
13     GridKa - Large                      Default Disk              128MB 4GB   1    11718818256kB  128MB      1   4kB     80 90   13  13
21     Small                               Default Disk               32kB 1MB   1    11718818256kB  32kB       1   4kB     80 90   21  21
22     Medium                              Default Disk                1MB 64MB  1    11718818256kB  1MB        1   4kB     80 90   22  22
23     Large                               Default Disk              128MB 4GB   1    11718818256kB  128MB      1   4kB     80 90   23  23
31     GHI                                 Default Disk              128kB 1GB   1    11718818256kB  128kB      1   4kB     80 90   31  31
------ ----------------------------------- ------------------------- ----- ----- ----- ------ ---------- --- ----- ---- ---- --- ---
VVBS=Virtual Volume Block Size


                                           Opt                      Stripe                     Segments
SC                                         Access  Stripe           Transfer     Multiplier     in VV
ID     Name                                Size    Length  VV Size  Rate(kB/sec)   min/max     min/max
------ ----------------------------------- ------- ------- -------- ------------ ----- ----- ----- -----
1      Default - No Storage                0       4kB     512MB    3072             1 1     131072 131072
12     GridKa - Medium                     0       1MB     11718818256kB 3072             1 64    178814 11444158
13     GridKa - Large                      0       128MB   11718818256kB 3072             1 32     2793 89407
21     Small                               0       32kB    11718818256kB 3072             1 32    11444158 366213070
22     Medium                              0       1MB     11718818256kB 3072             1 64    178814 11444158
23     Large                               0       128MB   11718818256kB 3072             1 32     2793 89407
31     GHI                                 0       128kB   11718818256kB 3072             1 8192  11175 91553267
------ ----------------------------------- ------- ------- -------- ------------ ----- ----- ----- -----


- TAPE STORAGE CLASS LIST-

                                                                     Media Est    Data   Parity Min     Num of              Threshold Mig
SC                                         Media                     Block PV     Stripe Stripe Write   RAIT                (volumes) Pol
ID     Name                                Type                      Size  Size   Width  Width  Parity  Engines VVBS  BBTM  Warn Crit ID
------ ----------------------------------- ------------------------- ----- ------ ------ ------ ------- ------- ----- ----- ---- ---- ---
101    GridKa-LTO4                         3580 Gen4 Tape            256kB 800GB  1      0      0       0       1MB   21600    1 0    0
102    GridKa-LTO5                         3580 Gen5 Tape            256kB 1500GB 1      0      0       0       1MB   25200    1 0    0
103    GridKa-T10kD                        Titanium 10000D Tape      256kB 8000GB 1      0      0       0       1MB   45720    1 0    0
201    General - Primary Copy              3580 Gen5 Tape            256kB 1500GB 1      0      0       0       1MB   25200    1 0    0
202    General - Second Copy               3580 Gen5 Tape            256kB 1500GB 1      0      0       0       1MB   25200    1 0    0
203    General - Third Copy                3580 Gen5 Tape            256kB 1500GB 1      0      0       0       1MB   25200    1 0    0
204    General - Primary Copy T10KD        Titanium 10000D Tape      256kB 8000GB 1      0      0       0       1MB   45720    1 0    0
205    General - Second Copy TS1140        3592 E07 XL Tape          256kB 4000GB 1      0      0       0       1MB   43200    1 0    0
------ ----------------------------------- ------------------------- ----- ------ ------ ------ ------- ------- ----- ----- ---- ---- ---
BBTM=Blocks Between Tape Marks
VVBS=Virtual Volume Block Size


- TAPE STORAGE CLASS LIST cont'd-

                                           Max              Avg                Stripe       Opt            Read         Mount
SC                                         VVs to    VV     Latency    Stripe  Transfer     Access         Verification Minimum
ID     Name                                Write     Size   (sec)      Length  Rate(kB/s)   Size      SBTM              PVs
------ ----------------------------------- --------- ------ ---------- ------- ------------ --------- ---- ------------ -------
101    GridKa-LTO4                         1         800GB  20         1MB     122880       0         45   off          off
102    GridKa-LTO5                         1         1500GB 20         1MB     143360       0         45   off          off
103    GridKa-T10kD                        1         8000GB 20         1MB     260096       0         45   off          off
201    General - Primary Copy              5         1500GB 20         1MB     143360       0         45   off          off
202    General - Second Copy               3         1500GB 20         1MB     143360       0         45   off          off
203    General - Third Copy                3         1500GB 20         1MB     143360       0         45   off          off
204    General - Primary Copy T10KD        5         8000GB 20         1MB     260096       0         45   off          off
205    General - Second Copy TS1140        3         4000GB 20         1MB     245760       0         45   off          off
------ ----------------------------------- --------- ------ ---------- ------- ------------ --------- ---- ------------ -------
SBTM=Seconds Between Tape Marks

back to HPPS main page

Retrieved from "https://wiki.scc.kit.edu/lsdf/index.php?title=hidden:HPSS_Configuration&oldid=4517"