Difference between revisions of "DCache"

From Gridkaschool
(→‎Assigned excercise machines)
 
(34 intermediate revisions by 4 users not shown)
Line 1: Line 1:
 
=== Authors ===
  
=== Authors ===
−
S. Kalinin, C. Mitterer, D. Ressmann, O. Tsigenov, known as ''the German storage support group''.
 +
C. Mitterer, O. Tsigenov, C. Delle Fratte, C.Bernardt
   
 
=== Abstract ===
  
=== Abstract ===
−
dCache is one of the most used storage solutions in the WLCG consisting of 94 PB of storage distributed world wide on 77 sites. Depending on the Persistency Model, dCache provides methods for exchanging data with backend (tertiary) Storage Systems as well as space management, pool attraction, dataset replication, hot spot determination and recovery from disk or node failures. Beside HEP specific protocols, data in dCache can be accessed via NFSv4.1 (pNFS) as well as through WebDav.
 +
dCache is one of storage solutions used in the WLCG consisting of 94 PB of storage distributed world wide on 77 sites. Depending on the Persistency Model, dCache provides methods for exchanging data with backend (tertiary) Storage Systems as well as space management, pool attraction, dataset replication, hot spot determination and recovery from disk or node failures. Beside HEP specific protocols, data in dCache can be accessed via NFSv4.1 (pNFS) as well as through WebDav.
   
 
The workshop includes theoretical sessions and practical hands-on sessions such as installation, configuration of its components, simple usage and monitoring. The basic knowledge of Unix systems is required.
  
The workshop includes theoretical sessions and practical hands-on sessions such as installation, configuration of its components, simple usage and monitoring. The basic knowledge of Unix systems is required.
   
 
=== Event ===
  
=== Event ===
−
Thursday, August 30, 10:50-18:30<br />
 +
Thursday, August 29, 11:30-18:30<br />
 
The maximal number of participants is restricted to 30.
  
The maximal number of participants is restricted to 30.
   
 
__NOTOC__
  
__NOTOC__
−  
   
 
== Time Table ==
  
== Time Table ==
 
{| cellpadding="5px" rules="cols" style="border-collaps:collapse; border:2px solid black"
  
{| cellpadding="5px" rules="cols" style="border-collaps:collapse; border:2px solid black"
 
|- valign="top"
  
|- valign="top"
−
| style="background-color:lightsteelblue;" | 11:00
 +
| style="background-color:lightsteelblue;" | 11:30
−
| '''[[Media:GKS2012 Introduction.pdf|Welcome And Overview]]''', ''held by Doris Ressmann''
 +
| '''[http://svn.dcache.org/downloads/tutorials/gridka_2013/Karlsruhe_GridKASchool_P2013.pdf Welcome And Overview]''', ''held by Christian Bernardt''
   
 
A welcome and overview to the course.
  
A welcome and overview to the course.
 
|- valign="top"
  
|- valign="top"
−
| style="background-color:lightsteelblue;" | 11:15
 +
| style="background-color:lightsteelblue;" | 11:40
−
| '''[[Media:DCache_Introduction_Course_–_Introduction_To_dCache.pdf|Introduction To dCache]]''', ''held by Christoph Anton Mitterer''
 +
| '''[[Media:I._Introduction_To_dCache_(2013)|Introduction To dCache]]''', ''held by Christoph Anton Mitterer''
   
 
Gives an overview on dCache, its history, future and application areas, its basic functionality and special features, its structure, main components, databases, protocols and data access model as well as typical cluster setups.
  
Gives an overview on dCache, its history, future and application areas, its basic functionality and special features, its structure, main components, databases, protocols and data access model as well as typical cluster setups.
 
|- valign="top"
  
|- valign="top"
−
| style="background-color:lightsteelblue;" | 12:15
 +
| style="background-color:lightsteelblue;" | 12:30
−
| '''[[Media:DCacheWithinGrids.pdf|dCache Within Grids]]''', ''held by Christoph Anton Mitterer''
 +
| '''[[Media:II._dCache_Within_Grids_(2013)|dCache Within Grids]]''', ''held by Christoph Anton Mitterer''
   
 
Gives some brief notes on grid-specific concepts, techniques, tools and clients that are important for using dCache within a grid (for example the LCG) and that will be referenced in later chapters.
 
Gives some brief notes on grid-specific concepts, techniques, tools and clients that are important for using dCache within a grid (for example the LCG) and that will be referenced in later chapters.
 
|- valign="top" style="background-color:yellow;"
  
|- valign="top" style="background-color:yellow;"
−
| style="background-color:lightsteelblue;" | 12:30
 +
| style="background-color:lightsteelblue;" | 12:40
 
| Lunch
  
| Lunch
 
|- valign="top"
  
|- valign="top"
 
| style="background-color:lightsteelblue;" | 13:30
  
| style="background-color:lightsteelblue;" | 13:30
  +
| '''[http://trac.dcache.org/wiki/Karlsruhe2013WS dCache installation]''', ''held by Cesare Delle Fratte''
−
| '''[[Media:DCache_Installation_2012.pdf|Installation]]''' (with [[Installing dCache (2012)|exercises]]), ''held by Doris Ressmann''
  
   
 
Describes the typical installation-procedure for a dCache cluster, including its external dependencies, the core-services and the file hierarchy provider, the creation of pools as well as the configuration system.
  
Describes the typical installation-procedure for a dCache cluster, including its external dependencies, the core-services and the file hierarchy provider, the creation of pools as well as the configuration system.
Line 48: Line 47:
 
|- valign="top"
  
|- valign="top"
 
| style="background-color:lightsteelblue;" | 15:30
  
| style="background-color:lightsteelblue;" | 15:30
−
| '''[[Media:Pool_Management_And_Pool_Selection2012.pdf|Pool Management And Pool Selection]]''' (with [[Pool Management And Pool Selection (2012)|exercises]]), <i>held by Oleg Tsigenov</i>
 +
| '''[http://trac.dcache.org/wiki/Pool%20Management%20And%20Pool%20Selection Pool Management And Pool Selection]''' , <i>held by Oleg Tsigenov</i>
 
Covers some of the concepts and means of selecting pools for client read- and write-accesses as well as their configuration.
  
Covers some of the concepts and means of selecting pools for client read- and write-accesses as well as their configuration.
   
 
|- valign="top"
  
|- valign="top"
−
| style="background-color:lightsteelblue;" | 16:30
 +
| style="background-color:lightsteelblue;" | 17:00
−
| '''[[Media:DCache Introduction Course – Access Control.pdf|Access Control]]''' (with [[Media:AccessControl_Exercises.pdf‎|exercises]]), <i>held by Christoph Anton Mitterer</i>
 +
| '''[[Media:II._dCache_Within_Grids|Access Control]]''' (with [[Media:VIII._Examples_And_Exercises_–_5._Access_Control|exercises]]), <i>held by Christoph Anton Mitterer</i>
   
 
Gives a basic overview on the main access control systems within dCache as well as their configuration.
  
Gives a basic overview on the main access control systems within dCache as well as their configuration.
Line 60: Line 59:
 
|- valign="top"
  
|- valign="top"
 
| style="background-color:lightsteelblue;" | 16:30
  
| style="background-color:lightsteelblue;" | 16:30
−
| '''[[Media:DCache Introduction Course – Space Management, Space Reservation And SRM.pdf|Space Management, Space Reservation And SRM]]''' (with [[Media:DCache_Introduction_Course_–_Space_Management%2C_Space_Reservation_And_SRM_(Exercises).pdf|exercises]]), <i>held by Christoph Anton Mitterer</i>
 +
| '''[https://indico.scc.kit.edu/indico/getFile.py/access?sessionId=29&resId=5&materialId=0&confId=6 Space Management, Space Reservation And SRM]''' (with [https://indico.scc.kit.edu/indico/getFile.py/access?sessionId=29&resId=4&materialId=0&confId=6 exercises]), <i>held by Christoph Anton Mitterer</i>
 
Gives an introduction to the concepts and configuration of space management, space reservation and space tokens, mostly from the view of SRM.
 
Gives an introduction to the concepts and configuration of space management, space reservation and space tokens, mostly from the view of SRM.
 
--->
  
--->
Line 73: Line 72:
   
 
==== Recent changes ====
  
==== Recent changes ====
  +
−
-->
  
   
 
{{Slides (dCache, 2012)}}
  
{{Slides (dCache, 2012)}}
  +
-->
   
 
====Assigned excercise machines====
  
====Assigned excercise machines====
−
UID Host name IP address
 +
UID Host name IP address
−
015 gks-021.scc.kit.edu 141.52.174.21
  
−
016 gks-022.scc.kit.edu 141.52.174.22
  
−
002
 
−
017 gks-033.scc.kit.edu 141.52.174.33
  
−
003 gks-034.scc.kit.edu 141.52.174.34
  
−
004 gks-035.scc.kit.edu 141.52.174.35
 
−
005 gks-036.scc.kit.edu 141.52.174.36
  
−
018 gks-037.scc.kit.edu 141.52.174.37
  
−
019 gks-038.scc.kit.edu 141.52.174.38
  
−
020
 
−
021 gks-039.scc.kit.edu 141.52.174.39
  
−
008 gks-040.scc.kit.edu 141.52.174.40
  
−
022 gks-041.scc.kit.edu 141.52.174.41
  
−
023
 
−
024
 
−
025 gks-042.scc.kit.edu 141.52.174.42
 
−
026
 
−
011 gks-043.scc.kit.edu 141.52.174.43
  
−
014 gks-044.scc.kit.edu 141.52.174.44
  
−  
   
 
=== Links ===
  
=== Links ===
Line 104: Line 84:
   
 
== Acknowledgement ==
  
== Acknowledgement ==
  +
Thank you German Support Team. A special thanks to D-Grid and the HGF-Alliance Physics on the Terascale for funding.
−
We want to thank Xavier Mol for helping in previous years and preparing earlier installation instructions. Many thanks to the dCache developer team for assisting on open questions.<br />
  
−
A special "Thank you" to D-Grid and the HGF-Alliance Physics on the Terascale for funding.
  

Latest revision as of 00:40, 29 August 2013

Authors

C. Mitterer, O. Tsigenov, C. Delle Fratte, C.Bernardt

Abstract

dCache is one of storage solutions used in the WLCG consisting of 94 PB of storage distributed world wide on 77 sites. Depending on the Persistency Model, dCache provides methods for exchanging data with backend (tertiary) Storage Systems as well as space management, pool attraction, dataset replication, hot spot determination and recovery from disk or node failures. Beside HEP specific protocols, data in dCache can be accessed via NFSv4.1 (pNFS) as well as through WebDav.

The workshop includes theoretical sessions and practical hands-on sessions such as installation, configuration of its components, simple usage and monitoring. The basic knowledge of Unix systems is required.

Event

Thursday, August 29, 11:30-18:30
The maximal number of participants is restricted to 30.


Time Table

11:30 Welcome And Overview, held by Christian Bernardt

A welcome and overview to the course.

11:40 Introduction To dCache, held by Christoph Anton Mitterer

Gives an overview on dCache, its history, future and application areas, its basic functionality and special features, its structure, main components, databases, protocols and data access model as well as typical cluster setups.

12:30 dCache Within Grids, held by Christoph Anton Mitterer

Gives some brief notes on grid-specific concepts, techniques, tools and clients that are important for using dCache within a grid (for example the LCG) and that will be referenced in later chapters.

12:40 Lunch
13:30 dCache installation, held by Cesare Delle Fratte

Describes the typical installation-procedure for a dCache cluster, including its external dependencies, the core-services and the file hierarchy provider, the creation of pools as well as the configuration system.


15:00 Coffee break


15:30 Pool Management And Pool Selection , held by Oleg Tsigenov

Covers some of the concepts and means of selecting pools for client read- and write-accesses as well as their configuration.

17:00 Access Control (with exercises), held by Christoph Anton Mitterer

Gives a basic overview on the main access control systems within dCache as well as their configuration.


18:30 End of the workshop


Assigned excercise machines

UID             Host name                    IP address

Links

The dcache.org main page is the starting point for all interests about dCache. Either searching for documentation or support, news or source code, everything can be found there.

Acknowledgement

Thank you German Support Team. A special thanks to D-Grid and the HGF-Alliance Physics on the Terascale for funding.

Retrieved from "https://wiki.scc.kit.edu/gridkaschool/index.php?title=DCache&oldid=1242"