Data services: Difference between revisions

From Lsdf
Jump to navigationJump to search
No edit summary
mNo edit summary
 
(18 intermediate revisions by 4 users not shown)
Line 1: Line 1:
[[File:hw_lsdf.jpg|500px|right]]
The services currently provided by LSDF are:
* Fast reliable storage acessible via standard protocols
* [[Archival services]] for long term access to data
* Cloud storage: [[S3 / REST]]
* [[Hadoop data intensive computing framework]]
* GridFTP [[Data Transfers]]
* HTTP/SFTP [[data sharing service]]
* [[GPU nodes (NVIDIA)]]


== Access and use of services and resources ==
* Storage, comprising two systems with 1,4 PB and 500 TB
* Request [[Access to Resources]]
* Cloud computing: OpenNebula cloud environment
* After access is granted, continue to [[registration]]
* Hadoop data intensive computing framework
* About [[LSDF Usage]]

* Acceptible [[Services Usage]]

The "Hadoop cluster" consists of '''58 nodes''' with '''464 physical cores''' in total, each node having:
* 2 sockets Intel Xeon CPU E5520 @ 2.27GHz, 4 cores each, hyperthreading active (16 cores total)
* 36 GB of RAM
* 2 TB of disk
* 1 GE network connection
* OS Scientific Linux 5.5
** Linux kernel 2.6.18
plus '''2 headnodes''', each having:
* 2 sockets Intel Xeon CPU E5520 @ 2.27GHz, 4 cores each, hyperthreading active (16 cores total)
* 96 GB of RAM
* 10 GE network connection
* OS Scientific Linux 5.5
** Linux kernel 2.6.18
All nodes are however SHARED between the different Hadoop tasks and the OpenNebula virtual machines.

Latest revision as of 10:27, 29 July 2016

Hw lsdf.jpg

Access and use of services and resources