Data services: Difference between revisions
From Lsdf
Jump to navigationJump to search
No edit summary |
mNo edit summary |
||
| (20 intermediate revisions by 5 users not shown) | |||
| Line 1: | Line 1: | ||
[[File:hw_lsdf.jpg|500px|right]] |
|||
The services currently provided by LSDF are: |
|||
* Fast reliable storage acessible via standard protocols |
|||
* [[Archival services]] for long term access to data |
|||
* Cloud storage: [[S3 / REST]] |
|||
| ⚫ | |||
* GridFTP [[Data Transfers]] |
|||
* HTTP/SFTP [[data sharing service]] |
|||
* [[GPU nodes (NVIDIA)]] |
|||
== Access and use of services and resources == |
|||
* Storage, comprising two systems with 1,4 PB and 500 TB |
|||
* Request [[Access to Resources]] |
|||
* Cloud computing: OpenNebula cloud environment |
|||
* After access is granted, continue to [[registration]] |
|||
| ⚫ | |||
* About [[LSDF Usage]] |
|||
* Acceptible [[Services Usage]] |
|||
The "Hadoop cluster" consists of |
|||
* 58 nodes with 464 physical cores |
|||
** 2 sockets Intel Xeon CPU E5520 @ 2.27GHz, 4 cores each, hyperthreading active |
|||
* 36 GB of RAM |
|||
* 2 TB of disk each |
|||
* 1 GE network connection |
|||
* OS Scientific Linux 5.5 |
|||
** Linux kernel 2.6.18 |
|||
plus |
|||
* 2 headnodes |
|||
** 2 sockets Intel Xeon CPU E5520 @ 2.27GHz, 4 cores each, hyperthreading active |
|||
* 96 GB of RAM |
|||
* 10 GE network connection |
|||
* OS Scientific Linux 5.5 |
|||
** Linux kernel 2.6.18 |
|||
All nodes are however SHARED between the different Hadoop tasks and the OpenNebula virtual machines. |
|||
Latest revision as of 10:27, 29 July 2016
- Fast reliable storage acessible via standard protocols
- Archival services for long term access to data
- Cloud storage: S3 / REST
- Hadoop data intensive computing framework
- GridFTP Data Transfers
- HTTP/SFTP data sharing service
- GPU nodes (NVIDIA)
Access and use of services and resources
- Request Access to Resources
- After access is granted, continue to registration
- About LSDF Usage
- Acceptible Services Usage
