Difference between revisions of "Hadoop data intensive computing framework"

From Lsdf
m
Line 13: Line 13:
 
** Linux kernel 2.6.18
 
** Linux kernel 2.6.18
 
All nodes are however SHARED between the different Hadoop tasks and the OpenNebula virtual machines.
 
All nodes are however SHARED between the different Hadoop tasks and the OpenNebula virtual machines.
  +
 
[[Setup Hadoop Nodes]]
 
[[Setup Hadoop Nodes]]

Revision as of 16:42, 30 July 2014

The "Hadoop cluster" consists of 58 nodes with 464 physical cores in total, each node having:

  • 2 sockets Intel Xeon CPU E5520 @ 2.27GHz, 4 cores each, hyperthreading active (16 cores total)
  • 36 GB of RAM
  • 2 TB of disk
  • 1 GE network connection
  • OS Scientific Linux 5.5
    • Linux kernel 2.6.18

plus 2 headnodes, each having:

  • 2 sockets Intel Xeon CPU E5520 @ 2.27GHz, 4 cores each, hyperthreading active (16 cores total)
  • 96 GB of RAM
  • 10 GE network connection
  • OS Scientific Linux 5.5
    • Linux kernel 2.6.18

All nodes are however SHARED between the different Hadoop tasks and the OpenNebula virtual machines.

Setup Hadoop Nodes