Hadoop data intensive computing framework: Difference between revisions

From Lsdf
Jump to navigationJump to search
(Created page with " The "Hadoop cluster" consists of '''58 nodes''' with '''464 physical cores''' in total, each node having: * 2 sockets Intel Xeon CPU E5520 @ 2.27GHz, 4 cores each, hyperthreadin…")
 
No edit summary
Line 1: Line 1:

The "Hadoop cluster" consists of '''58 nodes''' with '''464 physical cores''' in total, each node having:
The "Hadoop cluster" consists of '''58 nodes''' with '''464 physical cores''' in total, each node having:
* 2 sockets Intel Xeon CPU E5520 @ 2.27GHz, 4 cores each, hyperthreading active (16 cores total)
* 2 sockets Intel Xeon CPU E5520 @ 2.27GHz, 4 cores each, hyperthreading active (16 cores total)
Line 14: Line 13:
** Linux kernel 2.6.18
** Linux kernel 2.6.18
All nodes are however SHARED between the different Hadoop tasks and the OpenNebula virtual machines.
All nodes are however SHARED between the different Hadoop tasks and the OpenNebula virtual machines.
[[Setup Hadoop Nodes]]

Revision as of 16:42, 30 July 2014

The "Hadoop cluster" consists of 58 nodes with 464 physical cores in total, each node having:

  • 2 sockets Intel Xeon CPU E5520 @ 2.27GHz, 4 cores each, hyperthreading active (16 cores total)
  • 36 GB of RAM
  • 2 TB of disk
  • 1 GE network connection
  • OS Scientific Linux 5.5
    • Linux kernel 2.6.18

plus 2 headnodes, each having:

  • 2 sockets Intel Xeon CPU E5520 @ 2.27GHz, 4 cores each, hyperthreading active (16 cores total)
  • 96 GB of RAM
  • 10 GE network connection
  • OS Scientific Linux 5.5
    • Linux kernel 2.6.18

All nodes are however SHARED between the different Hadoop tasks and the OpenNebula virtual machines. Setup Hadoop Nodes