Basic cluster software
Ubuntu 10.04 LTS x86_64
OpenSSH
Cluster Setup (2012.09): Cloudera CDH3u4
JDK 6 update 22 - x64 (jdk-6u22-linux-x64.bin)
Current cluster software setup & history
2012.09
- Hadoop 0.20.2+923.256
- PIG 0.8.1+28.32
- HADOOP_HEAPSIZE=1000
- MAP / REDUCE slot ratio 6/1
Cluster hardware
NETWORK infrastructure
The CONTROLLER and the NODEs are connected through a 100Mbps network of the hosting provider (Leaseweb).
CONTROLLER
Dell Poweredge R210
CPU: 1 x Xeon E3430@2.40GHz Quadcore CPU (8 HyperThreading cores)
RAM: 4GB
NIC: 2 x 100Mbps Ethernet (1 used)
DISK: 2 x 250GB DISKs; configured as RAID1 (redundancy) => 250GB effective disk space
NODE (worker nodes 1 to 6)
Dell Poweredge R210
CPU: 1 x Xeon X3430@2.40GHz Quadcore CPU (8 HyperThreading cores)
RAM: 4GB
NIC: 2 x 100Mbps Ethernet (1 used)
DISK: 2 x 250GB DISKs; configured as RAID1 (redundancy) => 250GB effective disk space
Labels:
None