Basic cluster software

Ubuntu 10.04 LTS x86_64

OpenSSH

Cluster Setup (2012.09): Cloudera CDH3u4

JDK 6 update 22 - x64 (jdk-6u22-linux-x64.bin)

Current cluster software setup & history

2012.09

Hadoop 0.20.2+923.256
PIG 0.8.1+28.32
HADOOP_HEAPSIZE=1000
MAP / REDUCE slot ratio 6/1

Cluster hardware

NETWORK infrastructure

The CONTROLLER and the NODEs are connected through a 100Mbps network of the hosting provider (Leaseweb).

CONTROLLER

Dell Poweredge R210
CPU: 1 x Xeon [email protected] Quadcore CPU (8 HyperThreading cores)
RAM: 4GB
NIC: 2 x 100Mbps Ethernet (1 used)
DISK: 2 x 250GB DISKs; configured as RAID1 (redundancy) => 250GB effective disk space

NODE (worker nodes 1 to 6)