SB Hadoop Platform
Field |
Datatype |
Value |
Description |
---|---|---|---|
Platform-ID | String | Platform SB Hadoop | Unique string that identifies this specific platform. Use the platform name |
Platform description | String | We have five Blade servers located at SB | Human readable description of the platform. Where is it located, contact info, etc. |
Number of nodes | integer | 4 physical servers | Number of hosts involved - could be both physical hosts as well as virtual hosts |
Total number of physical CPUs | integer | 8 | Number of CPU's involved |
CPU specs | string | Intel® Xeon® Processor X5670 (12M Cache, 2.93 GHz, 6.40 GT/s Intel® QPI) |
Specification of CPUs |
Total number of CPU-cores | integer | 48 | Number of CPU-cores involved Each physical CPU consists of 6 cores, and 12 threads |
Total amount of RAM in Gbytes |
integer | 384 GB | Total amount of RAM on all nodes |
|
integer | 12 | Number of CPU-cores in average across all nodes |
|
integer | 96 GB | Amount of memory in average across all nodes |
Operating System on nodes |
String | Red Hat based Linux | Linux (specific distribution), Windows (specific distribution), other? |
Storage system/layer | String | mounted NFS | NFS, HDFS, local files, ? |
Network layer between nodes | String | 2 GB ethernet | Speed of network interfaces, general network speed |
Parallel Execution System
Field | Value |
---|---|
Installation description | Cloudera CDH4, Hadoop 2.0.0-cdh4.5.0 |
Configuration notes | Replicationfactor is n/a. Using HDFS protocol for EMC Isilon Storage System 1 x Namenode (JobTracker) 4 x Datanode (TaskTracker) |
Benchmark of Parallel Execution System
Metric | Benchmark type | Value | Comment |
---|---|---|---|
Concurrent write throughput | TestDFSIO |
2.6 Gb/s | |
Concurrent read throughput |
TestDFSIO |
4.4 Gb/s | |
Execution time | TeraSort of one billion 100 bytes index's (100GB) | 10,07 minutes |
Labels:
None