Platform
| Field |
Datatype |
Value |
Description |
|---|---|---|---|
| Platform-ID | String | Platform SB 1 | Unique string that identifies this specific platform. Use the platform name |
| Platform description | String | We have five Blade servers located at SB | Human readable description of the platform. Where is it located, contact info, etc. |
| Number of nodes | integer | 5 physical servers | Number of hosts involved - could be both physical hosts as well as virtual hosts |
| Total number of physical CPUs | integer | 10 | Number of CPU's involved |
| CPU specs | string | Intel® Xeon® Processor X5670 (12M Cache, 2.93 GHz, 6.40 GT/s Intel® QPI) |
Specification of CPUs |
| Total number of CPU-cores | integer | 60 | Number of CPU-cores involved |
| Total amount of RAM in Gbytes |
integer | 288 GB | Total amount of RAM on all nodes |
| average CPU-cores for nodes |
integer | 6 | Number of CPU-cores in average across all nodes |
| avarage RAM in Gbytes for nodes |
integer | 4 with 48 GB and one with 96 GB | Amount of memory in average across all nodes |
| Operating System on nodes |
String | Red Hat based Linux | Linux (specific distribution), Windows (specific distribution), other? |
| Storage system/layer | String | Only SAN storage | NFS, HDFS, local files, ? |
| Network layer between nodes | String | 1 GB ethernet | Speed of network interfaces, general network speed |
| |
|
Parallel Execution System
| Field | Value |
|---|---|
| Installation version | Cloudera CDH4 |
| Hadoop version | Hadoop 2.0.0-cdh4.0.1 |
| HDFS replication factor |
n/a. Using HDFS protocol for EMC Isilon Storage System |
| Installation notes | 3 task tracker servers 1 separate job tracker server Datanode and name node on EMC Isilon |
Benchmarks of Parallel Execution System
| Metric | Benchmark type | Value | Description |
|---|---|---|---|
| Concurrent write throughput mb/s | TestDFSIO |
384 | |
| Concurrent write Average IO rate mb/s |
TestDFSIO |
||
| Concurrent read throughput mb/s |
TestDFSIO |
529 | |
| Concurrent read Average IO rate mb/s |
TestDFSIO |
||
| Execution time in minuttes | TeraSort of one billion 100 bytes index's (100GB) | 10,07 |
Labels:
None