View Source

h1. Platform

|| {color:#333333}Field{color} \\ || {color:#333333}Datatype{color} \\ || {color:#333333}Value{color} \\ || {color:#333333}Description{color} \\ ||
| Platform-ID | String | Platform SB 1 | Unique string that identifies this specific platform. \\
Use the platform name |
| Platform description | String | We have five Blade servers located at SB | Human readable description of the platform. Where is it located, contact info, etc. |
| Number of nodes | integer | 5 physical servers | Number of hosts involved - could be both physical hosts as well as virtual hosts \\ |
| Total number of physical CPUs | integer | 10 | Number of CPU's involved \\ |
| CPU specs | string | Intel® Xeon® Processor X5670   \\
(12M Cache, 2.93 GHz, 6.40 GT/s Intel® QPI) | Specification of CPUs \\ |
| Total number of CPU-cores | integer | 60 | Number of CPU-cores involved \\ |
| Total amount of RAM in Gbytes \\ | integer | 288 GB | Total amount of RAM on all nodes \\ |
| average CPU-cores for nodes \\ | integer | 6 | Number of CPU-cores in average across all nodes \\ |
| avarage RAM in Gbytes for nodes \\ | integer | 4 with 48 GB and one with 96 GB | Amount of memory in average across all nodes \\ |
| Operating System on nodes \\ | String | Red Hat based Linux | Linux (specific distribution), Windows (specific distribution), other? |
| Storage system/layer | String | Only SAN storage | NFS, HDFS, local files, ? |
| Network layer between nodes | String | 1 GB ethernet | Speed of network interfaces, general network speed |
| | | | |
| \\ | | | \\ |

h1. {color:#ff0000}Parallel Execution System{color}

|| Field || Value ||
| Installation version | Cloudera CDH4 |
| Hadoop version | Hadoop 2.0.0-cdh4.0.1 \\ |
| HDFS replication factor \\ | n/a. Using HDFS protocol for EMC Isilon Storage System |
| Installation notes | 3 task tracker servers \\
1 separate job tracker server \\
Datanode and name node on EMC Isilon |


h1. Benchmarks of Parallel Execution System

|| Metric || Benchmark type || Value || Description ||
| Concurrent write throughput mb/s | TestDFSIO \\ | 384 | |
| Concurrent write Average IO rate mb/s \\ | TestDFSIO \\ | | |
| Concurrent read throughput mb/s \\ | TestDFSIO \\ | 529 | |
| Concurrent read Average IO rate mb/s \\ | TestDFSIO \\ | | |
| Execution time in minuttes | TeraSort of one billion 100 bytes index's (100GB) | 10,07 | |