Evaluator(s)
Alastair Duncan
Evaluation points
Assessment of measurable points
| Metric | Description | Metric baseline | Metric goal | 02/07/2014 maps 1 split 1 | 03/07/2014 maps 4 split 1 |
08/07/2014 maps 8 split 1 | 08/07/2014 maps 8 split 4 |
|---|---|---|---|---|---|---|---|
| NumberOfObjectsPerHour | Number of objects processed in one hour | |
|
1711.29 |
2261.80 |
2522.29 | |
| MaxObjectSizeHandledInGbytes | Max size of raw files | 0.433 | 0.433 | 0.433 | 0.433 | ||
| MinObjectSizeHandledInGbytes | Min size of raw files | 6.19888e-6 | 6.19888e-6 | 6.19888e-6 | 6.19888e-6 | ||
| ThroughputGbytesPerMinute | The throughput of data measured in Gybtes per minute | 0.001 |
0.002 | 0.002 | |||
| ThroughputGbytesPerHour | The throughput of data measured in Gybtes per hour | 0.082 | 0.109 | 0.122 | |||
| ReliableAndStableAssessment | Manual assessment on if the experiment performed reliable and stable | true |
true | true | false |
||
| NumberOfFailedFiles | Number of files that failed in the workflow | 1 |
1 | 1 |
16810 |
||
| AverageRuntimePerItemInSeconds | The average processing time in seconds per item | 0.475 |
0.630 | 0.700 | |||
| throughput in bytes per second | The throughput of data measured in bytes per second | 24587665.126 |
32497311.333 | 32640084.059 | |||
| number of objects per second | Number of objects that can be processed per second | 2.10 |
1.59 | 1.43 | |||
| max object size handled in bytes | Max size of raw files | 465826304 | 465826304 | 465826304 |
465826304 |
||
| min object size handled in bytes | Min size of raw files | 6656 | 6656 | 6656 | 6656 |
Technical details
No taverna workflow just raw2nexus migration of 20130 files ranging in size from 6Kb up to 454.1Mb The single failure was for a raw file which was corrupt.
WebDAV
http://fue.onb.ac.at/scape-tb-evaluation/stfc/raw2nexus/largedatasetbigmap1split1
http://fue.onb.ac.at/scape-tb-evaluation/stfc/raw2nexus/largedatasetbigmap4split1/
http://fue.onb.ac.at/scape-tb-evaluation/stfc/raw2nexus/largedatasetbigmap8split1/
http://fue.onb.ac.at/scape-tb-evaluation/stfc/raw2nexus/largedatasetbigmap8split4/
Evaluation notes
The larger files failed with Task attempt_201407021401_0001_m_000064_0 failed to report status for 600 seconds. Killing! These were then retried and were all successful except for the test 08/07/2014 maps 8 split 4. The failures were tried 4 times, after 4 failures and then killed after a number of such failures the whole job was killed with 830 completed tasks out of the 5033 tasks.