Skip to end of metadata
Go to start of metadata

Evaluator(s)

Alastair Duncan

Evaluation points

Assessment of measurable points
Metric Description Metric baseline Metric goal 02/07/2014 maps 1 split 1 03/07/2014 maps 4 split 1
08/07/2014 maps 8 split 1 08/07/2014 maps 8 split 4
NumberOfObjectsPerHour Number of objects processed in one hour

1711.29
2261.80
2522.29  
MaxObjectSizeHandledInGbytes Max size of raw files     0.433 0.433 0.433 0.433
MinObjectSizeHandledInGbytes Min size of raw files     6.19888e-6 6.19888e-6 6.19888e-6 6.19888e-6
ThroughputGbytesPerMinute The throughput of data measured in Gybtes per minute     0.001
0.002 0.002  
ThroughputGbytesPerHour The throughput of data measured in Gybtes per hour     0.082 0.109 0.122  
ReliableAndStableAssessment Manual assessment on if the experiment performed reliable and stable     true
true true false
NumberOfFailedFiles Number of files that failed in the workflow     1
1 1
16810
AverageRuntimePerItemInSeconds The average processing time in seconds per item     0.475
0.630 0.700  
throughput in bytes per second The throughput of data measured in bytes per second     24587665.126
32497311.333 32640084.059  
number of  objects per second Number of objects that can be processed per second     2.10
1.59 1.43  
max object size handled in bytes Max size of raw files     465826304 465826304 465826304
465826304
min object size handled in bytes Min size of raw files     6656 6656 6656 6656

Technical details

No taverna workflow just raw2nexus migration of 20130 files ranging in size from 6Kb up to 454.1Mb The single failure was for a raw file which was corrupt.

WebDAV

http://fue.onb.ac.at/scape-tb-evaluation/stfc/raw2nexus/largedatasetbigmap1split1

http://fue.onb.ac.at/scape-tb-evaluation/stfc/raw2nexus/largedatasetbigmap4split1/

http://fue.onb.ac.at/scape-tb-evaluation/stfc/raw2nexus/largedatasetbigmap8split1/

http://fue.onb.ac.at/scape-tb-evaluation/stfc/raw2nexus/largedatasetbigmap8split4/

Evaluation notes

The larger files failed with Task attempt_201407021401_0001_m_000064_0 failed to report status for 600 seconds. Killing! These were then retried and were all successful except for the test 08/07/2014 maps 8 split 4. The failures were tried 4 times, after 4 failures and then killed after a number of such failures the whole job was killed with 830 completed tasks out of the 5033 tasks.

Labels:
None
Enter labels to add to this page:
Please wait 
Looking for a label? Just start typing.