Evaluator(s)
Alastair Duncan
Evaluation points
Baseline
Metric | Description | Metric baseline | Metric goal | 20/06/2014 Maps per node 8 Split 1 | 20/06/2014 Maps per node 4 Split 4 | 20/06/2014 Maps per node 4 Split 50 |
---|---|---|---|---|---|---|
NumberOfObjectsPerHour | Number of objects processed in one hour | 479.3 |
|
998.32 | 720 | 238.55 |
MaxObjectSizeHandledInGbytes | Max size of raw files | 0.16689453 | 0.16689453 | 0.16689453 | 0.16689453 | |
MinObjectSizeHandledInGbytes | Min size of raw files | 2.24113e-5 | 2.24113e-5 | 2.24113e-5 | 2.24113e-5 | |
ThroughputGbytesPerMinute | The throughput of data measured in Gigabytes per minute | 0.246 | 0.513 | 0.370 | 0.123 | |
ThroughputGbytesPerHour | The throughput of data measured in Gigabyte per hour | 14.764 | 30.768 | 22.190 | 7.352 | |
ReliableAndStableAssessment | Manual assessment on if the experiment performed reliable and stable | true | true | true | true | |
NumberOfFailedFiles | Number of files that failed in the workflow | 1 |
1 | 1 | 1 | |
AverageRuntimePerItemInSeconds | The average processing time in seconds per item | 7.51 |
3.60 | 5.0 | 15.09 | |
throughput in bytes per second | The throughput of data measured in bytes per second | 4403436.169 |
9176908.992 |
6618498.000 |
2191875.843 |
|
number of objects per second |
Number of objects that can be processed per second | 0.13 | 0.28 |
0.20 |
0.07 | |
max object size handled in bytes | Max size of raw files | 24064 |
24064 | 24064 | 24064 | |
min object size handled in bytes | Min size of raw files | 160312320 | 160312320 | 160312320 | 160312320 |
WebDAV
http://fue.onb.ac.at/scape-tb-evaluation/stfc/raw2nexus/smalldatasetmap4split50/
http://fue.onb.ac.at/scape-tb-evaluation/stfc/raw2nexus/smalldatasetmap4split4/
http://fue.onb.ac.at/scape-tb-evaluation/stfc/raw2nexus/smalldatasetmap8split1/
Evaluation notes
Timings for moving the data onto hdfs and generating the input files for ToMaR are not included in any of the evaluations. Baseline results are for the small dataset with the non Hadoop workflow executed using Taverna on a single node from the Hadoop cluster. Timings for baseline included Taverna overheads, no stage timings are available from CLI version of Taverna 2.4. Taverna overheads were not included in Hadoop experiments.
One failure due to missing metadata file for one of the test files.
2 Comments
comments.show.hideDec 24, 2015
Anonymous
That is very fascinating, You're a very skilled
blogger. I have joined your feed and sit up for searching for more of your excellent post.
Also, I have shared your site in my social networks
Feb 22, 2016
Anonymous
While doing the resettlement work shifters get confused in between the puzzling works.
Whatever you do, do not get her a gift that is too forward.
Executive personal assistants help accomplish tasks efficiently.
You can find companies offering packing services and this means
that you have less to worry about when moving. I have literally seen a new vacuum burnt out after 1 use to clean a small mess like this.
Functional and striking, track lighting fixtures can be found in different shapes and sizes according to your choices and
needs, from ultra modern to that which resembles turn-of-the century, any style to
fit any dcor. Preponderance of evidence translates mathematically to 50.
However, being a little bit careful with good
and the people involved in shifting may help to avoid
clashes between the hirers and removal companies. Simply said, a one way truck is a rental method that allows you to rent a truck in a
given state and return it at the destination state to a branch of the same company in that
area. Every morning, we condition ourselves on how to face the brand new
challenges of life.