Skip to end of metadata
Go to start of metadata

Evaluator(s)

Alastair Duncan

Evaluation points

Baseline
Metric Description Metric baseline Metric goal 20/06/2014 Maps per node 8 Split 1 20/06/2014 Maps per node 4 Split 4 20/06/2014 Maps per node 4 Split 50
NumberOfObjectsPerHour Number of objects processed in one hour 479.3

998.32 720 238.55
MaxObjectSizeHandledInGbytes Max size of raw files 0.16689453   0.16689453 0.16689453 0.16689453
MinObjectSizeHandledInGbytes Min size of raw files 2.24113e-5   2.24113e-5 2.24113e-5 2.24113e-5
ThroughputGbytesPerMinute The throughput of data measured in Gigabytes per minute 0.246   0.513 0.370 0.123
ThroughputGbytesPerHour The throughput of data measured in Gigabyte per hour 14.764   30.768 22.190 7.352
ReliableAndStableAssessment Manual assessment on if the experiment performed reliable and stable true   true true true
NumberOfFailedFiles Number of files that failed in the workflow 1
   1 1 1
AverageRuntimePerItemInSeconds The average processing time in seconds per item 7.51
  3.60 5.0 15.09
throughput in bytes per second The throughput of data measured in bytes per second 4403436.169
  9176908.992
6618498.000
2191875.843
number of  objects per second
Number of objects that can be processed per second 0.13   0.28
0.20
0.07
max object size handled in bytes Max size of raw files 24064
  24064 24064 24064
min object size handled in bytes Min size of raw files 160312320   160312320 160312320 160312320
WebDAV

http://fue.onb.ac.at/scape-tb-evaluation/stfc/raw2nexus/smalldatasetmap4split50/

http://fue.onb.ac.at/scape-tb-evaluation/stfc/raw2nexus/smalldatasetmap4split4/

http://fue.onb.ac.at/scape-tb-evaluation/stfc/raw2nexus/smalldatasetmap8split1/

Evaluation notes

Timings for moving the data onto hdfs and generating the input files for ToMaR are not included in any of the evaluations. Baseline results are for the small dataset with the non Hadoop workflow executed using Taverna on a single node from the Hadoop cluster. Timings for baseline included Taverna overheads, no stage timings are available from CLI version of Taverna 2.4. Taverna overheads were not included in Hadoop experiments.

One failure due to missing metadata file for one of the test files.

Labels:
None
Enter labels to add to this page:
Please wait 
Looking for a label? Just start typing.

2 Comments

comments.show.hide

  1. Dec 24, 2015

    Anonymous

    That is very fascinating, You're a very skilled
    blogger. I have joined your feed and sit up for searching for more of your excellent post.
    Also, I have shared your site in my social networks

  2. Feb 22, 2016

    Anonymous

    While doing the resettlement work shifters get confused in between the puzzling works.

    Whatever you do, do not get her a gift that is too forward.
    Executive personal assistants help accomplish tasks efficiently.
    You can find companies offering packing services and this means
    that you have less to worry about when moving. I have literally seen a new vacuum burnt out after 1 use to clean a small mess like this.
    Functional and striking, track lighting fixtures can be found in different shapes and sizes according to your choices and
    needs, from ultra modern to that which resembles turn-of-the century, any style to
    fit any dcor. Preponderance of evidence translates mathematically to 50.
    However, being a little bit careful with good
    and the people involved in shifting may help to avoid
    clashes between the hirers and removal companies. Simply said, a one way truck is a rental method that allows you to rent a truck in a
    given state and return it at the destination state to a branch of the same company in that
    area. Every morning, we condition ourselves on how to face the brand new
    challenges of life.