View Source

h2. Evaluator(s)

_Ondrej Klima (BUT)_

h2. Evaluation points


h5. Assessment of measurable points

* Dependency of memory consumption on *input* resolution from *July 7 - July 25, 2014*

|| Metric || Description || Metric baseline || Metric goal || _resolution 64 points_ || _128 points_ || _256 points_ || _512 points_ || _1024 points_ \\ ||
| average runtime per item in seconds | The average processing time in seconds per item. | _\-_ \\ | _\-_ \\ | 2.3 | 1.8 | 2.5 | 6.0 \\ | 29.8 \\ |
| reliable and stable assessment | Manual assessment on if the experiment performed reliable and stable. | \- \\ | \- | true \\ | true | true | true | true |
| number of failed files | Number of files that failed in the workflow. | \- \\ | \- \\ | 0 | 0 \\ | 0 \\ | 0 \\ | 0 \\ |
* Dependency of memory consumption on *output* resolution from *July 7 - July 25, 2014*

|| Metric || Description || Metric baseline || Metric goal || _resolution 64 points_ || _128 points_ || _256 points_ || _512 points_ ||
| average runtime per item in seconds | The average processing time in seconds per item. | _\-_ \\ | _\-_ \\ | 0.4 \\ | 4.9 \\ | 55.0 \\ | 673.5 |
| reliable and stable assessment | Manual assessment on if the experiment performed reliable and stable. | \- \\ | \- | true | true | true | true |
| number of failed files | Number of files that failed in the workflow. | \- \\ | \- \\ | 0 | 0 \\ | 0 \\ | 0 \\ |

!sumtime.png|width=745,height=745!

h2. Technical details

* The actual wall time was measured. The *boost* library was used for time measurement.


h2. Evaluation notes