Evaluator(s)
Ondrej Klima (BUT)
Evaluation points
Assessment of measurable points
- Dependency of memory consumption on input resolution from July 7 - July 25, 2014
| Metric | Description | Metric baseline | Metric goal | resolution 64 points | 128 points | 256 points | 512 points | 1024 points |
|---|---|---|---|---|---|---|---|---|
| average runtime per item in seconds | The average processing time in seconds per item. | - |
- |
2.3 | 1.8 | 2.5 | 6.0 |
29.8 |
| reliable and stable assessment | Manual assessment on if the experiment performed reliable and stable. | - |
- | true |
true | true | true | true |
| number of failed files | Number of files that failed in the workflow. | - |
- |
0 | 0 |
0 |
0 |
0 |
- Dependency of memory consumption on output resolution from July 7 - July 25, 2014
| Metric | Description | Metric baseline | Metric goal | resolution 64 points | 128 points | 256 points | 512 points |
|---|---|---|---|---|---|---|---|
| average runtime per item in seconds | The average processing time in seconds per item. | - |
- |
0.4 |
4.9 |
55.0 |
673.5 |
| reliable and stable assessment | Manual assessment on if the experiment performed reliable and stable. | - |
- | true | true | true | true |
| number of failed files | Number of files that failed in the workflow. | - |
- |
0 | 0 |
0 |
0 |
Technical details
- The actual wall time was measured. The boost library was used for time measurement.
Evaluation notes
Labels:
None