Version 1 by Pavel Smrz
on Jul 28, 2014 02:38.

compared with
Current by Pavel Smrz
on Jul 28, 2014 03:05.

Key
This line was removed.
This word was removed. This word was added.
This line was added.

Changes (14)

View Page History
h2. Evaluator(s)

\_Ondrej Klima (BUT)\_
_Ondrej Klima (BUT)_


h2. Evaluation points


h5. Assessment of measurable points

\* Dependency of memory consumption on \*input\* resolution from \*July 7 - July 25, 2014\*
* Dependency of memory consumption on *input* resolution from *July 7 - July 25, 2014*

|| Metric || Description || Metric baseline || Metric goal || _resolution 64 points_ || _128 points_ || _256 points_ || _512 points_ || _1024 points_ \\ ||
| average runtime per item in seconds | The average processing time in seconds per item. | _\-_ \\ | _\-_ \\ | 2.3 | 1.8 | 2.5 | 6.0 \\ | 29.8 \\ |
| reliable and stable assessment | Manual assessment on if the experiment performed reliable and stable. | \- \\ | \- | true \\ | true | true | true | true |
| number of failed files | Number of files that failed in the workflow. | \- \\ | \- \\ | 0 | 0 \\ | 0 \\ | 0 \\ | 0 \\ |
* Dependency of memory consumption on *output* resolution from *July 7 - July 25, 2014*

\|\| Metric \|\| Description \|\| Metric baseline \|\| Metric goal \|\| \_resolution 64 points\_ \|\| \_128 points\_ \|\| \_256 points\_ \|\| \_512 points\_ \|\| \_1024 points\_ \\ \|\|
\| \[maximum peak memory used\|http://purl.org/DP/quality/measures#98\] \| Maximum of the peak memory used in processing, measured in megabytes. \| \_\-\_ \\ \| \_\-\_ \\ \| 129.180 \| 129.727 \| 132.007 \| 212.263 \\ \| 1528.524 \|
\| \[max object size handled in bytes\|http://purl.org/DP/quality/measures#404\] \| Maximum size of PFM file, measured in megabytes. \\ \| \\- \\ \| \\- \| 33.82 \| 33.82 \\ \| 33.82 \| 33.82 \| 33.82 \|
\| \[min object size handled in bytes\|http://purl.org/DP/quality/measures#405\]\\ \| Minimum size of input file in megabytes. \\ \| \\- \\ \| \\- \\ \| 0.28 \| 0.28 \\ \| 0.28 \\ \| 0.28 \\ \| 0.28 \\ \|
|| Metric || Description || Metric baseline || Metric goal || _resolution 64 points_ || _128 points_ || _256 points_ || _512 points_ ||
| average runtime per item in seconds | The average processing time in seconds per item. | _\-_ \\ | _\-_ \\ | 0.4 \\ | 4.9 \\ | 55.0 \\ | 673.5 |
| reliable and stable assessment | Manual assessment on if the experiment performed reliable and stable. | \- \\ | \- | true | true | true | true |
| number of failed files | Number of files that failed in the workflow. | \- \\ | \- \\ | 0 | 0 \\ | 0 \\ | 0 \\ |

!sumtime.png|width=745,height=745!

\* Dependency of memory consumption on \*output\* resolution from \*July 7 - July 25, 2014\*


\|\| Metric \|\| Description \|\| Metric baseline \|\| Metric goal \|\| \_resolution 64 points\_ \|\| \_128 points\_ \|\| \_256 points\_ \|\| \_512 points\_ \|\|
\| \[maximum peak memory used\|http://purl.org/DP/quality/measures#98\] \| Maximum of the peak memory used in processing, measured in megabytes. \| \_\-\_ \\ \| \_\-\_ \\ \| 32.058 \| 256.005 \| 2048.005 \| 16384.006 \|
\| \[max object size handled in bytes\|http://purl.org/DP/quality/measures#404\] \| Maximum size of PFM file, measured in megabytes. \\ \| \\- \\ \| \\- \| 33.82 \| 33.82 \\ \| 33.82 \| 33.82 \|
\| \[min object size handled in bytes\|http://purl.org/DP/quality/measures#405\]\\ \| Minimum size of input file in megabytes. \\ \| \\- \\ \| \\- \\ \| 0.28 \| 0.28 \\ \| 0.28 \\ \| 0.28 \\ \|

\!wikimem.png\|width=766,,height=766\!

h2. Technical details

\* Values of "maximum peak memory used" metric were extracted from \*/proc/self/status\* file, concretely the field "RSS" was used. The \*resident set size\* is the ammount of a process's memory that is actually held in RAM.
* The actual wall time was measured. The *boost* library was used for time measurement.




h2. Evaluation notes