Key
This line was removed.
This word was removed. This word was added.
This line was added.

Changes (9)

View Page History
| *Evaluation* \\ | This Migration and QA solution has been developed as a Taverna workflow using web services. This puts focus on availability rather than scalability. The sparse tests run i February 2012 have also been run through Taverna. \\
\\
We tested the _Mp3 to Wav Migrate Validate Compare Workflow_ on file P1_1000_1200_890106_001.mp3 from the [SP:mp3 (128kbit) with Danish Radio broadcasts|SP:mp3 (128kbit) with Danish Radio broadcasts] testbed dataset. The file is 112 Mbyte and the duration is 2 hours, \\
2 minutes and 5.23 seconds. The workflow was run from Taverna on a local work station using the web services deployed on the SB iapetus test machine. The total time for the workflow is 2.3 minutes, and the most expensive nested workflow is the \\
JHove2Validate workflow with 1.3 minutes, closely followed by the FFmpegMigrate workflow with 59.2 s. The FFprobeExtractCompare workflow with 12.9 seconds seems to be the cheaper QA in this set-up. The result of the workflow is a migrated \\
WAV file, and a report that it is valid and that the extracted properties have been preserved. \\
\\
Running the workflow on 4 additional files from the dataset gave similar results of between 2.2 and 2.3 minutes, valid migrated WAV files and properties preserved. The 6th test run also gave a result wav file, but we could not hear the file, and neither \\
JHOVE2 or FFprobe was able to read the file. Interestingly the nested FFprobe workflow failed, while the nested JHove2 workflow finished, but without output. At the intermediate values, we see the JHOVE2 SCAPE web service is unable to read the \\
\\
We note that we are working on 2-hour sound files. The average file size of the original mp3 files is only 118Mb, but the migrated wav files are approximately 1.4Gb. This means we can probably not hope to improve much on the performance of the \\
actual FFmpeg migration of the individual files. The [SP:mp3 (128kbit) with Danish Radio broadcasts|SP:mp3 (128kbit) with Danish Radio broadcasts] collection is 20 TB and around 150000 files. This means that running the basic workflow migrations sequentially on the test machine would take around 300 \\
days. We can however hope to improve by using the Scape execution platform instead of doing the migrations sequentially. \\
\\
The migrationQA workflow was tested separately, see [SP:SO2 xcorrSound QA audio comparison tool].\\
\\
The full MP3 to WAV Migration + QA workflow has been tested on a shorter file using the ONB webservices. The input mp3 file was the Creative Commons example file [http://ia700308.us.archive.org/21/items/Radiators2008-09-19/Rads2008-19-09-d1t02_vbr.mp3. |http://ia700308.us.archive.org/21/items/Radiators2008-09-19/Rads2008-19-09-d1t02_vbr.mp3 ]The total time was 47.9 seconds. The time for FFmpegMigrate 12.2 seconds. For FFprobeExtractCompare 5.5 seconds. For JHove2Validate 9.6 seconds. And for _migrationQA comparison including MPG321 decoding_ 31 seconds.The output wav file is available from [http://fue.onb.ac.at/scape/tmp/Rads2008-19-09-d1t02_vbr.mp3_SCAPEFFMPEG25305Service_wavFile_4413676179244047691.wav. |http://fue.onb.ac.at/scape/tmp/Rads2008-19-09-d1t02_vbr.mp3_SCAPEFFMPEG25305Service_wavFile_4413676179244047691.wav ]The JHOVE2 validation, the FFprobe comparison and the migrationQA comparison returned true, and the output of the migrationQA comparison looks like this:\\
\\
\\
The migrationQA workflow was tested separately, see [SP:SO2 xcorrSound QA audio comparison tool]. \\
\\
The full MP3 to WAV Migration + QA workflow has been tested on a shorter file using the ONB webservices. The input mp3 file was the Creative Commons example file [http://ia700308.us.archive.org/21/items/Radiators2008-09-19/Rads2008-19-09-d1t02_vbr.mp3. |http://ia700308.us.archive.org/21/items/Radiators2008-09-19/Rads2008-19-09-d1t02_vbr.mp3]The total time was 47.9 seconds. The time for FFmpegMigrate 12.2 seconds. For FFprobeExtractCompare 5.5 seconds. For JHove2Validate 9.6 seconds. And for _migrationQA comparison including MPG321 decoding_ 31 seconds.The output wav file is available from [http://fue.onb.ac.at/scape/tmp/Rads2008-19-09-d1t02_vbr.mp3_SCAPEFFMPEG25305Service_wavFile_4413676179244047691.wav. |http://fue.onb.ac.at/scape/tmp/Rads2008-19-09-d1t02_vbr.mp3_SCAPEFFMPEG25305Service_wavFile_4413676179244047691.wav]The JHOVE2 validation, the FFprobe comparison and the migrationQA comparison returned true, and the output of the migrationQA comparison looks like this: \\
\\
\\ {noformat}
block 1: 0.999998 1152
block 2: 1 1152
block 45: 0.999999 1152
block 46: 0.999978 1152
{noformat} |
{noformat}The solution performs as expected and solves the corresponding issue,but further testing for accuracy and performance is required.\\ |