IS14 Diverse preservation risks in large archives with millions of objects

| *Title* \\ | IS14 Diverse preservation risks in large archives with millions of objects |
| *Detailed description* | While we ingested millions of objects in the past, we expanded our knowledge about the risks of the objects. However, before we could make a decision whether the risks required immediate action, we need to have an idea about the severity of the risk. It would be a very costly activitity to re-ingest the millions of objects so a more effective solution would save a lot of time and money. \\
Example issues: \\

Finally there is a relationship with the institutional policies (WP.PW.2) |
| *Scalability Challenge* \\ | Currently we have millions of objects that we would like to have more information about which we did not capture at Ingest and which can't be re-ingested only to get this kind of information |
| *[Issue champion|SP:Responsibilities of the roles described on these pages]* | [Barbara Sierman |~barbarasierman](KB-NL) digital preservation manager |
| *Other interested parties* \\ | _Any other parties who are also interested in applying Issue Solutions to their Datasets. Identify the party with a link to their contact page on the SCAPE Sharepoint site, as well as identifying their institution in brackets. Eg:_ [Schlarb Sven|https://portal.ait.ac.at/sites/Scape/_layouts/userdisp.aspx?ID=32] _(ONB)_ |
| *Possible Solution approaches* | \- make existing tools fit for working in the background of an archive and creating a consolidated list of the results, by extracting information from the objects or the metadata \\
\- create a new tool to work in the background of an archive and capable to do a set of specified actions, like counting file extensions, read a specific metadata field in an object |
| *Context* | _Details of the institutional context to the Issue. (May be expanded at a later date)_ \\ |
| *Lessons Learned* | _Notes on Lessons Learned from tackling this Issue that might be useful to inform the development of Future Additional Best Practices, Task 8 (SCAPE TU.WP.1 Dissemination and Promotion of Best Practices)_ \\ |
| *Training Needs* | _Is there a need for providing training for the Solution(s) associated with this Issue? Notes added here will provide guidance to the SCAPE TU.WP.3 Sustainability WP._ \\ |
| *Datasets* | [KB-IR content|National Library of the Netherlands - Image Repository Content] |
| *Solutions* | _Reference to the appropriate Solution page(s), by hyperlink_ |

h1. Evaluation

| *Objectives* | _Scalability, reliability, automation_ |
| *Success criteria* | _Ideal situation: have a program running in the back ground of our repository that automatically detects some criteria given beforehand, for example detect whether pfd's require a password, or what is in the zip file of additional material in an object. And report about these findings in a clear and understandable way._ |
| *Automatic measures* | _What automated measures would you like the solution to give to evaluate the solution for this specific issue? which measures are important?_ \\
The action should not need too much capacity of the CPU resources, as it need to be running in the background and should not conflict with production activities, this should be adjustable. If so then the scanning of 20 million objects might take a month. \\ |