Update on UDFR (Unified Digital Format Registry) NDIIPP Meeting June 25, 2009 Andrea Goethals

Today’s agenda Why do we need a format registry for digital preservation? UDFR background and process

Why do we need a format registry for digital preservation?

Usability A key goal of digital preservation is to maintain the usability of the information content stored in digital form We need to be able to: – Determine if it’s already or likely to become unusable – Make plans to take action if its already or likely to become unusable

Using information content information content bits formats SW HW HW (paper) information content HW (paper) symbols language Analog book Unmediated use Digital book Technology-mediated use

Formats are key to determining usability information content bits formats SW HW supporting technologies digital content Formats are the bridge between the content we want to preserve and supporting technologies

How do we know if it’s usable? 1.Determine content’s format 2.Based on format, assess content – What current technologies can render this format? – Are there sustainability issues related to this format? – How is this format viewed by the preservation community?

What do we do if its unusable? Based on the format, develop plan for action – What alternative formats could be used for the content? – What software can transform between these formats? – What technologies can emulate this format? – Is there enough documentation to write a renderer for this format?

Format registry: pooled knowledge For these formats… Repository A For these formats… Repository B For these formats… Repository C For these formats… Repository D What current technologies can render this format? Are there sustainability issues related to this format? How is this format viewed by the preservation community? What alternative formats could be used for the content? What software can transform between these formats? What technologies can emulate this format? Is there enough documentation to write a renderer for this format?

Format Registry Format information + much more Common format model & identifiers

A base for a network of preservation tools and services Format Registry Repository ARepository BRepository CRepository D Assessment Services Format Validation Tools Format Transformation Tools Format Identification Tools Migration Services Tech. Watch Services Emulation Services

UDFR background and process

Unified Digital Format Registry Combination of two format registry initiatives – PRONOM (UK National Archives) Make use of software and reuse data – Global Digital Format Registry (GDFR) Support use cases, data model and distributed architectural model Plus additional features – Local registry extensions – Distributed data input & quality vetting

UDFR Governance Interim governing body (April - Nov. 2009) – Library and Archives Canada – The National Archives UK – Harvard University Library – The British Library – University of Illinois UC Permanent governing body (Nov ) – Georgia Institute of Technology – NARA – Koninklijke Bibliotheek – Library of Congress

Interim Process: 2 working groups Technical working group – Subset of interim governing body members + some additional experts/consultants Governance working group – All interim governing body members

Schedule Have a 1.5 year roadmap It’s very ambitious! Maybe too ambitious?

June-September 2009 Technical Working Group – Use cases / functional requirements – Data model – Investigate technologies for distributed data input – Phase 1 registry requirements – Phase 1 development plan

June-September 2009 Governance Working Group – Organizational structure – Financial model – Registry operations – Membership constraints and responsibilities – IP policy for registry software and data

September – October 2009 Invitation for public comment on: – Proposed governance charter – Proposed registry policy for IP – UDFR Phase 1 functional requirements – UDFR Phase 1 development plan

October 2009 Technical working group – Oversee technical specification development Governance working group – Proposal for editorial process for vetting contributed data

November 2009 Permanent governing body established – Establishes funding model – Takes over all interim body work – Revises schedule if necessary UDFR Phase 1 development begins

According to plan… Feb. 2010: UDFR Phase 1 ready for testing March 2010: UDFR Phase 1 in production June 2010: UDFR Phase 2 ready for testing July 2010: UDFR Phase 2 in production – Includes editorial process for data contributions

Questions? Pam Armstrong Andrea Goethals