Open Access & Institutional Repositories, Accra June 2007 Metadata and e-preservation Dr D Peters DISA: Digital Innovation South Africa

2 Topics What is digital preservation? Addressing new challenges…first steps Role of metadata in digital preservation Digital repository functions Legal rights management

3 Future scenario Where will our descendents find today’s information - in 50 years time? In what media will it be presented? What must happen in the space/ time between creation and presentation?

4 What is digital preservation?

5 PARS :DEFINING DIGITAL PRESERVATIONDEFINING DIGITAL PRESERVATION SHORT DEFINITION Digital preservation combines policies, strategies and actions that ensure access to information in digital formats over time. MEDIUM DEFINITION Digital preservation combines policies, strategies and actions to ensure access to reformatted and born digital content regardless of the challenges of media failure and technological change. The goal of digital preservation is the accurate rendering of authenticated content over time LONG DEFINITION Digital preservation combines policies, strategies and actions to ensure the accurate rendering of authenticated content over time, regardless of the challenges of media failure and technological change. Digital preservation applies to both born digital and reformatted content. Digital preservation policies document an organization’s commitment to preserve digital content for future use; specify file formats to be preserved and the level of preservation to be provided; and ensure compliance with standards and best practices for responsible stewardship of digital information. Digital preservation strategies and actions address content creation, integrity and maintenance.

6 Chain of digital preservation Authenticity  Committing to storage  Maintaining in storage  Retrieval  Presentation Transmission  Over time and across technologies  Technological approaches  Digital curation

7 Paradigm shift Preserve an electronic record? Software translation Beyond safe storage Digital components

8 Digital Information Object METADATA DATA Representation Information

9 Addressing new challenges Regional collaboration Stakeholder group to develop national legal and policy frameworks Raise the level of prioritsation of digital preservation through mechanisms of advocacy, research, education and training. Designated responsibility in centre of excellence to support implementation Development of a standard assessment tool to serve in the advocacy of digital preservation functions and build organisation support.

10 Strategies for implementation Research agenda  Archival systems  Methods and tools  Policy and legal framework Education and training  Promotional workshops  Develop suitable educational qualifications  Operational training in digital curation Centre of excellence  Third party service provider: commercial / consortial  Lead a shared community of practice  Trusted digital repository

11 Attributes of a Trusted Digital Repository “…an organisation that has responsibility for the long-term maintenance of digital resources, as well as making them available [through time and across changing technologies] to communities agreed on by the depositor and the repository.” Research Libraries Group

12 Trusted Digital Repository Administrative responsibility Organisational viability Financial sustainability Technological suitability System security Procedural accountability

13 Metadata and Digital Preservation Metadata is the glue of any digital preservation strategy:  Within a digital repository, “metadata accompanies and makes reference to each digital object and provides associated descriptive, structural, administrative, rights management, and other kinds of information.” Clifford Lynch (D-Lib Magazine, 1999)

14 Preservation Metadata Viability  bit stream is intact and readable from digital storage media Renderability  translation of the bit stream into a form that can be viewed by humans, or processed by computers Understandability  providing enough information that the rendered content can be interpreted and understood by users PREMIS Metadata Framework to support the preservation of digital objects

15 Digital Information Object METADATA DATA Representation Descriptive Content Preservation

16 Ingest Access InterPARES Digital Curation Model

17

18 OAIS Information Model SIP = Submission Information Package AIP = Archive In formation Package DIP = Dissemination Information Package

19 Functions of Ingest

20 Archive Information Package

21

22 Technical Metadata

23

24

25 Another Use for LOCKSS OAIS information model lacks a level of metadata that describes partnerships in collaborative archives. Ensuring Access to Mathematics Over Time EATMOT repository: XML-encoded metadata about the partnership members, rights agreements, storage capabilities, preservation policies. LOCKSS for the repository—inexpensive, format-agnostic, self-repairing, no one owns it.

26 Digital Repository Functions Operational  Establish metadata requirements and communication protocols for data ingest  Data management  Archival storage  Access process Management  Preservation planning  Archive administration

27

28 Producer Ingest Archival Storage & Data Manage- ment

29 Ingest validation by format

30 Ingest Administration Access Archival Storage & Data Management

31 Access Archival Storage Data Management

32 Administration Archival Storage & Data Management Access Preservation Planning

33 Preservation Planning Consumer Producer Administration

34

35 Interoperability: creating the wrapper Metadata Encoding & Transmission Standard (METS)  Digital Library Federation-sponsored initiative  XML document format for encoding metadata necessary for  management of digital library objects within a repository  exchange of such objects between repositories (or between repositories and their users).

36 METS & Digital Preservation As a vehicle to express/contain various types of metadata  Descriptive, administrative, structural, rights, technical As a vehicle/wrapper for information and digital repository management  OAIS (SIP, AIP, DIP)

37

38 Content Management Systems General Requirements  Handle repository functions  Representation  Structural organisation  Aggregation  Networked distribution Preservation Requirements  Defined preservation strategy  Metadata support  Integrity checks

39 Legal Rights Management Fair use IP provisions for digital preservation Establishing ownership Open copyright management metadata standards Repositories manage own rights information Integration of IP management metadata Dynamic association of services with digital objects

40 IFLA Definition Information Object WorkExpresssion Item Manifestation

41 Distributed Active Relationships DANIELS, W., C. LAGOSE, et al. (2001). "A Metadata Architecture for Digital Libraries. "

42 Copyright wedge Separates OA from digital preservation Growing trend towards IR  Publicly funded research  Technical, organisational and financial support… Preservation infringement of owners’ rights  Data refreshing – right of reproduction  Migration – derivate works Transfer agreements with publishers Elsevier – allows preprint in IR indefinitely – no modifications..? - no third party right to copy or modify…? SPARC or Scholar’s Copyright Addendum  Creative Commons

43 Digital preservation strategies Network of preservation partners Trusted digital repository Metadata support Digital curation functions Standards: Open Archival Information System (OAIS) IP provisions for digital preservation

44 More information… PADI Preservation Metadata Bibliography: PREMIS: JHOVE: OAIS: pdf/CCSDS B-1.pdf METS: DISA: Digital Innovation South Africa

45 Attribution-NonCommercial-ShareAlike 2.0 South Africa You are free: to copy, distribute, display, and perform the work to make derivative works Under the following conditions: Attribution. You must attribute the work in the manner specified by the author or licensor. Noncommercial. You may not use this work for commercial purposes. Share Alike. If you alter, transform, or build upon this work, you may distribute the resulting work only under a license identical to this one. For any reuse or distribution, you must make clear to others the license terms of this work. Any of these conditions can be waived if you get permission from the copyright holder. Your fair use and other rights are in no way affected by the above.