1. Preservation Rumination Priscilla Caplan, FCLA OCLC DSS February 16, 2005

2. Preservation Basics

3. THE NEED FOR DIGITAL PRESERVATION Number of academic/scholarly journals published online: 15,757 Percent of U.S. federal government publications produced only online in 2003: 65 percent Estimated percent of U.S. federal government publications available only online by 2008: 90 percent From: California Digital Library http://www.cdlib.org/inside/projects/preservation

4. The problem of abundance

5. Percent of web-based references in scientific articles from 3 major journals inaccessible within 2 years of publication: 21% Proportion of websites in 1998 gone in 1999: 44% Life of an average website: 44 days The problem of ephemerality

6. The problems of media life expectancy and obsolescence

7. The problem of format obsolescence

9. The problem of rights

10. Integrity Viability Renderability The Preservation Pyramid Description Secure storage Media management Preservation strategies Availability Identity Capture Selection

11. Authenticity

12. Traditionally, preserving things meant keeping them unchanged; however … if we hold on to digital information without modifications, accessing the information will become increasingly more difficult, if not impossible. From: The Paradox of Preservation, Su-Shing Chen

13. Preservation metadata...is the information necessary to maintain the viability, renderability, and understandability of digital resources over the long-term. OCLC/RLG Preservation Metadata Framework Working Group Understandability

14. Integrity Viability Renderability Revised Preservation Pyramid Description Secure storage Media management Availability Identity Capture Selection UnderstandabilityAuthenticity Preservation strategies

15. Who is doing preservation? Research Libraries Government Archives Historical Societies Individual Collectors

16. Who is doing digital preservation? Research Libraries Government Archives Historical Societies Individual Collectors National Libraries Research Centers Public broadcasting

17. Integrity Viability Renderability Description Secure storage Media management Availability Identity Capture Selection UnderstandabilityAuthenticity Preservation strategies DSPACE

18. Integrity Viability Renderability Description Secure storage Media management Availability Identity Capture Selection UnderstandabilityAuthenticity Preservation strategies LOCKSS

19. Integrity Viability Renderability Description Secure storage Media management Availability Identity Capture Selection UnderstandabilityAuthenticity Preservation strategies OCLC Digital Archive

20. Integrity Viability Renderability Description Secure storage Media management Availability Identity Capture Selection UnderstandabilityAuthenticity Preservation strategies LC Minerva

21. Integrity Viability Renderability Description Secure storage Media management Availability Identity Capture Selection UnderstandabilityAuthenticity Preservation strategies FCLA Digital Archive

22. Preservation in Action

24. State Universities FCLA

25. Designed as a dark archive Preservation repository functions only Based on OAIS functional architecture Bit-level and Full preservation Format migration and normalization

26. OAIS Functional Architecture

27. DAITSS Functional Architecture Ingest SIP AIP Storage management Access DIP Reporting Mgmt DB LIBRARYLIBRARY LIBRARYLIBRARY

28. DAITSS Data Model Intellectual entity (1) Bitstream (0..n) Information Package Data File (1..n)

29. DAITSS Data File Object DAITSS Bitstream Object

30. Risk Management Storing multiple master copies of files Calculating two message digests Storing metadata as XML and in RDBMs Normalizing when possible Always retaining original Action plans and background papers

31. Ingest Functions METS validation and metadata extraction Virus check and checksum verification File format identification Creation of Data File and Bitstream objects Harvesting of external files Normalization and Forward Migration Technical, relationship and event metadata AIP creation Storage update Data table update

32. Ingest Example: A simple SIP XML PDF AVI SIP

33. XML PDF AVI SIP XML TIFF Database AIP

34. Future Plans Find partners to install at other places Finish DAITSS Release under open source license Build a community of developers for different formats

35. References Priscilla Caplan: www.fcla.edu/~pcaplan, pcaplan@ufl.edu FCLA Digital Archive: www.fcla.edu/digitalArchive Terry Kuny, A Digital Dark Ages? www.ifla.org/IV/ifla63/63kuny1.pdf PREMIS Implementation Survey www.oclc.org/research/projects/pmwg/surveyreport.pdf Roy Rosenzweig, Scarcity or Abundance? www.historycooperative.org/journals/ahr/108.3/rosenzweig.html ONeil et al. Trends in the Evolution of the Public Web www.dlib.org/dlib/april03/lavoie/04lavoie.html Clifford Lynch, Authenticity and Integrity in the Digital Environment www.clir.org/pubs/reports/pub92/lynch.html