Presentation is loading. Please wait.

Presentation is loading. Please wait.

Besser--VALA 2/8/02 1 Moving from Isolated Digital Collections to Interoperable Digital Libraries VALA 2002 Conference Howard Besser UCLA School of Education.

Similar presentations


Presentation on theme: "Besser--VALA 2/8/02 1 Moving from Isolated Digital Collections to Interoperable Digital Libraries VALA 2002 Conference Howard Besser UCLA School of Education."— Presentation transcript:

1 Besser--VALA 2/8/02 1 Moving from Isolated Digital Collections to Interoperable Digital Libraries VALA 2002 Conference Howard Besser UCLA School of Education & Information http://www.gseis.ucla.edu/~howard

2 Besser--VALA 2/8/02 2 Moving from Isolated Digital Collections to Interoperable Digital Libraries- _ Digital Collections vs Digital Libraries -- What’s missing? _ Importance of Standards and New Metadata Models _ Best Practices & Standards for Managing Digital Projects _ Longevity _ Other issues remaining in order to create real Digital Libraries

3 Besser--VALA 2/8/02 3 Important parts of conventional Libraries- _ Components _ Ethics & Traditions

4 Besser--VALA 2/8/02 4 Components _ Service to a clientele _ Stewardship over a collection _ Sustainability _ Ability to find material outside that collection

5 Besser--VALA 2/8/02 5 Ethics & Traditions _ Free speech _ Privacy _ Equal access to info _ Diversity of info _ Serving the underserved

6 Besser--VALA 2/8/02 6 Brief Digital Library Funding History

7 Besser--VALA 2/8/02 7 Moving from Digital Collections to Digital Libraries _ What’s the difference? –not experiments –real users –service –longevity

8 Besser--VALA 2/8/02 8 Traditional Digital Collection Model DL user search & presentation

9 Besser--VALA 2/8/02 9 Ideal Digital Collection Model DL user search & presentation

10 Besser--VALA 2/8/02 10 Developmental Stages _ Experiment with methods _ Build real operational systems _ Build interoperable operational systems _ Make the system useful for users –For DL Initiatives –For OPACs –For I & A Services –For Image Retrieval

11 Besser--VALA 2/8/02 11 To move from Collections to Libraries, we need _ Standards & Metadata _ Sustainability _ Other issues involving components and ethics/traditions

12 Besser--VALA 2/8/02 12 For Interoperability Digital Collections Need Standards _ Descriptive Metadata for consistent description _ Discovery Metadata for finding _ Administrative Metadata for viewing and maintaining _ Structural Metadata for navigation _... Terms & Conditions Metadata for controlling access...

13 Besser--VALA 2/8/02 13 Metadata is not just indexing terms _ CBIR attributes used for retrieval on color, shape, texture, etc. _ Structural attributes used for page-turning _ Administrative attributes used for managing a digital work over time _ IPR attributes to limit unauthorized use _ Identification attributes to determine what application software is needed to view a particular digital work _ Can be located anywhere

14 Besser--VALA 2/8/02 14 Why are Standards and Metadata consensus important?  Managing digital files over time  Longevity  Interoperability  Veracity  Recording in a consistent manner  Will give vendors incentive to create applications that support this

15 Besser--VALA 2/8/02 15 Moving to New Metadata Models- _ Containers & Packages _ Qualifiers _ Crosswalks

16 Besser--VALA 2/8/02 16 Containers and Packages of Metadata Warwick, not MARC _ modular _ overlapping _ extensible _ community-based _ designed for a networked world to aid commonality btwn communities while still providing full functionality within each community

17 Besser--VALA 2/8/02 17 DC Qualifiers _ allows one community to express important nuances and qualifications, while still making the basic importance available to communities with simple needs _ our community can reflect alternate title, transliterated title, and main title, yet they will all be found under a simple Web search under “title”

18 Besser--VALA 2/8/02 18 Crosswalks  mapping btwn differing metadata structures  eliminate the need for monolithic, universally adopted standards  focus on flexibility and interoperatiblity  RDF-based metadata registries

19 Besser--VALA 2/8/02 19 Crosswalk Example

20 Besser--VALA 2/8/02 20 Best Practices & Standards for Managing Digital Projects- _ Who will your users be? _ Best Practices Guidelines (CDL, MOA2) _ NISO/DLF Imaging Technical Standards _ Managing Multiple Image Files

21 Besser--VALA 2/8/02 21 Why are you Managing this Information?  Organizational mission & type  Users  Uses

22 Besser--VALA 2/8/02 22 Scanning Best Practices _ Think about users (and potential users), uses, and type of material/collection _ Scan at the highest quality that does not exceed the likely potential users/uses/material _ Do not let today’s delivery limitations influence your scanning file sizes; understand the difference between digital masters and derivative files used for delivery _ Many documents which appear to be bitonal actually are better represented with greyscale scans _ Include color bar and ruler in the scan _ Use objective measurements to determine scanner settings (do NOT attempt to make the image good on your particular monitor or use image processing to color correct) _ Don’t use lossy compression _ Store in a common (standardized) file format _ Capture as much metadata as is reasonably possible (including metadata about the scanning process itself)

23 Besser--VALA 2/8/02 23 Why Scale is important

24 Besser--VALA 2/8/02 24 Digital Object Behaviors _ Book example

25 Besser--VALA 2/8/02 25 Metadata Standards (from MOA2) _ Administrative Metadata – for enhancing resource management _ Structural Metadata – for reflecting internal hierarchies and relationships btwn parts _ Raw/Seared/Cooked

26 Besser--VALA 2/8/02 26 The number of variant forms of a work can be enormous _ different views of the same object _ different scans of the same photo _ different resolutions _ different compression schemes _ different compression ratios _ different file storage formats _ different details of the same image _...

27 Image Families

28 Besser--VALA 2/8/02 28 Identification/Provenance  how to deal with different versions (browse, hi-res, medium res) derived from the same scan or different encoding schemes (TIFF, PICT, JFIF)  Vocabulary Standards to express this – VRA Surrogate Categories – CIMI's "Image Elements”

29 Besser--VALA 2/8/02 29 Digital Longevity Serious Longevity Problems _ What we know from prior widespread digital file formats _ Images separating from their metadata _ Inaccessibility of software needed to view an image _ Inability to even decode the file format of an image

30 Besser--VALA 2/8/02 30 Digital Longevity The Short Life of Digital Info: Digital Longevity Problems- _ Disappearing Information _ The Viewing Problem _ The Scrambling Problem _ The Inter-relation Problem _ The Custodial Problem _ The Translation Problem

31 Besser--VALA 2/8/02 31 Digital Longevity: The Viewing Problem  Digital Info requires a whole infrastructure to view it  Each piece of that infrastructure is changing at an incredibly rapid rate  How can we ever hope to deal with all the permutations and combinations

32 Besser--VALA 2/8/02 32 Digital Longevity: The Scrambling Problem Dangers from:  Compression to ease storage & delivery  Container Architecture to enhance digital commerce

33 Besser--VALA 2/8/02 33 Digital Longevity: The Inter-relation Problem  -Info is increasingly inter-related to other info  -How do we make our own Info persist when it points to and integrates with Info owned by others?  -What is the boundary of a set of information (or even of a digital object)?

34 Besser--VALA 2/8/02 34 Digital Longevity: The Custodial Problem  How do we decide what to save?  Who should save it?  How should they save it? – -methods for later access: emulation, migration, etc. – -issues of authenticity and evidence

35 Besser--VALA 2/8/02 35 Digital Longevity: The Translation Problem  Content translated into new delivery devices changes meaning – -A photo vs. a painting – -If Info is produced originally in digital form in one encoded format, will it be the same when translated into another format? – Behaviors

36 Besser--VALA 2/8/02 36 Digital Longevity Pieces of the Solution (1/2)  -We need to insist upon clearly readable standardized ways for digital objects to self- identify their formats  -We should discourage scrambling  -We need to better understand information inter-relates to other Info, and what constitutes “boundaries” of Info objects

37 Besser--VALA 2/8/02 37 Digital Longevity Pieces of the Solution (2/2)  -People and organizations wishing to make information persist need guidelines of how to go about doing it  -We need to better understand how translating from one storage or display format to another affects the meaning of a work  -We need to save the “behaviors” of a digital object, not just it’s “contents”

38 Besser--VALA 2/8/02 38 Digital Longevity Metadata can be the first line of defense  Can tell you – where the file is (if you can’t find the file) – where more info about the file is (if you have the file but most other metadata has become separated) – what the file format is – what the compression scheme is – what application program and version is needed for the file

39 Besser--VALA 2/8/02 39 Digital Longevity Migration/Refreshing _ Impact on evidential value

40 Besser--VALA 2/8/02 40 Digital Longevity Older Longevity Projects http://sunsite.berkeley.edu/Longevity/  CPA Task Force  Getty “Time & Bits” Conference & Follow-ups-  Preservation experiments in US and Elsewhere  NEDLIB, CURL, Michigan, Pandora  Internet Archive  Long Now

41 Besser--VALA 2/8/02 41 Digital Longevity Preservation Repositories: Open Archival Info System Model  High-level reference model describing submission, organization and management, and continuing access  Conceptual framework for different organizations to share discussions with a common language  Producers, consumers, management, actual repository  SIP, DIP, AIP  AIP consists of data objects plus representation info (Content, Preservation Description, Packaging, Descriptive)  Originally developed for Space Science community

42 Besser--VALA 2/8/02 42 Digital Longevity Preservation Repositories: Projects based on OAIS Model  CEDARS  NEDLIB  Pandora  CDL  OCLC/RLG Working Group on Preservation Metadata, Attributes of a Trusted Digital Repository, August 2001-

43 Besser--VALA 2/8/02 43 Digital Longevity OCLC/RLG Digital Repository Attributes _ Administrative responsibility _ Organizational viability _ Financial sustainability _ Technological suitability _ System security _ Procedural accountability

44 Besser--VALA 2/8/02 44 Digital Longevity OCLC/RLG Selected Recommendations _ Policies, Certification processes, Risk management, Persistent ID, Migration/Emulation experiments _ Stakeholders meet to decide how to describe what is in a dig repository _ Examine special properties of particular classes of digital objects _ Technical standards for exchange and interoperability btwn repositories _ Develop projects and case studies _ Copyright issues

45 Besser--VALA 2/8/02 45 Digital Longevity Preservation Metadata  OCLC/RLG Working Group on Preservation Metadata, Preservation Metadata for Digital Objects: A Review of the State of the Art, January 31 2001  OCLC/RLG Working Group on Preservation Metadata, A Recommendation for Content Information, October 2001

46 Besser--VALA 2/8/02 46 Digital Longevity Other Digital Preservation Activities-  LC Natl Dig Info Infrastructure & Preservation  InterPARES  Emulation Projects  E-Journal Archiving  ERPANET  Persistent Naming

47 Besser--VALA 2/8/02 47 Digital Longevity LC’s National Digital Information Infrastructure and Preservation Program _ Authorized Dec 2000 _ LC, Dept of Commerce, NARA, White House Office of Sci & Tech Policy _ with help from CLIR, NLM, NAL, OCLC, RLG _ Ongoing collab process _ Commissioned papers on preserving: the Web, periodicals, digital sound, E-Books, Digital TV, Digital Video

48 Besser--VALA 2/8/02 48 Digital Longevity InterPARES International Research on Permanent Authentication Records in Electronic Systems _ Ongoing international archival world project examining how to make electronically-generated records last over time _ Developing the theoretical and methodological knowledge needed, then will formulate model policies, strategies, and standards _ Next year will be extended to include images and rich media

49 Besser--VALA 2/8/02 49 Digital Longevity Emulation Projects _ CAMiLEON (Michigan/Leeds) _ NEDLIB

50 Besser--VALA 2/8/02 50 Digital Longevity E-Journal Archiving _ Issues –License, don’t own; may not be even able to obtain right to make archival copy –Increasingly no paper back-up at all –Usually we don’t have the important redundancy factor _ Mellon funded projects (2001) –Yale, Harvard, Penn working w/individual publishers –Cornell, NYPL--specific disciplines –MIT exploring characteristics that change (dynamic)\ –Stanford--archiving software tools

51 Besser--VALA 2/8/02 51 Digital Longevity Electronic Resource Preservation and Access NETwork (ERPANET) _ Best practices and skills development for digital preservation of cultural heritage and scientific objects _ 3 year project launched Nov 2001; 1.2 million Euros

52 Besser--VALA 2/8/02 52 Digital Longevity What’s special about Cult Heritage Materials? _ Images & rich media _ Inter-relationships btwn parts _ For Contemporary Art: What is the Work?-

53 Besser--VALA 2/8/02 53 Digital Longevity One Final Longevity Question: Who will collect the digital works of today that should become the Special Collections of tomorrow? _ web sites _ zines _ electronic journals _ listserve and email discussions _ drafts of works that later become famous

54 Besser--VALA 2/8/02 54 Other Standards Issues- _ Persistent Naming _ Making your works accessible throughout the Net _ Problems with works residing outside the library’s jurisdiction

55 Besser--VALA 2/8/02 55 Persistent IDs--the Problem _ Need to separate work ID from work location _ URNs probably won’t be ready until 2003 _ Becomes a business process issue when one organization maintains the resource and another organization references it (ie. licensed from vendors or managed by separate administrative structures)

56 Besser--VALA 2/8/02 56 Persistent Naming  URNs  Handles  PURLs  Re-directs

57 Besser--VALA 2/8/02 57 Making your works accessible throughout the Net _ Open Archives & Metadata Harvesting _ An administrative and political issue as much as a a technical one

58 Besser--VALA 2/8/02 58 Problems with works residing outside the library’s jurisdiction _ Open URL _ Authentication

59 Besser--VALA 2/8/02 59 Digitization means New Audiences _ more access for more people _ outreach to new groups _ but new groups have different usability requirements –different user interfaces –different vocabulary –new methods of navigation _ we already have enough differences btwn different institution types (& even within the same type) –MESL results –Organization & indexing reflects the biases of the original intent when records were formed

60 Besser--VALA 2/8/02 60 Still Further Research _ Development of good tools to encourage use _ Seamless integration of Remote-source content with locally-scanned content _ Making specialized vocabulary more accessible to general audiences _ Building Adaptive delivery systems _ Understanding what really is the work-

61 Besser--VALA 2/8/02 61 What Really is the Work? _ Artifact or informational content? _ Creator’s Intent (Gary Hill) _ With artistic works, sometimes it’s very difficult to determine what the work really is, what its boundaries are, etc. (more later if time remains)

62 Besser--VALA 2/8/02 62 LeWitt: Wall Drawing 340

63 Besser--VALA 2/8/02 63 Installing LeWitt

64 Besser--VALA 2/8/02 64 LeWitt Install Directions

65 Besser--VALA 2/8/02 65 ECI - Hole in Space (both)

66 Besser--VALA 2/8/02 66 ECI - 84-locations

67 Besser--VALA 2/8/02 67 ECI - 84-Community Memory

68 Besser--VALA 2/8/02 68 ECI - 84-kids

69 Besser--VALA 2/8/02 69 What do we need for Real Digital Libraries? _ Components –Service to a clientele –Stewardship over a collection –Sustainability –Ability to find material outside that collection _ Ethics & Traditions –Free speech –Privacy –Equal access to info –Diversity of info –Serving the underserved

70 Besser--VALA 2/8/02 70 Moving from Isolated Digital Collections to Interoperable Digital Libraries http://www.getty.edu/gri/standard/intrometadata/ http://www.ifla.org/II/metadata.htm http://sunsite.Berkeley.EDU/Imaging/Databases/ http://www.ucop.edu/irc/cdl/tasw/Current/current.html http://sunsite.Berkeley.EDU/moa2/ http://sunsite.Berkeley.EDU/Longevity/ http://www.gseis.ucla.edu/~howard/image-meta.html http://sunsite.berkeley.edu/Metadata/sp2000.html http://www.gseis.ucla.edu/~howard/ http://is.gseis.ucla.edu/impact/f95/special-collectns.html http://is.gseis.ucla.edu/us-interpares/ http://www.diglib.org/preserve/ejp.htm http://www.longnow.com/10klibrary/TimeBitsDisc/ http://www.archive.org/


Download ppt "Besser--VALA 2/8/02 1 Moving from Isolated Digital Collections to Interoperable Digital Libraries VALA 2002 Conference Howard Besser UCLA School of Education."

Similar presentations


Ads by Google