Danish Legal Deposit on the Internet National Diet Library, Tokyo, January 2002 by Birgit N. Henriksen Head of Digitization and Web Department The Royal Library, Denmark

Presentation outline Experiences with legal deposit of web materials in DK since 1998 Period with new projects, A new strategy in the future?

Denmark 5 million people in Northern Europe

The Danish Legal Deposit Law 1697: The first legal deposit law in Denmark 1902: All printed materials to be deposited 1997: All published works to be deposited

The law from 1997 covers any work published in Denmark regardless of medium “work”: a delimited quantity of information which must be considered a final and independent unit “published”: when … copies of the work have been placed on sale or otherwise distributed to the public

Types of Net Publications Static publications included (only periodically updated) monographs periodicals Dynamic publications excluded (continuously updated) Databases Homepages

Notification Who the person in charge of the technical completion of the digital copy How by filling out a form at the Danish legal deposit website: When as soon as the net publication is placed on the web. The Royal Library must then download it within three months

DC Registration Form - Monographs

Download - workflow The staff at the Danish Department : determine whether a publication is covered by the law if yes, download all files belonging to the work check downloaded work catalogue and classify the work in the OPAC (only periodicals) transfer work to archival server (server mirrored every night to State and University Library, Århus)

Cataloguing – Indexing Danish Bibliographic Centre makes MARC records of the part included in the National Bibliography Searches in OPAC supplemented or replaced with: access by searching directly in data provided by the publisher full text search in the archived material through a ‘web index’ – the same way you use the material when it is online on the net

Access to archived web material Theory - Restricted Access One PC in each legal deposit library placed in a reading room – free for all No possibility of making electronic copies from the archive, only paper print-outs Practice - No Access

Statistics January 2002 Subdomains within top level domain.dk: # subdomains in Denmark: 352,000 # subdomains in archive: ~ 1,000 Volume: # net publications : 10,522 # files :693,309 # Gbytes: 23 Content: 1/3 monographs, 2/3 periodical issues 2/3 public publishers, 1/3 private publishers

Staff resources Man YearsPaid hours/ publication Comment s 19982,312,75 System being developed and set up 19991,91,2 Downloading, cataloguing and classifying all publications ,30,6 Downloading, cataloguing and classifying all periodicals

MimeType Statistics – 2001 % of collected files Selective collection, Denmark Bulk collection, Sweden TEXT/ HTML 59,3 %55,6 % Image (GIF, JPEG, PNG) 37,9 %40,0 % PDF1,7 %1,0 % Other formats 1,1 %3,4 %

Problems related to harvesting Errors or inconsistencies in the published files Java applets and java scripts – no solution at the moment Data protected with username/password logins is covered by the law but more difficult to download Can't harvest more sophisticated formats Can't harvest interactive processes

Summary Selective web archiving based on notification covered by law and practiced since 1998 Only static publications Doesn’t get everything covered by the law Doesn’t get a representative part of the net Doesn’t get the most advanced part Labour intensive Cataloguing partly replaced by alternatives Very restricted access

Web Archiving Conference, CPH June 2001 Focus: User Expectations for web archiving Input from scholars & scientists: Archive the dynamic part of the web Focus on archiving the content the context the evidence of use Archivists: Use different archiving approaches Find new methods for archiving interactive material Budgets for making snapshots and making selective collections are comparable

Why harvesting ? Possible to get a representative part of the net Private and public publishers Material about Danes as well as material that interests the Danes Get new trends as soon as they appear The easiest way to get (all) updated versions quick and easy Accumulative harvesting of news and media

Why not only harvesting? Programmes and plug-ins difficult to handle Harvesting is not always possible (e.g. streamed and web casted material, flash applications, chat …) Harvesting may not give a useful result technical problems (java, interactive sites like net art, games, auctions …) personalised sites services (search engines, route planners, home banking, e-commerce…)

Birte Christensen-Dalsgaard, SB: Archive Experience, not Data

Three Danish web archiving initiatives Legal deposit based on selective approach since 1998, Nordic Web Archive (Nordic project , access to web archives) netarchive.dk (Danish project, multiple archiving strategies, )

netarchive.dk Project testing different archival approaches and the subsequent usability of the archived material for research Project partners: State and University Library, Aarhus Centre for Internet Research, Aarhus University The Royal Library, Copenhagen Economic support from the Danish Electronic Research Library (DEF) Period: August 2001 – July 2002 Case: Danish municipal elections November 2001

netarchive.dk Interactivity StaticDynamic Real time dialog Published, static Signal lifetime Different archival approaches Chatter botsChatWeb conference Report Web forms Searching OPAC Net auctions Net art

Accumulative Snapshot netarchive.dk Interactivity Static Dynamic Real time dialog Published, static Signal lifetime Process Different archival approaches

netarchive.dk - Experiences Experiences with event based harvesting New materials: web sites, discussion groups, portals and chat Hard to find the relevant, new URL’s during the event Experiences with contracts/agreements Only 3 of 44 contracts have been signed Knowledge of agreements do not spread out sufficiently in a top-down organisation Agreements must cover how to harvest (Technical issues) how to give access to harvested (Copyright issues) Experiences with different harvesters Browsers more robust to errors on sites than harvesters, and they interpret programme objects like java scripts

netarchive.dk Process rather than data Make a film of the process ‘container’ with known preservation strategy Accept loss of all functionality ‘Filming’ through a browser Catch chronological series of displayed WebPages Tools to take into consideration: Business intelligence tools Tools used in usability laboratories

New Strategy Proposal Archiving dynamic material must be legal Selective approach replaced/supplemented with bulk collections done by robot harvesting Retain possibility for delivery ‘Filming’ parts of the net Access less restrictive

END