1 EDLocal: introduction MICHAEL, London 23 May Rob Davies Project Manager

2 For the users it is not important whether the sources of knowledge and experience are kept by archives, libraries or museums, but to get access to the sources they want, and to be able to use these sources across types of sources and sectors of institutions. For the users it is not important whether the sources of knowledge and experience are kept by archives, libraries or museums, but to get access to the sources they want, and to be able to use these sources across types of sources and sectors of institutions.

3 A structure for EDL? EDL National Digital Library ACE Film Archive X EurbicaNational Archive 1 MICHAEL TEL NL 1 NL 2 NL 3 Museum X Archive X National Archive 2 Film Archive 1 Film Archive 2 Film Archive 3 National Archive 3 Library X Museum A Archive A Library A

4

5 Europeana Infrastructure Content level (infinite) Local level (1000s) National level (10s) European level (1) European Digital Library Virtual Information Space National Archives National Libraries Aggregated repositories Archives Items & Collections Libraries Items & Collections Museums Items & Collections

6 Establish trust between the institutions Establish trust between the institutions Create the organisational structure for a European Digital Library (Europeana) Create the organisational structure for a European Digital Library (Europeana) Tackle domain interoperability issues (standards) Tackle domain interoperability issues (standards) Propose a practical implementation of the European Digital Library Propose a practical implementation of the European Digital Library Make recommendations for future research Make recommendations for future research Europeana.Net: goals Europeana.Net: goals

7 EDLocal Best Practice Network Best Practice Network Three years (starts 1 June) Three years (starts 1 June) Improve interoperability of digital content held by regional and local museums, libraries and archives Improve interoperability of digital content held by regional and local museums, libraries and archives Make over 20 million items available initially Make over 20 million items available initially prove the value of local/regionally sourced content prove the value of local/regionally sourced content Europe wide network of regional repositories/ aggregations Europe wide network of regional repositories/ aggregations Integrated Europeana prototype service including EDLocal content Integrated Europeana prototype service including EDLocal content

8 Why should we do this? Make local content infrastructure available for harvesting and indexing by Europeana service Make local content infrastructure available for harvesting and indexing by Europeana service Make branded content available to other service providers Make branded content available to other service providers tourism tourism education education family history family history humanities research humanities research publishing/media industries publishing/media industries through other search engines and services on the web through other search engines and services on the web

9 Standards, tools and infrastructure Establish easy processes for making content available Establish easy processes for making content available Implement Europeana specifications and tools Implement Europeana specifications and tools OAI-PMH repositories OAI-PMH repositories Europeana Metadata Application Profile Europeana Metadata Application Profile And then ….. And then ….. Object Modeling, Authorisation, Usage Logging, Accounting, Payment, Legal and Access Protection Issues (IPR / Rights / DRM), Advanced Semantic Interoperability, Name Authority Services,Multilingualism of Content, Preservation etc Object Modeling, Authorisation, Usage Logging, Accounting, Payment, Legal and Access Protection Issues (IPR / Rights / DRM), Advanced Semantic Interoperability, Name Authority Services,Multilingualism of Content, Preservation etc

10 Types of content Items and collections of high cultural value (treasures) held at local or regional level Items and collections of high cultural value (treasures) held at local or regional level Specific local collections held by libraries, museums and archives, local audio-visual archives Specific local collections held by libraries, museums and archives, local audio-visual archives Public records held by archives etc. Public records held by archives etc.

11 Key objectives Help regions to implement Europeana-friendly infrastructure and standards Help regions to implement Europeana-friendly infrastructure and standards Negotiate sensible aggregation arrangements Negotiate sensible aggregation arrangements (e.g. with national libraries or cultural portals) (e.g. with national libraries or cultural portals) Promote digitisation at local/regional level Promote digitisation at local/regional level Promote and enable future Europeana participation by local/regional content holders Promote and enable future Europeana participation by local/regional content holders

12 EDLocal partners – analysis EDL Foundation EDL Foundation 1 Ministry of Culture 1 Ministry of Culture 2 national libraries (as aggregators of local content) 2 national libraries (as aggregators of local content) 2 national museums 2 national museums 3 national cultural agencies 3 national cultural agencies 5 regional cultural authorities 5 regional cultural authorities 7 public libraries 7 public libraries 1 local museum 1 local museum 1 research foundation 1 research foundation 1 regional digital library provider 1 regional digital library provider 7 private sector organisations 7 private sector organisations

13 EDLocal partners 1Sogn og Fjordane County Municipality 2Stichting European Digital Library 3MDR Partners 4Public Library 'Pencho Slaveykov' (Public Library of Varna) 5Cyprus Research and Educational Foundation 5Cyprus Research and Educational Foundation 6Cross Czech A.S 7Roskilde Kommune 7Roskilde Kommune 8City of Helsinki 8City of Helsinki 9Zentral- und Landesbibliothek Berlin 10Veria Central Public Library 11Békés County Library & Human Service Centre 12An Chomhairle Leabharlanna 13Regione Marche 14National Library of Latvia 15Dizi (Lithuania)

14 EDLocal partners (2) 16AcrossLimits Technologies Ltd 17MDA (Europe) 17MDA (Europe) 18Instytut Chemii Bioorganicznej PAN 19Fundacao Museu Nacional Ferroviario 20Biblioteca Judeteana "Octavian Goga" Cluj 21Slovenské národné múzeum (Slovak National Museum) 22Narodna in univerzitetna knjižnica 23Stiftelsen Länsmuseet Västernorrland 24EEA s.r.o. 25Asplan Viak Internet AS 26Angewandte Informationstechnik Forschungsgesellschaft mbH 27Provincie Limburg 28Eesti Rahva Muuseum (Estonian National Museum) 29Conseil Général de la Gironde 30Stichting Brabantse Regionale Geschiedbeoefening 31Ministry of Culture, Spain 32ABM Utvikling, Norway

15 One partner per country Very different starting points Very different starting points Advanced practice in implementing digital libraries, portals, OAI- PMH etc (France, Norway, Poland, Spain, UK) Advanced practice in implementing digital libraries, portals, OAI- PMH etc (France, Norway, Poland, Spain, UK) Limited progress (Bulgaria, Greece, Romania etc) Limited progress (Bulgaria, Greece, Romania etc) Somewhat centralised versus very regional/local Somewhat centralised versus very regional/local Establish EDL-friendly infrastructure Establish EDL-friendly infrastructure OAI-PMH repositories OAI-PMH repositories Europeana metadata application profile Europeana metadata application profile Work towards a sensible level of aggregation Work towards a sensible level of aggregation Digitise more Digitise more Identify centre of competence on digitisation Identify centre of competence on digitisation Train people Train people Establish some priorities for digitisation Establish some priorities for digitisation Work cross domain Work cross domain archives, audio-visual archives, museums archives, audio-visual archives, museums

16 Main stages Kick off meeting, London 26/7 June - structure, goals Kick off meeting, London 26/7 June - structure, goals Analyse what content we have available, what metadata and infrastructures in use Analyse what content we have available, what metadata and infrastructures in use Themes? Themes? EDLF sets up parallel test environment EDLF sets up parallel test environment index harvested EDLocal content (eventual convergence) index harvested EDLocal content (eventual convergence) implement Europeana interface developments implement Europeana interface developments EDLocal guidance on installing repositories and supports implementation where necessary EDLocal guidance on installing repositories and supports implementation where necessary Fedora, DSpace, EPrints, Greenstone etc Fedora, DSpace, EPrints, Greenstone etc import from existing databases to OAI-PMH repositories import from existing databases to OAI-PMH repositories automate metadata conversion automate metadata conversion convert vocabularies to improve semantics convert vocabularies to improve semantics

17 Main stages (2) Regional training workshops and technical help/support Regional training workshops and technical help/support Local implementation planning Local implementation planning phased/groups phased/groups Policy/dissemination work Policy/dissemination work Sensible levels of aggregation Sensible levels of aggregation Low entrance barrier for new content suppliers to join Low entrance barrier for new content suppliers to join Promoting low-cost digitisation (e.g. Minerva guidelines) Promoting low-cost digitisation (e.g. Minerva guidelines) National Meetings National Meetings Website service Website service Evaluation and progress monitoring Evaluation and progress monitoring User perspective, national user groups, impact study User perspective, national user groups, impact study

18 Key technical focus Map existing metadata to Europeana application profile Map existing metadata to Europeana application profile SKOS local vocabularies emerging from EDLocal SKOS local vocabularies emerging from EDLocal Monitor impact of alternative/ complementary infrastructural standards beyond OAI-PMH Monitor impact of alternative/ complementary infrastructural standards beyond OAI-PMH Object modelling/ORE, Object modelling/ORE, RSS/|ATOM RSS/|ATOM Semantic web Semantic web Social networks Social networks Things adopted centrally which may have local implications Things adopted centrally which may have local implications Collections Collections Rights expression (C20 black hole) Rights expression (C20 black hole) Identifiers Identifiers Locally-implemented processes for metadata enrichment? Locally-implemented processes for metadata enrichment? Road testing and bug identification for Europeana tools Road testing and bug identification for Europeana tools

19 Technical partners Asplan Viak (Norway) and EEA (Slovakia) Asplan Viak (Norway) and EEA (Slovakia) Transfer knowledge from EDLF central to technical partners Transfer knowledge from EDLF central to technical partners Europe coverage split in two Europe coverage split in two Get involved with Europeana.net working groups Get involved with Europeana.net working groups Establish effective support to local regional partners Establish effective support to local regional partners training workshops training workshops translated guidelines translated guidelines Individual partner implementation plans Individual partner implementation plans help desk and flying doctor help desk and flying doctor Establish tools scenario Establish tools scenario automated metadata conversion tools etc? automated metadata conversion tools etc?

20 Contributing content – not straightforward Content collections items and resources Content providers, mediators and aggregators Machine-to-machine technologies End-user service technologies EDLocal content provider organisation Content XML/HTTP Resources Collections Metadata harvesting Legacy databases Standards Items IPR Metadata OCR Mining Commission EDLocal Michael EDL Foundation Committee of Regions National Cps Ministries of Culture Local Cps Regional Cps National initiatives Thematic networks MinervaTEL Tagging Folksonomies Ontologies OWL RDF OAI-PMH SemanticWeb Meta noise Taxonomies Collabularies Search engines Geography Deep content Web Services Web 2.0 Future services Syndication/RSS/Atom XML/HTTP WIKIs Participation Blogs Open Source Multi-lingual services Business models AJAX IPR EDLnet Application profiles Authentication Controlled vocabularies Payment i2010 Google TELplus TEL-ME-MOR Europeana Fedora DSpace Greenstone SKOS

21 Open Archive Initiative Protocol for Metadata Harvesting Item metadata URL Collection metadata Object Reuse and Exchange Object data OAI-PMH Repository & Toolkit Metadata storage Object data model for storage of metadata according to a joint EDLocal application profile Data migration toolkit Tools to facilitate migration of metadata from existing object data model to repository including harmonization Web Service GetRecord, Identify, ListIdentifiers, ListMetaDataFormats, ListRecords, ListSets

22 Establishing local repositories EDLnet tools and standards Assess available technologies Select preferred product Choose repository technology Identify hardware needs Acquire and configure hardware Establish hardware platform Install and configure software Perform production testing Establish software platform Metadata export from existing system Migrate content

23 Content migration process steps Content & Content Collections Metadata extraction Local classification shemas Metadata harmonization & cross mapping Controlled vocabularies Multi-linguality Metadata enrichment IPR clearance Assign Unique IDs Populate repository Authentication mechanisms Europeana

24 Challenges of different types of contentC Local content Standards compliant online content Online content from legacy systems Content which only exists as metadata Born digital content

25 Metadata enrichment Object data Persons and roles metadata Topical metadata Geography and coverage metadata Temporal metadata Mainly manually entered but also process text to look for person names Similar technology as is applied by search engines, extracting keywords and assigning relevance according to frequency Coverage is specified in any number of ways such as geographical names, administrative entities and coordinates. Need geo-metadata Difficult to get disambiguous temporal metadata but possible

26 How to persuade local institutions to contribute? Pragmatic approcah Must take into account existing infrastructure and systems Wider picture Improved discoverability and accessibility to content Regional services Need to establish basis for services on regional level Granularity Must be able to link content to common ontology European services Need a killer application on trans national level Legacy systems A multitude of database and storage technologies exist without any apparent standardisation Local repository Local services are built on existing systems and the local repository doesnt immediately add value to existing system Regional repository Regional repositories might form the basis for services useful to local institutions but do not currently exist EDL repository Once information arrives in EDL repository metadata granularity will have increased because of harmonization EDL applications EDL applications are currently focussed on 3rd party end-users and does not immediately add value to local institutions

27 Time to make a start on a big job! Contact com