Open Archive Initiative – Protocol for metadata Harvesting (OAI-PMH) Surinder Kumar Technical Director NIC, New Delhi 011-24305503.

Slides:



Advertisements
Similar presentations
A centre of expertise in digital information management The OAI Protocol for Metadata Harvesting Andy Powell UKOLN,
Advertisements

Search, access and impact: Web citation services Tim Brody Intelligence, Agents, Multimedia Group University of Southampton.
A busy persons introduction to OAI-PMH Christopher Gutteridge ALT, April 2003.
A brief overview of the Open Archives Initiative Steve Hitchcock Open Citation Project (OpCit) Southampton University Prepared for Z39.50/OAI/OpenURL plenary.
DLM-Forum - Barcelona, 7-8 May 2002 Promoting and Supporting Open Archives in Europe: The Open Archives Forum Project Donatella Castelli IEI-CNR
OLAC Process and OLAC Protocol: A Guided Tour Gary F. Simons SIL International ___________________________ OLAC Workshop 10 Dec 2002, Philadelphia.
The Discovery Landscape in Crystallography UKOLN is supported by: Monica Duke UKOLN, University of Bath, UK – eBank UK project A centre.
Y.T. a brief history of the OAI 0 Kaynak: Herbert van de Sompel.
OAI in DigiTool DigiTool Version 3.0.
OAI-PMH Dawn Petherick, University Web Services Team Manager, Information Services, University of Birmingham MIDESS Dissemination.
OAIster != Google Kat Hagedorn University of Michigan Libraries October 26, 2007.
Building Digital Libraries on Open Archives Donatella Castelli IEI-CNR Italy.
UCLA Digital Library UC Digital Library Forum August 5, 2002 UCLA Digital Library Presenter: Curtis Fornadley Senior Programmer/Analyst.
The Open Archives Initiative Simeon Warner (Cornell University) Symposium on “Scholarly Publishing and Archiving on the Web”, University.
OAI Standards for Sheet Music Meeting March 28-29, 2002 Basic OAI Principals How They Apply to Sheet Music Presenter: Curtis Fornadley, Senior Programmer/Analyst.
The Open Archives Initiative Simeon Warner (Cornell University) Open Archives seminar “Facilitating Free and Efficient Scientific.
OAI and OAIster Kat Hagedorn University of Michigan Libraries October 30, 2006.
The Open Archives Initiative Simeon Warner Cornell University, Ithaca, NY, USA CREPUQ 2002, Montréal, Canada 14:00, 24 October 2002.
Release 4 of the COUNTER Code of Practice for e- Resources and new usage- based measures of impact Peter Shepherd COUNTER May 2014.
A Digital Library Repository Utilizing the Open Archives Initiative Developed to meet the needs of UTK Library Special Collections.
Publishing Digital Content to a LOR Publishing Digital Content to a LOR 1.
Introduction to the OAI Metadata Harvesting Protocol Hussein Suleman, Digital Library Research Laboratory Virginia Tech.
32nd LIBER Annual General Conference - Rome, June 2003 Open archive solutions to traditional archive/library cooperation Donatella Castelli ISTI-CNR.
Open Archives Iniative – Protocol for Metadata Harvesting Iztok Kavkler, University of Ljubljana Some slides by Stefaan Ternier, KUL Bram Vandenputte,
Avano, an OAI harvester for marine and aquatic sciences Fred Merceur What could be improved in OAI-PMH protocol and in repositories implementation?
Indo-US Workshop, June23-25, 2003 Building Digital Libraries for Communities using Kepler Framework M. Zubair Old Dominion University.
07/11/2002Thomas Baron - JACoW Workshop1 CERN Library Requirements T. Baron CERN ETT-DH-CDS.
SCIELO AS AN OPEN ARCHIVE: the development of SciELO / OpenArchives data provider interface Prof. Carlos H. Marcondes Federal Fluminense University/ Information.
A centre of expertise in digital information management RDN, e-Prints UK and NOF- Digitise: a (very) small sample of UK OAI activity Andy.
OAI-PMH: Open Archives Initiative Protocol for Metadata Harvesting T.B. Rajashekar National Centre for Science Information (NCSI) Indian Institute of Science,
Sharing With the Open Archives Initiative Jenn Riley Metadata Librarian Indiana University.
Metadata harvesting in regional digital libraries in PIONIER Network Cezary Mazurek, Maciej Stroiński, Marcin Werla, Jan Węglarz.
The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --
Open Archives Initiative Protocol for Metadata Harvesting (OAI-PMH) Phil Barker, March © Heriot-Watt University. You may reproduce all or any part.
Caltech CODA CODA: Collection of Digital Archives Caltech Scholarly Communication.
Slavic Digital Text Workshop 2006 The Open Archives Initiative Protocol for Metadata Harvesting: an Opportunity for Sharing Content in a Distributed Environment.
1 GRID Based Federated Digital Library K. Maly, M. Zubair, V. Chilukamarri, and P. Kothari Department of Computer Science Old Dominion University February,
OAI Overview DLESE OAI Workshop April 29-30, 2002 John Weatherley
Integrating Access to Digital Content Sarah Shreeves University of Illinois at Urbana-Champaign Visual Resources Association 23 rd Annual Conference Miami.
Bitter Harvest Metadata Harvesting Issues, Problems, and Possible Solutions Roy Tennant California Digital Library.
Search Interoperability, OAI, and Metadata Sarah Shreeves University of Illinois at Urbana-Champaign Basics and Beyond Grainger Engineering Library April.
Metadata and OAI DLESE OAI Workshop April 29-30, 2002 Katy Ginger Presentation available at:
Metadata and OAI DLESE OAI Workshop June 29 to July 2, 2002 Katy Ginger Presentation available at:
The OAI: technical overview OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University -- Computer Science.
The Open Archives Initiative Marshall Breeding Director for Innovative Technologies and Research Vanderbilt University
Open Archives Initiative Protocol for Metadata Harvesting.
Sharing Digital Scores: Will the Open Archives Initiative Protocol for Metadata Harvesting Provide the Key? Constance Mayer, Harvard University Peter Munstedt,
Open Archive Forum Rachel Heery UKOLN, University of Bath UKOLN is funded by Resource: The Council for Museums, Archives.
Standards OAI-Protocol Metadata: DC - Agris - MODS Marc Goovaerts Hasselt University Library ODIN-PI TRAINING OSTENDE, May 2008.
Designing Protocols in Support of Digital Library Componentization Hussein Suleman and Edward A. Fox Digital Library Research Laboratory Virginia Tech.
2/22/2016J Ammerman1 Open Archives Initiative What is it? What’s it good for?
NSDL & the Open Archives Initiative A Brief Introduction to OAI Timothy W. Cole Mathematics Librarian & Professor of Library Administration.
Metadata-based Discovery: Experience in Crystallography UKOLN is supported by: Monica Duke UKOLN, University of Bath, UK A centre of.
1 CS 430: Information Discovery Lecture 26 Architecture of Information Retrieval Systems 1.
The NSDL, OAI and Your Metadata Core Infrastructure Metadata Repository (“union catalog”) Naomi Dushay Cornell University.
Metadata & Repositories Jackie Knowles RSP Support Officer.
OAI and ODL Building Digital Libraries from Components Hussein Suleman Virginia Tech DLRL 12 September 2002.
Web Services Overview Thomas Hickey. 2 What are Web Services? Machine-to-machine communication Run over standard Web protocols –XML syntax, HTTP packaging.
Harvesting and Exporting Metadata 714: Metadata Margaret E.I. Kipp -
Repository Development – Universiteit Antwerpen november 2012.
Metadata Harvesting - OAI-PMH
Lifecycle …of OAI …of DPs and SPs
Repository Software - Standards
Repository Software Marc Goovaerts, Hasselt University Library
Institutional Repository at NIO: Inspiration to Implementation
OAI and Metadata Harvesting
Digitometric Services for Open Archives Environments
OAI 11/20/07.
Open Archive Initiative
IVOA Interoperability Meeting - Boston
Presentation transcript:

Open Archive Initiative – Protocol for metadata Harvesting (OAI-PMH) Surinder Kumar Technical Director NIC, New Delhi

OAI-PMH The mission of the Open Archives Initiative (OAI) ( is to develop and promote “interoperability standards that aim to facilitate efficient dissemination of content.

OAI-PMH The OAI-PMH is based on a simple and powerful model “whereby repositories (data providers) make metadata... available via a well-defined protocol. The exposure of the metadata allows other organizations (service providers) to harvest it and then aggregate it, post-process it, and refine it with the goal of developing services that add value.

Background Has origins in ePrints (arXive, CogPrints), dating back to 1999 – actively seeking wider applicability – Nothing to do with OAIS Aims to “f acilitate the efficient dissemination of content” – free access to the archives (at least: metadata) – consistent interfaces for archives and service provider – low barrier protocol / effortless implementation (e.g., because based on HTTP, XML, DC) Now on version 2.0 (June 2002)

OAI-PMH: what’s it all about Service providers harvest metadata from data providers. Requests (HTTP) Metadata (XML) Data provider Metadata (+ resources) Harvester Service Provider Metadata “service” Adapted from OAI PMH

What can be requested (verb) Description of the archive (Identify) A list of metadata formats supported by the data provider (ListMetadataFormats) A list of sets provided (ListSets) A list of resource identifiers (ListIdentifiers) Many records (ListRecords) An individual record (GetRecord)

Example Requests archive.example.org/oaipmh?verb= ListRecords&metadataPrefix=oai_dc

Metadata Formats Metadata may be returned in any XML format Dublin Core is mandatory – OAI-PMH specifies the XML schema to use – No single DC element is mandatory Other element sets / bindings are optional – Qualified DC (e.g. RDN, NSDL) – MODS (LoC) – LOM (RDN-LTSN) – ODRL (JORUM ( I think) ) –...

Sets A grouping of items made to allow selective harvesting – E.g. all theses – E.g. the Engineering section – E.g. all resources from a given source Optional

List Records Harvester can ask for specific metadata format for – All available items – All items in a set – All records modified in given date range – (A single item — GetRecord) Data provider can return – All relevant records – Some relevant records + resumption token – An error code (no such set / metadata format)

Static Repositories Even lighter-weight specification for data providers with small and relatively static collections – E.g. the output from a conference Essentially an XML file available at a URL Accessed through a “static repository gateway” intermediary

Issues: complexity Providing data is easy Harvesting data is easy However Doing so may lead to complex workflow / policy issues – What do you do with the harvested metadata? – Do you modify the metadata you harvest? – If so, do you feed this back to the provider? – What if the provider changes a modified record? – Does a service provider disseminate via OAI?

Issues: uptake Lots of implementers, who have produced lots of useful support However Relatively little commercial uptake Relatively little support for harvesting rich metadata Relatively little support/consensus on sets

Issues: Harvesting resource (e.g. Full text) Nothing in OAI-PMH requires that full-text should be available for harvesting. – Resource may be physical or accessed controlled Nothing in OAI-PMH requires that information required for harvesting should be available. However in many cases OAI-PMH will provide the information required to harvest the resource.

Service Provider Arc: A Cross Archive Search Service From October 2000 Arc is an experimental research service that serves as a platform for demonstrating the scalability of the OAI-PMH and as a vehicle for providing access to OAI-compliant repositories through a unified search interface. Arc is the oldest federated search service based on the OAI-PMH.

OAISTER OAIster is a union catalog of digital resources. We provide access to these digital resources by "harvesting" their descriptive metadata (records) using OAI-PMH (the Open Archives Initiative Protocol for Metadata Harvesting).OAI-PMH

Service Providers Citebase May 2001 Citebase “allows researchers to search across free, full-text research literature eprint archives, with results ranked according to many criteria (e.g., citation impact), and then to navigate that literature using citation links and analysis.”

Contd… SAIL-eprints (Search, Alert, Impact and Link) April 2003 SAIL-eprints (Search, Alert, Impact and Link) is “an electronic open access service provider for finding scientific or technical documents, published or unpublished, in Chemistry, Physics, Engineering, Materials Sciences, Nanotechnologies, Microelectronics, Computer Sciences, Astronomy, Astrophysics, Earth Sciences, Meteorology, Oceanography,... [Agriculture], and related... [subjects].”

Resources Open Archives Initiative – – Spec, best practice guide and useful resources, mailing lists OAI for beginners – – Online tutorial OAI Repository Explorer – – Web interface for issuing OAI-PMH requests