Mirroring an OAI archive with an I2-DSI channel Ryan Richardson Edward A. Fox Digital Library Research Laboratory Virginia Tech May 7 th, 2002.

Slides:



Advertisements
Similar presentations
ePrints UK: progress so far Ruth Martin UKOLN, University of Bath
Advertisements

The DRIVER Infrastructure (Digital Repository Infrastructure Vision for European Research) Paolo Manghi ISTI - National Research Council, Italy.
EXtensible Catalog David Lindahl University of Rochester.
1 NDLTD Union Catalog Panel Session 1C, Auditorium Introduction and Opening Statement ETD 2011: 14 th Int. Symp. on ETDs Cape Town, South Africa Edward.
Harvesting Metadata Using OAI-PMH Roy Tennant California Digital Library.
Sustainable Preservation Services for Archivists through Distributed Custody Caryn Wojcik State of Michigan Records Management Services.
ETANA-DL: Leveraging Digital Library Technologies to Support Archaeology Vanderbilt University Nashville, TN -- Sept. 8, 2006 Weiguo Fan, Edward A. Fox,
OAI-PMH Dawn Petherick, University Web Services Team Manager, Information Services, University of Birmingham MIDESS Dissemination.
The Fedora Project April 28-29, 2003 CNI, Washington DC Thornton Staples University of Virginia Sandy Payette Cornell Information Science.
Digital Library in a Box Ming Luo, Hussein Suleman, Edward Fox Virginia Tech Subcontract to Collaborative Project led by University of Florida (also with.
NAL-Institutional Repository: A Case Study CSIR Metadata Harvester I.R.N. Goudar Head, ICAST, NAL National Symposium on Open Access and.
Data-PASS Shared Catalog Micah Altman & Jonathan Crabtree 1 Micah Altman Harvard University Archival Director, Henry A. Murray Research Archive Associate.
Introduction to Digital Libraries hussein suleman uct cs honours 2004.
Introduction to the OAI Metadata Harvesting Protocol Hussein Suleman, Digital Library Research Laboratory Virginia Tech.
How to participate in the Union Catalogue Project Hussein Suleman Sivulile – Open Access South Africa Advanced Information Management.
Hussein Suleman University of Cape Town Department of Computer Science Advanced Information Management Laboratory High Performance.
Open Archives Initiative OAI openarchives.org “Opening Remarks & Historical Overview” - ACM SIGIR’2001 Ed Fox (w. Lagoze.
Project Builder and MediaMatrix: Redefining Access in the Digital Age Dean Rehberger and Michael Fegan MERLOT August 7-10, 2006 New Orleans, LA.
The Internet2 Distributed Storage Infrastructure Project Innovative Computing Laboratory, Tennessee –Micah Beck –Terry Moore.
1 Introduction to NDLTD and Brief History of the ETD Movement ETD 2009: 12 th Int. Symp. on ETDs Pittsburgh, PA: Newcomers Edward A. Fox, Executive.
Ms. Irene Onyancha ISTD/Library & Information Management Services United Nations Economic Commission for Africa The Second Session of the Committee on.
Indo-US Workshop, June23-25, 2003 Building Digital Libraries for Communities using Kepler Framework M. Zubair Old Dominion University.
Digital/Open Access repositories Paul Sheehan Director of Library Services DCU HEAnet National Networking Conference Athlone 11 th November 2005.
Developing a Concept Extraction Technique with Ensemble Pathway Prat Tanapaisankit (NJIT), Min Song (NJIT), and Edward A. Fox (Virginia Tech) Abstract.
Themes Architecture Content Metadata Interoperability Standards Knowledge Organisation Systems Use and Users Legal and Economic Issues The Future.
Open Virginia Tech DLRL Hussein Suleman
Open Archives Work at Virginia Tech Hussein Suleman Digital Libraries Research Laboratory Virginia Tech.
1 NDLTD Welcome and Introduction ETD 2011: 14 th Int. Symp. on ETDs Cape Town, South Africa Edward A. Fox Executive Director, NDLTD,
Creating an Open Archives Metadata Harvesting Protocol Compliant Repository for the American Memory Online Collections OAI Open Meeting, Washington, DC.
Introduction to Digital Libraries hussein suleman uct cs honours 2004.
SCIELO AS AN OPEN ARCHIVE: the development of SciELO / OpenArchives data provider interface Prof. Carlos H. Marcondes Federal Fluminense University/ Information.
Emory ▪ notre dame ▪ oregon state ▪ virginia tech The OCKHAM Project And Digital Library Services Registries.
Metadata harvesting in regional digital libraries in PIONIER Network Cezary Mazurek, Maciej Stroiński, Marcin Werla, Jan Węglarz.
Tsinghua University Library Yang Zhao & Airong Jiang Tsinghua University Library, Beijing China 4 June, 2004 Electronic Thesis and Dissertation System.
Caltech CODA CODA: Collection of Digital Archives Caltech Scholarly Communication.
Alternative Architecture for Information in Digital Libraries Onno W. Purbo
OAI Overview DLESE OAI Workshop April 29-30, 2002 John Weatherley
1 The NSDL Program Stephen Griffin National Science Foundation.
Bitter Harvest Metadata Harvesting Issues, Problems, and Possible Solutions Roy Tennant California Digital Library.
NSDL October 12-15, 2003Eisenhower National Clearinghouse Slide 1 NSDL and the Open Archives Initiative NSDL – OAI – and the Eisenhower National Clearinghouse.
Enforcing Interoperability with the Open Archives Initiative Repository Explorer Hussein Suleman, Digital Library Research.
Hussein Suleman University of Cape Town Department of Computer Science Digital Libraries Laboratory February 2008 Data Curation Repositories:
Introduction to Concept Maps Edward A. Fox and Rao Shen CS5604 Fall 2002 “Information Storage & Retrieval” Dept. of Computer Science Virginia Tech, Blacksburg,
The Open Archives Initiative Marshall Breeding Director for Innovative Technologies and Research Vanderbilt University
Access to distributed resources Lorcan Dempsey VP, Research Research Library Directors Conference OCLC Institute Post-Conference, "Building the Global.
1 IBM Academic Initiative Introduction for Pamplin School of Business Virginia Tech – October 13, 2011 “IBM Academic Skills Cloud and Computing Education.
ETD Search Services Ming Luo Edward A. Fox Virginia Tech.
Sharing Digital Scores: Will the Open Archives Initiative Protocol for Metadata Harvesting Provide the Key? Constance Mayer, Harvard University Peter Munstedt,
NSDL Technical Platforms Diagrams. NSDL Collections Technical Platform NSDL.org Library search and browse UI Key Ingest services and tools Repository.
OAI-PMH for Resource Harvesting Tutorial OAI4, October 20 th 2005, CERN, Geneva, Switzerland The American Physical Society Project: Standards-based Mirroring.
ETDs and NDLTD Hussein Suleman University of Cape Town May 2004.
Foundations of, and Experiences with, Componentized Digital Libraries OCKHAM Panel ECDL Rome, Italy Edward A. Fox Digital Library Research.
Designing Protocols in Support of Digital Library Componentization Hussein Suleman and Edward A. Fox Digital Library Research Laboratory Virginia Tech.
2/22/2016J Ammerman1 Open Archives Initiative What is it? What’s it good for?
Open Digital Libraries Edward A. Fox Virginia Tech, Dept. of Computer Science.
Infrastructure Breakout What capacities should we build now to manage data and migrate it over the future generations of technologies, standards, formats,
OAI-PMH Making our collections better known Gail McMillan, Virginia Tech Dorothea Salo, George Mason 26 January 2007.
1 CS 430: Information Discovery Lecture 26 Architecture of Information Retrieval Systems 1.
Identifiers and Repositories hussein suleman uct cs honours 2006.
Internet2 Distributed Storage Infrastructure Status Micah Beck, Chair Network Storage WG Innovative Computing Laboratory University of Tennessee, Knoxville.
The OAI PMH (Open Archives Initiative Protocol for Metadata Harvesting) MetaScholar Initiative All-Project Meeting Atlanta, GA 6/18/2002 Edward A. Fox.
Technical Report 4th CERN Workshop of Innovations in Scholarly Communication (OAI4)
NDLTD Toward Universal Accessibility of ETDs: Building the NDLTD Union Archive Hussein Suleman, Edward A. Fox,
OAI and ODL Building Digital Libraries from Components Ryan Richardson Virginia Tech DLRL 18 September 2003.
OAI and ODL Building Digital Libraries from Components Hussein Suleman Virginia Tech DLRL 12 September 2002.
NIST Office of Data and Informatics (ODI) of the Material Measurement Laboratory Robert Hanisch, director Ray Plante, interoperability expert ODI has responsibility.
The Fedora Project March 19, 2003 ISTEC Symposium, Brazil
And Digital Library Services Registries
SCALABLE OPEN ACCESS Hussein Suleman
Enforcing Interoperability with the Open Archives Initiative Repository Explorer Hussein Suleman, Digital Library Research Laboratory Virginia.
Presentation transcript:

Mirroring an OAI archive with an I2-DSI channel Ryan Richardson Edward A. Fox Digital Library Research Laboratory Virginia Tech May 7 th, 2002

OAI and I2-DSI OAI – metadata harvesting – OAI-PMH – Data providers/Service providers I2-DSI – mirroring and replication Can we put them together to get benefits of both? Is this the first of many higher level mirroring schemes for Internet2, that provide independence from lower level representation issues?

Architectural Diagram Mirror User Internet OAI Server Distributed Director

Technical Issues Resumption tokens – Mirrors are stateless, so any mirror can answer (any part of) a request Every client request to the mirror is logged, to enable log comparison among the mirror archives Mirroring time is dependent on # of records sent in each chunk

The interface

Additional Partners UT-Knoxville developed the I2-DSI tools software Hussein Suleman at VT developed the Repository Explorer for OAI Mirrors are planned across the US and in Mexico and Germany NSF grant IIS provided funding