1 S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29 VizieR repository Lessons learnt and issues.

Slides:

Advertisements

Similar presentations

Chapter 1: The Database Environment

Advertisements

IVOA Registry WG, IVOA Registry WG Pune, 28 Sept 2004.

Registry Interop Summary IVOA Interoperability meeting Cambridge, Boston, MA May 2004.

T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE May 14, 2013 Registry Coverage * Status and Necessity Gretchen Greene 1Apps IV/ Registry I Session -

28 October 2008 IVOA Interoperability Meeting -- Baltimore T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE TAP/VOTable Registry Interface Reg 1 – G.

SSA Query Interface M. Dolensky, ESO Data Access Layer Working Group Interoperability Workshop, Pune, India 27-Sep-2004.

IVOA, Pune September Data Access Layer Working Group SSA Overview and Status Doug Tody National Radio Astronomy Observatory International V.

16 October 2003IVOA Interoperability Conference Registry Working Group VOResource (v0.8.4) XML Schema defining core metadata applicable to all resources.

Yuji Shirasaki National Astronomical Observatory of Japan JVO JVO Publishing/Searchable Registry Implementation Experience IVOA Interoperability Meeting.

May IVOA Interop Meeting1 STScI/JHU Registry Status Gretchen Greene Wil OMullane T HE US N ATIONAL V IRTUAL O BSERVATORY.

23 May 2008 IVOA Interoperability Meeting -- Trieste T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE Resource Registries Closing Plenary Integration.

IVOA Interoperablity meeting KyotoMasahiro Tanaka (NAOJ) 1 JVO use of Globus Toolkit Masahiro Tanaka (NAOJ)

27 October 2008 IVOA Interoperability Meeting -- Baltimore T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE Resource Registries Opening Plenary Registry.

14 Apr 2005 VOEvent workshop1 XML Schema and the VO Registry Matthew J. Graham CACR/Caltech T HE US N ATIONAL V IRTUAL O BSERVATORY.

A centre of expertise in digital information management The OAI Protocol for Metadata Harvesting Andy Powell UKOLN,

OLAC Process and OLAC Protocol: A Guided Tour Gary F. Simons SIL International ___________________________ OLAC Workshop 10 Dec 2002, Philadelphia.

September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.

September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.

NVO Summer School, Aspen Center for Physics1 Publishing and Resource Discovery with Registries Ray Plante Matthew Graham.

Sept NVO Summer School1 Cone, SIAP, and OpenSkyQuery Client Development Gretchen Greene, Maria Nieto-Santisteban T HE US N ATIONAL V IRTUAL O.

DigiTools support of Web Services Repositories and Web Services workshop | 2 June 2009 Alan Oliver, Business Development Director.

Distributed Service Registries Workshop, July 2005 Slide 1 NISO Metasearch Initiative Registries Robert Sanderson Dept. of Computer Science University.

1 Euro-VO Technology Forum, 23 September 2009, Annotations at the CDS Web 2.0: annotations at the CDS Brice GASSMANN Sébastien DERRIERE Thomas BOCH.

Displaying Data from Multiple Tables

Collections and services in the information environment JISC Collection/Service Description Workshop, London, 11 July 2002 Pete Johnston UKOLN, University.

Query Methods (SQL). What is SQL A programming language for databases. SQL (structured Query Language) It allows you add, edit, delete and run queries.

OAI in DigiTool DigiTool Version 3.0.

Harvesting Metadata Using OAI-PMH Roy Tennant California Digital Library.

OAI-PMH Dawn Petherick, University Web Services Team Manager, Information Services, University of Birmingham MIDESS Dissemination.

OAI Standards for Sheet Music Meeting March 28-29, 2002 Basic OAI Principals How They Apply to Sheet Music Presenter: Curtis Fornadley, Senior Programmer/Analyst.

Thomas G. Habing – University of Illinois at Urbana-Champaign Recap: SIGIR 2001 OAI Workshop 19 September OAI Provider Workshop, University of.

Introduction to the OAI Metadata Harvesting Protocol Hussein Suleman, Digital Library Research Laboratory Virginia Tech.

T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE VAO Registry Publishing Theresa Dower Registry WG May 2014 IVOA Interoperability Meeting -- Madrid.

S. Derriere et al., ESSW03 Budapest, 2003 May 20 UCDs - metadata for astronomy Sébastien Derriere François Ochsenbein Thomas Boch CDS, Observatoire astronomique.

Open Archives Iniative – Protocol for Metadata Harvesting Iztok Kavkler, University of Ljubljana Some slides by Stefaan Ternier, KUL Bram Vandenputte,

Metadata Harvesting Interoperable digital collections.

OAI-PMH The Open Archives Initiative Protocol for Metadata Harvesting Presenter: Knud Möller Friday,

Open Archives Work at Virginia Tech Hussein Suleman Digital Libraries Research Laboratory Virginia Tech.

1 OAI-PMH harvester for agricultural knowledge gathering (Development, testing and implementation) Francesco Castellani and Stefka Kaloyanova 4 February.

1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.

OAI-PMH: Open Archives Initiative Protocol for Metadata Harvesting T.B. Rajashekar National Centre for Science Information (NCSI) Indian Institute of Science,

The OAI Protocol for Metadata Harvesting Van de Sompel, Herbert Los Alamos National Laboratory – Research Library.

Metadata harvesting in regional digital libraries in PIONIER Network Cezary Mazurek, Maciej Stroiński, Marcin Werla, Jan Węglarz.

Open Archives Initiative Protocol for Metadata Harvesting (OAI-PMH) Phil Barker, March © Heriot-Watt University. You may reproduce all or any part.

Open Archive Initiative – Protocol for metadata Harvesting (OAI-PMH) Surinder Kumar Technical Director NIC, New Delhi

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé Registry and Curation, Oct 2005, ESAC, Spain ESAVO Registry.

OAI Overview DLESE OAI Workshop April 29-30, 2002 John Weatherley

16 October 2003Registry Interface CallsIVOA Interoperability, Strasbourg IVOA Interoperability Elizabeth Auden & Registry Workgroup 16 – 17 October 2003.

IVOA Interoperability MeetingUCD Session – 2004/05/26 S. Derriere UCD services.

SPASE and the VxOs Jim Thieman Todd King Aaron Roberts.

Enforcing Interoperability with the Open Archives Initiative Repository Explorer Hussein Suleman, Digital Library Research.

The OAI: technical overview OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University -- Computer Science.

Open Archives Initiative Protocol for Metadata Harvesting.

UCL DEPARTMENT OF SPACE AND CLIMATE PHYSICS MULLARD SPACE SCIENCE LABORATORY Taverna Plugin VAMDC and HELIO (part of the ‘taverna-astronomy’ edition) Kevin.

IVOA RM, VOResources, Identifiers, Interfaces Chenzhou CUI.

Metadata Harvesting Interoperable digital collections.

Introduction to the OAI Protocol for Metadata Harvesting Version 2.0 Hussein Suleman Virginia Tech DLRL 25 March 2002.

The NSDL, OAI and Your Metadata Core Infrastructure Metadata Repository (“union catalog”) Naomi Dushay Cornell University.

16 May 2006IVOA Interoperability – Registries WG1 VOResource Schema v1.0 Release 6 Ray Plante NCSA T HE I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.

1 Copyright © 2008, Oracle. All rights reserved. Repository Basics.

OAI and ODL Building Digital Libraries from Components Hussein Suleman Virginia Tech DLRL 12 September 2002.

NDLTD Standards, Metadata and the OAI-PMH Hussein Suleman University of Cape Town October 2003.

Getting a Leg Up on OAI for the NSDL

University of Illinois at Urbana-Champaign OAI Alpha Experiences

Accomplishments RSM v0.7 First draft XML Schema completed: VOResource.xsd NVO: Working prototype resource using VOResource as format for metadata exchange.

Georges Arnaout Chaitanya Krishna

OAI and Metadata Harvesting

IVOA registry interfacing to GLU

IVOA Interoperability Meeting - Boston

Presentation transcript:

1 S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29 VizieR repository Lessons learnt and issues

2 S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29 Repository implementation Uses the VTOAI OAI-PMH2 Perl Data Provider library (H. Suleman, V. Tech) Slightly modified to handle namespaces (vs:...) in elements Answers OAI-PMH requests verbs: Identify, ListSets, ListRecords, GetRecord from, until metadataPrefix (ivo_vor), identifier, resumptionToken (for long lists)

3 S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29 Repository implementation Latest version uses VOResource-v (in test... will move to oai.pl) Only a repository (not full registry) Dynamical content/answer Resources are built on-the-fly from the contents of the VizieR DB Uses VizieR metadata to fill resource elements

4 S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29 Catalogue 2: Table1 Table2 Table3 Catalogue 3: Obsoleted by Cat34 Table Catalogue 1: Table1 Table2 + Standardized metadata catalogues tables VizieR structure Catalogue 2: Table1 Table2 Table3 Catalogue 3: Obsoleted by Cat34 Table Catalogue 1: Table1 Table2 + Standardized metadata Clone1 Catalogue 2: Table1 Table2 Table3 Catalogue 3: Obsoleted by Cat34 Table Catalogue 1: Table1 Table2 + Standardized metadata Clone2

5 S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29 Metadata extraction

6 S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29 Metadata extraction

7 S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29 Metadata extraction

8 S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29 Metadata extraction

9 S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29 XML generation

10 S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29 Dynamical repository The VizieR repository currently has no memory: :o) always up-to-date :o) easy to maintain (especially useful for HUGE collections like VizieR) :o( not the OAI spirit (OAI is book-oriented: once a resource has existed, it must exist forever, even as 'deleted') Need hard-coded XML version ? What date should be used ? Metadata change => created=? modified=?

11 S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29 Issues Resources granularity Currently, VizieR description at Table level only Why not Catalogues ? Create resources for Tables AND Catalogues ? Make use of OAI Sets (4000 sets?) How to handle hierarchy in a 'flat' registry? Handling mirrors (no, not again?) Dupplicate resources? 10,000 resources * 9 mirrors = 90,000 ! Dupplicate interfaces (and accessURL)?

12 S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29 Issues Currently, all VizieR tables are presented as (needed to describe the table columns) For each table, there are different interfaces WebBrowser (for humans) ParamHTTP (retrieve VOTable) If the table contains positions, I can make a ConeSearch on this table new ? new interface? single resource VizieRConeSearch ? thousands possible table-id as parameters!

13 S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29 Issues How to describe a WS in an interface (methods?) Relations between resources with Standard 'deprecatedBy' ? Point to ivo-id and not Name?