European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé Registry and Curation, Oct 2005, ESAC, Spain ESAVO Registry.

Slides:



Advertisements
Similar presentations
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé AIDA WP3 - Curation September 2009, VOTech, Trieste Curation.
Advertisements

IVOA Registry WG, IVOA Registry WG Pune, 28 Sept 2004.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé DALToolKit Ingestor & Server September 2006, Moscow DALToolKit.
Registry Interop Summary IVOA Interoperability meeting Cambridge, Boston, MA May 2004.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Jesús Salgado SLAP Implementations Sep 2006, Moscow, Russia Simple Line.
Yuji Shirasaki National Astronomical Observatory of Japan JVO JVO Publishing/Searchable Registry Implementation Experience IVOA Interoperability Meeting.
May IVOA Interop Meeting1 STScI/JHU Registry Status Gretchen Greene Wil OMullane T HE US N ATIONAL V IRTUAL O BSERVATORY.
23 May 2008 IVOA Interoperability Meeting -- Trieste T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE Resource Registries Closing Plenary Integration.
T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE Service Validators in Practice (within the VAO) Theresa Dower Registry WG 18 May 2011 IVOA Interoperability.
8 September 2006NVO Summer School Aspen1 Publishing and Resource Discovery with Registries Ray Plante Gretchen Greene T HE US N ATIONAL V IRTUAL.
NVO Summer School, Aspen Center for Physics1 Publishing and Resource Discovery with Registries Ray Plante Gretchen Greene.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
2008 NVO Summer School1 Finding Services in the NVO Registry Gretchen Greene T HE US N ATIONAL V IRTUAL O BSERVATORY.
9 September 2005NVO Summer School Aspen Astronomical Dataset Query Language (ADQL) Ray Plante T HE US N ATIONAL V IRTUAL O BSERVATORY.
8 September 2008NVO Summer School 2008 – Santa Fe1 Publishing Data and Services to the VO Ray Plante Gretchen Greene T HE US N ATIONAL V IRTUAL O BSERVATORY.
Schedule of Releases (since Tromso meeting) and New Access Interfaces.
A Prototype Implementation of a Framework for Organising Virtual Exhibitions over the Web Ali Elbekai, Nick Rossiter School of Computing, Engineering and.
19-20 March 2003 IVOA Registry Workgroup LeSc Astrogrid Registry: Early Designs Elizabeth Auden Astrogrid Registry Workgroup Leader IVOA Registry Workgroup.
14 October 2003ADASS 2003 – Strasbourg1 Resource Registries for the Virtual Observatory R.Plante (NCSA), G. Greene (STScI), R. Hanisch (STScI), T. McGlynn.
National Science Digital Library (NSDL) Core Infrastructure Metadata Repository (“union catalog”) Naomi Dushay Cornell University.
FHIRFarm – How to build a FHIR Server Farm (quickly)
TAP service at ESAC - VOTAP Carlos Rios Diaz Science Archives Team (SAT) ESA-ESAC, Madrid, Spain VOTAP.
Status of upgrading CDI service (user interface, harvesting via GeoNetwork, CDI interoperability options following SeaDataNet D8.7) By Dick M.A. Schaap.
T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE VAO Registry Relational Schema: Updates and New Interface(s) Theresa Dower Registry WG 16 May 2013 IVOA.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé Homogeneous Access to Tabular Data Beijing, China - May.
Use of XSLT Formats in Creation, Maintenance and Optimization of Web Site Templates Jay Mercer IU Communications Indiana University
Metadata Harvesting The Hague, 13 & 14 January 2009 Julie Verleyen Scientific Coordinator, Europeana Office EuropeanaLocal Knowledge Sharing Workshop.
XML Overview. Chapter 8 © 2011 Pearson Education 2 Extensible Markup Language (XML) A text-based markup language (like HTML) A text-based markup language.
Astrogrid Resource Registry Querying the Registry 1.Mullard Space Science Laboratory, University College London, Holmbury St. Mary, Dorking, Surrey RH5.
Dynamic Data Exchanges with the Java Flow Processor Presenter: Scott Bowers Date: April 25, 2007.
Astronomical Data Query Language Simple Query Protocol for the Virtual Observatory Naoki Yasuda 1, William O'Mullane 2, Tamas Budavari 2, Vivek Haridas.
COLD FUSION Deepak Sethi. What is it…. Cold fusion is a complete web application server mainly used for developing e-business applications. It allows.
Copyright © Orbeon, Inc. All rights reserved. Erik Bruchez Applications of XML Pipelines XML Prague, June 16 th, 2007.
T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE VAO Registry Status Spring 2014 Theresa Dower Registry WG IVOA Interoperability Meeting – Madrid 2014.
How to Adapt existing Archives to VO: the ISO and XMM-Newton cases Research and Scientific Support Department Science Operations.
Serving society Stimulating innovation Supporting legislation Joint Research Centre The Inspire Geoportal Validator.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Isa Barbarisi VOSpec, new functionalities Madrid, 6-7Oct 2005 New functionalities.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Jesús Salgado Spectroscopic lines in the VO context Mar 2007, ESAC, Madrid,
ESAVO/European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Isa Barbarisi Beijing, May 2007 VOSpec new functionalities.
1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Jesús Salgado IVOA Interop meeting Strasbourg, May 2009 (1/12) SLAP v0.9.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Pedro OSUNA ESAC ADT Team VO-tech Cambridge 2004 VOSpec: A Tool to Handle.
A PPARC funded project VOTech AstroGrid DSA Update Kona Andrews Institute for Astronomy University of Edinburgh.
30 October 2008 IVOA Interoperability Meeting -- Baltimore T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE VOTable interface with Registry Joint Apps/DM/Registry.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Applications May 2006, Victoria, Canada VOQuest A tool.
16 October 2003Registry Interface CallsIVOA Interoperability, Strasbourg IVOA Interoperability Elizabeth Auden & Registry Workgroup 16 – 17 October 2003.
© 2006 Altova GmbH. All Rights Reserved. Altova ® Product Line Overview.
May 24, 2004IVOA Interop Meeting1 An AXIS-based Java SkyNode Ramon Williamson NCSA T HE US N ATIONAL V IRTUAL O BSERVATORY.
D. Heynderickx DH Consultancy, Leuven, Belgium 22 April 2010EuroPlanet, London, UK.
1 Registry Services Overview J. Steven Hughes (Deputy Chair) Principal Computer Scientist NASA/JPL 17 December 2015.
ESA-VO Registry Aurélien STEBE, Christophe ARVISET.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Jesús Salgado AIDA Tech. Meeting Strasbourg, March 2009 (1/8) WP7 Task.
IVOA RM, VOResources, Identifiers, Interfaces Chenzhou CUI.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé DALToolKit Ingestor & Server January 2008, VODay, Sofia.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Pedro Osuna VOSpec Kyoto May 2005 VOSpec: A Tool to Handle VO-Compatible.
16 May 2006IVOA Interoperability – Registries WG1 VOResource Schema v1.0 Release 6 Ray Plante NCSA T HE I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
Sept. 2004IVOA Meeting / Pune1 Virtual Observatory Query Language (VOQL) Working Group William O’Mullane For Masatoshi Oishi T HE US N ATIONAL V IRTUAL.
Lecture Transforming Data: Using Apache Xalan to apply XSLT transformations Marc Dumontier Blueprint Initiative Samuel Lunenfeld Research Institute.
XML 1. Chapter 8 © 2013 Pearson Education, Inc. Publishing as Prentice Hall SAMPLE XML SCHEMA (XSD) 2 Schema is a record definition, analogous to the.
End of the Beginning for IVOA is now Roy Williams IVOA Technical Lead.
Introduction: AstroGrid increases scientific research possibilities by enabling access to distributed astronomical data and information resources. AstroGrid.
AstroGrid: The Registry Kevin Benson MSSL. ➲ Definitions ➲ Standards ➲ XML Resource Model ➲ Registry Matrix ➲ Resource Types ➲ Future Work ➲ Install ➲
ALTOVA XMLSPY.
Accomplishments RSM v0.7 First draft XML Schema completed: VOResource.xsd NVO: Working prototype resource using VOResource as format for metadata exchange.
CO6025 Advanced Programming
WP3 – SA1 Service activities in support of deployment of IVOA protocols and standards Christophe ARVISET, ESA.
Building an Integrable XBRL Portal Daniel Hamm German Central Bank
IVOA – VOQL WG session ESAC Villafranca del Castillo Madrid, Spain Friday, October 7th, 9: :00 Yuji Shirasaki Maria Nieto-Santisteban VOQL-Madrid.
IVOA Interoperability Meeting - Boston
Presentation transcript:

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé Registry and Curation, Oct 2005, ESAC, Spain ESAVO Registry and Curation Utility Aurélien Stébé

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé Registry and Curation, Oct 2005, ESAC, Spain The ESAVO Registry  Full Searchable Registry implemented in Java with Sybase RDBMS  Resource Metadata schemas version 0.10 (+ OpenSkyNode v0.1)  Services accessible by Web Service, HTTP POST or GET  User Interface on Web Pages for Search and Insert/Update  Fully compliant OAI interface for harvesting  New AuthorityIDs registration support IVOA Registry WG Release in July 2005 Publicly Released in September 2005

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé Registry and Curation, Oct 2005, ESAC, Spain The Website Interface  Search Interface fully accessible : Quick Search box and KeywordSearch GetResource and Type Menu ADQL/x and XPathQL  Result display with toolbar options  Edit/Clone with complete XForms : Handling of multiple elements First level validation Registry Search Registry Results Registry Edit

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé Registry and Curation, Oct 2005, ESAC, Spain Implementation Details  Programming Languages used : Java (main engine) and JSP/HTML/CSS (user interface) XSD (resource schemas) and XSLT (data manipulations) Sybase/SQL (data saving) and XForm (resource edition)  Java Libraries used : Axis (web services) / Xerces (xml parser) / Xalan (xslt engine) Jconn (jdbc/database) / Altova (database-xml interface) Chiba (xforms engine) / Standard Java XML APIs  Applications used : Altova XMLSpy & MapForce for schemas manipulation and design, database creation and database-xml interface code generation. Tomcat for deployment and Chiba for schemas to xforms mapping.

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé Registry and Curation, Oct 2005, ESAC, Spain The ADQL Support  Support ADQL v0.7.4, v0.8, v0.9 and v1.0 with different stylesheets  XPathQLSearch method branching after ADQL transformation  Broad regular expr. to offer large XPath support (no namespaces) Xalan <Where xmlns=".../ADQL/v0.?? " xmlns:xsi="..."> <Arg xsi:type="columnReferenceType" xpathName="content/description"/> <Literal xsi:type="stringType" Value="%esa%"/> XSLT Stylesheets #content/description# LIKE '%esa%' regex ADQL XPathQL Regex config XML file Content.description LIKE '%esa%' SQL

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé Registry and Curation, Oct 2005, ESAC, Spain The Schemas Handling  Extensive use of stylesheet transformations  Database interfacing ESAVO Resource schema XMLSpy & MapForce IVOA Resource XSLT Files XHTML output XForm output ESAVO Resource JAVA Code MapForce & NetBeans Sybase RDBMS flat structure schema

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé Registry and Curation, Oct 2005, ESAC, Spain The Harvesting Interface  The OAI Implementation : MetadataFormats : ivo_vor, esa_vor and oai_dc Sets : ivo_{ResourceTypes}, ivo_standard and ivo_managed Resumption Tokens / YYYY-MM-DD only granularity  Harvesting the following Registries : Heasarc (ivo://nvo.heasarc/registry) JapanVO (ivo://jvo/publishingregistry) NVO NCSA (ivo://nvo.ncsa/registry) CDS (  Problems harvesting other Registries, should be fixed soon.

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé Registry and Curation, Oct 2005, ESAC, Spain The Curation Utility  Testing Validation Levels sequentially  Extendable to different Resource types  Easily configurable by XML file Welcome to the curation utility for the Virtual Observatory... Starting curation of resource : ivo://esavo/iso/siap... Getting the resource description... Registry Endpoint : Registry Portname : { Registry Operation : { Checking the resource description... ** Error, line 10 The content of element 'vr:curation' is not complete. One of '{contact}' is expected. ** Error, line 19 The content of element 'vr:interface' is not complete. One of '{resultType}' is expected.... but lets try to keep going anyway... Calling the resource type check... Checking a 'SimpleImageAccess' type resource... Checking the resource description... The resource contact name is missing from the description ! The resource contact is missing from the description ! This resource referenceURL is : Checking the service metadata... Calling URL : This ContentType doesn't look correct to me : text/html;charset=ISO ! Checking the service Image Query... Calling URL : Calling URL : Calling URL : Checking the service Image Retrieval... No Image Access Reference found to test, passing but lets try to keep going anyway... Checking the service Region Coverage... Checking Region : AllSky Calling URL : Calling URL : Calling URL : Checking the service Image Retrieval... Calling URL : Calling URL : please check the log output...

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé Registry and Curation, Oct 2005, ESAC, Spain The Curation Tests  Level 0 : a Resource entry exist Get the Resource entry from the Registry  Level 1 : the Resource is valid Validate the Resource using the VOResource schemas  Level 2 : the Service is valid Extract the Resource type and call the specific sub-method Check Resource content for minimum information

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé Registry and Curation, Oct 2005, ESAC, Spain The Curation Tests  Level 2 : SIAP specific Check the referenceURL validity Call the METADATA method and validate the result Call multiple Image Queries, both correct and bogus Download image references we got, if any  Level 3 : SIAP specific Extract the Region Coverage from the Resource Call Image Queries on all regions using random coordinates and increasing SIZE Download image references we got, if any

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé Registry and Curation, Oct 2005, ESAC, Spain Future Plans  ESAVO Registry Future Evolutions : Optimize the KeywordSearch algorithm Optimize the database connection system Upgrade the interface to the latest specifications Upgrade the Resource schemas to future v1.0 Implement the full DateTime OAI granularity Implement some “call forms” for services  Curation Utility Future Evolutions : Implement Curation of other protocols (SSAP, SkyNode, …) Interface the utility with the Registry One button Resource Curation Fill in ValidationLevel attribute