TAP service at ESAC - VOTAP Carlos Rios Diaz Science Archives Team (SAT) ESA-ESAC, Madrid, Spain VOTAP.

Slides:



Advertisements
Similar presentations
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé DALToolKit Ingestor & Server September 2006, Moscow DALToolKit.
Advertisements

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Jesús Salgado SLAP Implementations Sep 2006, Moscow, Russia Simple Line.
28 October 2008 IVOA Interoperability Meeting -- Baltimore T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE TAP/VOTable Registry Interface Reg 1 – G.
IVOA, Kyoto May Data Access Layer Working Group Working Group Report and Summary Doug Tody National Radio Astronomy Observatory International.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
CASDA Virtual Observatory CSIRO ASTRONOMY AND SPACE SCIENCE Arkadi Kosmynin 11 March 2014.
A Prototype Implementation of a Framework for Organising Virtual Exhibitions over the Web Ali Elbekai, Nick Rossiter School of Computing, Engineering and.
1 CEOS/WGISS20 – Kyiv – September 13, 2005 Paul Kopp SIPAD New Generation: Dominique Heulet CNES 18, Avenue E.Belin Toulouse Cedex 9 France
AstroGrid: Virtual Observatory Service Nicholas Walton AstroGrid: Virtual Observatory Service Nicholas Walton AstroGrid and Euro-VO Technology Centre Project.
Solar and STP Physics with AstroGrid 1. Mullard Space Science Laboratory, University College London. 2. School of Physics and Astronomy, University of.
A Smart On-line Astronomical Information Collector Chenzhou CUI, Huaping SUN China-VO National Astronomical Observatory of China.
SQL Overview Defining a Schema CPSC 315 – Programming Studio Spring 2008 Project 1, Lecture 3 Slides adapted from those used by Jeffrey Ullman, via Jennifer.
SQL Overview Defining a Schema CPSC 315 – Programming Studio Slides adapted from those used by Jeffrey Ullman, via Jennifer Welch Via Yoonsuck Choe.
SOLAR ORBITER Archive status Pedro Osuna Solar Orbiter Archive Scientist SOWG#7 – 6-9 July 2015.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé Homogeneous Access to Tabular Data Beijing, China - May.
Eric Westfall – Indiana University James Bennett – Indiana University ADMINISTERING A PRODUCTION KUALI RICE INFRASTRUCTURE.
Using the SAS® Information Delivery Portal
Astronomical Data Query Language Simple Query Protocol for the Virtual Observatory Naoki Yasuda 1, William O'Mullane 2, Tamas Budavari 2, Vivek Haridas.
A PPARC funded project AstroGrid: new technology for the virtual observatory SC2004 Pittsburgh, PA November 2004 Guy Rixon AstroGrid Technical Architect.
Data File Access API : Under the Hood Simon Horwith CTO Etrilogy Ltd.
WSRF Supported Data Access Service (VO-DAS)‏ Chao Liu, Haijun Tian, Dan Gao, Yang Yang, Yong Lu China-VO National Astronomical Observatories, CAS, China.
Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.
Restricted Daejeon, April An SDMX based unified data catalogue (UDC) MSIS – Meeting on the Management of Statistical Information Systems 1.
Last News of and
29-30 April 2004NVO Team Meeting NCSA1 Data Access Layer (DAL) SSA, SIA Enhancement Doug Tody National Radio Astronomy Observatory National Virtual Observatory.
Virtual Observatory & LIGO Roy Williams California Institute of Technology.
How to Adapt existing Archives to VO: the ISO and XMM-Newton cases Research and Scientific Support Department Science Operations.
Summary of distributed tools of potential use for JRA3 Dugan Witherick HPC Programmer for the Miracle Consortium University College.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Isa Barbarisi VOSpec, new functionalities Madrid, 6-7Oct 2005 New functionalities.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Jesús Salgado Spectroscopic lines in the VO context Mar 2007, ESAC, Madrid,
Esri UC 2014 | Technical Workshop | Esri Roads and Highways: Integrating and Developing LRS Business Systems Tom Hill.
Archivists' Toolkit - CDL Presentation, October 17, 2005 The Archivists’ Toolkit Lee Mandell Brad Westbrook.
1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.
October 7, 2005VOQL-Madrid1 IVOA – VOQL WG session ESAC Villafranca del Castillo Madrid, Spain Friday, October 7th, 9: :00 Yuji Shirasaki Maria Nieto-Santisteban.
IVOA, Kyoto May Data Access Layer Thoughts on ADQL/DAL Integration Doug Tody (NRAO) International V IRTUAL O BSERVATORY.
Common Archive Observation Model (CAOM) What is it and why does JWST care?
Solar and space physics datasets within a Virtual Observatory: the AstroGrid experience Silvia Dalla * and Nicholas A Walton  * School of Physics & Astronomy,
Japanese Virtual Observatory Project Abstract : The National Astronomical Observatory of Japan (NAOJ) started the Japanese Virtual Observatory (JVO) project.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Applications May 2006, Victoria, Canada VOQuest A tool.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé Registry and Curation, Oct 2005, ESAC, Spain ESAVO Registry.
16 October 2003Registry Interface CallsIVOA Interoperability, Strasbourg IVOA Interoperability Elizabeth Auden & Registry Workgroup 16 – 17 October 2003.
The International Virtual Observatory Alliance (IVOA) interoperability in action.
PhotDM implementation feedback | Jesus Salgado | ESAC | 18 October 2011 | IVOA Pune 2011 | Pag. 1 Photometry DM implementation feedback Jesus.
Science ESAC Cluster Final Archive Pedro Osuna Head of the Science Archives and VO Team Science Operations Department CAA-CFA Review Meeting.
May 24, 2004IVOA Interop Meeting1 An AXIS-based Java SkyNode Ramon Williamson NCSA T HE US N ATIONAL V IRTUAL O BSERVATORY.
A compiler is a computer program that translate written code (source code) into another computer language Associated with high level languages A well.
German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.
1 Registry Services Overview J. Steven Hughes (Deputy Chair) Principal Computer Scientist NASA/JPL 17 December 2015.
ESA-VO Registry Aurélien STEBE, Christophe ARVISET.
Virtual Observatories, Press Release Images, and Web Services Dr. Frank Summers Space Telescope Science Institute November 3, 2005.
UCL DEPARTMENT OF SPACE AND CLIMATE PHYSICS MULLARD SPACE SCIENCE LABORATORY Taverna Plugin VAMDC and HELIO (part of the ‘taverna-astronomy’ edition) Kevin.
JVO portal service Yuji Shirasaki National Astronomical Observatory of Japan.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé DALToolKit Ingestor & Server January 2008, VODay, Sofia.
GENIUS Kick-Off meeting December 4th 2013 WP-620 Simulated catalogue data Francesc Julbe UB – IEEC, Barcelona.
Introduction to the VO ESAVO ESA/ESAC – Madrid, Spain.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Pedro Osuna VOSpec Kyoto May 2005 VOSpec: A Tool to Handle VO-Compatible.
Publishing Combined Image & Spectral Data Packages Introduction to MEx M. Sierra, J.-C. Malapert, B. Rino VO ESO - Garching Virtual Observatory Info-Workshop.
ESA Scientific Archives and Virtual Observatory Systems Science Archives and VO Team Research and Scientific Support Department.
IVOA Interop, Beijing, China, May IVOA Data Access Layer Working Group Sessions Doug Tody (NRAO/NVO ) Markus Dolensky (ESO/EuroVO) Data Access Layer.
Simulation Production System Science Advisory Committee Meeting UW-Madison March 1 st -2 nd 2007 Juan Carlos Díaz Vélez.
Introduction: AstroGrid increases scientific research possibilities by enabling access to distributed astronomical data and information resources. AstroGrid.
Simulation Production System
aspects of archive system design
Service-centric Software Engineering
SQL OVERVIEW DEFINING A SCHEMA
Google Sky.
IVOA – VOQL WG session ESAC Villafranca del Castillo Madrid, Spain Friday, October 7th, 9: :00 Yuji Shirasaki Maria Nieto-Santisteban VOQL-Madrid.
CEA Experiences Paul Harrison ESO.
Presentation transcript:

TAP service at ESAC - VOTAP Carlos Rios Diaz Science Archives Team (SAT) ESA-ESAC, Madrid, Spain VOTAP

Presentation Overview Getting started Architecture Service Capabilities Use cases Future expectations References

VOTAP – Getting started (1 / 2) Adaptation to our needs and solving some issues during the process Building of our own TAP service to make (in principle) 2XMMi and AKARI catalogues available Starting point: published code from the Canadian Astronomy Data Centre (CADC) ESAC Aerial view Planning to make more catalogues available in a future

VOTAP – Getting started (2 / 2)  Added some extensions and new functionality, such as the following items: Set of mathematical and trigonometrical functions (100% ADQL compliant) supported 100% geometrical functions ADQL compliant supported Related to asynchronous performance (optional within TAP spec): Modifiable parameters for a job ( MAXREC, LANG, QUERY and FORMAT) Job deletion from user request Daemon checking destruction dates for every job to delete the expired ones  Our source code is available at: (VOTAP)  Remaining features to offer this source code as a toolkit Pending of a collaboration with other groups Automation of data ingestion Abstracting it from dependence on a specific database

Presentation Overview Getting started Architecture Service Capabilities Use cases Future expectations References

VOTAP - Architecture  Web service using Apache Axis 2 v1.4.1  Java JDK 1.6  Tomcat application server v6.0 with Java Virtual Machine 1.6  Database: PostgreSQL 8.3 with PgSphere extension  Easy access to the service (sync and async ways) and asynchronous job management, simply typing the proper URL in your favorite web browser  Easy addition of new catalogues Only a data ingestion of the sources and their parameters are needed to subscribe a new catalogue

VOTAP - Architecture  Asynchronous performance schematics

Presentation Overview Getting started Architecture Service Capabilities Use cases Future expectations References

VOTAP – Service Capabilities  The service offers the following capabilities: Checking of the service availability (if up or down) Published schemas Published tables on each schema Published columns for each public table To launch queries:  Synchronous (sync) performance  Asynchronous (async) performance All of this can be consulted on

Presentation Overview Getting started Architecture Service Capabilities Use cases Future expectations References

VOTAP – Use case on 2XMMi catalogue Use case #1 Search sources in a circle over 2XMMi catalogue [ using synchronous performance and an output restricted to 10 items ]  c.ra, c.dec from tap_schema.source_cat_epic as c where ( INTERSECTS(CIRCLE('ICRS GEOCENTER', 10.5, 41, 1),POINT('ICRS GEOCENTER', c.ra,c.dec))=1)&MAXREC=10 c.ra, c.dec from tap_schema.source_cat_epic as c where ( INTERSECTS(CIRCLE('ICRS GEOCENTER', 10.5, 41, 1),POINT('ICRS GEOCENTER', c.ra,c.dec))=1)&MAXREC=10

VOTAP – Use case on AKARI catalogue (1 / 2) Use case #2 Positional crossmatch between 2XMMi and II_298_FIS AKARI [ using asynchronous performance and an output restricted to 10 items ]  1 st step: create the job (*) c.ra, c.dec, f.RAJ2000, f.DEJ2000 from tap_schema.source_cat_epic as c, tap_schema.II_298_fis as f where(INTERSECTS(CIRCLE('ICRS GEOCENTER', f.RAJ2000, f.DEJ2000,.1),CIRCLE('ICRS GEOCENTER', c.ra, c.dec,.1))=1)&MAXREC=10http:// /votap/services/TapService/async?REQUEST=doQuery&LANG=ADQL&QUERY=select c.ra, c.dec, f.RAJ2000, f.DEJ2000 from tap_schema.source_cat_epic as c, tap_schema.II_298_fis as f where(INTERSECTS(CIRCLE('ICRS GEOCENTER', f.RAJ2000, f.DEJ2000,.1),CIRCLE('ICRS GEOCENTER', c.ra, c.dec,.1))=1)&MAXREC=10 * Annotate the JOB ID given as the result of the job creation  2 nd step (optional) : Check the new job is already included into the job list for the service  3 rd step (optional) : Watch the parameters for the job (**) ** substituting JOB_ID for the given ID

VOTAP – Use case on AKARI catalogue (2 / 2)  4 th step: Running the job  5 th step : Checking the job execution phase (until it will be COMPLETED or ERROR)  6 th step : According to the updated execution phase, view the result for the process: If COMPLETED without errors: If ERROR:

Presentation Overview Getting started Architecture Service Capabilities Use cases Future expectations References

VOTAP - Future Expectations Idea of releasing to the community a developer-friendly project as a toolkit to be able to construct TAP services Abstracting it from dependence on the PostgreSQL database (and its geometrical extension Pgsphere) Initiate a collaboration as a three-party enterprise Involved CADC – Spanish VO – ESAVO Sharing resources Avoiding many distinct branches To unify in a single way

Presentation Overview Getting started Architecture Service Capabilities Use cases Future expectations References

VOTAP - References  International Virtual Observatory Alliance (IVOA)  Astronomical Data Query Language (ADQL) version 2.0, IVOA recommendation 30 th October  Table Access Protocol (TAP) version 1.0, IVOA recommendation 27 th March  STC Space-Time Coordinate Metadata for VO version 1.33, IVOA recommendation 30 th October  VOTable Format Definition version 1.2, IVOA recommendation 30 th November