Astronomical Data Query Language Simple Query Protocol for the Virtual Observatory Naoki Yasuda 1, William O'Mullane 2, Tamas Budavari 2, Vivek Haridas.

Slides:



Advertisements
Similar presentations
Web Services for the Virtual Observatory Alex Szalay, Tamas Budavari, Tanu Malik, Jim Gray, and Ani Thakar SPIE, Hawaii, 2002 (Living in an exponential.
Advertisements

Recommendations for a Table Access Protocol Ray Plante, Tamas Budavari, Gretchen Greene, John Goode, Tom McGlynn, Maria Nieto-Santistaban, Alex Szalay,
VOQL WG May 24 & 25, 2004 Masatoshi Ohishi. Agreement at the Cambridge Meeting Two level approach Level-1 : Extended SQL-based QL as the first version,
VOQL WG Plenary Session Sept 27, 2004 William OMullane for Masatoshi Ohishi.
May. 2004IVOA Meeting / Boston1 OpenSkyQuery,SkyNodes and ADQL William OMullane Johns Hopkins University T HE US N ATIONAL V IRTUAL O BSERVATORY.
May 2005IVOA Kyoto1 Astronomical Data Query Language(ADQL) William OMullane Johns Hopkins University T HE US N ATIONAL V IRTUAL O BSERVATORY.
Sept. 2003NVO Team Meeting / Victoria1 VOQL/ADQL/MYDB for VO William OMullane Johns Hopkins University T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
2008 NVO Summer School1 Finding Services in the NVO Registry Gretchen Greene T HE US N ATIONAL V IRTUAL O BSERVATORY.
9 September 2005NVO Summer School Aspen Astronomical Dataset Query Language (ADQL) Ray Plante T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 7, 2005NVO Summer School1 Building a SkyNode Server Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
Sept NVO Summer School1 Cone, SIAP, and OpenSkyQuery Client Development Gretchen Greene, Maria Nieto-Santisteban T HE US N ATIONAL V IRTUAL O.
VO Standards – Catalog Access Tamás Budavári Johns Hopkins University.
Aus-VO Workshop 2003 International Virtual Observatory Alliance effort on Virtual Observatory Query Language Naoki Yasuda (JVO), VOQL WG.
A PPARC funded project AstroGrid Framework Consortium meeting, Dec 14-15, 2004 Edinburgh Tony Linde Programme Manager.
Data Source in MicroStrategy
A Prototype Implementation of a Framework for Organising Virtual Exhibitions over the Web Ali Elbekai, Nick Rossiter School of Computing, Engineering and.
Solar and STP Physics with AstroGrid 1. Mullard Space Science Laboratory, University College London. 2. School of Physics and Astronomy, University of.
1 Introduction to XML. XML eXtensible implies that users define tag content Markup implies it is a coded document Language implies it is a metalanguage.
Surfing the Service Web Sudhir Agarwal, Siegfried Handschuh, and Steffen Staab Presenter: Yihong Ding.
Presentation 7 part 2: SOAP & WSDL. Ingeniørhøjskolen i Århus Slide 2 Outline Building blocks in Web Services SOA SOAP WSDL (UDDI)
SDSS Web Services Tamás Budavári Johns Hopkins University Coding against the Universe.
BinX and Astronomy Bob Mann Institute for Astronomy and National e-Science Centre.
TAP service at ESAC - VOTAP Carlos Rios Diaz Science Archives Team (SAT) ESA-ESAC, Madrid, Spain VOTAP.
2003 April 151 Data Centres: Connecting to the Real World Clive Page.
Supported by the National Science Foundation’s Information Technology Research Program under Cooperative Agreement AST with The Johns Hopkins University.
T Network Application Frameworks and XML Web Services and WSDL Sasu Tarkoma Based on slides by Pekka Nikander.
XML Overview. Chapter 8 © 2011 Pearson Education 2 Extensible Markup Language (XML) A text-based markup language (like HTML) A text-based markup language.
Diversity of domain descriptions in natural science: virtual observatory as a case study Briukhov D.O., Kalinichenko L.A., Zakharov V.N. Institute of Informatics.
Astrogrid Resource Registry Querying the Registry 1.Mullard Space Science Laboratory, University College London, Holmbury St. Mary, Dorking, Surrey RH5.
VOQL WG Progress Report May 28, 2004 Masatoshi Ohishi.
Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.
29-30 April 2004NVO Team Meeting NCSA1 Data Access Layer (DAL) SSA, SIA Enhancement Doug Tody National Radio Astronomy Observatory National Virtual Observatory.
Scalable Metadata Definition Frameworks Raymond Plante NCSA/NVO Toward an International Virtual Observatory How do we encourage a smooth evolution of metadata.
Prototype system of the Japanese Virtual Observatory The Japanese Virtual Observatory (JVO) aims at providing easy access to federated astronomical databases.
JVO JVO Portal Japanese Virtual Observatory (JVO) Prototype 2 Masahiro Tanaka, Yuji Shirasaki, Satoshi Honda, Yoshihiko Mizumoto, Masatoshi Ohishi (NAOJ),
A PPARC funded project AstroGrid Intro & Demo John Taylor Institute for Astronomy, Edinburgh.
ILDG Middleware Status Chip Watson ILDG-6 Workshop May 12, 2005.
Making FITS available in.NET and its Applications Vivek Haridas 1, Tamas Budavari 1, William O'Mullane 1, Alex Szalay 1, Alberto Conti 2, Bill Pence 3,
P Structured Query Language for Virtual Observatory Yuji Shirasaki National Astronomical Observatory of Japan, and Masahiro Tanaka (NAOJ), Satoshi.
Federation and Fusion of astronomical information Daniel Egret & Françoise Genova, CDS, Strasbourg Standards and tools for the Virtual Observatories.
Oct. 1, 2004IVOA Small Projects Meeting1 Development of JVO prototype system and its application to Astrophysics Portal System : M. Tanaka Data Service.
Japanese Virtual Observatory Project Abstract : The National Astronomical Observatory of Japan (NAOJ) started the Japanese Virtual Observatory (JVO) project.
Web Services for the National Virtual Observatory Tamás Budavári Johns Hopkins University.
Progress Report of VOQL WG May 15 (Thu) Masatoshi Ohishi (Japan)
16 October 2003Registry Interface CallsIVOA Interoperability, Strasbourg IVOA Interoperability Elizabeth Auden & Registry Workgroup 16 – 17 October 2003.
The International Virtual Observatory Alliance (IVOA) interoperability in action.
ADQL/s Syntax (Proposal) -- towards unification of ADQL, SIAP, SSAP, SXAP Yuji SHIRASAKI National Astronomical Observatory.
Japanese Virtual Observatory Project Abstract : The National Astronomical Observatory of Japan (NAOJ) started the Japanese Virtual Observatory (JVO) project.
May 17, 2005Maria Nieto-Santisteban, JHU / IVOA - Kyoto1 VO JHU Open SkyQuery and more … T. Budavari, S. Carliles, L. Dobos, G. Fekete,
May 24, 2004IVOA Interop Meeting1 An AXIS-based Java SkyNode Ramon Williamson NCSA T HE US N ATIONAL V IRTUAL O BSERVATORY.
AstroGrid Datacenters IVOA Interoperability meeting M Hill (ROE), May 2004.
A PPARC funded project Common Execution Architecture Paul Harrison IVOA Interoperability Meeting Cambridge MA May 2004.
IVOA RM, VOResources, Identifiers, Interfaces Chenzhou CUI.
JVO portal service Yuji Shirasaki National Astronomical Observatory of Japan.
Intro to Web Services Dr. John P. Abraham UTPA. What are Web Services? Applications execute across multiple computers on a network.  The machine on which.
William O’Mullane/ Tannu Malik - JHU IVOA Cambridge May 12-16, 2003 SkyQuery.Net SKYQUERY Federated Database Query System (using WebServices)
Introduction to the VO ESAVO ESA/ESAC – Madrid, Spain.
May 2006IVOA Victoria, Canada1 VOQL Where do we stand? What is left? Yuji Shirasaki JVO Maria A. Nieto-Santisteban JHU T HE US N ATIONAL V IRTUAL O BSERVATORY.
Copyright 2007, Information Builders. Slide 1 iWay Web Services and WebFOCUS Consumption Michael Florkowski Information Builders.
Sept. 2004IVOA Meeting / Pune1 Virtual Observatory Query Language (VOQL) Working Group William O’Mullane For Masatoshi Oishi T HE US N ATIONAL V IRTUAL.
XML 1. Chapter 8 © 2013 Pearson Education, Inc. Publishing as Prentice Hall SAMPLE XML SCHEMA (XSD) 2 Schema is a record definition, analogous to the.
Introduction: AstroGrid increases scientific research possibilities by enabling access to distributed astronomical data and information resources. AstroGrid.
Standard Query Language for VO
Database Processing with XML
Chapter 9 Web Services: JAX-RPC, WSDL, XML Schema, and SOAP
Progress Report of VOQL WG
Google Sky.
VOQL WG Plenary Session
Presentation transcript:

Astronomical Data Query Language Simple Query Protocol for the Virtual Observatory Naoki Yasuda 1, William O'Mullane 2, Tamas Budavari 2, Vivek Haridas 2, Martin Hill 3, Nolan Li 2, Tony Linde 3, Tanu Malik 2, Bob Mann 3, Yoshihiko Mizumoto 1, Masatoshi Ohishi 1, Clive Page 3, Alex Szalay 2 1 National Astronomical Observatory of Japan 2 Johns Hopkins University, USA 3 AstroGrid, UK The mission of IVOA is to facilitate the international coordination and collaboration necessary for the development and deployment of the tools, systems and organizational structures necessary to enable the international utilization of astronomical archives as an integrated and interoperating virtual observatory. VOQL is currently under discussion in the IVOA forum. See Current thinking is – VOQL has 3 layers as depicted below. ADQL and SkyNode constitute layer 1. Select t.*, b.* From Tab t, Bob b Where t.g <> b.g and Region('Circle J ') The Astronomical Data Query Language (ADQL) is a proposed standard query language for the interoperability of the International Virtual Observatory. The data servers in the International Virtual Observatory could be searched using an ADQL query. The servers would return as a minimum VOTables as a result of the query (other formats may be supported by some nodes). t b Tab t Bob b t g <> b g Ra Dec Converter between ADQL and SkyQL : SkyQL is a string like representation of ADQL. Semantically SkyQL and ADQL are identical. Syntactically ADQL is XML and SkyQL is more human readable. ADQL is passed as an XML document to the Query Interface. ADQL is based on a subset of SQL plus Region and XMatch. The only SQL command allowed in ADQL is a “select”. All data servers joining the International Virtual Observatory would implement a standard IVOA SkyNode Interface based on SOAP (Simple Object Access Protocol) Web Services. See current proposal specification on ADQL, SkyQL, and SkyNode The main element of ADQL - SELECT The following is an example of simple SkyQL and its ADQL (XML) representation. A converter exists to exchange these formats (url listed below). Further tools and information may be found at The Virtual Observatory Query Language Table part of the select statementWhere part of the select statement Query in SkyQL Query in ADQL Cross matching between tables will be supported in Full SkyNode (higher level SkyNode). The service XMatch() takes an ADQL structure and a set of VOTables. An example of the SkyQL (which would be expressed in ADQL format) is select.... from SDSS:PhotoObj o, EXT:0 my1, EXT:1 my2 where XMatch(o,my1,my2) < 3 Virtual Observatory Portal will be constructed on top of SkyNode’s services to federate multiple data servers. One example of such portal is Open SkyQuery Portal which is open version (not restricted on Microsoft Technology) of SkyQuery ( See details on poster by Budavari. The diagrams with pale yellow background are part of Schema diagrams for ADQL. These may be helpful to understand the ADQL structure. See the XSD ( for complete structure of ADQL. The XML document in the center of the poster is a valid ADQL document with relevant parts linked to the schema diagrams to aid understanding. From this document it is clear why we might like a human readable SkyQL (top of poster) as well as the machine readable ADQL. XMATCHXMATCH SkyNode Interface These are the Pseudo methods for the SkyNode Interface. BASIC SkyNode //Return RSM compliant VOResource public VOResource MetaData(); //Return a list of all tables that may be used from this node. public string[] Tables(); //Return ucd, name, unit, type for each column of table public MetaColumn[] Columns(); //Return available query result formats public string[] Formats(); //Return the result of executing ADQL query in requested format public VOResult PerformQuery(Select query, string format); FULL SkyNode // Return result of executing an ExecPlan, format specified in plan public VOResult ExecutePlan(ExecPlan plan); //Return region of intersection between given region and this SkyNode public Region Footprint(Region region); //Returns object density per square degree for a given criteria. public float PerformanceQuery(Select query); //Return Cross matched objects according to Query and input Tables") public VOResult XMatch(Select select, VOTABLE[] votables); SkyNode The services of IVOA SkyNode is defined as WSDL (Web Services Definition Language) at WSDL definition enables automatic code generation of Web Services e.g. using Microsoft.NET or Apache Axis. Brief overview of the interface is given below.