Sept. 2004IVOA Meeting / Pune1 Virtual Observatory Query Language (VOQL) Working Group William O’Mullane For Masatoshi Oishi T HE US N ATIONAL V IRTUAL.

Slides:



Advertisements
Similar presentations
Recommendations for a Table Access Protocol Ray Plante, Tamas Budavari, Gretchen Greene, John Goode, Tom McGlynn, Maria Nieto-Santistaban, Alex Szalay,
Advertisements

IVOA Interop, Cambridge UK, IVOA Data Access Layer Table Access Protocol Analysis Doug Tody (NRAO/NVO ) I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
VOQL WG May 24 & 25, 2004 Masatoshi Ohishi. Agreement at the Cambridge Meeting Two level approach Level-1 : Extended SQL-based QL as the first version,
IVOA, Pune India September Data Access Layer Working Group Pune Workshop Summary Doug Tody National Radio Astronomy Observatory International.
VOQL WG Plenary Session Sept 27, 2004 William OMullane for Masatoshi Ohishi.
28 October 2008 IVOA Interoperability Meeting -- Baltimore T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE TAP/VOTable Registry Interface Reg 1 – G.
May. 2004IVOA Meeting / Boston1 OpenSkyQuery,SkyNodes and ADQL William OMullane Johns Hopkins University T HE US N ATIONAL V IRTUAL O BSERVATORY.
May 2005IVOA Interoperability Meeting, Kyoto1 IRAF Web Services Michael Fitzpatrick NOAO T HE US N ATIONAL V IRTUAL O BSERVATORY.
IVOA, Pune September Data Access Layer Working Group SSA Overview and Status Doug Tody National Radio Astronomy Observatory International V.
May IVOA Interop Meeting1 STScI/JHU Registry Status Gretchen Greene Wil OMullane T HE US N ATIONAL V IRTUAL O BSERVATORY.
23 May 2008 IVOA Interoperability Meeting -- Trieste T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE Resource Registries Closing Plenary Integration.
27 October 2008 IVOA Interoperability Meeting -- Baltimore T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE Resource Registries Opening Plenary Registry.
IVOA, Kyoto May Data Access Layer Working Group Working Group Report and Summary Doug Tody National Radio Astronomy Observatory International.
May 2005IVOA Kyoto1 Astronomical Data Query Language(ADQL) William OMullane Johns Hopkins University T HE US N ATIONAL V IRTUAL O BSERVATORY.
Sept. 2003NVO Team Meeting / Victoria1 VOQL/ADQL/MYDB for VO William OMullane Johns Hopkins University T HE US N ATIONAL V IRTUAL O BSERVATORY.
NVO Summer School VO Protocols and Jargon Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
9 September 2005NVO Summer School Aspen Astronomical Dataset Query Language (ADQL) Ray Plante T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 7, 2005NVO Summer School1 Building a SkyNode Server Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
Sept NVO Summer School1 Cone, SIAP, and OpenSkyQuery Client Development Gretchen Greene, Maria Nieto-Santisteban T HE US N ATIONAL V IRTUAL O.
VO Standards – Catalog Access Tamás Budavári Johns Hopkins University.
8 September 2008NVO Summer School 2008 – Santa Fe1 Publishing Data and Services to the VO Ray Plante Gretchen Greene T HE US N ATIONAL V IRTUAL O BSERVATORY.
Aus-VO Workshop 2003 International Virtual Observatory Alliance effort on Virtual Observatory Query Language Naoki Yasuda (JVO), VOQL WG.
14 October 2003ADASS 2003 – Strasbourg1 Resource Registries for the Virtual Observatory R.Plante (NCSA), G. Greene (STScI), R. Hanisch (STScI), T. McGlynn.
Solar and STP Physics with AstroGrid 1. Mullard Space Science Laboratory, University College London. 2. School of Physics and Astronomy, University of.
26 October 2004ADASS Pasadena1 Publishing and Resource Discovery with Registries Ray Plante T HE US N ATIONAL V IRTUAL O BSERVATORY Kevin Benson.
July 2004SC4DEVO -Caltech1 IVOA WebServices William O’Mullane The Johns Hopkins University T HE US N ATIONAL V IRTUAL O BSERVATORY.
T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE VAO Registry Relational Schema: Updates and New Interface(s) Theresa Dower Registry WG 16 May 2013 IVOA.
Supported by the National Science Foundation’s Information Technology Research Program under Cooperative Agreement AST with The Johns Hopkins University.
Diversity of domain descriptions in natural science: virtual observatory as a case study Briukhov D.O., Kalinichenko L.A., Zakharov V.N. Institute of Informatics.
Astrogrid Resource Registry Querying the Registry 1.Mullard Space Science Laboratory, University College London, Holmbury St. Mary, Dorking, Surrey RH5.
Astronomical Data Query Language Simple Query Protocol for the Virtual Observatory Naoki Yasuda 1, William O'Mullane 2, Tamas Budavari 2, Vivek Haridas.
VOQL WG Progress Report May 28, 2004 Masatoshi Ohishi.
WSRF Supported Data Access Service (VO-DAS)‏ Chao Liu, Haijun Tian, Dan Gao, Yang Yang, Yong Lu China-VO National Astronomical Observatories, CAS, China.
IVOA Interop, Victoria Canada, May IVOA Data Access Layer Closing Plenary Summary, Victoria May 2006 Doug Tody (NRAO/NVO/IVOA) I NTERNATIONAL V IRTUAL.
Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.
AstroGrid AstroGrid increases scientific research possibilities by : enabling access to distributed astronomical data and information resources. providing.
29-30 April 2004NVO Team Meeting NCSA1 Data Access Layer (DAL) SSA, SIA Enhancement Doug Tody National Radio Astronomy Observatory National Virtual Observatory.
T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE VAO Registry Status Spring 2014 Theresa Dower Registry WG IVOA Interoperability Meeting – Madrid 2014.
IVOA, Kyoto May Data Access Layer Working Group Status and Plans for this Workshop Doug Tody National Radio Astronomy Observatory International.
October 7, 2005VOQL-Madrid1 IVOA – VOQL WG session ESAC Villafranca del Castillo Madrid, Spain Friday, October 7th, 9: :00 Yuji Shirasaki Maria Nieto-Santisteban.
IVOA, Kyoto May Data Access Layer Thoughts on ADQL/DAL Integration Doug Tody (NRAO) International V IRTUAL O BSERVATORY.
Oct. 1, 2004IVOA Small Projects Meeting1 Development of JVO prototype system and its application to Astrophysics Portal System : M. Tanaka Data Service.
Solar and space physics datasets within a Virtual Observatory: the AstroGrid experience Silvia Dalla * and Nicholas A Walton  * School of Physics & Astronomy,
A PPARC funded project VOTech AstroGrid DSA Update Kona Andrews Institute for Astronomy University of Edinburgh.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Applications May 2006, Victoria, Canada VOQuest A tool.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé Registry and Curation, Oct 2005, ESAC, Spain ESAVO Registry.
Progress Report of VOQL WG May 15 (Thu) Masatoshi Ohishi (Japan)
16 October 2003Registry Interface CallsIVOA Interoperability, Strasbourg IVOA Interoperability Elizabeth Auden & Registry Workgroup 16 – 17 October 2003.
The International Virtual Observatory Alliance (IVOA) interoperability in action.
VO Enabled Mirage and The IVOA Client Package Samuel Carliles 1, Tin Kam Ho 2, and William O’Mullane 1 1 Department of Physics and Astronomy, The Johns.
May 17, 2005Maria Nieto-Santisteban, JHU / IVOA - Kyoto1 VO JHU Open SkyQuery and more … T. Budavari, S. Carliles, L. Dobos, G. Fekete,
May 24, 2004IVOA Interop Meeting1 An AXIS-based Java SkyNode Ramon Williamson NCSA T HE US N ATIONAL V IRTUAL O BSERVATORY.
AstroGrid Datacenters IVOA Interoperability meeting M Hill (ROE), May 2004.
German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE 25 May 2009 IVOA Interoperability Meeting -- Strasbourg Resource Registries Opening Plenary Interoperability.
William O’Mullane/ Tannu Malik - JHU IVOA Cambridge May 12-16, 2003 SkyQuery.Net SKYQUERY Federated Database Query System (using WebServices)
May 2006IVOA Victoria, Canada1 VOQL Where do we stand? What is left? Yuji Shirasaki JVO Maria A. Nieto-Santisteban JHU T HE US N ATIONAL V IRTUAL O BSERVATORY.
May IVOA Interop Meeting1 Standard Interfaces William O’Mullane T HE US N ATIONAL V IRTUAL O BSERVATORY.
7 Dec 2009R. J. Hanisch: Astronomy Data Standards CERN 1 Data Standards in Astronomy Dr. Robert J. Hanisch Director, US Virtual Astronomical Observatory.
VO Data Access Layer IVOA Cambridge, UK 12 May 2003 Doug Tody, NRAO.
IVOA Interop, Beijing, China, May IVOA Data Access Layer Working Group Sessions Doug Tody (NRAO/NVO ) Markus Dolensky (ESO/EuroVO) Data Access Layer.
16 May 2006IVOA Interoperability – Registries WG1 VOResource Schema v1.0 Release 6 Ray Plante NCSA T HE I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
Introduction: AstroGrid increases scientific research possibilities by enabling access to distributed astronomical data and information resources. AstroGrid.
Google Sky.
IVOA – VOQL WG session ESAC Villafranca del Castillo Madrid, Spain Friday, October 7th, 9: :00 Yuji Shirasaki Maria Nieto-Santisteban VOQL-Madrid.
Implementing VOSpace 1.0 without Axis
VOQL WG Plenary Session
Presentation transcript:

Sept. 2004IVOA Meeting / Pune1 Virtual Observatory Query Language (VOQL) Working Group William O’Mullane For Masatoshi Oishi T HE US N ATIONAL V IRTUAL O BSERVATORY

Sept. 2004IVOA Meeting / Pune2 VOQL WG - Background Started Cambridge England May 2003 Decision to concentrate on Astronomical Data Query Language (ADQL) –SQL based –Allow exposure of catalogues –Good step up from Cone Search –Should be XML for easy parsing Also agreed to look at WebServices to take ADQL and return VOTable (OpenSkyNode)

Sept. 2004IVOA Meeting / Pune3 VOQL WG – This session 1.Make or 0.9 Proposed Recommendation or must we have DML (create insert delete). AstroGrid and NVO will probably go with from Jan 2005 demos.. Should that be the PR? 2.Other ADQL syntactic issues since last time 3.Integration with DAL group and further enhancements (Yugi)

Sept. 2004IVOA Meeting / Pune4 OpenSkyQuery,SkyNodes Status William O’Mullane Johns Hopkins University T HE US N ATIONAL V IRTUAL O BSERVATORY

Sept. 2004IVOA Meeting / Pune5 Context OpenSkyNode is a SOAP interface accepting ADQL and exposing metadata OpenSkyQuery is a demonstration portal which uses multiple nodes to perform distributed queries ADQL may be used by multiple services in DAL. E.g. upgraded CONE/SIAP services.

Sept. 2004IVOA Meeting / Pune6 Architecture

Sept. 2004IVOA Meeting / Pune7 SkyNode Interface for tables,columns etc. Interface for PerformQuery Interface for ExecutePlan What is the Node InterfaceWhat is the Node Interface? Also have Portal Interface for tracking Lets see the PORTAL

Sept. 2004IVOA Meeting / Pune8 Exec plan SKYNODE 3SKYNODE 2 SKYNODE 1 CLIENT PORTAL 2. ExecPlan T3 result T2 result 1.Performance Queries

Sept. 2004IVOA Meeting / Pune9 What to do with an ExecPlan ExecPlan List of nodes + Queries, sent from portal If I am the last node – run query return result. 1.If not pass on to the next node in the list and await response. 2.Upload response table 3.Perform Xmatch 4.Join result of Xmatch to the original query 5.Return the result

Sept. 2004IVOA Meeting / Pune10 Status Portal working well Skynode fairly stable Need better docs on Xmatch Need better docs in general Need Full Node in Java (have basic) Still problems with VOTable XSD in portal and C# Nodes – have workarounds

Sept. 2004IVOA Meeting / Pune11 Future MYDB- ala CasJobs does all of this – Identification across nodes – federated trust. WS-Security/ Now will be in line with WS-REF for grid. Single Sign On on the table !

Sept. 2004IVOA Meeting / Pune12 ADQL status, Issues William O’Mullane Johns Hopkins University T HE US N ATIONAL V IRTUAL O BSERVATORY

Sept. 2004IVOA Meeting / Pune13 ADQL/x ADQL/s Same semantics different syntax ADQL/x - parse tree easy for SkyNodes ADQL/s – textual easy for humans ADQL Includes, regions, Xmatch (parser only for circle now),math functions Some people still want one or the other Simple parser working both ways ADQLtoSkyQLADQLtoSkyQL SkyQLtoADQLSkyQLtoADQL

Sept. 2004IVOA Meeting / Pune14 ADQL/s and ADQL/x Select a.* from Tab a This would be the same in 0.8 ADQL/s ADQL/x

Sept. 2004IVOA Meeting / Pune15 ADQL0.8.1 INTO : MyDb, MySpace for both SELECT TOP : tie down semantics JOIN : Use Explicit JOIN syntax Add units : to ADQL/s, ADQL/x (need more metadata on table in SkyNode) Web services conversion tool is available in Oz Improve XMATCH : Move sigma inside the bracket Add ‘+’ for outer join and ‘?’ for uncovered areas

Sept. 2004IVOA Meeting / Pune16 ADQL0.8.1 NOT DONE No Data Manipulation Language e.g no –Insert –Create –Update –Delete GCDIST put off to have full list of Astronomy functions C# Translator not updated –Problems integrating new Space Time Coordinate Schema NCSA (Ray Plante) working on java translator

Sept. 2004IVOA Meeting / Pune17 New issues Funny table names e.g DEC –[DEC] in sqlServer `DEC` in mySql –OK in ADQL/x not in ADQL/s(need to check)

Sept. 2004IVOA Meeting / Pune18 Proposed Recommendation ?