May 2006IVOA Victoria, Canada1 VOQL Where do we stand? What is left? Yuji Shirasaki JVO Maria A. Nieto-Santisteban JHU T HE US N ATIONAL V IRTUAL O BSERVATORY.

Slides:



Advertisements
Similar presentations
IVOA Interop, Cambridge UK, IVOA Data Access Layer Table Access Protocol Analysis Doug Tody (NRAO/NVO ) I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
Advertisements

Registry Interop Summary IVOA Interoperability meeting Cambridge, Boston, MA May 2004.
VOQL WG May 24 & 25, 2004 Masatoshi Ohishi. Agreement at the Cambridge Meeting Two level approach Level-1 : Extended SQL-based QL as the first version,
Interop May 2008 TriesteIVOA VOQL Group – Pedro Osuna IVOA VOQL Closing Plenary Session Trieste Interop meeting May 2008.
Registry WG IVOA Interoperability meeting Cambridge, Boston, MA May 2004.
IVOA, Pune India September Data Access Layer Working Group Pune Workshop Summary Doug Tody National Radio Astronomy Observatory International.
VOQL WG Plenary Session Sept 27, 2004 William OMullane for Masatoshi Ohishi.
28 October 2008 IVOA Interoperability Meeting -- Baltimore T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE TAP/VOTable Registry Interface Reg 1 – G.
May. 2004IVOA Meeting / Boston1 OpenSkyQuery,SkyNodes and ADQL William OMullane Johns Hopkins University T HE US N ATIONAL V IRTUAL O BSERVATORY.
T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE Resource Registries Gretchen Greene Pierre Lesidaner Closing Plenary 20 May 2011 IVOA Interoperability.
Achievements in VOQL WG May 20, 2005 Masatoshi Ohishi.
19 May 2008 IVOA Interoperability Meeting -- Trieste T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE Registry Extension Schemas VODataService VOStandard.
27-28 Sep 2007 CambridgeIVOA VOQL Group – Pedro Osuna IVOA VOQL Opening Plenary Session Cambridge Interop meeting Sep 2007.
May IVOA Interop Meeting1 STScI/JHU Registry Status Gretchen Greene Wil OMullane T HE US N ATIONAL V IRTUAL O BSERVATORY.
23 May 2008 IVOA Interoperability Meeting -- Trieste T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE Resource Registries Closing Plenary Integration.
27-28 Sep 2007 CambridgeIVOA VOQL Group – Pedro Osuna IVOA VOQL Closing Plenary Session Cambridge Interop meeting Sep 2007.
T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE Service Validators in Practice (within the VAO) Theresa Dower Registry WG 18 May 2011 IVOA Interoperability.
27 October 2008 IVOA Interoperability Meeting -- Baltimore T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE Resource Registries Opening Plenary Registry.
IVOA, Kyoto May Data Access Layer Working Group Working Group Report and Summary Doug Tody National Radio Astronomy Observatory International.
May 2005IVOA Kyoto1 Astronomical Data Query Language(ADQL) William OMullane Johns Hopkins University T HE US N ATIONAL V IRTUAL O BSERVATORY.
Sept. 2003NVO Team Meeting / Victoria1 VOQL/ADQL/MYDB for VO William OMullane Johns Hopkins University T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
9 September 2005NVO Summer School Aspen Astronomical Dataset Query Language (ADQL) Ray Plante T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 7, 2005NVO Summer School1 Building a SkyNode Server Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
Aus-VO Workshop 2003 International Virtual Observatory Alliance effort on Virtual Observatory Query Language Naoki Yasuda (JVO), VOQL WG.
1 16-May-2005Andy Lawrence : IVOA workshop, Kyoto Roadmap and charge news roadmap issues goals.
May 2005IVOA Kyoto1 Support Interfaces Ani Thakar, William O’Mullane Johns Hopkins University T HE US N ATIONAL V IRTUAL O BSERVATORY.
Sponsored by the Office of the Under Secretary of Defense for Personnel and Readiness (OUSD P&R) Experience API (xAPI) Update Andy Johnson Contractor with.
14 October 2003ADASS 2003 – Strasbourg1 Resource Registries for the Virtual Observatory R.Plante (NCSA), G. Greene (STScI), R. Hanisch (STScI), T. McGlynn.
Interop May 2008 TriesteIVOA VOQL Group – Pedro Osuna IVOA VOQL Opening Plenary Session Trieste Interop meeting May 2008.
TAP service at ESAC - VOTAP Carlos Rios Diaz Science Archives Team (SAT) ESA-ESAC, Madrid, Spain VOTAP.
26 May 2004IVOA Interoperability Meeting - Boston1 Recommendations for Revisions to the VOResource XML Schema IVOA Registry Working Group.
T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE VAO Registry Relational Schema: Updates and New Interface(s) Theresa Dower Registry WG 16 May 2013 IVOA.
Supported by the National Science Foundation’s Information Technology Research Program under Cooperative Agreement AST with The Johns Hopkins University.
Astronomical Data Query Language Simple Query Protocol for the Virtual Observatory Naoki Yasuda 1, William O'Mullane 2, Tamas Budavari 2, Vivek Haridas.
VOQL WG Progress Report May 28, 2004 Masatoshi Ohishi.
IVOA Interop, Victoria Canada, May IVOA Data Access Layer Closing Plenary Summary, Victoria May 2006 Doug Tody (NRAO/NVO/IVOA) I NTERNATIONAL V IRTUAL.
29-30 April 2004NVO Team Meeting NCSA1 Data Access Layer (DAL) SSA, SIA Enhancement Doug Tody National Radio Astronomy Observatory National Virtual Observatory.
T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE VAO Registry Status Spring 2014 Theresa Dower Registry WG IVOA Interoperability Meeting – Madrid 2014.
IVOA, Kyoto May Data Access Layer Working Group Status and Plans for this Workshop Doug Tody National Radio Astronomy Observatory International.
October 7, 2005VOQL-Madrid1 IVOA – VOQL WG session ESAC Villafranca del Castillo Madrid, Spain Friday, October 7th, 9: :00 Yuji Shirasaki Maria Nieto-Santisteban.
IVOA, Kyoto May Data Access Layer Thoughts on ADQL/DAL Integration Doug Tody (NRAO) International V IRTUAL O BSERVATORY.
IVOA InterOperability Meeting Overview Dave De Young Baltimore 26 – 31 October 2008.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé Registry and Curation, Oct 2005, ESAC, Spain ESAVO Registry.
16 October 2003Registry Interface CallsIVOA Interoperability, Strasbourg IVOA Interoperability Elizabeth Auden & Registry Workgroup 16 – 17 October 2003.
May 19, 2006IVOA InterOp WS 2006 May, Victoria, Canada 1 Plenary (DAY2) Masatoshi Ohishi / NAOJ & Sokendai 大石雅寿 / 国立天文台 & 総合研究大学院大学
May 17, 2005Maria Nieto-Santisteban, JHU / IVOA - Kyoto1 VO JHU Open SkyQuery and more … T. Budavari, S. Carliles, L. Dobos, G. Fekete,
WP 7 - JRA2 - Data Access Protocols and Data Models EuroVO-AIDA – Final review – 5 October 2010 Christophe Arviset (ESA) Work Package 7 - JRA2 Data Access.
May 24, 2004IVOA Interop Meeting1 An AXIS-based Java SkyNode Ramon Williamson NCSA T HE US N ATIONAL V IRTUAL O BSERVATORY.
JVO portal service Yuji Shirasaki National Astronomical Observatory of Japan.
T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE 25 May 2009 IVOA Interoperability Meeting -- Strasbourg Resource Registries Opening Plenary Interoperability.
An adoption phase for RDA WGs?. Background WGs end after 18 months WGs (and some IGs) produce outputs, but adoption of these outputs often only takes.
William O’Mullane/ Tannu Malik - JHU IVOA Cambridge May 12-16, 2003 SkyQuery.Net SKYQUERY Federated Database Query System (using WebServices)
State of the TCG Christophe Arviset For the TCG. TCG State of the TCG 6 December 2010 Christophe Arviset – TCG chair Page 2 Technical Coordination Group.
State of the TCG Christophe Arviset for the IVOA Technical Coordination Group.
May IVOA Interop Meeting1 Standard Interfaces William O’Mullane T HE US N ATIONAL V IRTUAL O BSERVATORY.
Registry workgroup: Final summary IVOA Interop Plenary Kyoto May 16-20, 2005 Tony Linde IVOA Registry workgroup chair AstroGrid Programme Manager VOTech.
16 May 2006IVOA Interoperability – Registries WG1 VOResource Schema v1.0 Release 6 Ray Plante NCSA T HE I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
Sept. 2004IVOA Meeting / Pune1 Virtual Observatory Query Language (VOQL) Working Group William O’Mullane For Masatoshi Oishi T HE US N ATIONAL V IRTUAL.
Review of MGs involvement in SRA process MG meeting 24 th January 2007 Brussels.
IVOA Interoperability Meeting Oct 2008, BaltimoreIVOA VOQL-TEG – Iñaki Ortiz ADQL status Iñaki Ortiz VOQL-TEG.
A review of the VO standards process Matthew Graham Cape Town
Standard Query Language for VO
Data Models: Plenary-1 Jonathan McDowell May 2006
Cross-matching the sky with database server cluster
GWS-WG: summary and objectives
IVOA – VOQL WG session ESAC Villafranca del Castillo Madrid, Spain Friday, October 7th, 9: :00 Yuji Shirasaki Maria Nieto-Santisteban VOQL-Madrid.
IVOA Interoperability Meeting - Boston
VOQL WG Plenary Session
Presentation transcript:

May 2006IVOA Victoria, Canada1 VOQL Where do we stand? What is left? Yuji Shirasaki JVO Maria A. Nieto-Santisteban JHU T HE US N ATIONAL V IRTUAL O BSERVATORY

May 2006IVOA Victoria, Canada2 Agreed (IVOA – Madrid Spain) First, Get WD -> PR -> Rec Finish WDs: –Nov 15 –Open for comments within WG: 2 weeks (end of Nov) –Promote to PR (needs at least a month) –Promote to Rec (needs approval from Exec) Implement changes & Upgrade by –March 1 st 

May 2006IVOA Victoria, Canada3 VOQL Roadmap (Oct – 7 th 05) JVO will release a new SkyNode toolkit in October (done in May 06) on the tap for future The '!' operator problem. Need for proper footprints More flexibility for XMATCH –How do we include errors? –new algorithms SkyNode -> High level data access service? ADQL/x ADQL/s what do we really need? Include VOStore – Async mech. Inclusion of simulated data access (with theory IG) Jan 2006NVO demos Spring 2006 reference implementation ? May 2006InterOp WS in Canada Aug 2006 IAU Prague : VO Special Session Autumn 2006InterOp WS in Russia

May 2006IVOA Victoria, Canada4 ADQL Where do we stand? What is left? Maria A. Nieto-Santisteban Johns Hopkins University T HE US N ATIONAL V IRTUAL O BSERVATORY

May 2006IVOA Victoria, Canada5 ADQL Specification status ADQL WD V1.04 –One specification but two flavors of BNF (Appendix/ CORE-Appendix) do we have a preference? –The Restriction / Extension section structure doesn’t work any longer. The document needs to be restructured Is the CORE Specification (.xsd) ready to be approved and implemented? Is the FULL Specification (.xsd) ready to be approved and implemented? Are we closer or further to reach the PR point? Focus on What is –Mandatory / Desirable / Optional ? GOAL?

May 2006IVOA Victoria, Canada6 What should be our GOAL? SIMPLICITY Differ from SQL as minimum as possible! Define the minimum required to start implementing services compliant with ADQL 1.0

May 2006IVOA Victoria, Canada7 Under debate Alias –Mandatory or Optional? Comments –Do we need comments? CaseSensitive –Why/How/When did this get into the CORE ADQL? Select …. into ‘VOS:….’ –Is Create / Insert a feasible option?

May 2006IVOA Victoria, Canada8 Under debate Default units in the REGION constraint –ArcMinutes / Degrees / Arbitrary? Default frame in REGION Select * From table Where Region('CIRCLE ') –Do we have users (or developers) that lazy? Time type: strongly suggestion (from Arnold) for the ISO case to adopt the same restrictions that are in FITS and in STC: yyyy-mm-ddThh:mm:ss.s..., optionally dropping the 'T' in SQL conversion; no support for time zones o

May 2006IVOA Victoria, Canada9 Under debate XMATCH –Where should XMATCH go? FROM | WHERE? SELECT s.ra, s.dec, t.ra, t.dec, x.d, x.ra, x.dec FROM SDSS:PhotoPrimary s, TWOMASS:PhotoPrimary t WHERE XMATCH(s,t, 3) OR SELECT s.ra, s.dec, t.ra, t.dec, x.d, x.ra, x.dec FROM SDSS:PhotoPrimary s, TWOMASS:PhotoPrimary t, XMATCH(s,t, 3) x

May 2006IVOA Victoria, Canada10 Under debate Are XMATCH_CHi2 and XMATCH_Distance syntactically different? –XMATCH_CHI2 (s, t, sigma) –XMATCH_Distance (s, t, distance) –What does it mean? Xmatch is expressed by a FunctionType wrapped by booleanValueFunctionType

May 2006IVOA Victoria, Canada11 SkyNode Where do we stand? What is left? Maria A. Nieto-Santisteban Johns Hopkins University T HE US N ATIONAL V IRTUAL O BSERVATORY

May 2006IVOA Victoria, Canada12 SkyNode Specification status SkyNode WD V1.02 Are we closer or further to reach the PR point? Focus on what is –Mandatory / Desirable / Optional ? GOAL?

May 2006IVOA Victoria, Canada13 What should be our GOAL? SIMPLICITY Define the minimum required to start implementing services compliant with SkyNode 1.0 to allow data access and basic spatial XMatch

May 2006IVOA Victoria, Canada14 Under Debate Request to remove references to portals and the SkyQuery origin in the introduction What is an error versus a service failure? What are special exceptions? Feature table needs to be finished ADQL-Features table needs to be finished Update to the new VOResource metadata schema How do we enforce good metadata? Metadata through ADQL, why not/why yes? Shall we split the spec between BASIC SkyNode and Full SkyNode?

May 2006IVOA Victoria, Canada15 Under Big Debate XMATCH semantics –XMATCH_CHI2 –XMATCH_Distance Both must be CLEARLY defined in terms of inputs and outputs How does it work for 2 nodes, 3 nodes, n nodes …? Does it bring always the same results?

May 2006IVOA Victoria, Canada16 Under Big Debate: the XMATCH XMATCH_Distance (s, t, D) Output_table (,, d) d D

May 2006IVOA Victoria, Canada17 XMATCH_Distance (s, t, k, D) First Step Output_table (,, d) Second Step Output_table () -- empty Under Big Debate: the XMATCH d D d’d’

May 2006IVOA Victoria, Canada18 XMATCH_Distance (t, s, k, D) First Step Output_table (,, d ) Second Step ? Output_table (,, d ) (,, d’ ) Under Big Debate: the XMATCH d D d’d’

May 2006IVOA Victoria, Canada19 Under Big Debate: the XMATCH XMATCH_chi2 (s, t, l) Output_table (,, d,, likelihood) r r < search radius given threshold l and SkyNode positional error

May 2006IVOA Victoria, Canada20 XMATCH_chi2 (s, t, k, l) First Step Output_table (,,, likelihood) Second Step Output_table (,,,, likelihood’) Under Big Debate: the XMATCH rd’d’ r < search radius given threshold l and SkyNode positional error