May. 2004IVOA Meeting / Boston1 OpenSkyQuery,SkyNodes and ADQL William OMullane Johns Hopkins University T HE US N ATIONAL V IRTUAL O BSERVATORY.

Slides:



Advertisements
Similar presentations
Recommendations for a Table Access Protocol Ray Plante, Tamas Budavari, Gretchen Greene, John Goode, Tom McGlynn, Maria Nieto-Santistaban, Alex Szalay,
Advertisements

IVOA Interop, Cambridge UK, IVOA Data Access Layer Table Access Protocol Analysis Doug Tody (NRAO/NVO ) I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
The NVO Portal Tom McGlynn, NASA/GSFC Gretchen Greene, ST ScI John Good, IRSA/IPAC Roy Williams, CACR/Caltech Mike Fitzpatrick, NOAO T HE US N ATIONAL.
VOQL WG May 24 & 25, 2004 Masatoshi Ohishi. Agreement at the Cambridge Meeting Two level approach Level-1 : Extended SQL-based QL as the first version,
IVOA, Pune India September Data Access Layer Working Group Pune Workshop Summary Doug Tody National Radio Astronomy Observatory International.
VOQL WG Plenary Session Sept 27, 2004 William OMullane for Masatoshi Ohishi.
IVOA, Pune September Data Access Layer Working Group SSA Overview and Status Doug Tody National Radio Astronomy Observatory International V.
May IVOA Interop Meeting1 STScI/JHU Registry Status Gretchen Greene Wil OMullane T HE US N ATIONAL V IRTUAL O BSERVATORY.
23 May 2008 IVOA Interoperability Meeting -- Trieste T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE Resource Registries Closing Plenary Integration.
IVOA, Kyoto May Data Access Layer Working Group Working Group Report and Summary Doug Tody National Radio Astronomy Observatory International.
May 2005IVOA Kyoto1 Astronomical Data Query Language(ADQL) William OMullane Johns Hopkins University T HE US N ATIONAL V IRTUAL O BSERVATORY.
Sept. 2003NVO Team Meeting / Victoria1 VOQL/ADQL/MYDB for VO William OMullane Johns Hopkins University T HE US N ATIONAL V IRTUAL O BSERVATORY.
NVO Summer School VO Protocols and Jargon Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
2008 NVO Summer School1 Finding Services in the NVO Registry Gretchen Greene T HE US N ATIONAL V IRTUAL O BSERVATORY.
9 September 2005NVO Summer School Aspen Astronomical Dataset Query Language (ADQL) Ray Plante T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 7, 2005NVO Summer School1 Building a SkyNode Server Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
Sept NVO Summer School1 Cone, SIAP, and OpenSkyQuery Client Development Gretchen Greene, Maria Nieto-Santisteban T HE US N ATIONAL V IRTUAL O.
VO Standards – Catalog Access Tamás Budavári Johns Hopkins University.
8 September 2008NVO Summer School 2008 – Santa Fe1 Publishing Data and Services to the VO Ray Plante Gretchen Greene T HE US N ATIONAL V IRTUAL O BSERVATORY.
Aus-VO Workshop 2003 International Virtual Observatory Alliance effort on Virtual Observatory Query Language Naoki Yasuda (JVO), VOQL WG.
Smart Transducer Interface Standard - IEEE 1451 September 24, 2002Sensors Expo, Boston1 Proposed Changes to the Current IEEE 1451 Overall Architecture.
July 2004SC4DEVO -Caltech1 IVOA WebServices William O’Mullane The Johns Hopkins University T HE US N ATIONAL V IRTUAL O BSERVATORY.
SDSS Web Services Tamás Budavári Johns Hopkins University Coding against the Universe.
Copyright © The OWASP Foundation Permission is granted to copy, distribute and/or modify this document under the terms of the OWASP License. The OWASP.
Supported by the National Science Foundation’s Information Technology Research Program under Cooperative Agreement AST with The Johns Hopkins University.
Diversity of domain descriptions in natural science: virtual observatory as a case study Briukhov D.O., Kalinichenko L.A., Zakharov V.N. Institute of Informatics.
Astronomical Data Query Language Simple Query Protocol for the Virtual Observatory Naoki Yasuda 1, William O'Mullane 2, Tamas Budavari 2, Vivek Haridas.
VOQL WG Progress Report May 28, 2004 Masatoshi Ohishi.
WSRF Supported Data Access Service (VO-DAS)‏ Chao Liu, Haijun Tian, Dan Gao, Yang Yang, Yong Lu China-VO National Astronomical Observatories, CAS, China.
29-30 April 2004NVO Team Meeting NCSA1 Data Access Layer (DAL) SSA, SIA Enhancement Doug Tody National Radio Astronomy Observatory National Virtual Observatory.
Virtual Observatory & LIGO Roy Williams California Institute of Technology.
JVO JVO Portal Japanese Virtual Observatory (JVO) Prototype 2 Masahiro Tanaka, Yuji Shirasaki, Satoshi Honda, Yoshihiko Mizumoto, Masatoshi Ohishi (NAOJ),
May 10, 2006IVOA-GGF Astro-RG WS1 Welcome and Workshop Goal Masatoshi Ohishi / NAOJ & Sokendai Chairman, IVOA 大石雅寿 / 国立天文台 & 総合研究大学院大学
VAMDC use-case for the RDA Data Citation Working Group C.M. Zwölf and VAMDC consortium 6 th RDA Plenary PARIS September 2015.
IVOA, Kyoto May Data Access Layer Working Group Status and Plans for this Workshop Doug Tody National Radio Astronomy Observatory International.
GEM Portal and SERVOGrid for Earthquake Science PTLIU Laboratory for Community Grids Geoffrey Fox, Marlon Pierce Computer Science, Informatics, Physics.
October 7, 2005VOQL-Madrid1 IVOA – VOQL WG session ESAC Villafranca del Castillo Madrid, Spain Friday, October 7th, 9: :00 Yuji Shirasaki Maria Nieto-Santisteban.
Federation and Fusion of astronomical information Daniel Egret & Françoise Genova, CDS, Strasbourg Standards and tools for the Virtual Observatories.
IVOA, Kyoto May Data Access Layer Thoughts on ADQL/DAL Integration Doug Tody (NRAO) International V IRTUAL O BSERVATORY.
Oct. 1, 2004IVOA Small Projects Meeting1 Development of JVO prototype system and its application to Astrophysics Portal System : M. Tanaka Data Service.
Web Services for the National Virtual Observatory Tamás Budavári Johns Hopkins University.
30 October 2008 IVOA Interoperability Meeting -- Baltimore T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE VOTable interface with Registry Joint Apps/DM/Registry.
The International Virtual Observatory Alliance (IVOA) interoperability in action.
May 17, 2005Maria Nieto-Santisteban, JHU / IVOA - Kyoto1 VO JHU Open SkyQuery and more … T. Budavari, S. Carliles, L. Dobos, G. Fekete,
Catalog Data Interface Tool Virtual Observatory-India (VO-I) May 16-20, 2005 Catalog Data Interface.
May 24, 2004IVOA Interop Meeting1 An AXIS-based Java SkyNode Ramon Williamson NCSA T HE US N ATIONAL V IRTUAL O BSERVATORY.
AstroGrid Datacenters IVOA Interoperability meeting M Hill (ROE), May 2004.
German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.
21-jun-2009 IVOA Standards Pedro Osuna ESA-VO Project Science Archives and Computer Support Engineering Unit (SRE-OE) Science Operations Department (SRE-O)
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
JVO portal service Yuji Shirasaki National Astronomical Observatory of Japan.
William O’Mullane/ Tannu Malik - JHU IVOA Cambridge May 12-16, 2003 SkyQuery.Net SKYQUERY Federated Database Query System (using WebServices)
1 Data Architecture Strawman - Grimshaw Important points Everything is a service (object) >All have a name (EPR) and an interface (type) One or more base.
May 2006IVOA Victoria, Canada1 VOQL Where do we stand? What is left? Yuji Shirasaki JVO Maria A. Nieto-Santisteban JHU T HE US N ATIONAL V IRTUAL O BSERVATORY.
IVOA Interop, Beijing, China, May IVOA Data Access Layer Working Group Sessions Doug Tody (NRAO/NVO ) Markus Dolensky (ESO/EuroVO) Data Access Layer.
Copyright 2007, Information Builders. Slide 1 iWay Web Services and WebFOCUS Consumption Michael Florkowski Information Builders.
IVOA Interop, Beijing, China, May IVOA Data Access Layer Working Group Sessions Doug Tody (NRAO/NVO ) Markus Dolensky (ESO/EuroVO) Data Access Layer.
The AstroGrid-D Information Service Stellaris A central grid component to store, manage and transform metadata - and connect to the VO!
Sept. 2004IVOA Meeting / Pune1 Virtual Observatory Query Language (VOQL) Working Group William O’Mullane For Masatoshi Oishi T HE US N ATIONAL V IRTUAL.
XML and Distributed Applications By Quddus Chong Presentation for CS551 – Fall 2001.
Introduction: AstroGrid increases scientific research possibilities by enabling access to distributed astronomical data and information resources. AstroGrid.
Standard Query Language for VO
Google Sky.
Datamining VizieR and SDSS
IVOA – VOQL WG session ESAC Villafranca del Castillo Madrid, Spain Friday, October 7th, 9: :00 Yuji Shirasaki Maria Nieto-Santisteban VOQL-Madrid.
Implementing VOSpace 1.0 without Axis
VOQL WG Plenary Session
Presentation transcript:

May. 2004IVOA Meeting / Boston1 OpenSkyQuery,SkyNodes and ADQL William OMullane Johns Hopkins University T HE US N ATIONAL V IRTUAL O BSERVATORY

May. 2004IVOA Meeting / Boston2 Context SkyNode is a SOAP interface accepting ADQL and exposing metadata OpenSkyQuery is a demonstration portal which uses multiple nodes to perform distributed queries ADQL may be used by multiple services in DAL. E.g. upgraded CONE/SIAP services.

May. 2004IVOA Meeting / Boston3 Since Last Time We had ADQL v0.3 spec combined with SkyNode Now we have SkyNode0.7.4 and ADQL as separate specs We now also have ADQL XSD (much input from M.Hill and Co.) We spoke of Open SkyQuery – Now we have a working version using ADQL0.7.4 and VOTable1.1(DataTable). Page to gather comments fro ADQL 0.8

May. 2004IVOA Meeting / Boston4 Virtual Observatory Query Language Layers (Cambridge) VOQL3 SkyXQuery VOQL2 SkyQL VOQL1 WebServices XML-based semantically rich query language. Portals combining ADQL services e.g. OpenSkyQuery Astronomical Data Query Language (ADQL) and VOTABLE to exchange information between machines e.g. SkyNode

May. 2004IVOA Meeting / Boston5 ADQL/x ADQL/s - remains Same semantics different syntax ADQL/x - parse tree easy for SkyNodes ADQL/s – textual easy for humans ADQL Includes, regions, Xmatch (parser only for circle now),math functions Some people still want one or the other Simple parser working both ways ADQLtoSkyQLADQLtoSkyQL SkyQLtoADQLSkyQLtoADQL

May. 2004IVOA Meeting / Boston6 ADQL old and new a Tab a.. Select a.* from Tab a

May. 2004IVOA Meeting / Boston7 Architecture not changed March 2004

May. 2004IVOA Meeting / Boston8 SkyNode Interface for tables,columns etc. Interface for PerformQuery Interface for ExecutePlan What is the Node InterfaceWhat is the Node Interface? NEED Portal Interface for tracking Lets see the PORTAL

May. 2004IVOA Meeting / Boston9 Exec plan SKYNODE 3SKYNODE 2 SKYNODE 1 CLIENT PORTAL 2. ExecPlan T3 result T2 result 1.Performance Queries

May. 2004IVOA Meeting / Boston10 What to do with an ExecPlan ExecPlan List of nodes + Queries, sent from portal If I am the last node – run query return result. 1.If not pass on to the next node in the list and await response. 2.Upload response table 3.Perform Xmatch 4.Join result of Xmatch to the original query 5.Return the result

May. 2004IVOA Meeting / Boston11 Problems Main delay going from ADQL > Votable1.1 – not working with XSD.exe or JAXB – VOtables produced are not in good format. Problems with the tools. Choice caused some problems linked with AnyType

May. 2004IVOA Meeting / Boston12 Future MYDB- ala CasJobs does all of this (short demo) – Identification across nodes – federated trust. WS-Security/ Now will be in line with WS-REF for grid.

May. 2004IVOA Meeting / Boston13 Identification across Nodes Need user identification across nodes –Centralize (not nice technically nor politically) –How to integrate with exiting mysapce and MYDB … Federate ! (IBM/MS Paper )IBM/MS Paper –Authentication service on each node –User signs up anywhere or uses exisiting id –Accept userids issued by trusted nodes Authenticate userid with node it is supposed to be from Working with Savas Parastatatis on this