IVOA Interop, Beijing, China, May 20071 IVOA Data Access Layer Working Group Sessions Doug Tody (NRAO/NVO ) Markus Dolensky (ESO/EuroVO) Data Access Layer.

Slides:



Advertisements
Similar presentations
Recommendations for a Table Access Protocol Ray Plante, Tamas Budavari, Gretchen Greene, John Goode, Tom McGlynn, Maria Nieto-Santistaban, Alex Szalay,
Advertisements

IVOA Interop, Cambridge UK, IVOA Data Access Layer Table Access Protocol Analysis Doug Tody (NRAO/NVO ) I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
A VO experience: Lessons learnt from accessing SIA compliant image servers with the AVO prototype F.Bonnarel on behalf of M.Allen, T.Boch, M.Dolensky,
May 16, 2006 IVOA Interop - Victoria, BC1 WCSFixer - A Web-enabled IRAF Plate Solver Michael Fitzpatrick NOAO T HE US N ATIONAL V IRTUAL O BSERVATORY.
TAP Meeting, JHU Nov IVOA Data Access Layer Table Access Protocol Doug Tody (NRAO/NVO ) I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE US National.
IVOA, Pune India September Data Access Layer Working Group Pune Workshop Summary Doug Tody National Radio Astronomy Observatory International.
May. 2004IVOA Meeting / Boston1 OpenSkyQuery,SkyNodes and ADQL William OMullane Johns Hopkins University T HE US N ATIONAL V IRTUAL O BSERVATORY.
Victoria, May Session III Theory Interest Group Session III Victoria, May
T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE Resource Registries Gretchen Greene Pierre Lesidaner Closing Plenary 20 May 2011 IVOA Interoperability.
SSA Query Interface M. Dolensky, ESO Data Access Layer Working Group Interoperability Workshop, Pune, India 27-Sep-2004.
IVOA, Pune September Data Access Layer Working Group SSA Overview and Status Doug Tody National Radio Astronomy Observatory International V.
19 May 2008 IVOA Interoperability Meeting -- Trieste T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE Registry Extension Schemas VODataService VOStandard.
IVOA Interop meeting 05/17/2006 Victoria F.Bonnarel (CDS) Generic Data discovery, Cube acces: CGPS Archive browser F.Bonnarel,T.Boch,D.Durand (CDS, CADC)
27 October 2008 IVOA Interoperability Meeting -- Baltimore T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE Resource Registries Opening Plenary Registry.
SIAP Extensions F.Bonnarel, T.Boch, P.Fernique M.Louys, P.Osuna,J.Salgado.
IVOA, Kyoto May Data Access Layer Working Group Working Group Report and Summary Doug Tody National Radio Astronomy Observatory International.
Practical Footprints bin/twiki/bin/view/IVOA/DALBasicFootprintHere Gretchen Greene, Jonathan Fay, Thomas Boch, Francois Ochsenbein,
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
6 September 2008NVO Summer School 2008 – Santa Fe1 DAL Clients: Scripting Data Access with Python Ray Plante T HE US N ATIONAL V IRTUAL O BSERVATORY.
NVO Summer School, Santa Fe Sept Access to Spectroscopic Data In the VO Doug Tody (NRAO/US-NVO ) I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
2008 NVO Summer School1 Data Access Layer Services Doug Tody (NRAO) T HE US N ATIONAL V IRTUAL O BSERVATORY.
Sept NVO Summer School1 Cone, SIAP, and OpenSkyQuery Client Development Gretchen Greene, Maria Nieto-Santisteban T HE US N ATIONAL V IRTUAL O.
NVO Summer School, Aspen Sept Data Access Layer Working Group Image and Spectral Access Doug Tody National Radio Astronomy Observatory National.
NVO Summer School, September Data Access Layer Servers NVO Summer School, Aspen Sept Doug Tody (NRAO) US National Virtual Observatory.
CASDA Virtual Observatory CSIRO ASTRONOMY AND SPACE SCIENCE Arkadi Kosmynin 11 March 2014.
Lessons learnt with Aladin and characterization experience for SIA2.0 F.Bonnarel, CDS (credit to Aladin developpers, CADC,ECF,ESAC, ESO VO people, DAL.
October 12, 2003ADASS NVO Tutorial1 How-To Implement Cone and SIA Services Gretchen Greene Space Telescope Science.
Digital Object: A Virtual Online Storage Solution 598C Course Project Huajing Li.
Managing Data Interoperability with FME Tony Kent Applications Engineer IMGS.
T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE VAO Registry Relational Schema: Updates and New Interface(s) Theresa Dower Registry WG 16 May 2013 IVOA.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé Homogeneous Access to Tabular Data Beijing, China - May.
IVOA Interop, Victoria Canada, May IVOA Data Access Layer Closing Plenary Summary, Victoria May 2006 Doug Tody (NRAO/NVO/IVOA) I NTERNATIONAL V IRTUAL.
16-17 Oct 2003IVOA Data Access Layer, Strasbourg IVOA Data Access Layer (DAL) Working Group Doug Tody National Radio Astronomy Observatory International.
29-30 April 2004NVO Team Meeting NCSA1 Data Access Layer (DAL) SSA, SIA Enhancement Doug Tody National Radio Astronomy Observatory National Virtual Observatory.
Introduction to Apache OODT Yang Li Mar 9, What is OODT Object Oriented Data Technology Science data management Archiving Systems that span scientific.
Spectroscopy in VO, ESAC Mar Access to Spectroscopic Data In the VO Doug Tody (NRAO/US-NVO ) for the IVOA DAL working group I NTERNATIONAL.
MapServer Support for Web Coverage Services Stephen Lime - Minnesota DNR Dr. Thomas E. Burk - University of Minnesota MUM Ottawa, Canada.
IVOA Interop, SL de El Escorial, Oct IVOA DAL - Madrid DAL WG Summary October 7, 2005.
IVOA, Kyoto May Data Access Layer Working Group Status and Plans for this Workshop Doug Tody National Radio Astronomy Observatory International.
Footprint Service Specification IVOA Interop Meeting Trieste 2008 Gretchen Greene and Tamas Budavari.
P Structured Query Language for Virtual Observatory Yuji Shirasaki National Astronomical Observatory of Japan, and Masahiro Tanaka (NAOJ), Satoshi.
IVOA, Kyoto May Data Access Layer Thoughts on ADQL/DAL Integration Doug Tody (NRAO) International V IRTUAL O BSERVATORY.
AstroGrid Solar/STP planning meeting Agenda: Helioscope Preparing for Solar-B Time-series viewing application IVOA and time series A PPARC funded project.
11 F.Bonnarel (CDS) Kyoto IVOA Interoperabilty Meeting DAL: a mechanism for Metadata extensions F.Bonnarel In behalf of T.Boch, M. Louys, P.Fernique (CDS)
David Adams ATLAS DIAL/ADA JDL and catalogs David Adams BNL December 4, 2003 ATLAS software workshop Production session CERN.
Workshop on How to Publish Data in VO ESAC, June 25-June DAL (Data Access Layer) protocols Jesus Salgado
UCL DEPARTMENT OF SPACE AND CLIMATE PHYSICS MULLARD SPACE SCIENCE LABORATORY Taverna Plugin VAMDC and HELIO (part of the ‘taverna-astronomy’ edition) Kevin.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Jesús Salgado AIDA Tech. Meeting Strasbourg, March 2009 (1/8) WP7 Task.
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
Extended Content Control Information (ExCCI) Packet — The Studio Side of DRM Hollywood Post Alliance 11 th Technology Retreat – Rancho Mirage, CA January.
T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE 25 May 2009 IVOA Interoperability Meeting -- Strasbourg Resource Registries Opening Plenary Interoperability.
IVOA Interop, SL de El Escorial, Oct IVOA Data Access Layer Doug Tody (NRAO/NVO/IVOA) I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE Resource Registries Gretchen Greene Opening Plenary 16 May 2011 IVOA Interoperability Meeting -- Naples.
1 AHM, 2–4 Sept 2003 e-Science Centre GRID Authorization Framework for CCLRC Data Portal Ananta Manandhar.
MBAT Infrastructure Controversial remarks…. What is an atlas?  a set of 2D images or a 3D volume in a specified coordinate system with a set of spatially.
May IVOA Interop Meeting1 Standard Interfaces William O’Mullane T HE US N ATIONAL V IRTUAL O BSERVATORY.
Publishing Combined Image & Spectral Data Packages Introduction to MEx M. Sierra, J.-C. Malapert, B. Rino VO ESO - Garching Virtual Observatory Info-Workshop.
Describing 3D Datasets Igor Chilingarian (CRAL Observatoire de Lyon/Sternberg Astronomical Institute of the Moscow State University) IVOA DM & DAL WG –
VO Data Access Layer IVOA Cambridge, UK 12 May 2003 Doug Tody, NRAO.
IVOA Interop, Beijing, China, May IVOA Data Access Layer Working Group Sessions Doug Tody (NRAO/NVO ) Markus Dolensky (ESO/EuroVO) Data Access Layer.
ECHO Technical Interchange Meeting 2013 Timothy Goff 1 Raytheon EED Program | ECHO Technical Interchange 2013.
16 May 2006IVOA Interoperability – Registries WG1 VOResource Schema v1.0 Release 6 Ray Plante NCSA T HE I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
IVOA Interop, Beijing, China, May IVOA Data Access Layer Working Group Sessions Doug Tody (NRAO/NVO ) Markus Dolensky (ESO/EuroVO) Data Access Layer.
End of the Beginning for IVOA is now Roy Williams IVOA Technical Lead.
Simple Image Access International VIRTUAL OBSERVATORY
Accomplishments RSM v0.7 First draft XML Schema completed: VOResource.xsd NVO: Working prototype resource using VOResource as format for metadata exchange.
GWS-WG: summary and objectives
Observation/dataset datamodel: Restart non-characterization efforts?
Footprint Service Specification
Presentation transcript:

IVOA Interop, Beijing, China, May IVOA Data Access Layer Working Group Sessions Doug Tody (NRAO/NVO ) Markus Dolensky (ESO/EuroVO) Data Access Layer Working Group I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE

IVOA Interop, Beijing, China, May SIA V2 Planning

IVOA Interop, Beijing, China, May SIA V2.0 Motivation –SIA upgrade long planned to follow SSAP release –Major new release with upgraded interface and new functionality –Our purpose here is to establish priorities for a draft specification to follow Strawman Priorities –Simple access should continue to be simple –2ndGen query interface, query response metadata (Char etc.) –Expanded data access capabilities (image cubes) –Grid capabilities (stageData, bulk operations, etc.) –"Complex data" linkage (data associations, multiple views)

IVOA Interop, Beijing, China, May Query Parameters POS,SIZE –Syntax Currently POS = ",,...; " But in general POS can be any string –Features Support frames other than ICRS, e.g., galactic Rotated or non-rectangular regions are possible Multi-region support needed for large scale operations –Multi-region Input a separate table of regions (POST, acref, etc.) Index, ID, POS, SIZE, etc. for each region Link region IDs back to input table in query response

IVOA Interop, Beijing, China, May Query Parameters BAND, TIME –Basically unchanged from SSAP –BAND could be a range list for 2-D projection of a spectral cube –TIME could be a range list for 2-D projection of a time cube FORMAT –Probably unchanged from SSAP, SIAP V1 Other Query Parameters –SPATRES etc. - most should carry over –Collection, PubDID, etc. - apply equally well to images

IVOA Interop, Beijing, China, May Query Response Metadata DataID, Target, Curation, Characterization, etc. –Most of this should carry over without change –Characterization needs to be reviewed for the image case "Image" Metadata –Metadata specific to each dataset type is permitted –What do we need for images? –For SIA V1 this included Naxes, Naxis, scale, and so forth –Perhaps Char will provide most of this now –FITS WCS - how do we handle this? Metadata Extension –Carry over; probably nothing specific to images

IVOA Interop, Beijing, China, May Precision Data Access Purpose –Precise specification of generated virtual data –For example, mosaics, or slice/dice a large cube Already discussed in previous interops Subcube, 2D plane, 2D proj, slice, reprojection, etc. Issues –Image generation parameters specify the geometry and WCS of a new image this is another "declarative" approach to data access specify what we want, let service determine how to do it –Requires general WCS support including spectral and time axis

IVOA Interop, Beijing, China, May Grid Capabilities StageData –Front-end to UWS as already discussed –Images to be generated are described in a prior queryData –Submitted job may make any number of images in one job –Includes support for staging data (VOSpace etc.) Related Capabilities –Authentication –Secure access to proprietary data –Logging support Other –getCapabilities, getAvailability

IVOA Interop, Beijing, China, May SIA V2 Summary Key Challenges –Generalize POS,SIZE to support multiple regions, more general regions, while still providing simple ROI for common usage –Need more formal mapping of FITS WCS to our data models –Generalize image generation mechanism to support precision image cube access (requires WCS integration) –Integration of Grid capabilities –Complex data (dataset associations and views)

IVOA Interop, Beijing, China, May