Spectroscopy in VO, ESAC Mar 21-23 20071 Access to Spectroscopic Data In the VO Doug Tody (NRAO/US-NVO ) for the IVOA DAL working group I NTERNATIONAL.

Slides:



Advertisements
Similar presentations
IVOA Interop, Cambridge UK, IVOA Data Access Layer Table Access Protocol Analysis Doug Tody (NRAO/NVO ) I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
Advertisements

May 18, 2006IVOA Interoperability Meeting Fine-grained vs. Coarse-grained Registries or How much detail about a resource should be stored in a registry?
IVOA, Pune India September Data Access Layer Working Group Pune Workshop Summary Doug Tody National Radio Astronomy Observatory International.
Victoria, May Session III Theory Interest Group Session III Victoria, May
SSA Query Interface M. Dolensky, ESO Data Access Layer Working Group Interoperability Workshop, Pune, India 27-Sep-2004.
Characterization 2 and Provenance data models. Use cases and first roadmap F.Bonnarel (CDS)
IVOA, Pune September Data Access Layer Working Group SSA Overview and Status Doug Tody National Radio Astronomy Observatory International V.
IVOA Interop meeting 05/17/2006 Victoria F.Bonnarel (CDS) Generic Data discovery, Cube acces: CGPS Archive browser F.Bonnarel,T.Boch,D.Durand (CDS, CADC)
2004 Sepjcm/sao/nvo1 Spectrum Data Model Jonathan McDowell CfA US National Virtual Observatory.
SLAP: Simple Line Access Protocol v0.5
IVOA, Kyoto May Data Access Layer Working Group Working Group Report and Summary Doug Tody National Radio Astronomy Observatory International.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
6 September 2008NVO Summer School 2008 – Santa Fe1 DAL Clients: Scripting Data Access with Python Ray Plante T HE US N ATIONAL V IRTUAL O BSERVATORY.
NVO Summer School, Santa Fe Sept Access to Spectroscopic Data In the VO Doug Tody (NRAO/US-NVO ) I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
2008 NVO Summer School1 Image Visualization in the VO Doug Tody (NRAO) Francois Bonnarel (CDS) T HE US N ATIONAL V IRTUAL O BSERVATORY.
2008 NVO Summer School1 Data Access Layer Services Doug Tody (NRAO) T HE US N ATIONAL V IRTUAL O BSERVATORY.
NVO Summer School, Aspen Sept Data Access Layer Working Group Image and Spectral Access Doug Tody National Radio Astronomy Observatory National.
CASDA Virtual Observatory CSIRO ASTRONOMY AND SPACE SCIENCE Arkadi Kosmynin 11 March 2014.
14 October 2003ADASS 2003 – Strasbourg1 Resource Registries for the Virtual Observatory R.Plante (NCSA), G. Greene (STScI), R. Hanisch (STScI), T. McGlynn.
Lessons learnt with Aladin and characterization experience for SIA2.0 F.Bonnarel, CDS (credit to Aladin developpers, CADC,ECF,ESAC, ESO VO people, DAL.
Diversity of domain descriptions in natural science: virtual observatory as a case study Briukhov D.O., Kalinichenko L.A., Zakharov V.N. Institute of Informatics.
VO Data Access Layer Working Group Summary IVOA Cambridge, UK 16 May 2003 Doug Tody, NRAO.
3D Spectroscopy in the Virtual Observatory: Current Status Igor Chilingarian (Observatoire de Paris, France/SAI MSU, Russia) Ivan Zolotukhin (SAI MSU,
The VAO is operated by the VAO, LLC. VAO: Archival follow-up and time series Matthew J. Graham, Caltech/VAO.
Characterisation Data Model applied to simulated data Mireille Louys, CDS and LSIIT Strasbourg.
VO & Astro-Wise & others A.Belikov OmegaCEN
F. Genova, VOTECH kickoff meeting, 2004/11/ Interoperability standards F. Genova, M. Allen, T. Boch, F. Bonnarel, S. Derriere, P. Fernique, F. Ochsenbein,
WSRF Supported Data Access Service (VO-DAS)‏ Chao Liu, Haijun Tian, Dan Gao, Yang Yang, Yong Lu China-VO National Astronomical Observatories, CAS, China.
DateADASS How to Navigate VO Datasets Using VO Protocols Ray Plante (NCSA/UIUC), Thomas McGlynn and Eric Winter NASA/GSFC T HE US N ATIONAL V IRTUAL.
IVOA Interop, Victoria Canada, May IVOA Data Access Layer Closing Plenary Summary, Victoria May 2006 Doug Tody (NRAO/NVO/IVOA) I NTERNATIONAL V IRTUAL.
16-17 Oct 2003IVOA Data Access Layer, Strasbourg IVOA Data Access Layer (DAL) Working Group Doug Tody National Radio Astronomy Observatory International.
29-30 April 2004NVO Team Meeting NCSA1 Data Access Layer (DAL) SSA, SIA Enhancement Doug Tody National Radio Astronomy Observatory National Virtual Observatory.
Science with the Virtual Observatory Brian R. Kent NRAO.
Astronomical Spectroscopy and the Virtual Observatory ESAC, March 2007 VO tools and cross-calibration Pedro García-Lario European Space Astronomy.
IVOA Interop, SL de El Escorial, Oct IVOA DAL - Madrid DAL WG Summary October 7, 2005.
26 October 2005HST Calibration Workshop1 The National Virtual Observatory and HST T HE US N ATIONAL V IRTUAL O BSERVATORY Robert Hanisch US National Virtual.
ESAVO/European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Isa Barbarisi Beijing, May 2007 VOSpec new functionalities.
IVOA, Kyoto May Data Access Layer Working Group Status and Plans for this Workshop Doug Tody National Radio Astronomy Observatory International.
Federation and Fusion of astronomical information Daniel Egret & Françoise Genova, CDS, Strasbourg Standards and tools for the Virtual Observatories.
IVOA, Kyoto May Data Access Layer Thoughts on ADQL/DAL Integration Doug Tody (NRAO) International V IRTUAL O BSERVATORY.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Pedro OSUNA ESAC ADT Team VO-tech Cambridge 2004 VOSpec: A Tool to Handle.
Common Archive Observation Model (CAOM) What is it and why does JWST care?
Nov Common Archive Observation Model What is CAOM and why should MAST use it? Brian McLean.
30 October 2008 IVOA Interoperability Meeting -- Baltimore T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE VOTable interface with Registry Joint Apps/DM/Registry.
Aladin, VO standards, spectra and datacubes T.Boch, F.Bonnarel, P.Fernique (CDS, Aladin development group)
AstroGrid-D and GAVO AstroGrid-D: Infrastructure Network, Computing Resources Grid-Technology, Middleware GAVO: Interoperability of archives.
The International Virtual Observatory Alliance (IVOA) interoperability in action.
PhotDM implementation feedback | Jesus Salgado | ESAC | 18 October 2011 | IVOA Pune 2011 | Pag. 1 Photometry DM implementation feedback Jesus.
Workshop on How to Publish Data in VO ESAC, June 25-June DAL (Data Access Layer) protocols Jesus Salgado
German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.
21-jun-2009 IVOA Standards Pedro Osuna ESA-VO Project Science Archives and Computer Support Engineering Unit (SRE-OE) Science Operations Department (SRE-O)
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Jesús Salgado AIDA Tech. Meeting Strasbourg, March 2009 (1/8) WP7 Task.
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
Mireille Louys et al., OV-France Theory WG meeting, LYON, June DALIA : an observation vs simulation comparison frame work What could be a Model.
April , 2006 HEASARC Users Group Tom McGlynn The HEASARC On-line Services Tom McGlynn.
IVOA Interop, SL de El Escorial, Oct IVOA Data Access Layer Doug Tody (NRAO/NVO/IVOA) I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
Publishing Combined Image & Spectral Data Packages Introduction to MEx M. Sierra, J.-C. Malapert, B. Rino VO ESO - Garching Virtual Observatory Info-Workshop.
7 Dec 2009R. J. Hanisch: Astronomy Data Standards CERN 1 Data Standards in Astronomy Dr. Robert J. Hanisch Director, US Virtual Astronomical Observatory.
IVOA Interop, Beijing, China, May IVOA Data Access Layer Working Group Sessions Doug Tody (NRAO/NVO ) Markus Dolensky (ESO/EuroVO) Data Access Layer.
Describing 3D Datasets Igor Chilingarian (CRAL Observatoire de Lyon/Sternberg Astronomical Institute of the Moscow State University) IVOA DM & DAL WG –
VO Data Access Layer IVOA Cambridge, UK 12 May 2003 Doug Tody, NRAO.
IVOA Interop, Beijing, China, May IVOA Data Access Layer Working Group Sessions Doug Tody (NRAO/NVO ) Markus Dolensky (ESO/EuroVO) Data Access Layer.
IVOA Interoperability Workshop Theory and the Applications Interest Group.
IVOA Interop, Beijing, China, May IVOA Data Access Layer Working Group Sessions Doug Tody (NRAO/NVO ) Markus Dolensky (ESO/EuroVO) Data Access Layer.
End of the Beginning for IVOA is now Roy Williams IVOA Technical Lead.
Simple Image Access International VIRTUAL OBSERVATORY
Observation/dataset datamodel: Restart non-characterization efforts?
Google Sky.
SVO - ESAVO Use case: Comparison of evolutionary synthesis models
Presentation transcript:

Spectroscopy in VO, ESAC Mar Access to Spectroscopic Data In the VO Doug Tody (NRAO/US-NVO ) for the IVOA DAL working group I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE

Spectroscopy in VO, ESAC Mar Introduction Goals –Brief review of overall VO data access concepts (for newcomers) –Highlight current issues with spectra-related services –Identify issues for possible discussion at this workshop –Discuss SSAP implementations during meeting Agenda –VO data services –Data service functionality –Spectroscopic data services –1-D spectra, SEDs, (TimeSeries), Data cubes

Spectroscopy in VO, ESAC Mar VO Data Services Data Access in the VO –Its all about services ("middleware") –Client application - service/protocol - archival data –Necessary for large scale, multi-wavelength data analysis Access is organized by type of data –Generic dataset (what is common to all data) –Catalog, Image, Spectrum, SED, TimeSeries, Cube, etc. –Data mostly G&EG, but also solar, planetary, theory, etc. Service functionality –Data discovery –Dataset metadata access –Dataset data access

Spectroscopy in VO, ESAC Mar Data Service Functionality Data discovery –The VO Registry is used to find data collections and services –A data service is used to find (discover) individual datasets Dataset metadata access –Dataset metadata may be retrieved without having to get the data –Metadata is uniform, conforming to standard VO data models Dataset identification, curation, target, characterization, etc. –Uniform metadata is essential for automated data selection Dataset data access –Both "archival" and "virtual" (on-the-fly) data are supported Archival data is entire dataset; includes “native” project data –Distributed, multi-wavelength analysis requires virtual data Reduction in data volume: subsetting, filtering, projection Mediation to a standard model - spectral data is heterogeneous Same data can be viewed in different ways

Spectroscopy in VO, ESAC Mar VO Services for Spectroscopic Data Simple Spectral Access (SSA) –"Simple" 1-dimensional spectra –Most survey data is probably of this form Spectral Energy Distributions (SEDs) –SEDs are a vital tool for modern astronomical research Time Series Data –Not really spectral data; but it is not that simple Spectral/Time Data Cubes –A major data product in the future (and present) Spectral Line Lists (SLAP) –Access to observed and theoretical spectral line lists

Spectroscopy in VO, ESAC Mar Simple Spectral Access (SSA) Summary –Basic concept is a "simple" 1-D spectrum spectral coordinate, flux, error, quality flag, etc. –Includes both a query interface and a spectrum data model mediation to a standard model for heterogenous spectra –Virtual data generation mediation, cutout, reprojection, dynamic extraction, etc. –Data formats VOTable, FITS binary table, CSV, native XML, HTML, etc. Issues –Completion of V1.0 (implementations, interface tweaks) –How to treat multi-segment spectra –Flux units, e.g., absolute flux vs photometric magnitude

Spectroscopy in VO, ESAC Mar

8

9 Spectral Energy Distributions (SEDs) Summary –How to handle SEDs in the VO is still TBD This is a current hot topic; hope to resolve by May IVOA interop –What is a SED? - not as simple as it seems e.g., a (possibly multi-segment) spectrum is a degenerate case –SEDs can be complex Often generated by combining heterogeneous observations Individual observations can be very large SEDs can be dynamically generated A Possible Approach –A SED is a primary data object (like Image, Spectrum) –Generic dataset metadata describes entire SED object –A uniform view (table) is presented summarizing all segments –Pointers given to individual observations Other DAL interfaces used to access complex observations

Spectroscopy in VO, ESAC Mar Time Series Data Summary –Spectrum and TimeSeries are closely related both are a series of photometric points current Spectrum data model almost works for both –Both can be multi-segment time series often revisit the same object repeatedly –Time series can be large, like a highres spectrum "cutout" capability required, as for Spectrum A Possible Approach –TimeSeries is a primary data object (like Image, Spectrum) –Common spectrophotometric data model –Custom data access interface

Spectroscopy in VO, ESAC Mar Spectral/Time Data Cubes Summary –Data cubes are increasingly common with modern instruments radio interferometers, O/IR IFU/MOS instruments –Time cubes (synoptic imagery) are also important similar to Spectrum/TimeSeries relationship –Cubes can be very large typically 10 2 MB today, 10 2 GB not far off –Access required is complex subcube, 2-D plane or projection, slice, spectral filter, spectral extraction, etc. Possible Approach –Current plan is to extend image interface (SIA) to N-D –Parallels approach of using FITS for radio data cubes –IFU/MOS data may require a different approach (e.g., Euro3D)

Spectroscopy in VO, ESAC Mar

Spectroscopy in VO, ESAC Mar

Spectroscopy in VO, ESAC Mar DAL Scope: Types of data (Cambridge 2003) Dataset Time Series Catalog Source Catalog Event List Visibility Data Image NDImage 1D Spectrum SED Primary DAL Services Data Discovery

Spectroscopy in VO, ESAC Mar Dataset (etc.) Catalog Image Spectrum TimeSeries SED LineList Simulation Sloan SpectrumNative data STIS SpectrumNative data (etc.) XMM Spectrum Native data