Obscore DM v 1.1 Mireille Louys, Doug Tody, Patrick Dowler, Daniel Durand, Laurent Michel, François Bonnarel, Alberto Micol and the IVOA DataModel working.

Slides:



Advertisements
Similar presentations
Registries Work Package 2 Requirements, Science Cases, Use Cases, Test Cases Charter: Focus on science case scenarios, and use cases related specifically.
Advertisements

Characterisation of observations François Bonnarel, Mireille Louys, Anita Richards, Alberto Micol, Jonathan McDowell, Igor Chilingarian, et al.
State of the TCG Christophe Arviset For the TCG. TCG State of the TCG 17 May 2010 Christophe Arviset – TCG chair Page 2 Technical Coordination Group Technical.
T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE May 14, 2013 Registry Coverage * Status and Necessity Gretchen Greene 1Apps IV/ Registry I Session -
SSA Query Interface M. Dolensky, ESO Data Access Layer Working Group Interoperability Workshop, Pune, India 27-Sep-2004.
Characterization 2 and Provenance data models. Use cases and first roadmap F.Bonnarel (CDS)
IVOA Interop meeting 05/17/2006 Victoria F.Bonnarel (CDS) Generic Data discovery, Cube acces: CGPS Archive browser F.Bonnarel,T.Boch,D.Durand (CDS, CADC)
IVOA Interop Kyoto - VOTable1 Space-Time Coordinate Metadata for VOTable Arnold Rots Harvard-Smithsonian CfA / CXC T HE US N ATIONAL V IRTUAL.
SLAP: Simple Line Access Protocol v0.5
IVOA, Kyoto May Data Access Layer Working Group Working Group Report and Summary Doug Tody National Radio Astronomy Observatory International.
Practical Footprints bin/twiki/bin/view/IVOA/DALBasicFootprintHere Gretchen Greene, Jonathan Fay, Thomas Boch, Francois Ochsenbein,
A.Micol IVOA Registry REGISTRY WG Mar 2003 A Science Case (and 1000 Questions) for the IVOA Registry.
6 September 2008NVO Summer School 2008 – Santa Fe1 DAL Clients: Scripting Data Access with Python Ray Plante T HE US N ATIONAL V IRTUAL O BSERVATORY.
2008 NVO Summer School1 Data Access Layer Services Doug Tody (NRAO) T HE US N ATIONAL V IRTUAL O BSERVATORY.
NVOSS 2008 Santa Fe1 Space Time Coordinates Gretchen Greene (many thanks to Arnold Rots) T HE US N ATIONAL V IRTUAL O BSERVATORY Sept 2008.
Metadata in the TAP context (1) The Problem: learn about which tables, tablesets,... are available from a TAP server for each of the tables / tablesets,
CASDA Virtual Observatory CSIRO ASTRONOMY AND SPACE SCIENCE Arkadi Kosmynin 11 March 2014.
Lessons learnt with Aladin and characterization experience for SIA2.0 F.Bonnarel, CDS (credit to Aladin developpers, CADC,ECF,ESAC, ESO VO people, DAL.
IVOA Interoperability Meeting – Victoria, BC – 18 May 2006 Data Discovery and Metadata Query Using Characterisation DM Igor Chilingarian (CRAL Observatoire.
Time Table exchange QSAS / CL / CAA / AMDA CESR, 25/26 feb
Metadata Understanding the Value and Importance of Proper Data Documentation Exercise 2 Reading a Metadata File Exercise 3 Using the Workbook Exercise.
IVOA Interop Beijing, DM I Analysis of Characterisation in Domain Model Context With application to (SNAP) simulations Gerard Lemson DWith feedback.
3D Spectroscopy in the Virtual Observatory: Current Status Igor Chilingarian (Observatoire de Paris, France/SAI MSU, Russia) Ivan Zolotukhin (SAI MSU,
Characterisation Data Model applied to simulated data Mireille Louys, CDS and LSIIT Strasbourg.
Metadata, the CARARE Aggregation service and 3D ICONS Kate Fernie, MDR Partners, UK.
IVOA Interop, Victoria Canada, May IVOA Data Access Layer Closing Plenary Summary, Victoria May 2006 Doug Tody (NRAO/NVO/IVOA) I NTERNATIONAL V IRTUAL.
16-17 Oct 2003IVOA Data Access Layer, Strasbourg IVOA Data Access Layer (DAL) Working Group Doug Tody National Radio Astronomy Observatory International.
29-30 April 2004NVO Team Meeting NCSA1 Data Access Layer (DAL) SSA, SIA Enhancement Doug Tody National Radio Astronomy Observatory National Virtual Observatory.
Mapping between SOS standard specifications and INSPIRE legislation. Relationship between SOS and D2.9 Matthes Rieke, Dr. Albert Remke (m.rieke,
Handling 3D Data in the Virtual Observatory
Spectroscopy in VO, ESAC Mar Access to Spectroscopic Data In the VO Doug Tody (NRAO/US-NVO ) for the IVOA DAL working group I NTERNATIONAL.
IVOA Interop, SL de El Escorial, Oct IVOA DAL - Madrid DAL WG Summary October 7, 2005.
® GRDC Hydrologic Metadata - core concepts - 5 th, WMO/OGC Hydrology DWG New York, CCNY, August 11 – 15, 2014 Irina Dornblut, GRDC of WMO at BfG Copyright.
1 3 rd CAMELS Meeting November 2003 Nadine Gobron & Bernard Pinty presented by Peter Cox, with no french accent The JRC contribution to CAMELS: Dataset.
WGISS-40: IDN Report Michael Morahan WGISS-40 Fall meeting / Harwell, United Kingdom
Metadata – use data discovery e.g. a library catalog data assessment determine the fitness-for-purpose of a data set data retrieval e.g., format.
Intrinsic Short Term Variability in W3-OH and W49N Hydroxyl Masers W.M. Goss National Radio Astronomy Observatory Socorro, New Mexico, USA A.A. Deshpande,
11 F.Bonnarel (CDS) Kyoto IVOA Interoperabilty Meeting DAL: a mechanism for Metadata extensions F.Bonnarel In behalf of T.Boch, M. Louys, P.Fernique (CDS)
June 7, 2010COSMOS Team Meeting, IfA, Hawaii 1 The COSMOS Archive: Eight Years of Data Patrick L. Shopbell (Caltech), Nick Scoville (Caltech), The COSMOS.
Workshop on How to Publish Data in VO ESAC, June 25-June DAL (Data Access Layer) protocols Jesus Salgado
Issue/Revision: 1.0 Reference: Gaia Archive Status: Issued ESA UNCLASSIFIED - Releasable to the Public SourceDM: Some thoughts Jesús Salgado ESAC Science.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Jesús Salgado AIDA Tech. Meeting Strasbourg, March 2009 (1/8) WP7 Task.
00/XXXX 1 Data Processing in PRISM Introduction. COCO (CDMS Overloaded for CF Objects) What is it. Why is COCO written in Python. Implementation Data Operations.
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
Mireille Louys et al., OV-France Theory WG meeting, LYON, June DALIA : an observation vs simulation comparison frame work What could be a Model.
How to represent coverage: temporal, spectral, positional Clive Page AstroGrid Project University of Leicester 2003 March 19.
Describing 3D Datasets Igor Chilingarian (CRAL Observatoire de Lyon/Sternberg Astronomical Institute of the Moscow State University) IVOA DM & DAL WG –
EOVSA Data and Database System J. McTiernan EOVSA Technical DesignMeeting 7-Nov-2011.
Wide-field Infrared Survey Explorer (WISE) is a NASA infrared- wavelength astronomical space telescope launched on December 14, 2009 It’s an Earth-orbiting.
IVOA Interoperability Meeting Oct 2008, BaltimoreIVOA VOQL-TEG – Iñaki Ortiz ADQL status Iñaki Ortiz VOQL-TEG.
A review of the VO standards process Matthew Graham Cape Town
RichardsAMS_AIDA_WP7_T7_T11 EuroV_ Tech Forum AMS Richards, University of Manchester (UEDIN) WP7 T7 Radio Cubes Bonnarel, Harrison, Richards,
Mark Cresitello-Dittmar, SAO
<workgroup name>
Relevancy Ranking of Satellite Dataset Search Results
GWDAW - 8 University of Wisconsin - Milwaukee, December
STC-2 Design and Development: Status
Jesús Salgado, Omar Laurino
DAL concluding remarks
PDAP Query Language International Planetary Data Alliance
The GEO DAB possible contributions
Search Relevancy in GEO Data Access Broker
Cleaning up the mess.
MARINE STRATEGY FRAMEWORK DIRECTIVE (MSFD) COMMON IMPLEMENTATION STRATEGY Capturing metadata: Implementation of MSFD art – via a metadata catalogue.
Resolution.
Observation/dataset datamodel: Restart non-characterization efforts?
Utypes for Model Referencing
UTYPES Jonathan McDowell.
NRC’s fourth investigation over the last 35 years
WHERE TO FIND IT – Accessing the Inventory
Presentation transcript:

Obscore DM v 1.1 Mireille Louys, Doug Tody, Patrick Dowler, Daniel Durand, Laurent Michel, François Bonnarel, Alberto Micol and the IVOA DataModel working group Sydney Interop Meeting, Oct 2015

Points for the current update 1. Dimensions of the axes along which data are spanned s_dim1 Spatial s_dim2 em_dim Spectral t_dim Temporal pol_dim Polarization 2. Wording for these quantities: samples, elements, bins, ? 3. How to accomodate dimensions for an event list : number of events? 4. Previous intermediate version had Utypes strings fixed

More use-cases asked in Sesto (1) Use case 3.10 Show me a list of all data, For a selected list of SDSS objects that satisfies: 1.DataType=Cube with 3 dimensionsdataproduct_type = cube 2.Axes includes WAVEem_ucd=em.wl 3.Axes includes more than 200 pixels along each spatial axis s_dim1 and s_dim2 > Spatial resolution better than 2 arcsecs_resolution <2 Appendix A. in the ObsCore specification

More use-cases asked in Sesto (2) Use case 4.3 Show me a list of all data matching a particular event (e.g. gamma ray burst) in time interval and space: 1.DataType=time series 2.RA includes hours 3.DEC includes Time start > MJD and Time stop < MJD Number of time slots > 1000 Tested in TapHandle on ObsTAP services SELECT TOP 100 ivoa.ObsCore.access_url,ivoa.ObsCore.obs_id FROM ivoa.ObsCore WHERE (CONTAINS(POINT('ICRS', ivoa.ObsCore.s_ra, ivoa.ObsCore.s_dec), CIRCLE('ICRS', , , )) = 1) AND ivoa.ObsCore.dataproduct_type = 'timeseries' AND ivoa.ObsCore.t_resolution > 60 AND ivoa.ObsCore.t_min > AND ivoa.ObsCore.t_max 1000

Event list use-cases Show me a list of all event lists observed in the XMM data collection within the region covered by a particular image of GALEX data collection. 1.DataType = event list 2.Region contains polygon P1 extracted from the foot print of a particular GALEX image 3.Data collection= XMM 4.Instrument name=EPN SELECT xmm.access_url,xmm.obs_id FROM ivoa.ObsCore AS xmm JOIN ivoa.ObsCore as galex ON (CONTAINS(REGION(galex.s_region), REGION(xmm.s_region)) = 1) WHERE xmm.dataproduct_type = 'eventlist' AND galex.facility_name = ‘GALEX’ AND galex.dataproduct_type = 'image' AND xmm.facility_name = ‘XMM’ AND xmm.instrument_name = ‘EPN’

Data content search All characterisation axes are supported s, em, t, pol More dedicated parameters Detection limit SNR Nb of sources in an image field Number of Events … are not part of Obscore Data Model

How to advertise use-case and working examples ?An example Web page attached to TapHandle? ? An implementation note? ? Other

Document release schedule Update from this discussion Will be uploaded on ivoa.net/Documents Will be circulated on dm mailing list Discussion page at By 10 November 2015

Nature of the spectral axis How can I expose radio data in frequencies? How can I expose velocity cubes in km/s? em_ucd : em.wl, em.freq, em.dopplerVeloc.opt, em.dopplerVeloc.rel, … em_unit : any spectral unit following VOUnits spec ObsTAP constraints: Restricted units for spectral range in data discovery Data link services can bind the adequate description

Redshift ObsCore DM fields DOPPLER CHARACTERISATION (RedShift) d_ucdChar.DopplerAxis.ucdunitlessstringNature of the Doppler axisNO d_unit Char.DopplerAxis.unitunitlessstringUnits along the Doppler axisNO d_calib_statusChar.DopplerAxis.calibrationStat us unitlessenumType of Doppler coord calibrationNO d_reference_posit ion Char.DopplerAxis.ReferencePosit ion unitlessenumPhase space origin for Doppler velocity, also named Reference Position in STC REC, Section YES d_definitionChar.DopplerAxis.definitionunitlessenumDoppler velocity definition: RADIO, OPTICAL, RELATIVISTIC, as in STC REC, Section YES d_minChar.DopplerAxis.Coverage.Boun ds.Limits.LoLimit km/s (def) doubleStart in Doppler coordinatesYES d_maxChar.DopplerAxis.Coverage.Boun ds.Limits.HiLimit km/sdoubleStop in Doppler coordinatesYES d_res_powerChar.DopplerAxis.Resolution.Res olPower.refval unitlessdoubleValue of the resolving power along the Doppler axis. (Reference) YES d_res_power_minChar.DopplerAxis.Resolution.Res olPower.LoLimit unitlessdoubleResolving power min value on Doppler axisNO d_res_power_maxChar.DopplerAxis.Resolution.Res olPower.HiLimit unitlessdoubleResolving power max value on Doppler axisNO d_resolutionChar.DopplerAxis.Resolution.refv al.value km/sdoubleValue of Resolution along the Doppler axisNO d_stat_errorChar.DopplerAxis.Accuracy.StatE rror.refval.value km/sdoubleDoppler Coord statistical errorNO

Articulation of current data models ObsCore DM  Discovery oriented Dataset DM  Abstract view on generic datasets Two views on a common set of metadata  Take the benefit of each  Recognise the historical progression :  Obscore has been an efficient test bed for assessing the benefits of a common description accross archives to foster interoperability.  How to homogeneise ? Obscore:Observation  Obscore:Dataset like in DatasetDM