Presentation is loading. Please wait.

Presentation is loading. Please wait.

VOTable agenda Current VOTable status News from Applications Referring STC (as a data model example) Relations between s Questions about VOTable schema.

Similar presentations


Presentation on theme: "VOTable agenda Current VOTable status News from Applications Referring STC (as a data model example) Relations between s Questions about VOTable schema."— Presentation transcript:

1 VOTable agenda Current VOTable status News from Applications Referring STC (as a data model example) Relations between s Questions about VOTable schema Late topics Actions & Future

2 Where are we ? VOTable1.1 is almost 3 years old (quite stable!) quite generally used, many tools What’s missing:  general referencing to external data models, especially STC  Final schema which satisfies the applications... and some (bogus?) tools

3 News from Applications VOConvert v1.0 (successor of ConVOT) VOStat (beta version) (on Friday) VOMegaPlot (many rows, density plots), VOPlot v1.4 TOPCAT v2.3 (supports all formats: TABLEDATA / FITS / BINARY). Problem of GROUP not solved ?

4 Referencing Models in VOTable The tabular material may contain in its fields (columns) any kind of data it is impossible to add into a VOTable document all the various XML codes related to all data models developed by the VO a VOTable document therefore refers to data models without including them

5 Utypes: what is it ? in VOTable schema: utype is a non-mandatory attribute of any RESOURCE TABLE FIELD PARAM GROUP  originally created for DAL needs  is an acceptable attribute wherever the ucd accepted  contrary to the ucd, gives a fully detailed meaning of the field, parameter or group ucd = broad semantics, typically used for data mining utype = detailed semantics, refers to a data model

6 Utype: its usage in VOTable can supply an exact description of the column contents immediate application for referencing quantities (parameters and/or fields) which exact meaning is crucial  systems of coordinates: celestial, terrestrial, solar,... (connection with STC)  time definitions (connection with STC)  photometric systems & filters  more generally any parameter part of a model, simulation...

7 STC Connection STC is an essential component to precise the conventions of dates, locations, coordinate systems (WhenWhere in VOEvent) used in most VO components should replace (and deprecate) the COOSYS ad-hoc convention

8 Scenarios for STC 5 scenarios are proposed on an example of a table having 5 columns: ObservingTime, RightAscension, Declination, ErrorRA, ErrorDec examples proposed on the VOTable forum. Very few answers up to now – but we have to take a decision this week !

9 ----------------------------------------------------------------- ObservingTime RightAscension Declination RA_Err Dec_Err (ICRS, deg) (ICRS, deg) (arcsec) (arcsec) ----------------------------------------------------------------- 2007-05-13T23:00:05 358.1234 +05.1234 0.19 0.19 2007-05-13T23:00:06 358.4567 -05.4321 0.21 0.22 2007-05-13T23:00:07 358.5678 +04.1234 0.23 0.22 2007-05-13T23:00:08 358.6789 -04.4321 0.22 0.25 ----------------------------------------------------------------- A very simple example

10 <!-- Proposal #1 for an accurate definition of time and position: o Time and space kept apart, o the GROUP describes the parameters of the coordinate system, as well as its members ("double" referencing) o No description of the ObservingTime column, i.e. default (UTC) assumed. --> <PARAM name="CooFrame" datatype="char" arraysize="*" utype="stc:AstroCoordSystem.SpaceFrame.CoordRefFrame.Type" value="ICRS" /> <PARAM name="CooFrameOrigin" datatype="char" arraysize="*" utype="stc:AstroCoordSystem.SpaceFrame.ReferencePosition.Type" value="TOPOCENTER" /> <PARAM name="CooType" datatype="char" arraysize="*" utype="stc:AstroCoordSystem.SpaceFrame.CoordFlavor.Type" value="SPHERICAL" /> Double referencing

11 <FIELD ID="OT" name="ObservingTime" datatype="char" arraysize="19" utype="stc:AstroCoords.Time.TimeInstant.ISOTime" ucd="time.start;obs.exposure" /> <FIELD ID="RA" name="Right Ascension" datatype="double" utype="stc:AstroCoords.Position2D.Value.C1" ref="ICRS_TOPO_SPH" unit="deg" ucd="pos.eq.ra" /> <FIELD ID="DEC" name="DEClination" datatype="double" utype="stc:AstroCoords.Position2D.Value.C2" ref="ICRS_TOPO_SPH" unit="deg" ucd="pos.eq.dec" /> <FIELD ID= "Err1" name="RA_Error" datatype="float" utype="stc:AstroCoords.Position2D.Error.Value.C1" ref="ICRS_TOPO_SPH" unit="arcsec" ucd="error;pos.eq.ra" /> <FIELD ID= "Err2" name="DEC_Error" datatype="float" utype="stc:AstroCoords.Position2D.Error.Value.C2" ref="ICRS_TOPO_SPH" unit="arcsec" ucd=”error;pos.eq.dec" /> Default UTC Time

12 <!-- Proposal #2: o one GROUP for each of the space / time definitions o the GROUP does not describe its members (no "double referencing") --> <PARAM name="TimeScale" datatype="char" arraysize="*" utype="stc:AstroCoordSystem.TimeFrame.TimeScale" value="TT" /> <PARAM name="TimePos" datatype="char" arraysize="*" utype="stc:AstroCoordSystem.TimeFrame.ReferencePosition.Type" value="TOPOCENTER" /> <PARAM name="CooFrame" datatype="char" arraysize="*" utype="stc:AstroCoordSystem.SpaceFrame.CoordRefFrame.Type" value="ICRS" /> <PARAM name="CooFrameOrigin" datatype="char" arraysize="*" utype="stc:AstroCoordSystem.SpaceFrame.ReferencePosition.Type" value="TOPOCENTER" /> <PARAM name="CooType" datatype="char" arraysize="*" utype="stc:AstroCoordSystem.SpaceFrame.CoordFlavor.Type" value="SPHERICAL" /> Time defined No double referencing

13 <FIELD ID="OT" name="ObservingTime" datatype="char" arraysize="19" ucd="time.start;obs.exposure" utype="stc:AstroCoords.Time.TimeInstant.ISOTime" ref="TT_TOPO"/> <FIELD ID="RA" name="Right Ascension" datatype="double" ucd="pos.eq.ra" unit="deg" utype="stc:AstroCoords.Coord.Value.C1" ref="ICRS_TOPO_SPH"/> <FIELD ID="DEC" name="DEClination" datatype="double" ucd="pos.eq.dec" unit="deg" utype="stc:AstroCoords.Coord.Value.C2" ref="ICRS_TOPO_SPH"/> <FIELD ID= "Err1" name="RA_Error" datatype="float" ucd="error;pos.eq.ra" unit="arcsec" utype="stc:AstroCoords.Coord.Error.Value.C1" ref="ICRS_TOPO_SPH"/> <FIELD ID= "Err2" name="DEC_Error" datatype="float" ucd="error;pos.eq.dec" unit="arcsec" utype="stc:AstroCoords.Coord.Error.Value.C2" ref="ICRS_TOPO_SPH"/>

14 <!-- Proposal #3: o Hierarchy of GROUPs to mime the STC requirements for a hierarchy o Use the direct value in utype (e.g..TOPOCENTER), and then value is void. o the GROUP does not describe its members (no "double referencing") --> <PARAM name="TimeScale" datatype="char" arraysize="*" utype="stc:AstroCoordSystem.TimeFrame.TimeScale" value="TT" /> <PARAM name="TimePos" datatype="char" arraysize="*" utype="stc:AstroCoordSystem.TimeFrame.TOPOCENTER" value="" /> <PARAM name="CooFrame" datatype="char" arraysize="*" utype="stc:AstroCoordSystem.SpaceFrame.ICRS" value="" /> <PARAM name="CooFrameOrigin" datatype="char" arraysize="*" utype="stc:AstroCoordSystem.SpaceFrame.TOPOCENTER" value="" /> <GROUP name="CooType" datatype="char" arraysize="*" utype="stc:AstroCoordSystem.SpaceFrame.SPHERICAL" > <PARAM utype="stc:AstroCoordSystem.SpaceFrame.SPHERICAL.coord_naxes" value="2" /> <PARAM name="SpectralPos" datatype="char" arraysize="*" utype="stc:AstroCoordSystem.SpectralFrame.TOPOCENTER" value="" />

15 <FIELD ID="OT" name="ObservingTime" datatype="char" arraysize="19" ucd="time.start;obs.exposure" utype="stc:AstroCoords.Time.TimeInstant.ISOTime" ref="TT-ICRS-WAVELENGTH-TOPO" /> <FIELD ID="RA" name="Right Ascension" datatype="double" ucd="pos.eq.ra" unit="deg" utype="stc:AstroCoords.Position2D.Value2.C1" ref="TT-ICRS-WAVELENGTH-TOPO" /> <FIELD ID="DEC" name="DEClination" datatype="double" ucd="pos.eq.dec" unit="deg" utype="stc:AstroCoords.Position2D.Value2.C2" ref="TT-ICRS-WAVELENGTH-TOPO" /> <FIELD ID= "Err1" name="RA_Error" datatype="float" ucd="error;pos.eq.ra" unit="arcsec" utype="stc:AstroCoords.Position2D.Error2.C1" ref="TT-ICRS-WAVELENGTH-TOPO" /> <FIELD ID= "Err2" name="DEC_Error" datatype="float" ucd="error;pos.eq.dec" unit="arcsec" utype="stc:AstroCoords.Position2D.Error2.C2" ref="TT-ICRS-WAVELENGTH-TOPO" />

16 <!-- Proposal #4 (suggested by Roy) follows STC definitions o 2 GROUPs: one for the definition of the system, another for the coordinates o the GROUP does not describe its members (no "double referencing") --> <PARAM name="STC_ID" datatype="char" arraysize="*" utype="stc:AstroCoordSystem.id" value="TT_ICRS_TOPO"/> <PARAM name="TimeScale" datatype="char" arraysize="*" utype="stc:AstroCoordSystem.TimeFrame.TimeScale" value="TT" /> <PARAM name="TimePos" datatype="char" arraysize="*" utype="stc:AstroCoordSystem.TimeFrame.ReferencePosition.Type" value="TOPOCENTER" /> <PARAM name="CooFrame" datatype="char" arraysize="*" utype="stc:AstroCoordSystem.SpaceFrame.CoordRefFrame.Type" value="ICRS" /> <PARAM name="CooFrameOrigin" datatype="char" arraysize="*" utype="stc:AstroCoordSystem.SpaceFrame.ReferencePosition.Type" value="TOPOCENTER" /> <PARAM name="CooType" datatype="char" arraysize="*" utype="stc:AstroCoordSystem.SpaceFrame.CoordFlavor.Type" value="SPHERICAL" /> <PARAM name="AstroCoo" datatype="char" arraysize="*" utype="stc:AstroCoords.coord_sys_id" value="TT_ICRS_TOPO"/> duplication of the meaning of TT_ICRS _TOPO

17 <FIELD ID="OT" name="ObservingTime" datatype="char" arraysize="19" utype="stc:AstroCoords.Time.TimeInstant.ISOTime" ucd="time.start;obs.exposure" ref="Coords1" /> <FIELD ID="RA" name="Right Ascension" datatype="double" unit="deg" utype="stc:AstroCoords.Position2D.Value2.C1" ucd="pos.eq.ra" ref="Coords1" /> <FIELD ID="DEC" name="DEClination" unit="deg" datatype="double" utype="stc:AstroCoords.Coord.Value2.C2" ucd="pos.eq.dec" ref="Coords1" /> <FIELD ID= "Err1" name="RA_Error" datatype="float" unit="arcsec" utype="stc:AstroCoords.Coord.Error.Value.C1" ucd="error;pos.eq.ra" ref="Coords1" /> <FIELD ID= "Err2" name="DEC_Error" datatype="float" unit="arcsec" utype="stc:AstroCoords.Coord.Error.Value.C2" ucd="error;pos.eq.dec" ref="Coords1" />

18 <!-- Proposal #5 (expanded from 4) o 2 GROUPs: one for the definition of the system, another for the coordinates --> <PARAM name="STC_ID" datatype="char" arraysize="*" utype="stc:AstroCoordSystem.id" value="TT_ICRS_TOPO"/> <PARAM name="TimeScale" datatype="char" arraysize="*" utype="stc:AstroCoordSystem.TimeFrame.TimeScale" value="TT" /> <PARAM name="TimePos" datatype="char" arraysize="*" utype="stc:AstroCoordSystem.TimeFrame.ReferencePosition.Type" value="TOPOCENTER" /> <PARAM name="CooFrame" datatype="char" arraysize="*" utype="stc:AstroCoordSystem.SpaceFrame.CoordRefFrame.Type" value="ICRS" /> <PARAM name="CooFrameOrigin" datatype="char" arraysize="*" utype="stc:AstroCoordSystem.SpaceFrame.ReferencePosition.Type" value="TOPOCENTER" /> <PARAM name="CooType" datatype="char" arraysize="*" utype="stc:AstroCoordSystem.SpaceFrame.CoordFlavor.Type" value="SPHERICAL" />

19 <PARAM name="AstroCoo" datatype="char" arraysize="*" utype="stc:AstroCoords.coord_sys_id" value="TT_ICRS_TOPO"/> Double referencing

20 <FIELD ID="OT" name="ObservingTime" datatype="char" arraysize="19" utype="stc:AstroCoords.Time.TimeInstant.ISOTime" ucd="time.start;obs.exposure" ref="Coords1" /> <FIELD ID="RA" name="Right Ascension" datatype="double" unit="deg" utype="stc:AstroCoords.Position2D.Value2.C1" ucd="pos.eq.ra" ref="Coords1" /> <FIELD ID="DEC" name="DEClination" unit="deg" datatype="double" utype="stc:AstroCoords.Coord.Value2.C2" ucd="pos.eq.dec" ref="Coords1" /> <FIELD ID= "Err1" name="RA_Error" datatype="float" unit="arcsec" utype="stc:AstroCoords.Coord.Error.Value.C1" ucd="error;pos.eq.ra" ref="Coords1" /> <FIELD ID= "Err2" name="DEC_Error" datatype="float" unit="arcsec" utype="stc:AstroCoords.Coord.Error.Value.C2" ucd="error;pos.eq.dec" ref="Coords1" />

21 …conclusion ? definition of AstroCoordSystem – necessary or just reference some component of STClib (not yet fully described in STC) ? Wouldn't it be better to have distinct references for time and coordinates ? (most frequently time specification is completely disconnected from coordinate system) double referencing (from GROUP and from FIELD) – useful or bad ? GROUP hierarchy – can it be problematic ?

22 Why not choose Simplicity? AstroCoordSystem definition only for non- standard system – use otherwise a reference if agreed with other groups, have separate Space, time, wavelength, etc... axes “double referencing” optional

23 Relations between tables (1) One VOTable document may contain several tables, meaning tables logically grouped. In the relational model, relations between tables are specified via the concept of keys basic key definitions: primary key (non-null, unique) and foreign key (must exist as primary in the related table) A simple solution: GROUPs

24 Relations between tables (2)...

25 Relations between tables (3)...

26 Relations between tables (4) Other possible interesting details: order of the data, e.g. with

27 Relations between tables (5) What is better:  just a with a specific name ?  prefer the definition of some “relational” data model and refer to these groups with utypes ?

28 ref attribute to TABLE (1) Current definition: A TABLE may have a ref attribute referencing the ID of another table previously described, which is interpreted as defining a table having a structure identical to the one referenced: this facility avoids a repetition of the definition of tables which may be present many times in a VOTable document.

29 ref attribute to TABLE (2) the ref attribute refers to the table structure, what about the following: 1 2 1.1 2.1

30 ref attribute to TABLE (3) from Moscow meeting: allow a reference to an empty table only (i.e. a table without part) is useful for many chunks of the same data structure (e.g. excerpts around a set of positions)  but would it better to allow several in a ?  prefer a supplementary column ?

31 VOTable schema changes (1) Problem of code generators (xsd) where the class generated by TABLEDATA consists of TD [][] instead of a class TR [] where TR consists in TD []  Easy to solve if an attribute is added to, e.g.  discussed in Moscow – strong opposition !  could be in the schema without being allowed

32 VOTable schema changes (2) problem – again a bug from code generator  has just 3 attributes: name value ID, plus simple content (i.e. any non-tagged text between and ). This content generates a conflict with the “value” attribute  would be wise to make similar to where datatype is a string (character string of any length), which means: accept utype ucd ID ref unit attributes accept sub- elements

33 VOTable schema changes (3) Streaming processing delivering VOTable output: there must be a possibility of providing a diagnostic about possible failure in the output stream allow to insert and tags after a ?

34 VOTable schema changes (4) discussed in Moscow: RESOURCE recursivity can be a problem, accept ? Deprecate, replaced by with its parameters and utypes to the STC model. Accept several in a ?  VOTable1.2 : volunteers to test the new schema ?

35 VOTable document changes Write down how to reference the STC with actual examples Explain the table relations (primary / foreign key conventions) with examples; other conventions ? Detail the null/NaN conventions


Download ppt "VOTable agenda Current VOTable status News from Applications Referring STC (as a data model example) Relations between s Questions about VOTable schema."

Similar presentations


Ads by Google