VOTable agenda Current VOTable status Current VOTable status News from Applications News from Applications Questions about VOTable schema Questions about.

Slides:



Advertisements
Similar presentations
VOTable 2005 Discussion Summary and Roadmap. Agenda Description of some applications dealing.
Advertisements

IVOA, Pune India September Data Access Layer Working Group Pune Workshop Summary Doug Tody National Radio Astronomy Observatory International.
VOFilter & VOTable2XHTML Chenzhou CUI, Yanxia ZHANG China-VO Project National Astronomical Observatory of China.
VOTable 2005 Applications. Agenda Description of some applications Description of some applications Nilesh UrunkarAbout C++ Parser and CONVOT Nilesh UrunkarAbout.
SLAP: Simple Line Access Protocol v0.5
NVOSS 2008 Santa Fe1 Space Time Coordinates Gretchen Greene (many thanks to Arnold Rots) T HE US N ATIONAL V IRTUAL O BSERVATORY Sept 2008.
XML Schema Heewon Lee. Contents 1. Introduction 2. Concepts 3. Example 4. Conclusion.
An Introduction to XML Based on the W3C XML Recommendations.
1 DTD (Document Type Definition) Imposing Structure on XML Documents (W3Schools on DTDs)W3Schools on DTDs.
ILDG File Format Chip Watson, for Middleware & MetaData Working Groups.
CSC1016 Coursework Clarification Derek Mortimer March 2010.
Introduction to XLink Transparency No. 1 XML Information Set W3C Recommendation 24 October 2001 (1stEdition) 4 February 2004 (2ndEdition) Cheng-Chia Chen.
Data Management: Documentation & Metadata Types of Documentation.
Introduction to XML This material is based heavily on the tutorial by the same name at
Method of Converting Resource definitions into XSD Group Name: WG3 (PRO) Source: Shingo Fujimoto, FUJITSU, Meeting Date:
Data processing in MathCAD. Data in tables Tables are analogous to matrices Tables are analogous to matrices The numbers of columns and rows can be dynamically.
Pemrograman Berbasis WEB XML part 2 -Aurelio Rahmadian- Sumber: w3cschools.com.
1 CIM User Group Conference Call december 8th 2005 Using UN/CEFACT Core Component methodology for EIC/TC 57 works and CIM Jean-Luc SANSON Electrical Network.
CHP - 9 File Structures. INTRODUCTION In some of the previous chapters, we have discussed representations of and operations on data structures. These.
DAT602 Database Application Development Lecture 14 HTML.
VOTable: Tabular Data for Virtual Observatory François Ochsenbein Roy Williams Clive Davenhall, Daniel Durand, Pierre Fernique, Robert Hanisch, David Giaretta,
Mapping Data Models to VOTable The specification Published version dml/doc/MappingDMtoVOTable-v pdf.
SSFS Test Plan/Report Overview of the test cases What “success” means for a data format type test How the tests were conducted Key results and conclusions.
Introduction to XML cs3505. References –I got most of this presentation from this site –O’reilly tutorials.
Why XML ? Problems with HTML HTML design - HTML is intended for presentation of information as Web pages. - HTML contains a fixed set of markup tags. This.
XML CPSC 315 – Programming Studio Fall 2008 Project 3, Lecture 1.
XML Language Family Detailed Examples Most information contained in these slide comes from: These slides are intended.
Chapter 1 Understanding the Web Design Environment Principles of Web Design, 4 th Edition.
Week 1 Understanding the Web Design Environment. 1-2 HTML: Then and Now HTML is an application of the Standard Generalized Markup Language Intended to.
BUFR Information Model Gil Ross CAeM Met Office. BUFR Most BUFR Documentation is not easily understood –It treats it as a Decoding process Note – not.
Prof. Yousef B. Mahdy , Assuit University, Egypt File Organization Prof. Yousef B. Mahdy Chapter -4 Data Management in Files.
What is XML?  XML stands for EXtensible Markup Language  XML is a markup language much like HTML  XML was designed to carry data, not to display data.
WebDAV Issues Munich IETF August 11, Property URL encoding At present, spec. allows encoding of the name of a property so it can be appended to.
Processing of structured documents Spring 2002, Part 2 Helena Ahonen-Myka.
Data Representation in Computer Systems
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Jesús Salgado SLAP Implementations May 2007, Beijing, China Simple Line.
Avoid using attributes? Some of the problems using attributes: Attributes cannot contain multiple values (child elements can) Attributes are not easily.
XML Part 2 Josh Steele CS 6704, Spring XML Part 2 XSL/XSLT –Structure Revisited –Definition –Example –Components XML’s Linking Languages XML’s Uses.
XML Patch Operations based on XPath selectors Jari Urpalainen IETF62 Minneapolis.
CSC 221 Computer Organization and Assembly Language
The european ITM Task Force data structure F. Imbeaux.
Array in C++ / review. An array contains multiple objects of identical types stored sequentially in memory. The individual objects in an array, referred.
Lecture 5: Writing the Project Documentation Part III.
An OO schema language for XML SOX W3C Note 30 July 1999.
XML – Part III. The Element … This type of element either has the element content or the mixed content (child element and data) The attributes of the.
Data TypestMyn1 Data Types The type of a variable is not set by the programmer; rather, it is decided at runtime by PHP depending on the context in which.
1 Tutorial 14 Validating Documents with Schemas Exploring the XML Schema Vocabulary.
Tutorial 13 Validating Documents with Schemas
SIP working group IETF#70 Essential corrections Keith Drage.
Working with XML Schemas ©NIITeXtensible Markup Language/Lesson 3/Slide 1 of 36 Objectives In this lesson, you will learn to: * Declare attributes in an.
Workshop on How to Publish Data in VO ESAC, June 25-June DAL (Data Access Layer) protocols Jesus Salgado
Discussion on XSD implementation conventions (document number PRO R01) Group Name: PRO Source: Wolfgang Granzow, Meeting.
Discussed in Kyoto Schema changes for the next version (Gerard Lemson)  will be included in VOTable1.2 Schema changes for the next version (Gerard Lemson)
Java Doc Guideline R.SANTHANA GOPALAN. Java Doc Guideline Audience Internal Developers PQA - who write test plans PPT – who write the documentation Customers.
Games: XML Presented by: Idham bin Mat Desa Mohd Sharizal bin Hamzah Mohd Radzuan bin Mohd Shaari Shukor bin Nordin.
PRO/ARC and TST/PRO joint sessions at TP20 Group Name: oneM2M TP20 Source: Peter Niblett, IBM Meeting Date:
Starting with Oracle SQL Plus. Today in the lab… Connect to SQL Plus – your schema. Set up two tables. Find the tables in the catalog. Insert four rows.
VOTable agenda Current VOTable status News from Applications Referring STC (as a data model example) Relations between s Questions about VOTable schema.
Level 1-2 Trigger Data Base development Current status and overview Myron Campbell, Alexei Varganov, Stephen Miller University of Michigan August 17, 2000.
XML Extensible Markup Language
CHAPTER 9 File Storage Shared Preferences SQLite.
oneM2M interop 3 issues and optimizations
Subscribing to YANG datastore push updates draft-netconf-yang-push-00 IETF #94 Yokohama A. Clemm A. Gonzalez Prieto
(Part 3-Floating Point Arithmetic)
Utypes for Model Referencing
UTYPES Jonathan McDowell.
VOTable Meetings: Conclusions
Presentation transcript:

VOTable agenda Current VOTable status Current VOTable status News from Applications News from Applications Questions about VOTable schema Questions about VOTable schema Question of empty columns Question of empty columns Utype & STC Utype & STC Late topics Late topics Actions & Future Actions & Future

Where are we ? VOTable1.1 is 2 years old VOTable1.1 is 2 years old quite generally used, many tools quite generally used, many tools What’s missing: What’s missing: general referencing to external data models, especially STC general referencing to external data models, especially STC Final schema which satisfies the applications Final schema which satisfies the applications

News from Applications Heard about: Heard about: VOConvert v1.0 (successor of ConVOT) VOConvert v1.0 (successor of ConVOT) VOStat (beta version) (on Friday) VOStat (beta version) (on Friday) VOMegaPlot VOMegaPlot TOPCAT v2.2 TOPCAT v2.2 more applications support the different formats (TABLEDATA / FITS / BINARY) more applications support the different formats (TABLEDATA / FITS / BINARY) Some problems heard about input/output of VOTables apparently not fixed Some problems heard about input/output of VOTables apparently not fixed conservation of GROUP structures (TOPcat) conservation of GROUP structures (TOPcat)... ?... ?

VOTable schema changes Embedded spaces recommended as &32; or in the next document Embedded spaces recommended as &32; or in the next document Problem of code generators (xsd) where the class generated by TABLEDATA consists of TD[][] instead of a class TR[] where TR consists in TD[] Problem of code generators (xsd) where the class generated by TABLEDATA consists of TD[][] instead of a class TR[] where TR consists in TD[] Easy to solve if an attribute is added to Easy to solve if an attribute is added to acceptable ? acceptable ?

VOTable schema changes Question of recursivity (already discussed) Question of recursivity (already discussed) allowed in RESOURCE GROUP and OPTION allowed in RESOURCE GROUP and OPTION is useful, can describe trees instead of simple arrays, actually used in some applications is useful, can describe trees instead of simple arrays, actually used in some applications Accept ? Accept ?

Question of empty Question of empty How correct is (or ) ? How correct is (or ) ? Is a single representration (null or NaN) enough ? (FITS knows only one) Is a single representration (null or NaN) enough ? (FITS knows only one) In the TABLEDATA data representation, the default representation of a "null" value is an empty column (i.e. ); for fields containing arrays, individual "null" elements of the array can be specified either by the value specified in the null attribute, or by the "NaN" or "nan" text in place of the expected number.

(cont’d) (cont’d) Empty tag: Empty tag: concerns only the serialisation concerns only the serialisation Must be compatible with other serializations (FITS BINARY) Must be compatible with other serializations (FITS BINARY) The problem with FITS compatibility: The problem with FITS compatibility: NaN Floating-point values always possible (no possibility to force a column to contain actual values) NaN Floating-point values always possible (no possibility to force a column to contain actual values) No equivalent exists for integer (byte, short, int, long) i.e. the choice of a "special“ value is required in these cases No equivalent exists for integer (byte, short, int, long) i.e. the choice of a "special“ value is required in these cases

(cont’d) (cont’d) The VOTable document specifies that empty TDs are acceptable to represent NULLs – does not work for integer representations as well as arrays. Two possibilities: The VOTable document specifies that empty TDs are acceptable to represent NULLs – does not work for integer representations as well as arrays. Two possibilities: emtpy not allowed, use NaN emtpy not allowed, use NaN Accept widely used convention of null representation as the smallest integer (without positive counterpart): =0X8000 (short) ; similarly int =0x long=0x L ? Accept widely used convention of null representation as the smallest integer (without positive counterpart): =0X8000 (short) ; similarly int =0x long=0x L ?

Utypes: what is it ? Non-mandatory attribute of RESOURCE TABLE FIELD PARAM GROUP Non-mandatory attribute of RESOURCE TABLE FIELD PARAM GROUP originally created for DAL needs originally created for DAL needs is a possible attribute in VOTable1.1 wherever the ucd is an acceptable attribute is a possible attribute in VOTable1.1 wherever the ucd is an acceptable attribute contrary to the ucd, gives a fully detailed meaning of the field, parameter or group contrary to the ucd, gives a fully detailed meaning of the field, parameter or group ucd = broad semantics, typically used for data mining ucd = broad semantics, typically used for data mining utype = detailed semantics, refers to a data model utype = detailed semantics, refers to a data model

Utype: its usage in VOTable can supply an exact description of the column contents can supply an exact description of the column contents immediate application for a referencing of parameters which exact meaning is crucial immediate application for a referencing of parameters which exact meaning is crucial systems of coordinates: celestial, terrestrial, solar,... (connection with STC) systems of coordinates: celestial, terrestrial, solar,... (connection with STC) time definitions (connection with STC) time definitions (connection with STC) photometric systems & bandpasses photometric systems & bandpasses more generally any parameter in a model, simulation... more generally any parameter in a model, simulation...

Status after Victoria meeting At El Escorial: proposal of using in the utype attribute an XPath analogy was refused At El Escorial: proposal of using in the utype attribute an XPath analogy was refused DAL way ssa:Sky.Resolution DAL way ssa:Sky.Resolution a simple rule is defined to derive the utype contents (concatenation of elements' names with dots) a simple rule is defined to derive the utype contents (concatenation of elements' names with dots) define the recommended utype in the model ? define the recommended utype in the model ? should converge to common solutions across VO components should converge to common solutions across VO components

Scenario #1 for STC Use a with eters to define the reference system, as in this example (following Jonathan’s document “Cordinates Data Model“ )

Scenario #2 for STC As in scenario #1, define the reference system in a with eters, but use the ref= mechanism to specify the frame – see this examplethis example (following Jonathan’s document “Cordinates Data Model“ )

Scenario #3 for STC As in scenario #2, but closer to Arnold’s definition of STC – see the exampleexample

…conclusion ? #1 = GROUP of PARAM’s + FIELDref’s describing the coordinates #1 = GROUP of PARAM’s + FIELDref’s describing the coordinates #2 = GROUP defining the coordinate system; closer to the former ; FIELDs representing position components use the ref mechanism to indicate the coordinate system #2 = GROUP defining the coordinate system; closer to the former ; FIELDs representing position components use the ref mechanism to indicate the coordinate system #3 = similar to #2, closer to original STC definitions #3 = similar to #2, closer to original STC definitions

Sexagesimal representations Came out again during this week-end! Came out again during this week-end! Definition of a sexagesimal number: number edited with 1 or 2 `decimals’ in base 60; further decimals in base 10 if needed. Definition of a sexagesimal number: number edited with 1 or 2 `decimals’ in base 60; further decimals in base 10 if needed. Solution adopted at CDS: "quoted" units Solution adopted at CDS: "quoted" units (apparently adoped in TOPcat) Accept or discourage this multi-millenia usage ? Accept or discourage this multi-millenia usage ? should applications consuming VOTables be able to deal with sexagesimal representations? Or should VOTable promote decimal degrees (or radians) for angles, decimal seconds, hours, or days for time ? should applications consuming VOTables be able to deal with sexagesimal representations? Or should VOTable promote decimal degrees (or radians) for angles, decimal seconds, hours, or days for time ?

ref attribute to TABLE Current definition: Current definition: A TABLE may have a ref attribute referencing the ID of another table previously described, which is interpreted as defining a table having a structure identical to the one referenced: this facility avoids a repetition of the definition of tables which may be present many times in a VOTable document.

ref attribute to TABLE (cont’d) Question raised: should the ref attribute quote the table structure or the full table ? Question raised: should the ref attribute quote the table structure or the full table ?

Actions & Future Toward a VOTable1.2: Toward a VOTable1.2: Write down the utype conventions, and deprecate COOSYS Write down the utype conventions, and deprecate COOSYS clarify the NULL/NaN conventions clarify the NULL/NaN conventions clarify other possible controversies (ref attribute) clarify other possible controversies (ref attribute) VOTable1.2 schema – testing volunteers ? VOTable1.2 schema – testing volunteers ? And after adoption of VOTable1.2, continuation of this WG ? And after adoption of VOTable1.2, continuation of this WG ?