Presentation is loading. Please wait.

Presentation is loading. Please wait.

20 th CAA Cross-Calibration Workshop MPS, Göttingen, Germany Oct CAA Dataset Inventory.

Similar presentations


Presentation on theme: "20 th CAA Cross-Calibration Workshop MPS, Göttingen, Germany Oct CAA Dataset Inventory."— Presentation transcript:

1 20 th CAA Cross-Calibration Workshop MPS, Göttingen, Germany 15-17 Oct 2014 1 CAA Dataset Inventory

2 20 th CAA Cross-Calibration Workshop MPS, Göttingen, Germany 15-17 Oct 2014 2 Introduction  There are several similar datasets where the main difference is that data vectors or matrices are converted into another system. For instance, scientific data are given in different scientific units or coordinate systems  Consistence of such datasets have never been investigated although there is some evidence that some errors can occur  Such similar datasets can often be expected to have the same number of records  Exception: if a dataset is given in raw units, the corresponding datasets in scientific units may have less records if poor records were deleted  However, if poor data have been replaced with FILLVAL, the same number of records should exist  In addition such datasets should have similar values for  Version numbers  Generation and ingestion dates  Note: these metadata can have significant differences, so there is no automatic  CAA has developed a tool that collects such metadata and gives them in an xml file

3 20 th CAA Cross-Calibration Workshop MPS, Göttingen, Germany 15-17 Oct 2014 3 Inventory Output  The beta version of the inventory tool is available at http://caa.estec.esa.int/caa_stage/tk_inventory.xml  When the tool is ready, inventory is executed at TBD frequency (only for the newly ingested files)

4 20 th CAA Cross-Calibration Workshop MPS, Göttingen, Germany 15-17 Oct 2014 4 CIS Inventory List

5 20 th CAA Cross-Calibration Workshop MPS, Göttingen, Germany 15-17 Oct 2014 5 RAPID Inventory List

6 20 th CAA Cross-Calibration Workshop MPS, Göttingen, Germany 15-17 Oct 2014 6 PEACE Inventory List

7 20 th CAA Cross-Calibration Workshop MPS, Göttingen, Germany 15-17 Oct 2014 7 Example: PEACE PITCH_SPIN Inventory analysis for C1 "Electron Pitch Angle distribution (Spin-resolution, HEEA and LEEA sensors)" (C1_CP_PEA_PITCH_SPIN). Compared datasets: 1:C1_CP_PEA_PITCH_SPIN_DPFlux 2:C1_CP_PEA_PITCH_SPIN_DEFlux 3:C1_CP_PEA_PITCH_SPIN_PSD Generation date 2014-10-08T21:34:36Z Analysis is based on the database content at 2014-10-08T11:30:59Z Data coverage 2000-11-01T00:00:00Z/2012-12-30T23:59:59Z Columns description: Date: YYMMDD OK?: OK: comparison OK, ERR: error ERR: if ERR, the reason for error: F: not all files exist R: number of records don't match T: timestamps don't match V: versions don't match Rx: number of records in file x Vx: version of file x Gx: generation time Ix: ingestion time

8 20 th CAA Cross-Calibration Workshop MPS, Göttingen, Germany 15-17 Oct 2014 8 Example: PEACE PITCH_SPIN

9 20 th CAA Cross-Calibration Workshop MPS, Göttingen, Germany 15-17 Oct 2014 9 Example: PEACE PITCH_SPIN

10 20 th CAA Cross-Calibration Workshop MPS, Göttingen, Germany 15-17 Oct 2014 10 Example: PEACE PITCH_SPIN on 16 Apr 2001 Date OK? ERR R1 R2 R3 V1 V2 V3 010416ERR R 137211372113887040404 Note: if value>0 it is plotted as +1


Download ppt "20 th CAA Cross-Calibration Workshop MPS, Göttingen, Germany Oct CAA Dataset Inventory."

Similar presentations


Ads by Google