CAA inventory plots and graphical products overview Delphine Herment (ESTEC) ESAC - 17/03/2011.

Slides:



Advertisements
Similar presentations
Title: ICON L0 from MOC to SOC automation Author: MOC/SOC Resides: SOC Description: This is a script that copies the ICON L0 files from the MOC to the.
Advertisements

Multiple Tiers in Action
CFT Offline Monitoring Michael Friedman. Contents Procedure  About the executable  Notes on how to run Results  What output there is and how to access.
First Screen : First window form will always remain open, for the user to select menu options. 1.
UWG 2013 Meeting PO.DAAC Web Services Demo. What are PO.DAAC Web Services?
VSO Programmatic Interface Authors: Igor Suárez Solá Joe Hourclé Alisdair Davey VSO Team.
VIPER Quality Assessment Overview Presenter: Sathyadev Ramachandran, SPS Inc.
PaPCo, Das2, and Autoplot Jeremy Faden, University of Iowa.
EOVSA Pipeline Processing System J. McTiernan EOVSA Prototype Review 24-Sep-2012.
CAA/CFA Meeting | CFA Team | ESAC | Octiber CFA Under Development CAA/CFA Meeting ESAC, Oct 11 th 2011 European Space AgencyCFA Team.
EOVSA Data and Database System J. McTiernan EOVSA Technical DesignMeeting 7-Nov-2011.
1 CAA 2009 Peer Review, Jesus College, Cambridge, UK, March CAA Peer Review: Selected Recommendations.
20 th CAA Cross-Calibration Workshop MPS, Göttingen, Germany Oct ESOC datasets.
CAA Database Overview Sinéad McCaffrey. Metadata ObservatoryExperiment Instrument Mission Dataset File.
21 th CAA Cross-Calibration Workshop Leiden, Netherlands24-26 March ESOC datasets.
9 th CAA Cross-Calibration Workshop, Jesus College, Cambridge, UK, March /17 CAA Graphics: Pre-generated/On-demand Panels and Cross-Calibration.
CAA 8th Cross-Cal meeting Kinsale (Ireland), 28 Oct 2008 Edita Georgescu EDI Status of Calibration and Archiving Activities.
CAA Cross-Cal 18, Cosener’s, 23-25th Oct 2013 CAA Data Mining Tool Chris Perry.
1 CAA 2009 Cross Cal 9, Jesus College, Cambridge, UK, March 2009 Caveats, Versions, Quality and Documentation Specification Chris Perry.
The TIGGE Model Validation Portal: An Improvement in Data Interoperability 1 Thomas Cram Doug Schuster Hannah Wilcox Michael Burek Eric Nienhouse Steven.
Cluster Active Archive Science User Working Group (CAASUWG) - update Matt Taylor on behalf of CAASUWG.
8th Cross-calibration Workshop CIS data delivery report Kinsale – October 2008.
1 CAA 20 th Cross Calibration Meeting, MPS, Gottingen 16th Oct 2014 CAA Cross Cal Meeting Oct 2014 Pipeline Automation Chris Perry.
DAA Status/Progress B. Mihaljčić, A. Fazakerley, N. Doss, G. Watson UCL Department of Space and Climate Physics Mullard Space Science Laboratory 18 th.
8 th Cross-Calibration Workshop, Kinsale, Ireland, October 20081/14 Draft Replies and Actions to the Recommendations of the Review Panel for Final.
CHAPTER 7 LESSON B Creating Database Reports. Lesson B Objectives  Describe the components of a report  Modify report components  Modify the format.
Instrumentation, platforms, and data formats for ocean currents and temperature: a brief overview.
14 th CAA Cross-calibration Workshop CIS archiving activities York October 5-7, 2011.
20 th CAA Cross-Calibration Workshop MPS, Göttingen, Germany Oct CAA Dataset Inventory.
Training Guide for Residents
NETSTORM.
CAA Operational Review 9 Double Star PEACE Team Report
Working with MAVEN Data
Status Report of EDI on the CAA
Cluster data sets P-A Lindqvist, KTH
District And Club database
ASPOC Presentation for the CAA Operations Review-1 Klaus Torkar and Harald Jeszenszky IWF/OAW Graz ESTEC, May 2006.
16th CAA Cross-calibration Workshop
CIS Data Archival Status
Cluster Active Archive – Wideband data BM2 mode
Data Management Learning Goals:
SMT Historical Usage Reporting Functionality Backfill Requests Interim Solution Instructions Version 6 Dated March 17, 2014.
Cluster Active Archive Overview
CSA Implementation overview since OR-8 Test campaigns Scheduled development plan Arnaud Masson CSA/CAA Operational Review 9 ESTEC, 04-June-2014.
EDI – CAA STATUS REPORT EDI CAA Status
System Design Ashima Wadhwa.
H. Rème, I.Dandouras and A. Barthe IRAP, Toulouse, France
RCM Turbo SQL Version.
Bill Blair JWST Project Scientist for User Support STScI/JHU
Status Report of EDI on the CAA
Dissemination of Haze Data, Data Products and Information
Databases for THEMIS and GEOTAIL Magnetopause Crossings at GSFC
Two-Dimensional Plots
Introduction With TimeCard users can tag SharePoint events with information that converts them into time sheets. This way they can report.
iVend Retail Extensibility
Statistical Analysis with Excel
Statistical Analysis with Excel
SDMX Converter Raynald PALMIERI June 2015
A Web-Based Tool for Gathering Ordinal Rankings
Adding and Editing Users
Managing Rosters Screener Training Module Module 5
Long Time Spectrogram Measurement with ELQ 30A+
Long Time Spectrogram Measurement with ELQ 30
This presentation document has been prepared by Vault Intelligence Limited (“Vault") and is intended for off line demonstration, presentation and educational.
TIPS - Reporting.
Long Time Spectrogram Measurement with ELQ 35
Lesson 1.7 Represent Functions as Graphs
HTML Forms What are clients? What are servers?
SPM 7 – Tech Support Training
Presentation transcript:

CAA inventory plots and graphical products overview Delphine Herment (ESTEC) ESAC - 17/03/2011

Pre-generated inventory plots One plot per instrument Available in 3 resolutions (1 day, 1 month, 1 year) Only displays a sub-set of the experiment datasets (flagged with inventory=1 in the DB) One line on the plot can be valid for several datasets (for example for datasets delivered in multiple units) A perl script checks the “Inventory table” of the DB to get the list of data/gap interval for the required datasets/time It also requests the telemetry mode and event files (CEF datasets) from the DB – they are displayed on the first 2 panels It calls IDL to generate the inventory plot The intervals with data are marked by a vertical blue line, gap by an horizontal purple line and white means no files delivered for this interval The CEF products are shown first and then the non-CEF ones

Pre-generated inventory plots C1_CP_CIS-HIA_HS_MAG_IONS_CS C1_CP_CIS-HIA_HS_MAG_IONS_PEF C1_CP_CIS-HIA_HS_MAG_IONS_PF C1_CP_CIS-HIA_HS_MAG_IONS_PSD C1_CP_CIS-HIA_HS_MAG_IONS_RC

Inventory files The inventory files are generated after new files are ingested in the DB and the information they contain is then imported to the DB. They are monthly files generated per dataset. Each records contains 3 fields: – Time interval – Number of records in this interval (CEF) or number of files in this interval (non-CEF) – Higher file version (-1 = no file ingested) For non-CEF files we don’t have any information on the gaps it may contain, just if there is a file covering this interval. Example of an inventory file (CEF file): – C1_CP_WHI_NATURAL_ gap … T11:07: Z/ T18:49: Z, 88078, 3=> DATA T18:49: Z/ T19:03: Z, 0, 3=> GAP T19:03: Z/ T23:59: Z, 83896, 3=> DATA T23:59: Z/ T03:53: Z, 23036, 2=> DATA T03:53: Z/ T04:07: Z, 0, -1=> NO FILE DELIVERED …

Panels

Line plot Spectrogram On-demand only panel Panels

Pre-generated panels A sub-set of the available graphical products is available as pre-generated panels. They are generated in 3 resolutions (1 day, 6 hours, 1 hour) and 2 formats (PS, PNG). They are not downloadable from the GUI or command line as they don’t include any time information. When a list of pre-generated panels is requested the individual PNG panels and the time axis panel are located from the DB and displayed on the screen. If the user requests to download the file then the PS panels are merged together with the adequate time axis panel (pre-generated too) into one PS file.

Pre-generated panels PNG PS

On-demand panels GUI calls a perl script with a list of panels to plot + time interval. From this list the perl script determines the list of CEF datasets needed (note that one panel may require several input CEF datasets … eventually from different experiments). The perl script queries the DB to get the CEF files corresponding to these dataset(s) and time interval. It calls idl to process the CEF data and create the plot(s) as well as the time axis panel. It merges the individual PS panels and the axis panel into one PS file (if more than 7 panels are requested then the PS file has multiple pages) and converts the PS file to PNG(s). Then the PS file, PNG files and input CEF files are returned to the GUI -> PNG files for display and CEF and PS files for download.

One dataset Panel 2+ datasets PS panel PS plot PNG plot CAA GUI Panel CEF file Time interval CAA GUI IDL perl axis panel DB

On-demand panels PEACE + EFW input datasets Multiple sub-panels Processed component One component of a variable Multiple-lines plot Multiple STAFF input datasets 2 parameters displayed