16th CAA Cross-calibration Workshop CIS archiving activities report IRAP, Toulouse, 6-9 november 2012

Outline Data delivery status Data delivery plan Software 2012 data Caveats and Quality flags Software CEFLIB cl software 2012/11/06-09 CIS archiving report

Data delivery status 2012/11/06-09 CIS archiving report

Data delivery plan Most of the CIS datasets have been produced and delivered up to end of 2011 : CODIF RPA data should be produced and delivered soon Graphicals products could be delivered soon Caveats have to be completed before delivery (see further slides) Data processing delivery should continue for 2012 : depending on calibration updates depending on FGM data availability (moments, PAD's) Massive reprocessing always needed, but not a priority 2012/11/06-09 CIS archiving report

Data delivery plan Caveats We have identified and manually checked time intervals for several kind of events : eclipses (instrument dependant time periods) weekly resets (normal operations) unexpected resets lost telemetry packets (compression problems) We have still to merge them in our caveats database, before delivering caveats data Delivery expected for the end of 2012 2012/11/06-09 CIS archiving report

Data delivery plan Quality flags We can use the caveats database to compute quality flags corresponding to previously identified events Add progressively new algorithms to refine quality flags for other kind of events: low counting statistic CIS mode mismatch (need boundary locations) … We expect to product first quality files for beginning of 2013, than can be refined later 2012/11/06-09 CIS archiving report

Software CEFLIB v-1.7 has been delivered to CAA for test purpose, on June 2012 Handling CEF files generated on Windows (CR-LF end of line separator) request of last operationnal review : CAA-OR7-INST-R4 Handling BYTE data type (0-255 values) bug detected by A. Masson, while reading some CSDS PP converted from CDF to CEF using Qtran Adding interface with Python language need separate installation of numpy (multi-dimensionnal arrays) and matplotlib (MATLAB like plotting facilities) 2012/11/06-09 CIS archiving report

Software (continued) Problem on MacOSX to build library on case insensitive filesystem renaming ZLIB.h => ZZLIB.h to avoid conflict with /usr/lib/zlib.h Problem to build library for Matlab interface on latest MacOSX (Mountain Lion) Detected by A. Masson when testing the latest release Need an access to such computer to investigate and solve the problem (maybe this week) It's difficult to have access and to ensure that the library could work on all possible platforms : Solaris, Linux, MacOSX, in various releases 32 and 64 bits architectures IDL and Matlab (licences needed) 2012/11/06-09 CIS archiving report

Software (continued) We would want to create a WWW server dedicated to CEFLIB in order to provide : Installation manual Download library Reference guides (C, Matlab, IDL, Python API) Example files for each API User feedback and problems encountered http://cluster.irap.omp.eu/ceflib Is there any more need ? CEFLIB for Windows systems CEFLIB for Java (difficult) Users feedback are welcome 2012/11/06-09 CIS archiving report

Software Emmanuel PENOU is actually adding new interesting features to cl software : online access to whole CAA datasets (streaming interface) and CDAWeb datasets (web services) local data cache for already downloaded data browse interactively CAA and CDAWeb data tree to select a given dataset, then a given variable, automatically select the most suitable panel (time-series, spectrogram..) to plot this variable allows time-selection change, next/previous period, and automatically download corresponding data Will CAA streaming interface available from CFA ? 2012/11/06-09 CIS archiving report