1. 16th CAA Cross-calibration Workshop
CIS archiving activities report
IRAP, Toulouse, 6-9 november 2012

2. Outline Data delivery status Data delivery plan Software 2012 data
Caveats and Quality flags
Software
CEFLIB
cl software
2012/11/06-09
CIS archiving report

3. Data delivery status
2012/11/06-09
CIS archiving report

4. Data delivery plan
Most of the CIS datasets have been produced and delivered up to end of 2011 :
CODIF RPA data should be produced and delivered soon
Graphicals products could be delivered soon
Caveats have to be completed before delivery (see further slides)
Data processing delivery should continue for 2012 :
depending on calibration updates
depending on FGM data availability (moments, PAD's)
Massive reprocessing always needed, but not a priority
2012/11/06-09
CIS archiving report

5. Data delivery plan Caveats
We have identified and manually checked time intervals for several kind of events :
eclipses (instrument dependant time periods)
weekly resets (normal operations)
unexpected resets
lost telemetry packets (compression problems)
We have still to merge them in our caveats database, before delivering caveats data
Delivery expected for the end of 2012
2012/11/06-09
CIS archiving report

6. Data delivery plan Quality flags
We can use the caveats database to compute quality flags corresponding to previously identified events
Add progressively new algorithms to refine quality flags for other kind of events:
low counting statistic
CIS mode mismatch (need boundary locations) …
We expect to product first quality files for beginning of 2013, than can be refined later
2012/11/06-09
CIS archiving report

7. Software
CEFLIB v-1.7 has been delivered to CAA for test purpose, on June 2012
Handling CEF files generated on Windows (CR-LF end of line separator)
request of last operationnal review : CAA-OR7-INST-R4
Handling BYTE data type (0-255 values)
bug detected by A. Masson, while reading some CSDS PP converted from CDF to CEF using Qtran
Adding interface with Python language
need separate installation of numpy (multi-dimensionnal arrays) and matplotlib (MATLAB like plotting facilities)
2012/11/06-09
CIS archiving report

8. Software (continued)
Problem on MacOSX to build library on case insensitive filesystem
renaming ZLIB.h => ZZLIB.h to avoid conflict with /usr/lib/zlib.h
Problem to build library for Matlab interface on latest MacOSX (Mountain Lion)
Detected by A. Masson when testing the latest release
Need an access to such computer to investigate and solve the problem (maybe this week)
It's difficult to have access and to ensure that the library could work on all possible platforms :
Solaris, Linux, MacOSX, in various releases
32 and 64 bits architectures
IDL and Matlab (licences needed)
2012/11/06-09
CIS archiving report

9. Software (continued)
We would want to create a WWW server dedicated to CEFLIB in order to provide :
Installation manual
Download library
Reference guides (C, Matlab, IDL, Python API)
Example files for each API
User feedback and problems encountered
Is there any more need ?
CEFLIB for Windows systems
CEFLIB for Java (difficult)
Users feedback are welcome
2012/11/06-09
CIS archiving report

10. Software
Emmanuel PENOU is actually adding new interesting features to cl software :
online access to whole CAA datasets (streaming interface) and CDAWeb datasets (web services)
local data cache for already downloaded data
browse interactively CAA and CDAWeb data tree to select a given dataset, then a given variable,
automatically select the most suitable panel (time-series, spectrogram..) to plot this variable
allows time-selection change, next/previous period, and automatically download corresponding data
Will CAA streaming interface available from CFA ?
2012/11/06-09
CIS archiving report