14 th CAA Cross-calibration Workshop CIS archiving activities York October 5-7, 2011

Outline Data delivery status –Recently delivered datasets –New datasets –Missing deliveries Time-tagging issue Documentation & software Delivery schedule –Data for remaining years –Massive reprocessing of data –Quality flags datasets 14th CAA Cross-cal workshopYork, october 5-7, 20112

Dataset delivery status Products CODIF 3D C C C C F F F F G G G G CODIF 1D [1] A A A A A A A A A A A E E E E G G G G CODIF ancillary G G G G CODIF RPA C C C C CODIF PAD [1] C C C C E E E E F F F F G G G G CODIF ground moments [1] A A A A F F F F G G G G CODIF He+ improved density [2] A A A A HIA 3D C C C C E E E E E F F H H H H H HIA 1D A A A A E E E E E F F H H H H H HIA PAD C C C C E E E E E F F H H H H H HIA Onboard Moments E E E E E F F H H H H H Graphical products A A A A CIS modes G G G G CIS caveats A A A A [1]He++ data not delivered for these datasets [2]Data generated by UNH, and delivered for validation purpose on C4 14th CAA Cross-cal workshopYork, october 5-7, 20113

Recently delivered data New CODIF calibration files were delivered in July by UNH, covering the period up to the end of 2009 – All corresponding datasets (3D, 1D, PAD’s, moments) for have been generated and delivered to CAA – Data for the first years of the mission will have to be reprocessed. New HIA calibration files were also delivered by A. Blagau, covering data from October 2007 to October – All HIA datasets up to end of 2009 have been reprocessed and delivered to CAA – Data since October 2008 were produced using these preliminary calibrations and will be reprocessed later 14th CAA Cross-cal workshopYork, october 5-7, 20114

New dataset : Corrected He+ density Our Co-I’s from UNH (Lynn Kystler, Chris Mouikis, Jichun Zhang) have produced improved/corrected He+ density files, by removing estimated contamination of H+ spillover into the He+ mass channel. This dataset provides corrected density and density standard deviation Data files for C4 have been produced and delivered to CAA, covering 2001 up to 2007 Data for C1 and C3 will be delivered later. Not yet available on the CAA interface 14th CAA Cross-cal workshopYork, october 5-7, 20115

Corrected He+ density example plot 14th CAA Cross-cal workshopYork, october 5-7, 20116

Missing deliveries : Gap files CIS09-AI-3 : To provide gap files for LS side of CODIF, on C1 & C3 – CODIF LS mode is not really used on these spacecraft (only for tests) and not well calibrated. – It has been decided not to deliver LS data on C1 and C3, and to deliver empty files covering 2001 up to the end of CIS-PM10-AI7 : To provide empty files for datasets that are not provided anymore (e.g. Cluster1 CODIF datasets since ) – Empty files will be delivered soon covering period since instruments were switched-off up to end of 2014 – Same problem for CODIF and HIA on C3 after th CAA Cross-cal workshopYork, october 5-7, 20117

Missing deliveries CODIF RPA after 2005 RPA mode is only selected for short periods (some hours) and several days per year – We decided to provide data only for these days, and to deliver empty files covering whole periods where this mode is not selected. – We have to create software to identify such gaps and automatically create empty files – Data should be delivered soon. Graphical products after 2008 – They have to be reprocessed after the recent calibration updates – Should be delivered soon, for data up to December th CAA Cross-cal workshopYork, october 5-7, 20118

Time-tagging issue Time-tagging errors were found in telemetry raw data, generating not increasing timing in CAA datasets A list of corrupted CEF files has been produced by the CAA, that helped to identify all possible problems CIS Software has been updated to handle this bug, and we have reprocessed raw data from October 2007 up to end of 2009, before generating the CAA recently delivered datasets Raw data for remains to be reprocessed before massive reprocessing and delivery of CAA products 14th CAA Cross-cal workshopYork, october 5-7, 20119

Documentation No change since last Operational Review: CIS User guide: V.2.0 delivered (V.2.1 in preparation) CIS Calibration report:V.1.2 delivered CIS CAA ICD:V delivered 14th CAA Cross-cal workshopYork, october 5-7,

Software CESR CEFLIB problem with IDL 8.0: II found a bug recently, using the IDL interface of the CEFLIB library with IDL 8.0, on our Linux computer (CentOS 6.0, x86_64) IDL 8.0 is embedding some parts of the zlib library to handle compressed files, and this generates a conflict with CEFLIB library which is using the zlib library installed with Linux Same kind of problem occurred in the past with IDL 6.0 ~ 6.3, but it seems more difficult to solve with this release. However, it’s always possible to read uncompressed.cef files If you encounter same problem, on different OS or hardware, please let us know and contact : 14th CAA Cross-cal workshopYork, october 5-7,

Delivery schedule Data for remaining years Instrument status: – C1 : HIA still operational, but in Magnetospheric modes only since April 2011 – C3 : CODIF and HIA are no more operational since – C4 : CODIF still operational (HS and LS data) Update of the calibration files is the main driver for processing and delivering CIS data for the remaining years We can, if needed, deliver data with the latest available calibration files (only moderate efficiency evolution in 2010) 14th CAA Cross-cal workshopYork, october 5-7,

Delivery schedule Massive reprocessing of data Technical reasons (separate CEH header files) Time-tagging errors (needs reprocessing from raw telemetry data) Calibration updates Heavy job that will start next month, and should be closed by the end of the year 14th CAA Cross-cal workshopYork, october 5-7,

Quality flags Several kinds in separate files (3D products, PAD’s, moments) Some of them can be deduced from instrument caveats database Others will need knowledge or real magnetospheric location and boundary transitions, to identify inconsistent CIS modes We are expecting from FMI to provide such a database Still a lot of work before starting deliveries 14th CAA Cross-cal workshopYork, october 5-7,