Natasha Doss, Andrew Fazakerley, Branislav Mihaljčić and Gill Watson MSSL CAA PEACE Status Natasha Doss, Andrew Fazakerley, Branislav Mihaljčić and Gill Watson PEACE-CAA Progress Meeting, MSSL, UK, 13-14 February 2014

Since the last Progress Meeting - Summary MSSL Since the last Progress Meeting - Summary Deliveries Delivered MOMENTS, PITCH_SPIN, PITCH_3DR, PITCH_FULL, PITCH_FULL_LAR, LER, PADHAR, PADMAR, PADLAR for Apr – Dec 2011 Delivered all PEACE datasets for Jan – Jul 2012 Delivered all PEACE datasets for Aug – Dec 2012 Software Updates to production software Changes to headers Status_PartialCoverage flag finalised and produced for 2001-2008 Calibrations Calibrations version 6.0 extended to cover Feb – Dec 2012 Other Computing issues DPU data production problems on SC3 Personnel Cluster calibration paper written. In final stages of acceptance.

Deliveries progress since the last meeting MSSL Deliveries progress since the last meeting Since the last Progress meeting the following CL-1,2,3,4 PEACE data products were delivered: MOMENTS, PITCH_SPIN, PITCH_3DR, PITCH_FULL, PITCH_FULL_LAR, LER, PADHAR, PADMAR, PADLAR for Apr – Dec 2011 (This completed all deliveries for 2011) All PEACE CAA datasets for January – Dec 2012 * There is a problem with delivered MOMENTS files for Aug – Dec 2012. A new version of peacemoments was used to produce these files which uses FGM CAA data instead of PP. However another change also appeared relating to the Status_CalibrationVersion[H/L]EEA. This problem has been fixed and we will soon reproduce and deliver MOMENTS for Aug – Dec 2012 PEACE PP and SP data for January – mid Jul 2012 delivered to UKDC

PEACE CAA Delivery Status MSSL PEACE CAA Delivery Status Derived Products NOTE 1. MOMENTS calculated without optimisation for region and broken anodes: C3 HEEA – anode 5 from 22 August 2005 C2 LEEA – anode 1 from 15 May 2011 NOTE 2. zeros in PITCH_SPIN background noise and HAR/LAR problem need to be checked/fixed

PEACE CAA Delivery Status MSSL PEACE CAA Delivery Status Derived Products Advanced Science Products (sparse availability) NOTE 1. delivered (PITCH_)3DXPA(LAR) have 64 azimuths, 4/8 azimuth version of the software has been produced and awaiting validation before reproduction for 2001-2012 NOTE 2. delivered PITCH_3DR has 12 pitch angles, we are planning to redeliver PITCH_3DR with 6 pitch angles to avoid gaps in pa coverage. NOTE 3. PITCH_FULL PADAL problem needs fixing (only dayside 2008-2009 are affected). NOTE 4. PITCH_3DXP(LAR) is currently in PITCH_3DX(LAR) – may be made into a separate dataset.

PEACE CAA Delivery Status MSSL PEACE CAA Delivery Status Ancillary Products NOTE 1. NOI and OMS do not require calibrations.

PEACE CAA Delivery Status MSSL PEACE CAA Delivery Status Status datasets NOTE 1. these Status datasets are in delivered files already, generated on the fly when new data files are produced and are available for the whole duration of main data products. NOTE 2. Status_Quality will be regenerated when other status parameters are done. NOTE 3. We found that Status_ASPOC is not in delivered files – working to fix this.

PEACE CAA Delivery Status MSSL PEACE CAA Delivery Status Status datasets NOTE 1. the following Status datasets are NOT in delivered files: Status_PADSelectionQuality, Status_PitchAngleCoverage, Status_PenetratingRadiation, Status_CountStats, Status_PartialCoverage NOTE 2. There are gaps in Status_PADSelectionQuality & Status_PitchAngleCoverage between 2009-2011 when PAD_PATCH was run as code cannot deal with PADAL data yet NOTE 3. Status_PenetratingRadiation & Status_FGM – generated files with the earlier version of the software.

Software development progress since the last meeting MSSL Software development progress since the last meeting Software development Work on 4/8 azimuth version of 3DXPA(LAR) CAA file production code has finished. Work on 4/8 azimuth version of PITCH_3DXPA(LAR) CAA file production code has finished. Both of these changes have been incorporated into the main production software. 6 pitch angle version of PITCH_3DR has also been incorporated into the main production software. All the changes described above are subject to checks from Andrew Fazakerley Changes to headers: Changes have being made to Cluster and Double Star headers to remove Iryna Rozum as technical contact and replaced with Natasha Doss for Cluster and Branislav Mihaljcic for Double Star These will be delivered soon.

Software development progress since the last meeting MSSL Software development progress since the last meeting Status_PartialCoverage Rules have been finalised & software completed. Flag produced for 2001-2008 but requires validation Flag definition: 0. Full Coverage, Well Measured Full Coverage, Caution, Check Low Energy Population Full Coverage, Caution, Poorly Resolved Low Energy Population Partial Coverage, Warning, Low Energy Cutoff Partial Coverage, Warning, High Energy Cutoff Partial Coverage, Warning, High and Low Energy Cutoff Caution, Very Low Counts – see also Status_CountStats

Calibration progress since the last meeting MSSL Calibration progress since the last meeting Calibrations version 6.0 extended to cover Feb – Dec 2012 Nov-Dec 2012 more difficult to calibrate and took longer than usual due to many thruster firings in November for Foullon GI special ops. Also lack of good sheath intervals for calibration during Nov-Dec 2012

Other issues since the last meeting Status of PEACE operations computing system Multiple disk failures on one of our NAS storage systems (NAS 2) As a result CAA data production and delivery of 2012 data was on hold for several months. Some recently produced data was lost and had to be regenerated. We have also lost data from previous years already delivered to the CAA. A new dedicated PEACE operations storage system with improved disk management has been purchased and installed (NAS 5). Any data that was saved was copied from NAS 2 to NAS 5. NAS 2 has been converted to RAID 6 configuration and is operational again but not trusted for critical datasets. Overall this problem affected us for ~6 months. Alot of the setup/copying was performed by the computing group at MSSL however some manual copying and complete reorganisation of the data was performed by the ops team which took ~1 month. NAS 1, which holds our IDFS archive, is considered to be at risk as it is the same age as NAS 2 so we plan to replace this system with a new NAS. Other issues since the last meeting

Other issues since the last meeting MSSL Other issues since the last meeting DPU data production problems on SC3 These were reported at the last SWT. For the CAA it means that some products will no longer be routinely produced. LER, OMS and NOI are no longer produced onboard the spacecraft so there will be no corresponding CAA data from C3. This will also make it impossible to produce PP/SP data for CSDS in the usual way. 3DR and 3DX data is produced correctly onboard the spacecraft, and so will be delivered to CAA MOMENTS data is still produced on ground from 3DR and provided to CAA Onboard pitch angle selection no longer works properly. We need to think about whether to continue producing PITCH_SPIN and PITCH_FULL for CAA. We may deliver them but write a note in the user guide that to get a complete 0° to 180 ° p.a. range the user should refer to PITCH_3DR There is an interval of a few weeks without any useful science data whatsoever, as reported at the SWT. This will be noted in the User Guide.

Other issues since the last meeting MSSL Other issues since the last meeting Loss of two members of the team due to people taking other jobs (1.5 FTE) Natasha Doss will be on maternity leave from end of April PLS funds dropped from 3 people to 2 people at the end of 2013. A plan is in place to recruit an additional person, using unspent and internal funds. Interviews have taken place and an offer of a position has been provisionally accepted by Chandra Anekallu.

MSSL PEACE documentation GI Special Issue paper on Cluster cross-calibrations has been written and is in the final stages of acceptance for publication. The CAA currently has (delivered in May 2013):   User Guide to the PEACE measurements in the CAA V2.4 Calibration Report of the PEACE measurements in the CAA V1.4 Interface Control Document for PEACE in the CAA V6.4

MSSL Open issues Issues affecting the quality of the PEACE dataset PEACE-centric CL-3 HEEA bad anode 2 (from 22 August 2005) & CL-2 LEEA bad anode 1 (from 15 May 2011) – Plans have been prepared for a pilot study on how to handle the broken anodes. Penetrating radiation during some perigee passes (cleaning is possible) Required input information from other teams WHISPER densities – available till end of April 2013 EFW potential data – available till end of Sep 2013 AUX SUMMARY – available till end of Nov 2013 FGM cal files – available till end of Dec 2013

MSSL Future plans Calibration Short-term work extend cross-calibration work beyond December 2012 when supporting datasets are available extend v6.0 to 2000 – 2004 finish v6.1 inter-anode calibration for 2005 – 2008 extend v6.1 inter-anode calibration to 2009 – 2012 Short-term work Fix bug affecting PITCH_FULL with PADAL, produce data & deliver Check/fix zeros in PITCH_SPIN background counts Fix LAR-HAR problem in PITCH_SPIN and PITCH_FULL Produce 4/8 azimuth version of (PITCH_)3DXPA(LAR) and deliver Produce 6 p.a. Version of PITCH_3DR and deliver. Status parameter completion. Deliveries: 1) Produce and deliver 2013 data products when possible. Deal with problem of broken anodes (CL-3 HEEA and CL-2 LEEA) – redeliver C3 MOMENTS from 2005 onwards when we decide how to best deal with the problem. When calibration v6.1 available regenerate and deliver all datasets (2000 – latest data) with the latest calibrations and status parameters.

CAA PEACE review meeting 14-15 Nov 2012 MSSL CAA PEACE review meeting 14-15 Nov 2012 PEA12-AI-02 to PEACE (due 15-12-2012): to check why a large number of datasets were not produced. Examples from C1: Aug 03, Jan 04, Feb 05, Nov 05, Dec 06, Jan 08, Dec 08. IN PROGRESS Lists have been produced for all SC, for all products (except MOMENTS), for all units, for entire days (not partial days) where we are missing a file in our repository. So far we have attempted to regenerate all missing days for all products & units for C1 but these require validation checks. These data gaps were most likely caused by gaps in the PEACE IDFS data used to make PEACE CAA data. PEACE IDFS archive was fully regenerated in Autumn 2010, which fixed the majority of data gaps in the archive. Note that this work is somewhat hampered by the fact we lost some data files when we had NAS2 problem. This work will also answer, to some extent, the issues in the following AI’s. PEA12-AI-03 to PEACE (due 15-12-2012): to check why MOMENTS files were not complete (e.g. compared to PITCH datasets). Examples from C1: Jun 04, Jul 04, Nov 05, Dec 05, Feb 05, Jul 06, Apr 07, May 07, Nov 07, Feb 08. Missing data (entire days, not partial days) for C1 2001 – May 2008 have been produced and delivered to the CAA some months ago Detailed checks for gaps smaller than a day have been made for the months listed above for C1 only. No regeneration of files yet. [see CAA Action Items Investigation ppt for details]. Fill files for times when PEACE is off have been produced for all SC and are awaiting delivery. MOMENTS production requires FGM, EFW and AUXILIARY data. If these are absent then MOMENTS cannot be produced while PITCH datasets will still be made. We aim to check this.

CAA PEACE review meeting 14-15 Nov 2012 MSSL CAA PEACE review meeting 14-15 Nov 2012 PEA12-AI-04 to PEACE (due 15-12-2012): to check why PP files were not available (e.g. compared to MOMENTS datasets). Examples from C1: Jun 04, Jul 04, Dec 04, Nov 05, Dec 05, Mar 06, Apr 06, Aug 06. IN PROGRESS Detailed checks for all gaps have been made for the months listed above for C1 only. These files have been regenerated and delivered to UKDC. [see CAA Action Items Investigation ppt for details]. PEA12-AI-05 to PEACE (due 15-12-2012): to check why PITCH_SPIN/FULL do not have the same coverage as PAD datasets. Examples from C1: Jan 07, Apr 07, May 07, Jan 08, Feb 08, Mar 08, May 08, Apr 09 For entire missing days see response for PEA12-AI-02. For gaps smaller than a day detailed checks have been made for the months listed above for C1 only. No regeneration of files yet. [see CAA Action Items Investigation ppt for details]. Note that the current version of the production software cannot handle PADAL IDFS datasets (present for day-side orbits in 2007 – 2009) for making PITCH_SPIN/FULL data. This problem does not exist for PAD datasets. Also PITCH_FULL software cannot handle HAR/LAR mode combination so gaps are expected at these times. We plan to fix these problems, affected data will be regenerated and redelivered.

CAA PEACE review meeting 14-15 Nov 2012 MSSL CAA PEACE review meeting 14-15 Nov 2012 PEA12-AI-06 to PEACE (due 15-12-2012): to check why PITCH_3DRL/H and 3DRL/H do not have the same coverage. Examples from C1: Feb 09, Mar 09 IN PROGRESS For entire missing days see response for PEA12-AI-02. For gaps smaller than a day detailed checks have been made for the months listed above for C1 only. No regeneration of files yet. [see s CAA Action Items Investigation ppt for details]. PEA12-AI-07 to PEACE (due 15-12-2012): to check why OMSH/L are occasionally missing. Examples from C1: Mar 09 Detailed checks for all gaps have been made for the months listed above for C1 only. These files have been regenerated and delivered to CAA. [see CAA Action Items Investigation ppt for details]. PEA12-AI-08 to PEACE (due 15-12-2012): to investigate if the MODE dataset can be created for PEACE and what information is the most useful/relevant while searching PEACE in a given mode in a given region of space OPEN

CAA PEACE review meeting 25-26 Jan 2012 MSSL CAA PEACE review meeting 25-26 Jan 2012 PEA11-AI-10 to PEACE (due 15-02-2012): to check why all except MOMENTS have missing files, e.g. 16 Aug 2003, 27 Feb 2005, 9 Nov 2005, 22 Dec 2006, 1 Jan 2008 IN PROGRESS See response for PEA12-AI-02. PEA11-AI-13 to PEACE (due 15-02-2012): to check if the merging of the PITCH version of the 3DX and 3DXP datasets is what is wanted. OPEN

Status of open action items from Cross-cal meetings MSSL Status of open action items from Cross-cal meetings CC12-AI-11 to PEACE (due 30-10-2010): to process datasets for C3-HEEA. For the bad (broken) anode use interpolation. IN PROGRESS Plans have been prepared for a pilot study on how to handle the broken anodes. We aim to address this before the next CAA review. CC15-AI-7 to PEACE, DWP, CIS (due 31 May 2012): to include the instrument operation timeline in the Double Star data production pipeline as the old versions of raw data may have had wrong UT time added in the ground (e.g. see the intervals where the instrument seem to have produced data while it is known to be off) PROPOSE TO CLOSE This has been checked. CC17-AI-2 to All (due 15 May 2013): to investigate how to implement the time glitch information described in ESOC anomaly report in the instrument processing software OPEN It is suspected that the PEACE data processing software successfully deals with the glitch but detailed checks will be made. CC17-AI-5 to PEACE (due 15 May 2013): to consider to use both HIA and WHISPER to identify suitable intervals for the determination of alpha factors in 2001-2004, i.e. only the data points where the two measurement are near to each other are used.

Status of open action items from Cross-cal meetings MSSL Status of open action items from Cross-cal meetings CC18-AI-2 to All (due 30 Oct 2013): please update your replies in the action webpage even before you are ready to submit it. It helps to track the progress of the actions. OPEN CC18-AI-8 to CIS, PEACE, RAPID (due 30 Nov 2013): to investigate how to insure that PAD and MOMENTS are regenerated if new FGM science files are redelivered. This can be done using command-line tool using ingested since flag. CC18-AI-13 to All (due 30 Nov 2013): to use a file listing flag in command line to get a listing of active files on the CAA.

MSSL 2013 OR8 recommendations R1 to All: The board recommends that instrument teams ensure that all ancillary datasets are fully described in their ICDs. OPEN   R2 to All: All instrument teams should ensure that their user guides contain a detailed description and time-line of instrument operations and failures. R3 to All: The board recommends that all teams investigate data quality at mode changes and instrument switch-on or switch-off. R4 to PEACE: Add information regarding the pointing of the sun-sensor relative to PEACE on the pointing diagram in the PEACE user guide (see Steve Schwartz figure in QPEACE documentation).

MSSL 2012 OR7 recommendations R2 to All: The board recommends that all teams ensure that they have provided detailed information to the CAA regarding the pointing of instrument sensors relative to the spacecraft reference frame (e.g. sun-sensor or spacecraft Y-axis). OPEN   R3 to All: The board recommends that instrument teams provide information regarding “special operations”, e.g. special modes, solar wind operations, guest investigator campaigns, etc., including their description and time of operation. The CAA is to coordinate this activity and to make the information available through their web pages. R4 to PEACE: The board recommends that the PEACE team resolves their bad anode problem and spurious 0s in their pitch angle datasets. IN PROGRESS Plans have been prepared for a pilot study on how to handle the broken anodes.

MSSL 2011 OR6 recommendations R1 to All: The review board noted that all teams have shown progress in the development of data products and their delivery. The board encourages all teams to continue to deliver as planned, and where possible to accelerate delivery of products that are required by other teams for their analysis. All teams should agree a delivery schedule consistent with the Cluster mission post-operations constraints. ONGOING   R7 to PEACE: The board is encouraged by the progress made by the PEACE team in the delivery of data. However, the board notes that delivery is still behind the necessary schedule. A specific issue that should be addressed is the implementation of a work-around for the broken anode problem on C3: extrapolation over the broken anode is recommended to be used for the generation of moments, and fill values are used in other circumstances. The board encourages (1) the start of the provision of the PITCH_3DX family of data products, and (2) the completion of calibration activities for recent years, both very soon. 1) PITCH_3DX family data products delivered for 2001- 2012 2) Alpha-factors made till end of Dec 2012, inter-anode calibrations are in progress

MSSL 2010 OR5 recommendations R13 to CAA/ALL: Users with specific interests may wish to access only a portion of the information available in user guides. The board recommends that both CAA and instrument teams consider developing user guides with a fast browsing capabilities. OPEN There has been no work done yet. R16 to all teams: the board recommends delivery of observations from the commissioning stage particularly from January 2001 and December 2000 (also November 2000). CAA has provided potential times for commissioning times. Will there be WHISPER sheath densities from those few JSOC controlled orbits in 2000 when there were operations on all the payload together and sheath crossings? Will the interference campaign data be included? R25 to PEACE: PEACE team to ensure that the best calibrations are applied to all data sets as soon as possible. ONGOING We have produced alpha-factors from the end of 2004 up to end of 2012 based on comparison of PEACE-WHISPER densities. These latest calibrations have been applied to the recently delivered data for 2012. We are working to extend inter-anode calibrations up to end of 2009, and then for later years, using alpha-factors from the PEACE-WHISPER comparison studies.

Thank you for listening! MSSL Thank you for listening!