1. Natasha Doss, Andrew Fazakerley, Branislav Mihaljčić and Gill Watson
MSSL
CAA PEACE Status
Natasha Doss, Andrew Fazakerley, Branislav Mihaljčić and Gill Watson
PEACE-CAA Progress Meeting, MSSL, UK, February 2014

2. Since the last Progress Meeting - Summary
MSSL
Since the last Progress Meeting - Summary
Deliveries
Delivered MOMENTS, PITCH_SPIN, PITCH_3DR, PITCH_FULL,
PITCH_FULL_LAR, LER, PADHAR, PADMAR, PADLAR for Apr – Dec 2011
Delivered all PEACE datasets for Jan – Jul 2012
Delivered all PEACE datasets for Aug – Dec 2012
Software
Updates to production software
Changes to headers
Status_PartialCoverage flag finalised and produced for
Calibrations
Calibrations version 6.0 extended to cover Feb – Dec 2012
Other
Computing issues
DPU data production problems on SC3
Personnel
Cluster calibration paper written. In final stages of acceptance.

3. Deliveries progress since the last meeting
MSSL
Deliveries progress since the last meeting
Since the last Progress meeting the following CL-1,2,3,4 PEACE data products were delivered:
MOMENTS, PITCH_SPIN, PITCH_3DR, PITCH_FULL, PITCH_FULL_LAR, LER, PADHAR, PADMAR, PADLAR for Apr – Dec 2011 (This completed all deliveries for 2011)
All PEACE CAA datasets for January – Dec 2012
* There is a problem with delivered MOMENTS files for Aug – Dec A new version of peacemoments was used to produce these files which uses FGM CAA data instead of PP. However another change also appeared relating to the Status_CalibrationVersion[H/L]EEA. This problem has been fixed and we will soon reproduce and deliver MOMENTS for Aug – Dec 2012
PEACE PP and SP data for January – mid Jul 2012 delivered to UKDC

4. PEACE CAA Delivery Status
MSSL
PEACE CAA Delivery Status
Derived Products
NOTE 1. MOMENTS calculated without optimisation for region and broken anodes:
C3 HEEA – anode 5 from 22 August 2005
C2 LEEA – anode 1 from 15 May 2011
NOTE 2. zeros in PITCH_SPIN background noise and HAR/LAR problem need to be checked/fixed

5. PEACE CAA Delivery Status
MSSL
PEACE CAA Delivery Status
Derived
Products
Advanced
Science
Products
(sparse
availability)
NOTE 1. delivered (PITCH_)3DXPA(LAR) have 64 azimuths, 4/8 azimuth version of the software has been produced and awaiting validation before reproduction for
NOTE 2. delivered PITCH_3DR has 12 pitch angles, we are planning to redeliver PITCH_3DR with 6 pitch angles to avoid gaps in pa coverage.
NOTE 3. PITCH_FULL PADAL problem needs fixing (only dayside are affected).
NOTE 4. PITCH_3DXP(LAR) is currently in PITCH_3DX(LAR) – may be made into a separate dataset.

6. PEACE CAA Delivery Status
MSSL
PEACE CAA Delivery Status
Ancillary Products
NOTE 1. NOI and OMS do not require calibrations.

7. PEACE CAA Delivery Status
MSSL
PEACE CAA Delivery Status
Status datasets
NOTE 1. these Status datasets are in delivered files already, generated on the fly when new data files are produced and are available for the whole duration of main data products.
NOTE 2. Status_Quality will be regenerated when other status parameters are done.
NOTE 3. We found that Status_ASPOC is not in delivered files – working to fix this.

8. PEACE CAA Delivery Status
MSSL
PEACE CAA Delivery Status
Status datasets
NOTE 1. the following Status datasets are NOT in delivered files:
Status_PADSelectionQuality, Status_PitchAngleCoverage, Status_PenetratingRadiation, Status_CountStats, Status_PartialCoverage
NOTE 2. There are gaps in Status_PADSelectionQuality & Status_PitchAngleCoverage between when PAD_PATCH was run as code cannot deal with PADAL data yet
NOTE 3. Status_PenetratingRadiation & Status_FGM – generated files with the earlier version of the software.

9. Software development progress since the last meeting
MSSL
Software development progress since the last meeting
Software development
Work on 4/8 azimuth version of 3DXPA(LAR) CAA file production code has finished.
Work on 4/8 azimuth version of PITCH_3DXPA(LAR) CAA file production code has finished.
Both of these changes have been incorporated into the main production software.
6 pitch angle version of PITCH_3DR has also been incorporated into the main production software.
All the changes described above are subject to checks from Andrew Fazakerley
Changes to headers:
Changes have being made to Cluster and Double Star headers to remove Iryna Rozum as technical contact and replaced with Natasha Doss for Cluster and Branislav Mihaljcic for Double Star
These will be delivered soon.

10. Software development progress since the last meeting
MSSL
Software development progress since the last meeting
Status_PartialCoverage
Rules have been finalised & software completed.
Flag produced for but requires validation
Flag definition:
0. Full Coverage, Well Measured
Full Coverage, Caution, Check Low Energy Population
Full Coverage, Caution, Poorly Resolved Low Energy Population
Partial Coverage, Warning, Low Energy Cutoff
Partial Coverage, Warning, High Energy Cutoff
Partial Coverage, Warning, High and Low Energy Cutoff
Caution, Very Low Counts – see also Status_CountStats

11. Calibration progress since the last meeting
MSSL
Calibration progress since the last meeting
Calibrations version 6.0 extended to cover Feb – Dec 2012
Nov-Dec 2012 more difficult to calibrate and took longer than usual due to many thruster firings in November for Foullon GI special ops.
Also lack of good sheath intervals for calibration during Nov-Dec 2012

12. Other issues since the last meeting
Status of PEACE operations computing system
Multiple disk failures on one of our NAS storage systems (NAS 2)
As a result CAA data production and delivery of 2012 data was on hold for several months.
Some recently produced data was lost and had to be regenerated.
We have also lost data from previous years already delivered to the CAA.
A new dedicated PEACE operations storage system with improved disk management has been purchased and installed (NAS 5).
Any data that was saved was copied from NAS 2 to NAS 5.
NAS 2 has been converted to RAID 6 configuration and is operational again but not trusted for critical datasets.
Overall this problem affected us for ~6 months. Alot of the setup/copying was performed by the computing group at MSSL however some manual copying and complete reorganisation of the data was performed by the ops team which took ~1 month.
NAS 1, which holds our IDFS archive, is considered to be at risk as it is the same age as NAS 2 so we plan to replace this system with a new NAS.
Other issues since the last meeting

13. Other issues since the last meeting
MSSL
Other issues since the last meeting
DPU data production problems on SC3
These were reported at the last SWT.
For the CAA it means that some products will no longer be routinely produced.
LER, OMS and NOI are no longer produced onboard the spacecraft so there will be no corresponding CAA data from C3. This will also make it impossible to produce PP/SP data for CSDS in the usual way.
3DR and 3DX data is produced correctly onboard the spacecraft, and so will be delivered to CAA
MOMENTS data is still produced on ground from 3DR and provided to CAA
Onboard pitch angle selection no longer works properly. We need to think about whether to continue producing PITCH_SPIN and PITCH_FULL for CAA. We may deliver them but write a note in the user guide that to get a complete 0° to 180 ° p.a. range the user should refer to PITCH_3DR
There is an interval of a few weeks without any useful science data whatsoever, as reported at the SWT. This will be noted in the User Guide.

14. Other issues since the last meeting
MSSL
Other issues since the last meeting
Loss of two members of the team due to people taking other jobs (1.5 FTE)
Natasha Doss will be on maternity leave from end of April
PLS funds dropped from 3 people to 2 people at the end of 2013.
A plan is in place to recruit an additional person, using unspent and internal funds. Interviews have taken place and an offer of a position has been provisionally accepted by Chandra Anekallu.

15. MSSL PEACE documentation
GI Special Issue paper on Cluster cross-calibrations has been written and is in the final stages of acceptance for publication.
The CAA currently has (delivered in May 2013):
User Guide to the PEACE measurements in the CAA V2.4
Calibration Report of the PEACE measurements in the CAA V1.4
Interface Control Document for PEACE in the CAA V6.4

16. MSSL Open issues Issues affecting the quality of the PEACE dataset
PEACE-centric
CL-3 HEEA bad anode 2 (from 22 August 2005) & CL-2 LEEA bad anode 1 (from 15 May 2011) – Plans have been prepared for a pilot study on how to handle the broken anodes.
Penetrating radiation during some perigee passes (cleaning is possible)
Required input information from other teams
WHISPER densities – available till end of April 2013
EFW potential data – available till end of Sep 2013
AUX SUMMARY – available till end of Nov 2013
FGM cal files – available till end of Dec 2013

17. MSSL Future plans Calibration Short-term work
extend cross-calibration work beyond December 2012 when supporting datasets are available
extend v6.0 to 2000 – 2004
finish v6.1 inter-anode calibration for 2005 – 2008
extend v6.1 inter-anode calibration to 2009 – 2012
Short-term work
Fix bug affecting PITCH_FULL with PADAL, produce data & deliver
Check/fix zeros in PITCH_SPIN background counts
Fix LAR-HAR problem in PITCH_SPIN and PITCH_FULL
Produce 4/8 azimuth version of (PITCH_)3DXPA(LAR) and deliver
Produce 6 p.a. Version of PITCH_3DR and deliver.
Status parameter completion.
Deliveries:
1) Produce and deliver 2013 data products when possible.
Deal with problem of broken anodes (CL-3 HEEA and CL-2 LEEA) – redeliver C3 MOMENTS from 2005 onwards when we decide how to best deal with the problem.
When calibration v6.1 available regenerate and deliver all datasets (2000 – latest data) with the latest calibrations and status parameters.

18. CAA PEACE review meeting 14-15 Nov 2012
MSSL
CAA PEACE review meeting Nov 2012
PEA12-AI-02 to PEACE (due ): to check why a large number of datasets were not produced. Examples from C1: Aug 03, Jan 04, Feb 05, Nov 05, Dec 06, Jan 08, Dec 08.
IN PROGRESS
Lists have been produced for all SC, for all products (except MOMENTS), for all units, for entire days (not partial days) where we are missing a file in our repository. So far we have attempted to regenerate all missing days for all products & units for C1 but these require validation checks.
These data gaps were most likely caused by gaps in the PEACE IDFS data used to make PEACE CAA data. PEACE IDFS archive was fully regenerated in Autumn 2010, which fixed the majority of data gaps in the archive.
Note that this work is somewhat hampered by the fact we lost some data files when we had NAS2 problem.
This work will also answer, to some extent, the issues in the following AI’s.
PEA12-AI-03 to PEACE (due ): to check why MOMENTS files were not complete (e.g. compared to PITCH datasets). Examples from C1: Jun 04, Jul 04, Nov 05, Dec 05, Feb 05, Jul 06, Apr 07, May 07, Nov 07, Feb 08.
Missing data (entire days, not partial days) for C – May 2008 have been produced and delivered to the CAA some months ago
Detailed checks for gaps smaller than a day have been made for the months listed above for C1 only. No regeneration of files yet. [see CAA Action Items Investigation ppt for details].
Fill files for times when PEACE is off have been produced for all SC and are awaiting delivery.
MOMENTS production requires FGM, EFW and AUXILIARY data. If these are absent then MOMENTS cannot be produced while PITCH datasets will still be made. We aim to check this.

19. CAA PEACE review meeting 14-15 Nov 2012
MSSL
CAA PEACE review meeting Nov 2012
PEA12-AI-04 to PEACE (due ): to check why PP files were not available (e.g. compared to MOMENTS datasets). Examples from C1: Jun 04, Jul 04, Dec 04, Nov 05, Dec 05, Mar 06, Apr 06, Aug 06.
IN PROGRESS
Detailed checks for all gaps have been made for the months listed above for C1 only. These files have been regenerated and delivered to UKDC. [see CAA Action Items Investigation ppt for details].
PEA12-AI-05 to PEACE (due ): to check why PITCH_SPIN/FULL do not have the same coverage as PAD datasets. Examples from C1: Jan 07, Apr 07, May 07, Jan 08, Feb 08, Mar 08, May 08, Apr 09
For entire missing days see response for PEA12-AI-02.
For gaps smaller than a day detailed checks have been made for the months listed above for C1 only. No regeneration of files yet. [see CAA Action Items Investigation ppt for details].
Note that the current version of the production software cannot handle PADAL IDFS datasets (present for day-side orbits in 2007 – 2009) for making PITCH_SPIN/FULL data. This problem does not exist for PAD datasets. Also PITCH_FULL software cannot handle HAR/LAR mode combination so gaps are expected at these times. We plan to fix these problems, affected data will be regenerated and redelivered.

20. CAA PEACE review meeting 14-15 Nov 2012
MSSL
CAA PEACE review meeting Nov 2012
PEA12-AI-06 to PEACE (due ): to check why PITCH_3DRL/H and 3DRL/H do not have the same coverage. Examples from C1: Feb 09, Mar 09
IN PROGRESS
For entire missing days see response for PEA12-AI-02.
For gaps smaller than a day detailed checks have been made for the months listed above for C1 only. No regeneration of files yet. [see s CAA Action Items Investigation ppt for details].
PEA12-AI-07 to PEACE (due ): to check why OMSH/L are occasionally missing. Examples from C1: Mar 09
Detailed checks for all gaps have been made for the months listed above for C1 only. These files have been regenerated and delivered to CAA. [see CAA Action Items Investigation ppt for details].
PEA12-AI-08 to PEACE (due ): to investigate if the MODE dataset can be created for PEACE and what information is the most useful/relevant while searching PEACE in a given mode in a given region of space
OPEN

21. CAA PEACE review meeting 25-26 Jan 2012
MSSL
CAA PEACE review meeting Jan 2012
PEA11-AI-10 to PEACE (due ): to check why all except MOMENTS have missing files, e.g. 16 Aug 2003, 27 Feb 2005, 9 Nov 2005, 22 Dec 2006, 1 Jan 2008
IN PROGRESS
See response for PEA12-AI-02.
PEA11-AI-13 to PEACE (due ): to check if the merging of the PITCH version of the 3DX and 3DXP datasets is what is wanted.
OPEN

22. Status of open action items from Cross-cal meetings
MSSL
Status of open action items from Cross-cal meetings
CC12-AI-11 to PEACE (due ): to process datasets for C3-HEEA. For the bad (broken) anode use interpolation.
IN PROGRESS
Plans have been prepared for a pilot study on how to handle the broken anodes. We aim to address this before the next CAA review.
CC15-AI-7 to PEACE, DWP, CIS (due 31 May 2012): to include the instrument operation timeline in the Double Star data production pipeline as the old versions of raw data may have had wrong UT time added in the ground (e.g. see the intervals where the instrument seem to have produced data while it is known to be off)
PROPOSE TO CLOSE
This has been checked.
CC17-AI-2 to All (due 15 May 2013): to investigate how to implement the time glitch information described in ESOC anomaly report in the instrument processing software
OPEN
It is suspected that the PEACE data processing software successfully deals with the glitch but detailed checks will be made.
CC17-AI-5 to PEACE (due 15 May 2013): to consider to use both HIA and WHISPER to identify suitable intervals for the determination of alpha factors in , i.e. only the data points where the two measurement are near to each other are used.

23. Status of open action items from Cross-cal meetings
MSSL
Status of open action items from Cross-cal meetings
CC18-AI-2 to All (due 30 Oct 2013): please update your replies in the action webpage even before you are ready to submit it. It helps to track the progress of the actions.
OPEN
CC18-AI-8 to CIS, PEACE, RAPID (due 30 Nov 2013): to investigate how to insure that PAD and MOMENTS are regenerated if new FGM science files are redelivered. This can be done using command-line tool using ingested since flag.
CC18-AI-13 to All (due 30 Nov 2013): to use a file listing flag in command line to get a listing of active files on the CAA.

24. MSSL 2013 OR8 recommendations
R1 to All: The board recommends that instrument teams ensure that all ancillary datasets are fully
described in their ICDs.
OPEN
R2 to All: All instrument teams should ensure that their user guides contain a detailed description and
time-line of instrument operations and failures.
R3 to All: The board recommends that all teams investigate data quality at mode changes and instrument
switch-on or switch-off.
R4 to PEACE: Add information regarding the pointing of the sun-sensor relative to PEACE on the pointing
diagram in the PEACE user guide (see Steve Schwartz figure in QPEACE documentation).

25. MSSL 2012 OR7 recommendations
R2 to All: The board recommends that all teams ensure that they have provided detailed information to the CAA regarding the pointing of instrument sensors relative to the spacecraft reference frame (e.g. sun-sensor or spacecraft Y-axis).
OPEN
R3 to All: The board recommends that instrument teams provide information regarding “special operations”, e.g. special modes, solar wind operations, guest investigator campaigns, etc., including their description and time of operation. The CAA is to coordinate this activity and to make the information available through their web pages.
R4 to PEACE: The board recommends that the PEACE team resolves their bad anode problem and spurious 0s in their pitch angle datasets.
IN PROGRESS
Plans have been prepared for a pilot study on how to handle the broken anodes.

26. MSSL 2011 OR6 recommendations
R1 to All: The review board noted that all teams have shown progress in the development of data products and their delivery. The board encourages all teams to continue to deliver as planned, and where possible to accelerate delivery of products that are required by other teams for their analysis. All teams should agree a delivery schedule consistent with the Cluster mission post-operations constraints.
ONGOING
R7 to PEACE: The board is encouraged by the progress made by the PEACE team in the delivery of data. However, the board notes that delivery is still behind the necessary schedule. A specific issue that should be addressed is the implementation of a work-around for the broken anode problem on C3: extrapolation over the broken anode is recommended to be used for the generation of moments, and fill values are used in other circumstances. The board encourages (1) the start of the provision of the PITCH_3DX family of data products, and (2) the completion of calibration activities for recent years, both very soon.
1) PITCH_3DX family data products delivered for
2) Alpha-factors made till end of Dec 2012, inter-anode calibrations are in progress

27. MSSL 2010 OR5 recommendations
R13 to CAA/ALL: Users with specific interests may wish to access only a portion of the information available in user guides. The board recommends that both CAA and instrument teams consider developing user guides with a fast browsing capabilities.
OPEN
There has been no work done yet.
R16 to all teams: the board recommends delivery of observations from the commissioning stage particularly from January 2001 and December 2000 (also November 2000).
CAA has provided potential times for commissioning times. Will there be WHISPER sheath densities from those few JSOC controlled orbits in 2000 when there were operations on all the payload together and sheath crossings? Will the interference campaign data be included?
R25 to PEACE: PEACE team to ensure that the best calibrations are applied to all data sets as soon as possible.
ONGOING
We have produced alpha-factors from the end of 2004 up to end of 2012 based on comparison of PEACE-WHISPER densities. These latest calibrations have been applied to the recently delivered data for We are working to extend inter-anode calibrations up to end of 2009, and then for later years, using alpha-factors from the PEACE-WHISPER comparison studies.

28. Thank you for listening!
MSSL
Thank you for listening!