DAA Status/Progress B. Mihaljčić, A. Fazakerley, G. Watson, C. Anekallu UCL Department of Space and Climate Physics Mullard Space Science Laboratory 21 st Cross-Calibration Workshop, Nederland, Leiden, March 2015

DAA Current Status PITCH_SPIN 3DXLAR, 3DXMAR, 3DXHAR MOMENTS DAA Future Work Status of Action Items Summary Mullard Space Science Laboratory 2

(232) Mullard Space Science Laboratory PITCH_SPIN data ‘O’ version PITCH_SPIN data ‘G’ version PITCH_SPIN Merged data (spin-by-spin) Spin Origin CAA Format Data IDFS 3DF DS data ‘O’ version IDFS 3DF DS_rp data ‘G’ version IDFS RPAD DS data IDFS RPAD DS_rp data This final PITCH_SPIN file is delivered to the CAA, which is made by a merger (spin-by-spin) of PITCH_SPIN data from ‘O’ and ‘G’ versions. DAA Current Status – PITCH_SPIN Merging of O and G versions 3DX => RPAD => PITCH_SPIN

Mullard Space Science Laboratory DAA Current Status – PITCH_SPIN Headers The PEACE team has already delivered data for all units/years and spacecraft to the CAA. We noted a units label error for DEF data The PITCH_SPIN DEF header will be updated and re-delivered.

DAA Current Status – PITCH_SPIN LAR sweep mode data The PEACE team has already delivered data for all units/years and spacecraft to the CAA. However, we found that current production s/w cannot make PITCH_SPIN data when PEACE is commanded in LAR mode Affected dates only ~1 week on TC1 between T16:22 to T10:14 The production software will be updated and relevant dates re-delivered. Mullard Space Science Laboratory

DAA Current Status – PITCH_SPIN LAR sweep mode data The PEACE team has already delivered data for all units/years and spacecraft to the CAA. However, we found that current production s/w cannot make PITCH_SPIN data when PEACE is commanded in LAR mode Affected dates only ~1 week on TC1 between T16:22 to T10:14 The production software will be updated and relevant dates re-delivered. From the example on the right we show TC-1 data: 1 st panel is DS RPADH data, 2 nd panel is DS PITCH_SPIN data, 3 rd panel is DS_rp PITCH_SPIN data 4 th panel is merged DS/DS_rp PITCH_SPIN data. 5 th panel is spin origin of PITCH_SPIN data Commanding operations for this date are as follows: Power OFF/ON at Apogee01:24 – 01:29 Power ON (88m28-64m04)01:29 – 09:30 Change mode (88m28-68m08)09:30 – 11:05 Power OFF/ON at L=9(i)11:05 – 11:09 Power ON (88m28-60m00)01:09 – 14:00 Power OFF for Perigee pass14:00 – 16:22 Power ON (88l28-60l00)16:22 – 18:00 Power OFF/ON at L=7(o)18:00 – 18:05 Power ON (88l28-60l00)18:05 – 20:25 Power OFF/ON at M+20:25 – 20:25 Power ON (88l28-60l00)20:25 – 23:59 Key: m=>MAR mode, l=>LAR mode Mullard Space Science Laboratory 6 MARLAR

DAA Current Status - 3DX data Recent software updates 7 Mullard Space Science Laboratory Production is currently on hold, while s/w changes/testing was being implemented DAA production software was updated: Correction of azimuth angle labelling errors in IDFS PEACE data Correction of delta_azimuth angles Rotation of angles to SR2 coordinates Metadata information changes & header updates DAA production software status: We can produce the 3DXLAR & 3DX products in same format as for Cluster We propose instead to provide 3DXMAR, 3DXHAR, 3DXLAR (and also for Cluster) and have implemented the software to do produce the appropriate header and data files

DAA Current Status - 3DX data Reminder of LAR, MAR, HAR sweep mode differences 8 Mode Number of Azimuth bins Number of Energy bins Number of Polar bins Number of fly- back energy bins (fills) LAR MAR HAR a 32a 16a 60 energies 30e 15e MAR spin of Data LAR spin of Data HAR spin of Data 1f 2f 4f a=Azimuth bins e= Energy bins Mullard Space Science Laboratory

DAA Current Status - 3DX data Use of LAR, MAR, HAR 9 Mullard Space Science Laboratory 3DX MAR or HAR mode data For Double Star: MAR is the default sweep mode HAR mode is usually used just for MCP tests. HAR MAR MCP test 3DX LAR mode data only LAR For Double Star: LAR was used for ~ 1 week only on TC-1 LAR mode was not used on TC-2.

DAA Current Status – 3DX data organisation of data in file Mullard Space Science Laboratory 10 3DX MAR or HAR spin: ½ of data are FILL values 1 spin of MAR mode data 1 spin of HAR mode data 32 energies 64 azimuths 32a 32e 15e 16e 32a 3DX 30e 2f 1f 16a 1 spin of LAR mode data 3DXLAR LAR spin: No FILL values 60 energies 4f

PurposeItems SPIN RECORD Spin Data Record Timingtime_tags, time_tags_DeltaLower, time_tags_DeltaUpper PEACE Sensor Azimuth at Spin Record Time TagAngle_SR2phi PEACE spin start delay after spacecraft sun pulseMode_SRPOffset Which sensor provided the data (fixed for DS)Mode_Sensor Dimensions of the data & how the file is filledMode_RealSize, Mode_RealBinNum SENSORSource IDFS data product for the dataset & sensorMode_DataOrigin, Sensor behaviour.Mode_SweepMode, Mode_Preset, Mode_EnergyLevelRange, Mode_EnergyMaxMin, Mode_MCPlevel Energy bins (centres, upper/lower limits)Sweep_Energy, Sweep_Energy_DeltaLower, Sweep_Energy_DeltaUpper Polar bins (centres, upper/lower limits)Sweep_Polar, Sweep_Polar_DeltaLower, Sweep_Polar_DeltaUpper Azimuth bins (centres, upper/lower limits)Sweep_Azimuth, Sweep_Azimuth_DeltaLower, Sweep_Azimuth_DeltaUpper DATAElectron count rate or PSD or DPF or DEF in each bin (and minimum estimated background ) Data, BackgroundLevel QUALITY RECORD LEVEL Data Quality – overall assessmentStatus_Quality PEACE specific issues affecting qualityStatus_DatastreamErrors, Status_Eclipse Availability of support from other instrumentsStatus_ASPOC SENSOR QUALITY Sensor specific issues affecting qualityStatus_CountStats, Status_CalibrationVersion, Status_PEACErawData DAA/PEACE Variables in a 3DX, 3DXLAR File 3D files contain single sensor data. 3DX,. Parameters in purple are in preparation

PurposeItems SPIN RECORD Spin Data Record Timingtime_tags, time_tags_DeltaLower, time_tags_DeltaUpper PEACE Sensor Azimuth at Spin Record Time TagAngle_SR2phi PEACE spin start delay after spacecraft sun pulseMode_SRPOffset Which sensor provided the data (fixed for DS)Mode_Sensor SENSORSource IDFS data product for the dataset & sensorMode_DataOrigin, Sensor behaviour.Mode_SweepMode, Mode_Preset, Mode_EnergyLevelRange, Mode_EnergyMaxMin, Mode_MCPlevel Energy bins (centres, upper/lower limits)Sweep_Energy, Sweep_Energy_DeltaLower, Sweep_Energy_DeltaUpper Polar bins (centres, upper/lower limits)Sweep_Polar, Sweep_Polar_DeltaLower, Sweep_Polar_DeltaUpper Azimuth bins (centres, upper/lower limits)Sweep_Azimuth, Sweep_Azimuth_DeltaLower, Sweep_Azimuth_DeltaUpper DATAElectron count rate or PSD or DPF or DEF in each bin (and minimum estimated background ) Data, BackgroundLevel QUALITY RECORD LEVEL Data Quality – overall assessmentStatus_Quality PEACE specific issues affecting qualityStatus_DatastreamErrors, Status_Eclipse Availability of support from other instrumentsStatus_ASPOC SENSOR QUALITY Sensor specific issues affecting qualityStatus_CountStats, Status_CalibrationVersion, Status_PEACErawData Variables in a new 3DX_L/H/MAR File DAA/PEACE 3D files contain single sensor data. 3DX,. Parameters in purple are in preparation

DAA Current Status – 3DX data organisation of data in file Mullard Space Science Laboratory 13 16a 1 spin of LAR mode data 3DXLAR 60 energies 4f 32a 3DXMAR (New design) 30e 2f 3DXHAR (New design) 64 azimuths 15e 1f

Updated merging software example Mullard Space Science Laboratory 14 TC-1 3DXMAR version ‘O’ from DS data version ‘M’ from DS or DS_rp data version ‘G’ from DS_rp data Spin origin Data Stream Errors DAA Current Status – 3DXMAR Merging s/w modifications

Updated merging software example Mullard Space Science Laboratory DAA Current Status – 3DXHAR Merging s/w modifications 15 TC-1 3DXHAR version ‘O’ from DS data version ‘M’ from DS or DS_rp data version ‘G’ from DS_rp data Spin origin Data Stream Errors

Mullard Space Science Laboratory 16 DAA Current Status – 3DX Status Flags Progress Summary FLAG DESCRIPTION COMPLETENESS Status_Quality Code design required The plan is to automatically set the flag using the content of other status flags as inputs (and possibly other inputs too, e.g. Caveats) Status_CountStats In progress Status_ASPOCImplemented & Tested Status_EclipseImplemented & Tested Status_DatastreamErrorsImplemented & Tested Status_CalibrationVersionImplemented & Tested Status_PEACErawDataImplemented & Tested Status_DSRawDataVersionImplemented & Tested

PurposeItems SPIN RECORD Spin Data Record Timingtime_tags, time_tags_DeltaLower, time_tags_DeltaUpper PEACE Sensor Azimuth at Spin Record Time TagAngle_SR2phi PEACE spin start delay after spacecraft sun pulseMode_SRPOffset Which sensor provided the data (fixed for DS)Mode_Sensor SENSORSource IDFS data product for the dataset & sensorMode_DataOrigin, Sensor behaviour.Mode_SweepMode, Mode_Preset, Mode_EnergyLevelRange, Mode_EnergyMaxMin, Mode_MCPlevel Energy bins (centres, upper/lower limits)Sweep_Energy, Sweep_Energy_DeltaLower, Sweep_Energy_DeltaUpper Polar bins (centres, upper/lower limits)Sweep_Polar, Sweep_Polar_DeltaLower, Sweep_Polar_DeltaUpper Azimuth bins (centres, upper/lower limits)Sweep_Azimuth, Sweep_Azimuth_DeltaLower, Sweep_Azimuth_DeltaUpper DATAElectron count rate or PSD or DPF or DEF in each bin (and minimum estimated background ) Data, BackgroundLevel QUALITY RECORD LEVEL Data Quality – overall assessmentStatus_Quality PEACE specific issues affecting qualityStatus_DatastreamErrors, Status_Eclipse Availability of support from other instrumentsStatus_ASPOC SENSOR QUALITY Sensor specific issues affecting qualityStatus_CountStats, Status_CalibrationVersion, Status_PEACErawData Variables in a new 3DX_L/H/MAR File DAA/PEACE 3D files contain single sensor data. 3DX,. Parameters in purple are in preparation

Flag=1 (Data Stream Errors), Flag = 0 (No Data Stream errors) Mullard Space Science Laboratory 18 DAA Current Status – 3DXMAR Example of Status_DataStreamErrors version ‘O’ from DS data version ‘M’ from DS or DS_rp data version ‘G’ from DS_rp data Spin origin Data Stream Errors TC-2: Zoom: 05:55-05:56 TC-2: Zoom: 05:59-05:59:30 Implemented

Mullard Space Science Laboratory 19 DAA Current Status – 3DXMAR Example of Status_CountsStats TC1 ( ) 3DF 02:30-03:00 Flag=6; low counts<30), Flag=3; photo-e, Flag=-1; No data In progress – just to flag very low counts (adapted Cluster partial coverage code)

3DXMAR, 3DXHAR, 3DLAR Production and Merging s/w is ready to generate these files Reference Frame will be SR2 Headers are ready and have been tested Status flag work in progress The files are smaller by ~20%; only data is written without FILLs (except fly-backs) Changes in CAA/CSA ingestion protocols (or s/w) for these new products is needed Mullard Space Science Laboratory 20 DAA Current Status – 3DX Summary

DAA Current Status – MOMENTS Summary Production of CAA MOMENTS files is on hold Production software is ready and has been testedREADY Status ASPOC flag variable has been added and testedREADY Spacecraft potential estimation software has been tested READY Caveat production software has been designed & testedREADY Quality flagging software of the s/c potential was designedTESTING (see preliminary example on next slide) Validation software needs to be designed and testedNOT YET Other status flags production s/w needs to be designed NOT YET Status flag insertion software has to be designedNOT YET Mullard Space Science Laboratory 21

In order to judge if we can provide useful moments estimates or not: We want to know if spacecraft potential could be estimated or not We also want to judge whether we can get reasonable moments estimates, even with no spacecraft potential information (e.g. if the plasma population is at > keV energies) Current Software Capability: Determines if the s/c potential can be generated from PEACE data or not Currently we have demonstrated a flag for plasmasheet cases Future development: To include cases when plasma is at low energies (wind/sheath) as the lack of s/c potential knowledge can cause significant errors in the moments. Mullard Space Science Laboratory 22 DAA Current Status – MOMENTS quality flagging of s/c potential In progress (adapted Cluster partial coverage code)

Mullard Space Science Laboratory 23 Plasma-sheet electrons Photo electrons s/c potential estimate TC1 ( ) 3DF 00:00-01:00 Flag=7 (plasmasheet), Flag = 3 (photoelectrons), Flag = -1 (No Data) DAA Current Status – MOMENTS quality flagging of s/c potential

Mullard Space Science Laboratory 24 Plasma electrons Photo Electrons? TC1 ( ) 3DF 13:00-14:00 Flag=0 (good coverage, but no s/c pot. estimate), Flag = -1 (No Data) incorrect s/c potential estimate DAA Current Status – MOMENTS quality flagging of s/c potential Need to have a new flag setting for this case

DAA Future Work 1: PITCH_SPIN Deliver Double Star data (incomplete status variables) –FINISHED Header corrections–IN PROGRESS Fix production s/w bug, redeliver LAR mode interval data –IN PROGRESS Redeliver with PITCH_SPIN status variables incorporated–NOT YET 3DXLAR, 3DXMAR, 3DXHAR peaceDAAmerge.pl s/w update/tests for 3DXLAR/MAR/HAR–FINISHED Remove redundant variables from headers and metadata –FINISHED Completion of 3DX status variable codes–IN PROGRESS Delivery–NEXT MOMENTS Develop software to enable the quality flagging of the s/c potential –TESTING Provide improved spacecraft potential estimates where possible –NOT YET Completion of MOMENTS status variable codes–NOT YET Develop validation software for MOMENTS–NOT YET Produce, validate, deliver MOMENTS dataset–NOT YET Mullard Space Science Laboratory 25

DAA Future Work 2: Other products (3DR, PADLAR/MAR/HAR) Return to secondary code products –ON HOLD (if resources allow) Caveats Software Design/test DAA caveat software –FINISHED Updates for SR2 caveat comments –FINISHED Status Flags Software Provide all Double Star Status Flags–IN PROGRESS Provide Double Star documentation–NOT YET Calibrations Revisit calibrations for TC-1 and TC-2–FINISHED / ON HOLD IDFS DFUNIT Corrections/testing new IDFS DFUNIT s/w on Full Resolution DAA FGM data –ON HOLD Mullard Space Science Laboratory 26

Based on CAA list of Action Items that are open or not formally closed Action Item Status Summary TypeOpenIn ProgressTo CloseTotal Operations Reviews010 1 Cross-Calibration Meetings0000 Progress Meetings0000 Total1101

MSSL Status of OR recommendations OR9-R16 to CAA and PEACE: The board commends the recent progress in the calibration and delivery of Double Star data. The board recommends that the first version of the entire dataset from all European instruments is delivered and ingested before the end of October The ingestion of prime parameter data should be considered. IN PROGRESS (i)The PEACE team has delivered PITCH_SPIN for TC-1 and TC-2 for the entire missing in all units (ii)Whilst modifying the production codes for 3DX recently we noticed that the current software can not generate PITCH_SPIN when PEACE was commanded in LAR mode (even though there is 3DF and RPAD data available), so that needs to be fixed and relevant dates regenerated and re-delivered to the CAA.

MSSL Thank you for listening!