10th CAA Operations Review Annual Report of the FGM Experiment Chris Carr, Leah-Nani Alconcel, Peter Fox, Patrick Brown, Tim Oddy Imperial College London, London, UK

Introduction In the last year: Despite reduced (wo)manpower, data delivery rate was maintained - March 2014 through April 2015 delivered (thanks to PF’s sterling efforts) - Routine calibration will resume in 2016 - Additional files delivered to fill data gaps and improve calibration (details to follow) HPA Low mode data reinstated (Dec 2009) Commissioning phase data calibrated and delivered for C1, C2 and C3 Individual orbits reprocessed and delivered to fix data gaps in the CAA

Status of Management Chris Carr is PI (12%) Funding support from STFC finished at the end of December 2010. ESA funds (routed via UKSA and STFC) through end of December 2016. - in place for operations/DP support - reduced to 1.0 FTE (Full-Time Equivalent) of staff + 12% PI time ESA funds (direct) for CSA support - 0.5 FTE Proposal for UKSA funding for 2017/2018 submitted and under review. The team is configured as follows: Chris Carr is PI (12%) Leah-Nani Alconcel is Archive Engineer (50%) Patrick Brown is Operations and Data-Processing Manager (20%) Tim Oddy is software, calibration and instrument analyst (40%) Peter Fox does calibration and archiving (40%) For 17/18 we have submitted a detailed proposal to UKSA which is being reviewed by panel at the moment, but we don't expect to hear anything until after the government's autumn spending review.

Overview of Instrument Calibration Status FGM CAA product delivery status Product name 00 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 Cx_CP_FGM_SPIN P D1 Cx_CP_FGM_5VPS Cx_CP_FGM_FULL Cx_CQ_FGM_VALF Cx_CQ_FGM_GAPF Cx_CC_FGM_CALF Cx_CQ_FGM_CAVF D2 D = delivered P = partial delivery FGM have fulfilled contractual obligations for 2014 data delivery On track to fulfill 2015 data delivery obligations on time or ahead of schedule Contractual dates are: 2014 data delivered by mid-2015 and all 2015 data delivered by mid 2016 with all earlier datasets to be finalised by end 2016

Calibration Status – Consistency between 4 instruments QMUL flagged up a consistent problem in the July 2003 FGM data where the spin-axis calibration was suspect for C3. It was consistently offset from C124 by 0.4 nT. Due to small s/c separations (~200 km), an offset of this magnitude would not be expected. The inter-calibration step that had been added to the standard calibration procedure was found to have introduced this offset in both July and August 2003 data. The standard calibration was therefore run on July and August 2003 and the FGM data redelivered to the CAA. (Details in CrossCal 22 presentation)

Calibration Status – Comparison with other instruments No recent cross-instrument calibration efforts to report. It could be interesting to revisit the C1 and C3 FGM-EDI comparison for July and August 2003 but the FGM team is focusing its limited resource on Extended Mode processing this year. Point out FGMEXT processing could actually lead to increased CAA coverage, while FGM-EDI comparison won’t

Overview of Data Production Pipelines Data processing flow, per calendar month of data (12-14 orbits) Calibration Pipeline Submission to CAA Preprocessing of Raw Data Processing of Calibrated Data The combination of software improvements last year and hardware upgrades the year before have sped up the processing & calibration pipelines considerably.

Data Production Pipelines: Calibration Flow Calibration flow, conducted per calendar month of data (12-14 orbits) Dayside Season: Solar Wind Analysis Visual Inspection & Validation Fourier Analysis Range Jumps Tail Season: Spin-axis Offset Interpolation Huge improvements in the software efficiency have led to this, i.e. to demonstrate that we are still refining and improving our tools and procedures Calibrator #1 Calibrator #2 Full process used to take ~4 weeks, now takes ~1-1.5 weeks

Overview of Instrument Product Deliveries Datasets Delivered interval Comments FGM magnetic field data: FULL, 5VPS, SPIN – V01 Jan 2001– Apr 2015. Preparation of these core datasets was our highest priority. FGM supporting data: GAPF and VALF files These files are prepared routinely along with the core data sets. FGM calibration files: CALF Detached headers (required in order for these non-CEF data files to be ingested) have been submitted to the CSA. FGM caveat files: CAVF Files are prepared to highlight periods where problems with data occur that cannot be calibrated out. FGM calibration accuracy files: CALA Feb 2001 – Dec 2006, files prepared for all orbits CALA files have been superseded by CAVF files.

Status of Instrument Products – Recent Deliveries First calibration of Commissioning Phase data Spacecraft Orbit Numbers Dates Reason C123 68-80 Dec 2000 First calibration of commissioning phase orbits from December 2000 for C123 C4 not delivered because inboard sensor was used & has not been calibrated. Reinstatement of data taken during HPA Low Mode Spacecraft Orbit Numbers Dates Reason C1 1450-1462 Dec 2009 Reprocessing and redelivery of C1 data so that HPA Low Mode data is reinstated. NB: This is a one-off. HPA Low Mode data has been routinely delivered since Jan 2010.

Status of Instrument Products – Recent Deliveries Recalibrated FGM data Spacecraft Orbit Numbers Dates Reason C1234 464-489 Jul 2003 Aug 2003 Standard calibration found to be more realistic than calibration carried out with the inter-calibration step. QMUL flagged up a problem in the July 2003 FGM data where the spin-axis calibration was suspect for C3. It was consistently offset from C124 by 0.4 nT. Due to small s/c separations (~200 km), an offset of this magnitude would not be expected. The inter-calibration step that had been added to the standard calibration procedure was found to have introduced this offset in both July and August 2003 data. The standard calibration was therefore run on July and August 2003 and the FGM data redelivered to the CAA. Details will be presented during CrossCal 22.

Status of Instrument Products – Recent Deliveries Redelivery of files that failed CAA ingestion Spacecraft Orbit Numbers Dates Reason C1 158,1435 04-06 Jul 2001 28-31 Oct 2009 Removed misordered time records that had caused FULL resolution data files to fail ingestion into the CAA/CSA. C2 592,1435 02-04 May 2004 Ditto C3 223,811,899, 925, 929,1314 06-08 Dec 2001 05-07 Oct 2005 02-05 May 2006 03-05 Jul 2006 13-15 Jul 2006 14-16 Jan 2009 C4 106,151,592 02-05 Mar 2001 17-20 Jun 2001

Status of Instrument Products – Recent Deliveries Redelivery of files with missing data Spacecraft Orbit Numbers Dates Reason C1 643-644 30 Aug-04 Sep 2004 Reinstate a day’s worth of data (02 Sep) that hadn’t appeared in the original files C2 369-370 18-23 Nov 2002 Missing day was 20 Nov 709 03-06 Feb 2005 Missing day was 05 Feb C3 1346 31 Mar-02 Apr 2009 Missing day was 01 Apr 1489 01-03 Mar 2010 Reinstate all data. Orbit data files on CAA were empty. 811 05-07 Oct 2005 Correct a CAA data gap in SPIN caused by processing problem C4 655 28-30 Sep 2004 Missing day was 29 Sep

Status of Instrument Products – Recent Deliveries Redelivery of files with inconsistent data sets Spacecraft Orbit Numbers Dates Reason C1 98,99,246,456, 463 11-16 Feb 2001 29 Jan-01 Feb 2002 13-15 Jun 2003 30 Jun-02 Jul 2003 Correct an inconsistency between FULL, 5VPS and SPIN generation dates on CSA C2 263,996 11-13 Mar 2002 19-21 Dec 2006 Ditto C3 1538 20-22 Jun 2010 C4 114,297,362 21-24 Mar 2001 31 May-02 Jun 2002 01-04 Nov 2002

Status of Instrument Products – Required Redeliveries GI data that was embargoed for February and March 2015 has passed out of the embargo period and been delivered to the CAA. Upcoming GI periods include: Jun, Nov/Dec 2015 and Jan, Feb, Apr-Jun 2016 The GI embargo periods for these FGM data will be respected when routine data calibration begins again in 2016, except where the FGM team has been explicitly informed that the GI does not require the data to be embargoed (e.g. Jan 2016).

CAA/CSA Inventory Plot Inconsistencies Deliveries to the CAA have not propagated to the CSA Commissioning phase data C1: December 2000 All datasets available

CAA/CSA Inventory Plot Inconsistencies Deliveries to the CAA have not propagated to the CSA C1, December 2000 All data appears to be missing!

CAA/CSA: Slow Ingestion Deliveries not appearing in both CAA and CSA Commissioning phase data C2: December 2000 Data delivered to CAA (after CC21) No datasets available

CAA/CSA: Slow Ingestion Deliveries not appearing in both CAA and CSA C2, December 2000 All data appears to be missing

Open Action Items from 8th Operations Review AI Number Action Item Status CAA-OR8-R17 The board recommends that the FGM team investigates the possibility of providing extended-mode FGM data to the CAA. Open. FGM is investigating. These data are transmitted during BM3 and contain the measurements when the spacecraft was not transmitting data. Time stamping of the data is a nontrivial problem as the data are given in instrument internal timing with no reference to the SCET time. We have progressed somewhat recently but the data are still not in a deliverable state. No open actions for FGM from 9th Operations Review

Summary of Problems and Open Issues Bursty Spin Noise on C4 Seen since September 2010 (possibly earlier) and has continued No progress has been made in finding the source of the problem There appears to be no correlation with FGM commanding or platform commanding. We are continuing to caveat the C4 Range 2 and 3 data.

Summary of Problems and Open Issues Bursty Spin Noise on C4: Sep 2010, ~10 min interval, 5 vps

Summary of Problems and Open Issues Bursty Spin Noise on C4: Sep 2010, ~2 min sub-interval, 22 vps

Instrument Calibration Plan for 2016 The following calibration tasks will be addressed (in order of priority) Routine calibration, resuming February 2016 Reprocessing and redelivery to fill identified gaps in the CAA Continued efforts to process Extended Mode intervals for integration into the calibration pipeline (summer student 2016), following on from progress made by summer student in 2015

Data Production Plan for 2016 The long term plan is to deliver: all 2015 data by the 11th Operations Review (mid 2016?) 2016 data (through April 2016) by the 11th Operations Review