FGM report 10 th Cross calibration workshop Elizabeth Lucek, Patrick Brown, Chris Carr, Tim Oddy, André Balogh I mperial College London November 2009.

Slides:



Advertisements
Similar presentations
PG Planning the Network Task M3/M8 Performance Indicators Issues around delivery of Action Plan 20 March 2007.
Advertisements

CAA 10th Cross Calibration Workshop, Paris, France, 2-4th Nov CLUSTER / STAFF Action items C. Burlaud, P. Robert, M. Maksimovic, N. Cornilleau-Wehrlin,
STAFF Report. 1.Status of data delivery 2.Delivery Plan 3.Status of data pipeline 4.STAFF/FGM cross calibration 5.Conclusions 2 15th Cross-Calibration.
MPARWG Deborah K Smith DISCOVER MEaSUREs Project Remote Sensing Systems.
LSU 07/07/2004Communication1 Communication & Documentation Project Management Unit – Lecture 8.
LESSON 8 Booklet Sections: 12 & 13 Systems Analysis.
CS 360 Lecture 3.  The software process is a structured set of activities required to develop a software system.  Fundamental Assumption:  Good software.
Usability Issues Documentation J. Apostolakis for Geant4 16 January 2009.
FGM report 9 th Cross calibration workshop Elizabeth Lucek, Patrick Brown, Paul French, Chris Carr, Tim Oddy, André Balogh I mperial College London March.
System Development Lifecycle Verification and Validation.
Planetary Science Archive PSA User Group Meeting #1 PSA UG #1  July 2 - 3, 2013  ESAC PSA Archiving Standards.
Consortium Meeting La Palma October PV-Phase & Calibration Plans Sarah Leeks 1 SPIRE Consortium Meeting La Palma, Oct. 1 – PV Phase and.
11 14th CAA Cross-Calibration meeting, York, 5-7 Oct 2011 STAFF CAA products & Cross-Calibration activities Patrick ROBERT & STAFF Team 5) STAFF-SC CWF.
CEOS-CGMS Working Group on Climate John Bates NOAA/NESDIS/NCEI SIT Workshop Agenda Item 7 CEOS Action / Work Plan Reference CEOS SIT Technical Workshop.
CAA 12th Cross-cal meeting Toulouse Oct STAFF status report N. Cornilleau-Wehrlin,P. Robert, V. Bouzid, and STAFF team.
CLUSTER/STAFF DATA at CAA. 11th Cross-Calibration Meeting, 7-9th April 2010, Goslar. C. Burlaud, P. Robert, O. Santolik, N. Cornilleau-Werhlin, P. Canu,
STAFF Report Patrick Robert, Rodrigue Piberne & STAFF team.
1 12th CAA Cross-Calibration meeting, Toulouse, Oct 2010 STAFF/SC Calibration & Cross-Calibration activities Patrick ROBERT & STAFF Team, LPP 2)
EO Dataset Preservation Workflow Data Stewardship Interest Group WGISS-37 Meeting Cocoa Beach (Florida-US) - April 14-18, 2014.
1 14th CAA Cross-Calibration meeting, York, 5-7 Oct 2011 STAFF CAA products & Cross-Calibration activities Patrick ROBERT & STAFF Team 5) STAFF-SC CWF.
1 SUZAKU HUG 12-13April, 2006 Suzaku archive Lorella Angelini/HEASARC.
Software Development Process CS 360 Lecture 3. Software Process The software process is a structured set of activities required to develop a software.
CAA/CFA Meeting | CFA Team | ESAC | Octiber CFA Under Development CAA/CFA Meeting ESAC, Oct 11 th 2011 European Space AgencyCFA Team.
WHISPER action items Gábor Facskó, Jean-Gabriel Trotignon,Séna Kougblénou, Xavier Vallières, Guillaume Lointier LPC 2 E/CNRS, Orléans, France 10th CAA.
CAA PEACE Status Iryna Rozum, Andrew Fazakerley, Natasha Doss, Andrew Lahiff, Yulia Bogdanova, Branislav Mihaljčić & the PEACE ops team MSSL 12 th Cross-Calibration.
1 CAA 2009 Peer Review, Jesus College, Cambridge, UK, March CAA Peer Review: Selected Recommendations.
DAA PEACE Status A. Fazakerley, B. Mihaljčić, I. Rozum, A. Lahiff, G. Watson, D. Kataria UCL Department of Space and Climate Physics Mullard Space Science.
PDS4 Project Report PDS MC F2F University of Maryland Dan Crichton March 27,
9 th CAA Cross-Calibration Workshop, Jesus College, Cambridge, UK, March /17 CAA Graphics: Pre-generated/On-demand Panels and Cross-Calibration.
16 th CAA Cross-Calibration Workshop IRAP, Toulouse, 6-9 November20121 Removing strong solar array disturbances and telemetry errors from DC magnetic field.
CAA 8th Cross-Cal meeting Kinsale (Ireland), 28 Oct 2008 Edita Georgescu EDI Status of Calibration and Archiving Activities.
Using SAS Stored Processes and the SAS Portal for Delivering Statistics to Drug Discovery Volker Harm PhUSE/PSI One-day Event 2009, Marlow.
1 CAA 2009 Cross Cal 9, Jesus College, Cambridge, UK, March 2009 Caveats, Versions, Quality and Documentation Specification Chris Perry.
15th CAA Cross-calibration workshop CIS archiving activities report University College of London 2012, April
Cluster Active Archive Status of DWP Data Activities Simon Walker, Keith Yearby, Michael Balikhin Automatic Control and Systems Engineering, University.
Cluster Active Archive Status of DWP Activities Simon Walker, Keith Yearby, Hugo Alleyne ACSE, University of Sheffield.
FGM Report: Extended Mode Processing 22 nd Cross Calibration Workshop Chris Carr, Patrick Brown, Leah-Nani Alconcel, Tim Oddy, Peter Fox, Cary Colgan (summer.
10th CrossCal Workshop, L'Observatoire de Paris, France Cluster Active Archive Status of DWP Action Items Simon Walker, Keith Yearby, Hugo Alleyne ACSE,
FGM report 5 th Operations Review of the CAA Elizabeth Lucek, Patrick Brown Chris Carr, Tim Oddy, André Balogh I mperial College London June 9 th 2010.
Cluster Active Archive Status of DWP Data Activities Simon Walker, Keith Yearby, Michael Balikhin Automatic Control and Systems Engineering, University.
CIS Action Items 10 th Cross-Calibration Workshop Observatoire de Paris, Nov
1 CAA 21 th Cross Calibration Meeting, Leiden, th Mar 2015 CAA Cross Cal Meeting Mar 2015 Automated Pipeline Processing.
8th Cross-calibration Workshop CIS data delivery report Kinsale – October 2008.
FGM Report 17 th Cross Calibration Workshop Chris Carr, Elizabeth Lucek, Patrick Brown, Leah-Nani Alconcel, Barry Whiteside, Tim Oddy, Peter Fox, André.
Double Star Active Archive - DWP/STAFF 1 Double Star Active Archive STAFF/DWP Keith Yearby and Hugo Alleyne University of Sheffield Nicole Cornilleau-Wehrlin.
1 11 th CAA Cross-Calibration Workshop, Hotel die Tanne, Goslar, Germany 7-9 April 2010 CAA 11 th Cross-Calibration Workshop Hotel die Tanne, Goslar, Germany.
Laboratoire de Physique des Plasmas 20 TH CAA CROSS-CAL M EETING CLUSTER-STAFF REPORT O CTOBER 2014 G ÖTTINGEN The STAFF Team Laboratoire de Physique.
DAA Status/Progress B. Mihaljčić, A. Fazakerley, G. Watson, C. Anekallu UCL Department of Space and Climate Physics Mullard Space Science Laboratory 21.
WHISPER report whisper team 16th CAA Cross-Calibration workshop Toulouse, France, 7-8 November 2012 CENTRE NATIONAL DE LA RECHERCHE SCIENTIFIQUE Laboratoire.
MSSL * A.N. Fazakerley, I. Rozum, N. Doss, B. Mihaljcic & the PEACE ops team PEACE CAA Action Items Status 11 th CAA Cross Calibration Meeting, 7 – 9 April.
CAA PEACE Status PEACE Operations Team Presented by Iryna Rozum MSSL Cross-Calibration Meeting, Uppsala, Sweden, April 2011.
Investigation of a discrepancy between magnetic field magnitudes determined by the FGM and EDI instruments Jonny Gloag, Edita Georgescu, Elizabeth Lucek,
1 CAA 20 th Cross Calibration Meeting, MPS, Gottingen 16th Oct 2014 CAA Cross Cal Meeting Oct 2014 Pipeline Automation Chris Perry.
WEC meeting TED status and WEC timing.
Cluster Active Archive Status of DWP Data Activities Simon Walker, Keith Yearby, Michael Balikhin Automatic Control and Systems Engineering, University.
8 th Cross-Calibration Workshop, Kinsale, Ireland, October 20081/14 Draft Replies and Actions to the Recommendations of the Review Panel for Final.
CAA 6 th Cross Cal Meeting RAL, th Oct 2007 RAPID/IES Calibration Status J.A. Davies.
10 th CAA Cross-calibration meeting, 2nd – 4th November 2009, Paris N. Doss, A. Fazakerley, B. Mihaljčić and I. Rozum UCL Department of Space and Climate.
FGM report 9 th Cross Calibration Workshop Paul French, Elizabeth Lucek, Chris Carr, Patrick Brown, Tim Oddy, Andre Balogh Imperial College London March.
FGM Report 21 st Cross Calibration Workshop Chris Carr, Patrick Brown, Leah-Nani Alconcel, Tim Oddy, Peter Fox Imperial College London 24 March 2015.
The road to the first E2E tests
CAA Operational Review 9 Double Star PEACE Team Report
Status Report of EDI on the CAA
ASPOC Presentation for the CAA Operations Review-1 Klaus Torkar and Harald Jeszenszky IWF/OAW Graz ESTEC, May 2006.
CIS Data Archival Status
Cluster Active Archive – Wideband data BM2 mode
Annual Report of the DWP Experiment 9th CAA Operations Review
Status Report of EDI on the CAA
Annual Report of the FGM Experiment for the 8th Operations Review of the Cluster Active Archive (CAA) Chris Carr, Leah-Nani Alconcel, Patrick Brown,
10th CAA Operations Review Annual Report of the FGM Experiment
Presentation transcript:

FGM report 10 th Cross calibration workshop Elizabeth Lucek, Patrick Brown, Chris Carr, Tim Oddy, André Balogh I mperial College London November 2009

Primary FGM data delivered to CAA: Feb 2001 – April 2008, June 2008 –Magnetic field data: Full resolution, 5 vectors/second, spin averaged –Supporting files: GAPF (data gaps in processed data); VALF (data gaps introduced at validation stage – small number, generally only affects a few vectors at a time) Supporting FGM files delivered to CAA: Feb 2001 – Dec 2006 –CAVF: caveat files provided only when data quality is affected by external effects –CALA: calibration accuracy files Outlook –Several problems over the last year –Routine data delivery has recommenced - data from June delivered yesterday –Expect to deliver data from May – Oct 2008 by Christmas 2009 CAA status of data submission 2 Management changes Paul French left the team on October 16 th 2009 Archiving tasks currently divided among other team members

FGM CAA documentation Sources of documentation for FGM and FGM data –Interface Control Document (ICD) New ICD delivered to the CAA (CAA_FGM_ICD_0002_V0_4) –FGM User Guide V 1.0 delivered to the CAA in January 2009 –Cross-Calibration report V 1.0 delivered to the CAA in January 2009 –Some updates to be made in response to Peer Review recommendations Description of calibration procedure –Finalised paper prepared for proceedings of Tenerife workshop 3

Problems I Range 6 –FGM enters Range 6 within auroral acceleration zone –R6 implemented in electronics, but no ground calibration –DP modules updated (many thanks to Edita) –New calibration parameters have been derived for all four spacecraft using data from January 2009 Some additional testing required Browse data can be prepared on event-by-event basis –Updates to FGM DP software, implementation of R6 processing in PSDS/PP Full integration clearly highly desirable Requires CoI input – Karl-Heinz Glassmeier, Edita Georgescu, Karl-Heinz Fornacon Being considered Feasibility/timescale TBC 4

FGM R6 recalibrated data 5

R6 FGM comparison with WBD 6 White: FGM Black: IGRF Further testing needed Agreement is encouraging

Problems II Poorly determined spin axis offset –Effect: up to 1 nT discrepancy in B in solar wind –Data affected: Mar 2002; First half Jan 2003; First half Feb 2003 –Thought to arise from either: Error in application of solar wind calibration (Jan, Feb 2003) Insufficient solar wind data to yield good spin axis offsets (Mar 2002) –V02 data from Jan and Feb 2003 prepared –CAVF files for March 2002 prepared –Data will be checked and delivered when time allows –OPEN Outstanding CAVF and CALA files for Jan 2007 – April 2008 –Delayed by ssh problem –Data prepared when time allows –OPEN 7

Other Issues – medium priority Verification that CAA has complete data set –Before the end of the Active phase of the CAA, a check between the CAA and Imperial inventory will be made to ensure that all data have been delivered –OPEN Routine generation of CAVF files –Most of the software is written –Redelivery of all CAVF files would be straightforward once procedure finished –OPEN Delivery of data from Nov 2000 – Jan 2001 –Plan to deliver data from this period –Will use cut down calibration procedure –OPEN 8

Lower priority issues Preparation of data for summer 2001 incorporating inter-spacecraft calibration –Significant improvement not found to date –ON HOLD Calibration refinement files – for use in following changes in calibration parameters in a single orbit –Software written and tested, but not ready for routine use –ON HOLD 9

2009 CAA Peer Review Recommendations to all teams - I PR09-ALL01 – UG should illustrate instrument issues. –Propose to add some figures to the UG residual spin tone in the data residual jump at a range change spectral signature of residual tone at the spin frequency and twice spin frequency, also showing that single calibration file cannot always fit the data from a full orbit PR09-ALL02 – Caveat information –Caveat information routinely produced covering interval affected and likely cause if known PR09-ALL03 – ICD updates –FGM ICD updated to include CALA file description. Will consider the need for a further update before end of CAA PR09-ALL04 – Spacecraft-intercalibration –Some routine measures, e.g. when spacecraft are in solar wind –Results included in Calibration Accuracy (CALA) files –Formal intercalibration infrequent - special conditions required 10

2009 CAA Peer Review Recommendations to all teams - II PR09-ALL05 – Discussion of data errors/standard deviations –Qualititative estimates of data quality and quantitative measures are included in the CALA files PR09-ALL06 - A mission-long assessment of inter-calibration fidelity is missing from the calibration reports. –Analysis of the CALA files will be included in the calibration reports if time allows PR09-ALL07 – Documentation of physical region – instrument mode mismatch issues –FGM does not suffer from these effects PR09-ALL08 – Differences between CAA ‘simple’ and ‘advanced’ interfaces –FGM data are straightforward enough that we anticipate that the two interfaces will be the same PR09-ALL09 – Inclusion in Calibration Report of CAA generated cross calibration plots –We are not currently aware of any proposals of this nature for FGM 11

2009 CAA Peer Review Recommendations to all teams - III PR09-ALL10 – Discussion of use of PP/CAA data –PP data included for completeness PR09-ALL11 - Digital versions of calibration results presented in the calibration reports should also be archived at the CAA. –Not currently applicable to FGM since results derived results from calibration files are already archived in the CAA PR09-ALL12 – All reference documents referred to in the UG should be available at the CAA –All FGM references are publically available. PR09-ALL13 – The UG should contain a table of all datasets in the CAA –This table will be included in the next version of the FGM User Guide. PR09-ALL14 – All teams should include some flags in their data to indicate usability –Changes to FGM data products (FULL, 5VPS, SPIN) not feasible at this stage –Calibration accuracy files contain parameters summarising the usability of the data for different types of science. 12

2009 CAA Peer Review Recommendations to FGM - I PR09-FGM01 – UG should show how to identify data intervals with range changes, interference and spin modulation –These effects are already explained in the User Guide, but additional figures will be included as listed in the response to PR09-ALL01 PR09-FGM02 – A description is needed of the Calibration Accuracy files –A description is already included in the UG but some additional information on interpreting the ‘score value’ will be included in the next update PR09-FGM03 – The FGM team should try to provide a plan for long-term calibration issues such as instrument drifts –Long term drifts in instrument calibration parameters are accounted for in the routine calibration, and no further action is required PR09-FGM04 – PP data should not be included in the CAA –PP/UP data have been widely used, so it is essential that they are archived. However, we recommend SPIN for new studies PR09-FGM05 – Variances should be included in 5VPS and SPIN –With hindsight inclusion of the variances might have been useful, changes to the CAA datasets (FULL, 5VPS and SPIN) are not feasible at this stage 13

2009 CAA Peer Review Recommendations to FGM - II PR09-FGM06 – Quality flags and range information should be added to each record –We do not think that meaningful quality flags can be applied vector-by-vector to the FGM data –The instrument range and mode (normal or burst mode) are already supplied as part of every data record. PR09-FGM07 – FGM should be provided in ISR2 –If co-ordinate transformations are required for data products from more than one instrument we suggest that it would be better included as part of the CAA interface PR09-FGM08 – For SPIN and 5VPS the metadata should contain an entry describing how the averaging is done –This information will be included – averaging is done using a boxcar average. PR09-FGM09 – On the CAA Web page the dataset description for the CALA files is missing –This description has been supplied to the CAA 14