1. 1. Introduction: general information
LPP
moved from Vélizy to Ecole Polytechnique
at the middle of January 2001
Induced unavailability of some people for some months
Some difficulties in general computer facilities at lab level ( mass processing of new products will not be possible for some months).
The situation is improving continuously.
5th Operation Review of CAA, ESTEC, 09 June 2010

2. 1. Introduction: status of the archive
STAFF-SC
NBR and HBR mode
¤ Monthly produced on LPP web site:
Product
Content
Level
Produced and Delivered to CAA
C?_CP_STA_DWF_NBR/HBR
Decommutated
Waveform 1
Version 02
01 Jan 2001/31 Dec 2006
Version 03
01 Jan 2007/31 Dec 2008
C?_CP_STA_CWF_NBR/HBR
Calibrated
waveform 2
none
C?_CP_STA_CS_NBR/HBR
Spectra
01 Jan 2001/31 Dec 2005
01 Jan 2006/31 Dec 2008
CL_CG_STA_SC_SPECTRO_NBR/HBR
Spectrograms
Plots ¤ 3
01 Jan 2001/31 Jul 2009
5th Operation Review of CAA, ESTEC, 09 June 2010

3. a. STAFF-SC (continued)
TCOR: we are still waiting for 2009 TCOR. As soon as we will get them, DWF and then CS will be produced and delivered.
Data gap in TCOR files: caveat files will be produced and delivered together with CWF new products
CWF new products: work is in progress (details will be given later in the presentation).
5th Operation Review of CAA, ESTEC, 09 June 2010

4. ¤ Note that 24 hours of CPU time are required to process one month of data
Version 3 has a best decom since CD are concatenated (less waste)
b. STAFF-SA
Product
Content
Level
Mode
Num.
of files
Produced and Delivered to CAA
C?_CP_STA_AGC
Automatic Gain control 2
All
1 file /
1 sat. /
24h
Version 3 /
C?_CP_STA_PSD
Power Spectral Density
C?_CP_STA_SM
Spectral Matrix ¤
C?_CP_STA_PPP
Polarization and Propagation Parameters 3
Version 2
Feb
C?_CQ_STA_PSDNEG
PSDNEG caveat
Auxilliary /
C?_CQ_STA_NOTSRP
NOTSRP caveat
5th Operation Review of CAA, ESTEC, 09 June 2010

5. a. STAFF-SA (continued)
Already 2 new caveat files delivered
- PSDNEG
- NOTSRP
2 other caveats files remain to be defined
- Low attitude/FGM coverage: the change to MFA coordinate system cannot be done, so there will be fillvalue in the PPP datasets.
- The other caveat remains to be defined: it will concern the EFW Y/Z in density mode.
5th Operation Review of CAA, ESTEC, 09 June 2010

6. 5th Operation Review of CAA, ESTEC, 09 June 2010
2. Management
Flow chart
5th Operation Review of CAA, ESTEC, 09 June 2010

7. 3. Status of software development
a. STAFF-SC production chain
L1 product DWF: Version 03
This version is operational DWF has been produced/redelivered.
New data headers are included to allow the addition of caveat files, to update laboratory name and s.
In the telemetry, data are time tagged by blocks of 25/45 vectors, corresponding to NBR(25Hz)/HBR(450Hz) mode.
In version 03, the real value of the sample rate, slightly different for each spacecraft, but constant over time, is used. It insures a better continuity between each block.
L2 product CS: Version 03
This version is operational. 2006/2007 CS has been produced/redelivered.
New data headers are included to allow the add of caveat files, to update laboratory name and s.
L2 product CWF: Version 01
The S/W is under development. See part 4 of the presentation.
Data quality verification tool:
to verify that the new format L2 data are consistent with the previous one.
5th Operation Review of CAA, ESTEC, 09 June 2010

8. 3. Status of software development (continued)
b. STAFF-SA production chain
L2 products in version 04:
* Production of NEW dataset headers (SM, AGC, PSD): to include caveat files; to update laboratory name and s.
* Correction of EOF.
* PSD negative values removed.
* SM: PSDNEG caveat files when PSD have negative values.
* PSD/SM: NOTSRP caveat files has been produced and included in the headers of the data files.
L3 products: PPP
Version 01: Format of the datasets was wrong.
Version 02: The chain is operational.
Same caveats than SM: NOTSRP, PSDNEG
Software remaining to be written:
A caveat which gives the times where the change coordinate of SM data couldn’t have been done: Low attitude/FGM coverage.
Another caveat needs to be defined depending on EFW mode of operation: waiting for some EFW answers and/or some more study.
5th Operation Review of CAA, ESTEC, 09 June 2010

9. 4. Status of Experiment Activity: Calibration/Cross-Calibration
Continuous Calibration Method program is running.
Test on kernel size (length of calibration window) achieved.
Results lead to 1024 pts in NBR to avoid some modulation at 2*Fs on continuous despun signal.
Note that below (512 pts), a ~ 0.2 degrees phase modulation of spin signal in raw data is observed.
It induces a few nT modulation on X and Y components of the calibrated signal.
Conclusion: pts are required to get a good data quality nevertheless CPU time consuming.
Details remain to be done before mass processing.
* Saturation checks
* Data gaps management
* Code optimization
5th Operation Review of CAA, ESTEC, 09 June 2010

10. 5th Operation Review of CAA, ESTEC, 09 June 2010
Validation Method: Comparison between STAFF-SC CWF & FGM HR waveforms
Conditions: High DC, High fluctuations
Always ~ 10 % on the DC field
But DC mainly along X
Rather good agreement !
No DC for Bz STAFF,
but fluctuations look the same
Presented at 10th CAA Cross-Calibration meeting, Paris, 2-4 November 2009
5th Operation Review of CAA, ESTEC, 09 June 2010

11. Example of Future CWF product
CWF will be delivered in GSE coordinate system
(CAA recommendation)
 Filtered above 0.5 Hz.
Whatever
Low sensitivity at low frequencies.
No DC component on Z.
5th Operation Review of CAA, ESTEC, 09 June 2010

12. Comparisons STAFF-SC/FGM: Main conclusions
Whatever the conditions (low or high perpendicular DC field, weak or strong magnetic pulsations) all studies lead to the same conclusions:
The relative amplitude difference between STAFF and FGM is not dependant of the frequency.
This difference is always (with STAFF lower than FGM), ~10% for S/C#2,3 and 4 and~20% for S/C#1.
After investigation the difference on S/C#1 with respect to other spacecraft is due to a sensor initial calibration error on ground (before launch).
S/C #1 transfer function is suspicious and has to be corrected before CWF production.
The systematic 10 % difference source has to be identified.
 Further studies are needed.
5th Operation Review of CAA, ESTEC, 09 June 2010

13. 5. Status of dataset delivery
Product
Until now
SC DWF
2008
SC Complex spectra
SC Images
31/07/2009
SC CWF New
SA AGC/ PSD / SM
09/2009
SA Polarisation/
Propagation New
02/2001
SA PSDNEG Caveat New
SA NOTSRP Caveat New
5th Operation Review of CAA, ESTEC, 09 June 2010

14. 6. Data delivery plan for the Remaining Years
Product
2010
2011
2012
2013
SC DWF
2009
SC Complex spectra
SC Images
End of 2009
SC CWF New
2001
2002 – 2010
SA AGC/ PSD / SM
SA Polarisation/
Propagation New
2004 – 2010
For STAFF-SC products, the planning is subject to the availability of TCOR files (Waiting for TCOR 2009).
5th Operation Review of CAA, ESTEC, 09 June 2010

15. 5th Operation Review of CAA, ESTEC, 09 June 2010
7. Documentation
Calibration report and user guide:
- Versions 02 have been produced and delivered (May 2010).
- Both will be updated as soon as CWF dataset will be delivered.
ICD:
- A version 4.0 has been produced and delivered (May 2010).
- A version 5.0 will be produced when new products are delivered.
5th Operation Review of CAA, ESTEC, 09 June 2010

16. 8. Replies of the Recommendations
3rd Operation review (2008)
T1: CLOSED
Two caveats for STAFF-SA Level 2 data have been produced and delivered.
NOTSRP caveat: associated to SM/PSD/PPP in eclipse. It informs the users when the SRP (Sun Reference Pulse) times is not recorded in the S/C housekeeping in eclipse umbra.
PSDNEG caveat: associated to SM/PPP, concerning PSD negative values that could be used to calculate the diagonal terms of the spectral matrix.
New caveats for PPP are coming soon.
T5: IN PROGRESS
All data from year will be provided before June 2010 depending on TCOR availability.
4th Operation review (2009)
R2a: About CWF 5SC), PPP (SA): IN PROGRESS
STAFF-SA PPP: Software has been developed. Feb data have been produced and delivered. New associated caveats are under-development.
STAFF-SC CWF: In progress. Software is under-development. First results presented in the last cross-cal meetings.
R12: User Guide improvement: See User Guide V2.0.
R14: About continuation of cross-calibration activities: See Cal. Report. V2.0
T1:
PSD negative: les prochaines, on aura remplacé les psd negative par des fill value;, dans un premier temps, on a decide de ne pas reprocesser les donnees mais d’informer les users à l’interieur du userguide et d’écrire un fichier de caveat...next month...
5th Operation Review of CAA, ESTEC, 09 June 2010

17. 9. Status of the action items
CC8-AI-45: OPEN, due date next Cross-Cal Workshop.
O. Santolik, WBD and STAFF COI, has been contacted and will work on it.
STA08-AI-1: CLOSED
NOTSRP caveat has been produced and delivered.
STA08-AI-2: CLOSED
PSD negative values have been removed in PSD products version 04.
PSDNEG caveat has been produced and delivered.
STA09-AI-1: CLOSED
All dataset headers have been completed, corrected and delivered.
STA09-AI-7: CLOSED
To describe DWF flag and CS caveat in the UG.
Present also figure for the case of spin modulation in the UG.
See User Guide V2.0.
CC10-AI-7: OPEN
To include the UG and CR some information about the noise level of the measurements for high frequency waves where WHISPER appears to detect weaker signal.
For ref. see STAFF-SA presentation.
M. Maksimovic has been contacted.
5th Operation Review of CAA, ESTEC, 09 June 2010

18. 9. Status of the action items (continued)
CC10-AI-8: OPEN
To explain the processing details of STAFF-WHISPER comparisons.
M. Maksimovic has been contacted.
CC10-AI-9: CLOSED
Prassadco software has been modified to allow FGM 5VPS data as input for the coordinate system transformation in MFA.
CC11-AI-1: OPEN, due to 15th June 2010.
To indicate the waveform datasets intervals for which TCOR is unavailable to correct time.
It will be done together with calibrated waveforms delivery.
CC11-AI-2: CLOSED
To update ICD and UG according to the PM discussion and submit them together with other review documentation.
See UG and ICD.
CC11-AI-3: OPEN
To make a poster for the 10th anniversary of the Cluster mission in Corfu 27 Sept. – 1 Oct
It will be done in due time.
Tous les B :STAFF-SC/STAFF-SA, tous les E: EFW/STAFF-SA/WHISPER
Particules: sis and rapid, peace and rapid
5th Operation Review of CAA, ESTEC, 09 June 2010

19. 10. Replies of the Recommendations of the 2009 Peer review: ALL TEAMS
PR09-ALL01
CLOSED
In general the UG needs to show illustrative examples of many of the instrument « issues » that the user needs to be aware of.
See UG Chap. 6
PR09-ALL02
It is highly important to provide users with caveat information and its existence should clearly be stated in the UG.
PR09-ALL05
There is almost no discussion of data errors/standard deviations, and that assessment of instrument quality is at best qualitative.
See UG Chap. 2 and 6
PR09-ALL06
The inter-calibration effort is still on-going and that many of the reports are preliminary. Should be added in the CR.
See CR V2.0. It will be updated again when we will get new results.
PR09-ALL08
CAA user interface has been modified. The instruments UG should be restructed to reflect this.
See UG version 02
PR09-ALL09
There are further plans for the CAA to provide a set of on-going cross-calibration plots to allow the users his or her own assessment of instrument performance. Should be added in the CR.
T1:
PSD negative: les prochaines, on aura remplacé les psd negative par des fill value;, dans un premier temps, on a decide de ne pas reprocesser les donnees mais d’informer les users à l’interieur du userguide et d’écrire un fichier de caveat...next month...
5th Operation Review of CAA, ESTEC, 09 June 2010

20. 10. Replies of the Recommendations of the 2009 Peer review: ALL TEAMS
PR09-ALL10
CLOSED
The highest fidelity data are the CAA data and their use should be encouraged. If other data sources are used, caveat as to their limitations should be included.
STAFF uses only CAA datasets.
PR09-ALL11
OPEN
The digital version of a lot of calibration results presented in the CR should also be archived at the CAA.
It will come with the new product CWF (ex: Perp. DC field from STAFF).
PR09-ALL12
IN PROGRESS
Some reference documents listed in the UGs are internal to the teams. All referenced documents should be available at the CAA.
Some document only exist in printed versions
PR09-ALL13
To get a quicker overview of the data products, the UG should contain a table of ALL datasets in annex, including the datasets names and title and a brief description/comment where necessary e.g. on time resolutions, units, etc.
See UG
PR09-ALL14
All teams should include some flags in their data to indicate usability.
Caveats have been added; flags will come on new products
T1:
PSD negative: les prochaines, on aura remplacé les psd negative par des fill value;, dans un premier temps, on a decide de ne pas reprocesser les donnees mais d’informer les users à l’interieur du userguide et d’écrire un fichier de caveat...next month...
5th Operation Review of CAA, ESTEC, 09 June 2010

21. 10. Replies of the Recommendations of the 2009 Peer review: STAFF
PR09-STA01
DONE
The UG needs to be improved.
A version 02 has been delivered. A version 03 will follow.
PR09-STA02
CLOSED
UG should lists: Data sets contents, name and nature of variable (time series, vector…), units, supporting data (mode, spin phase, etc…) and quality flag.
See chap. 5 of UG
PR09-STA03
IN PROGRESS
Provide in the UG plotted examples of the most significant datasets to check outputs of users own software, including use of quality flags to illustrate their importance.
Example plots of principal products are included in the UG
PR09-STA04
The interpretation of the science datasets requires some additional information about the position of the instrument on the spacecraft, reference angles, reference frame, etc.
See UG chap. 2
PR09-STA05
It is recommended to delivered CWF data as soon as possible. The provision of quality flags should be considered for the CWF to reflect the difficulties in production.
A development software is running. Needs some improvements for mass production. Flags will be incorporated
PR09-STA06
The data collected in calibration mode should be provided (Annex of UG or CR).
After cross-calibration completed.
T1:
PSD negative: les prochaines, on aura remplacé les psd negative par des fill value;, dans un premier temps, on a decide de ne pas reprocesser les donnees mais d’informer les users à l’interieur du userguide et d’écrire un fichier de caveat...next month...
5th Operation Review of CAA, ESTEC, 09 June 2010

22. 10. Replies of the Recommendations of the 2009 Peer review: STAFF
PR09-STA07
IN PROGRESS
Improve the usability of STAFF-SA data. The team should consider including supplementary information in the documentation and datasets to take this into account.
Some caveats have already been delivered: NOTSRP and PSDNEG.
New caveats are coming. All documentation has been deeply revised
PR09-STA08
CLOSED
SA and SC should be delivered in the same physical referenced frame.
Chosen on purpose for the best data return and archiving reasons.
PR09-STA09
The 5x5 spectral matrix of STAFF-SA is not enough to provide a publication level datasets. Short terms : PPP.
Feb of new product PPP has already been produced and delivered. The rest will follow in the following months.
PR09-STA10
Prassadco at CAA.
O. Santolik has been contacted. He doesn’t want to have his software on 2 different websites. As PPP are coming, no more need.
PR09-STA11
It was found out that at least in one case the time tags of SC waveforms did not match with those of EFW waveforms in burst mode (450 Hz) and STAFF-SC waveforms.
Maybe TCOR, activated on STAFF and not on EFW
PR09-STA12
The document (UG) should discuss the discrepancies between similar data from other instruments (FGM, EFW, Whisper, WBD) and present an assessment when one may be better than the others. What should the users do in such cases?
Conclusions of Calibration document are reported in the UG. Some XCal studies to continue
T1:
PSD negative: les prochaines, on aura remplacé les psd negative par des fill value;, dans un premier temps, on a decide de ne pas reprocesser les donnees mais d’informer les users à l’interieur du userguide et d’écrire un fichier de caveat...next month...
5th Operation Review of CAA, ESTEC, 09 June 2010

23. 5th Operation Review of CAA, ESTEC, 09 June 2010
11. Open issues
STAFF-SC:
* Gaps in the TCOR files:
We need to test if it implies some time discontinuities in the DWF at the s level.
* Complex Spectra (CS):
Good considering the quality except around the spin frequency (0.25 Hz) where important noise (remnant of the spin signal ) is observed especially on the X and Y components close to perigee.
But 10% of difference with FGM in the low frequency band has to be understood. The additional 10 % with S/C1 should be solved soon, before CWF delivery.
STAFF SA:
Electric components may be affected by the EFW preamplifier failure on some of the spacecraft (see table). The STAFF SA onboard despin doesn’t permit to get rid of this problem and thus the 2 despun components telemetry data are affected.
Describe here if there are any issues that affect the quality of the experiment datasets.
S/C #
Date of failure 1
28/12/2001 2
13/05/2007 3
29/07/2002
5th Operation Review of CAA, ESTEC, 09 June 2010

24. 5th Operation Review of CAA, ESTEC, 09 June 2010
The End.
5th Operation Review of CAA, ESTEC, 09 June 2010