1. 10th CrossCal Workshop, L'Observatoire de Paris, France Cluster Active Archive Status of DWP Action Items Simon Walker, Keith Yearby, Hugo Alleyne ACSE, University of Sheffield

2. 10th CrossCal Workshop, L'Observatoire de Paris, France Overview Status Management Current Status Documentation Future delivery plans Action Items CC9 Peer Review Operations Review

3. Action Items 10th CrossCal Workshop, L'Observatoire de Paris, France Action Items received from CC9 Peer Review Operations Review Majority of items Required updates to ICD, UM Some refer to cross calibration activities Already been addressed in the latest issues of the documentation Answers to all action items attached to DWP CAA monthly report for September 2009

4. CROSSCAL 9 ACTION ITEMS 10th CrossCal Workshop, L'Observatoire de Paris, France

5. CC9-AI-1 Check from the WEC teams if the LOG dataset contain all necessary HK values (including for the full utilization of raw data files) CLOSED: The WEC teams were contacted. Only WHISPER expressed a requirement the WHISPER temperature This parameter is already included within this data set.. 10th CrossCal Workshop, L'Observatoire de Paris, France

6. PEER REVIEW RECOMMENDATIONS 10th CrossCal Workshop, L'Observatoire de Paris, France

7. PR09-ALL01 10th CrossCal Workshop, L'Observatoire de Paris, France The UG should inform the user about the instrument saturation in specific plasma regions and on the importance of using data when the instrument is in the right mode. This concerns particularly the particle experiments, but also some other experiments. One needs to add plots in the User Guide in order to show what the user should see when processing data files and also to illustrate data quality issues specific to the instrument (e.g. incorrect instrument mode, interferences, difficult calibration task etc). In general the UG needs to show illustrative examples of many of the instrument issues that the user needs to be aware of. CLOSED: The UG has been updated to include examples of the use of TCOR and COR data sets and to list caveats regarding the use of all DWP data sets.

8. PR09-ALL02 10th CrossCal Workshop, L'Observatoire de Paris, France It is highly important to provide users with caveat information and its existence should clearly be stated in the user guide. For nearly all datasets there is a reference to dataset caveats (C*CQ*) but in nearly all cases no such datasets exist. These datasets should either be provided or the references should be changed to datasets that exist. General caveats that apply to whole datasets are detailed in the UG. A first version of the caveats for specific datasets has been delivered to CAA. These files list all caveats for a specific dataset/satellite combination and cover the whole mission. New versions will be delivered from time to time with a final version being delivered after the mission has been completed. OPEN: Caveat files relating to instrument operations are currently under development.

9. PR09-ALL03 10th CrossCal Workshop, L'Observatoire de Paris, France Most of the instrument ICDs are somewhat or significantly out of date and the teams need to have an urgent and careful updating process of the ICDs very soon CLOSED: A substantially updated version of the DWP ICD was delivered to CAA in March 2009.

10. PR09-ALL04 10th CrossCal Workshop, L'Observatoire de Paris, France Spacecraft Inter-calibration: it seems that nearly all teams mention nothing with regard to use of multiple spacecraft data – which after all is a key ingredient of the CLUSTER mission. The teams should be candid about the utility and limitations of their data for this purpose. This would require a more detailed assessment of the instrument’s inter-spacecraft calibration fidelity, including some attempt at specifying the instrument’s error bars. The idea here is to give a general user an upfront assessment of the utility of the data to provide information on spatial gradients(Possible or not? What scales can actually be resolved?). CLOSED: DWP does not perform any inter-spacecraft calibrations.

11. PR09-ALL05 10th CrossCal Workshop, L'Observatoire de Paris, France There is almost no discussion of data errors/standard deviations, and that assessment of instrument quality is at best qualitative (“Good” or “bad” agreement on instrument cross-cal.) The accuracy of the TCOR data sets is mentioned in the UG as well as TCOR production/validation technical notes currently available on CAA. OPEN: Submit TCOR technical notes to CAA.

12. PR09-ALL06 10th CrossCal Workshop, L'Observatoire de Paris, France The inter-calibration effort is still on-going and that many of the reports are preliminary. However, missing from the calibration reports is a mission-long assessment of the inter-calibration fidelity. CLOSED: DWP does not participate in any intercalibration activity.

13. PR09-ALL07 10th CrossCal Workshop, L'Observatoire de Paris, France There are some general aspects of CLUSTER operation that while obvious to current “CLUSTERites” will not be so obvious to future users of the data – but it’s the CLUSTER mode of operation that explains and drives the multiple mode and data product strategy of the particle instruments. This should be explained at a high level on the CAA, and in its more specific implementation for each instrument – i.e. mention the CLUSTER science plan that provides for predicted regions ands witching into specific modes in an attempt to be in the “best” mode for boundary crossings, solar wind, sheath etc. One of the main problems resulting from this strategy is “region/mode mismatch”, which can cause a lot of confusion for a general user. The CAA or instrument teams are encouraged to investigate ways to indicate to the user the periods for which such region/mode mismatches exist. CLOSED: All DWP parameters available from CAA are unique. Thus, there is no difficulty in deciding which parameters are best suited to the observational environment.

14. PR09-ALL08 10th CrossCal Workshop, L'Observatoire de Paris, France The CAA plans to provide a ”simple” and “advanced” user interface. The simple version would hide many of the data complexities and allow access to an instrument’s most common and basic data products, while the advanced interface would basically be what is provided now. The Instrument Users Guides should be restructured to reflect this. OPEN: The UG will be updated to reflect the two user interfaces.

15. PR09-ALL09 10th CrossCal Workshop, L'Observatoire de Paris, France There are further plans for the CAA to provide a set of on-going cross- calibration plots to allow the user his/or her own assessment of instrument performance. This should be reflected and tied into the instruments calibration report. CLOSED: DWP does not participate in any intercalibration activity.

16. PR09-ALL10 10th CrossCal Workshop, L'Observatoire de Paris, France There is some concern on the differing origin/fidelity of the magnetic field data (PP parameters/onboard data link/CAA data) used to infer various parameters (pitch angles, drift velocities, electric fields etc). The highest fidelity data are the CAA data, and their use should be encouraged. If other data sources are used, caveats as to their limitations should be included CLOSED: Use of magnetic field data only affects the COR datasets. This data originates from the inter-experiment link between PEACE and FGM and is used onboard to select the polar zone used to collect the counts for the correlator.

17. PR09-ALL11 10th CrossCal Workshop, L'Observatoire de Paris, France The digital versions of a lot of the calibration results presented in the calibration reports should also be archived at the CAA. CLOSED: Any calibrations used by DWP for measurements of voltages and temperatures are listed in the WEC User Manual (chapter 2) which is available on CAA.

18. PR09-ALL12 10th CrossCal Workshop, L'Observatoire de Paris, France Some reference documents listed in the UGs are internal to the teams. All referenced documents should be available at the CAA CLOSED: All documents referenced in the UG are available on CAA or through web access to journal papers.

19. PR09-ALL13 10th CrossCal Workshop, L'Observatoire de Paris, France To get a quick overview of the data products, the UG should contain a table of ALL datasets in annex, including the dataset names and titles and a brief description/comment where necessary e.g. on time resolutions, units etc. CLOSED: The UG (version 1.1) already contains this information. A summary table could be produced based on the information contained in the data description sections but would provide no new information.

20. PR09-ALL14 10th CrossCal Workshop, L'Observatoire de Paris, France All teams should include some flags in their data to indicate usability. For teams that already do, there should be some indication as to what quality flag value is acceptable for general science use. CLOSED: Data flags are NOT included within the data files since they are not necessary, the only exception being the correlator data. When using the correlator datasets, the user is referred to the relevant caveat section in the user guide. Any data that is obviously bad due to incorrect mode settings or bad processing has been removed and a caveat has been added to indicate this.

21. PR09-DWP01 10th CrossCal Workshop, L'Observatoire de Paris, France The ICD needs an update. For example, the descriptions of the COR_FX and COR_ST products (section 5.1.6) do not match the actual data products. For example the data is not split into zero-lags and non-zero lags and there is no estimated count rate. The dataset titles of the two COR products are the same and should be updated to reflect the differences between these products. CLOSED: The ICD has been substantially updated and the latest version (5) was delivered in March 2009. It reflects the current definition of the data files submitted to CAA. The dataset titles of the COR_ST and COR_FX products have been altered to reflect the differences.

22. PR09-DWP02 10th CrossCal Workshop, L'Observatoire de Paris, France The description of the LOG product in both the UG and ICD is very brief. A more detailed specification should be provided in the ICD. Within the UG a clearer indication of the intended audience for this product (and the PIOR) would be useful(perhaps with cross reference from other WEC UGs). CLOSED: The description of the LOG product has been significantly enhanced in both the ICD and UG. The UG also addresses the point of the intended users for these products.

23. PR09-DWP03 10th CrossCal Workshop, L'Observatoire de Paris, France The TCOR description was clear. It would be useful to indicate if these correction shave already been applied to the datasets where it is required or where it is appropriate to apply the corrections. This could be done via a cross references from the other WEC UGs. The TCOR timing corrections are NOT applied to any of the DWP data products because accurate (microsecond) timing is not required for any of the datasets. The timing corrections may be applied to STAFF and WBD data products. OPEN: Update UM to specify this.

24. PR09-DWP04 10th CrossCal Workshop, L'Observatoire de Paris, France Many users will be unfamiliar with the COR_FX and COR_ST products, the UG could be significantly enhanced with some illustrative (plots) examples of the use of these data products. CLOSED: The UG now has a substantial section giving examples of the use of correlator data, as well as indicators for when the data is of low quality and untrustworthy.

25. PR09-DWP05 10th CrossCal Workshop, L'Observatoire de Paris, France The caveats section of the UG should make more reference to possible impact of PEACE caveats on the COR_FX and COR_ST products. For example the impact of the failure of anode 2 on C3 and duty cycle of the PEACE HEEA sensors. CLOSED: This point is now addressed in the UG.

26. PR09-DWP06 10th CrossCal Workshop, L'Observatoire de Paris, France The CR includes a number of referenced documents, some of which may be inaccessible to general users (e.g. technical notes, EID-A, ESOC files). DWP and CAA should aim to provide access to these items via the CAA wherever possible. CLOSED: The reference list has been updated to include only those documents that are publically available or already available on CAA.

27. PR09-DWP07 10th CrossCal Workshop, L'Observatoire de Paris, France The inclusion of the normalisation procedure for production of ACF amplitudes is a useful addition to the UG. This is currently not addressed in the UG. OPEN: A section will be added to clarify this point

28. PR09-DWP08 10th CrossCal Workshop, L'Observatoire de Paris, France The recommendation in the UG to consult the instrument team is not appropriate over the long term. OPEN: The phrase 'contact the DWP team' will be removed from the next version of the UG.

29. PR09-DWP09 10th CrossCal Workshop, L'Observatoire de Paris, France The headers were found to be generally complete and consistent, except: The PROPERTY of the energy parameter in the COR files contained a commented reference. The DWP and CAA should clarify the use of Speed or Energy for this metadata item. The QUALITY metadata for key science parameters such as the ACF data in the COR files was set to 0. This is inappropriate and should be updated, ideally with a time series to identify intervals of good correlator data. OPEN: The first point is being looked into. The second point should indicate that the data should be used with caution and that the potential user should consult the caveats in the UG. Add a caveat in the COR_FX and COR_ST headers to advise this.

30. PR09-DWP10 10th CrossCal Workshop, L'Observatoire de Paris, France The panel felt that all appropriate calibrations had been applied. The only question that was raised was over the ACF amplitudes which, although self-consistent, do not take account of the variable gain of the PEACE HEEA sensor. The DWP team should clarify this issue within the UG or CR and perhaps refer to relevant PEACE calibration information such as the MCP bias levels. The PEACE MCP level is included within the correlator datasets. Since these datasets contain a record of changes in the PEACE count rate, the results do not depend upon the gain setting. It was decided that it was not feasible to include the PEACE gain, and nothing could be gained by converting the count rate to fluxes. OPEN: Add to UG.

31. PR09-DWP11 10th CrossCal Workshop, L'Observatoire de Paris, France Appropriate quality information and flags were not included for the COR products and the COR_CAVEATS dataset was missing. The panel recommended that these be provided. CLOSED: The general caveats that apply to the COR datasets are now listed in the UG. Specific caveats may be found in the appropriate caveat files.

32. PR09-DWP12 10th CrossCal Workshop, L'Observatoire de Paris, France The panel noted that there was no other comparable datasets from Cluster and therefore it was not possible to assess the consistency of the products except for that between the DWP instruments on the different spacecraft. This concerns mainly the COR datasets. CLOSED: The team acknowledge this point.

33. REVIEW BOARD RECOMMENDATIONS 10th CrossCal Workshop, L'Observatoire de Paris, France

34. R1. All teams 10th CrossCal Workshop, L'Observatoire de Paris, France The review board would like to commend the teams on their efforts to provide data to the CAA in a timely manner. The delivery schedule requires that data to the end of 2009 be ingested into the CAA by May 2010, and the board expects that teams will adhere to this schedule. Teams should recognize that the current mission ends soon and should be preparing for this eventuality. CLOSED: The DWP team aim to meet this deadline. However, adherence depends strongly on the availability of the datasets required to generate the products. This mainly affects the TCOR dataset.

35. R2. All teams 10th CrossCal Workshop, L'Observatoire de Paris, France The board would like to reiterate that the CAA represents the final and full repository of Cluster data, and that every effort should be made by instrument teams to include all, best-calibrated data possible CLOSED: The DWP team is making every effort to pass the best quality data to CAA.

36. R3. All teams 10th CrossCal Workshop, L'Observatoire de Paris, France The board notes that the peer review process undertaken in 2009 was valuable. The board recommends that the CAA and instrument teams attempt to address and implement recommendations from the peer review to the level that is feasible within the existing resources. CLOSED: The DWP team will endeavour to implement all recommendations of the peer review, subject to their feasibility based on existing resources.

37. R12. All teams 10th CrossCal Workshop, L'Observatoire de Paris, France The instrument user guides are an essential tool for the CAA end user. The board is pleased to note the development of these guides by the instrument teams, as requested at the last review. However, the board notes that some of the guides could be improved by making them more complete, self-contained, readable, and usable. For instance, full descriptions of quality flags should be included, with diagrammatic examples of caveats where appropriate; plots of specific examples taken from the CAA graphical output would be most useful for the user. The board requests that all user guides are brought up to a consistent standard, as exemplified by the RAPID user guide. CLOSED: The UG has been substantially modified to provide more information to the end user.

38. R14 All teams 10th CrossCal Workshop, L'Observatoire de Paris, France The board also commends the inter-instrument cross-calibration efforts that have been undertaken, believing that this is the best route to producing high-quality, consistent data. The board recommends that these cross-calibration activities continue. The board also recommends that inter-spacecraft cross-calibration is undertaken as well and the results are presented in the calibration report. Double Star CLOSED: DWP does not participate in any intercalibration activities.

39. R15 10th CrossCal Workshop, L'Observatoire de Paris, France CAA and All teams & Double Star, the first bilateral mission between ESA and China, ceased collecting data in 2008, and the existing data currently resides with the individual instrument teams in Europe and China. Without proper archiving of the Double Star data it will eventually be lost to the scientific community as has happened many times in the past with previous space missions. The board is aware that activities to ingest Double Star data into the CAA have begun, as recommended in OR3. However, the board fears that in the absence of additional funds for the CAA to complete this work, this important activity will fail. The quality of the data ingested cannot be guaranteed without proper investment in calibration and data validation activities. Without extra funding, some of the instrument teams will be unable to provide their data to the CAA. The board urges that the CAA seek additional support to continue quality assurance and archiving of the Double Star data. CLOSED: The DWP team agrees with the recommendation that funding needs to be available to perform these activities.