CIS : Data Quality Indices Iannis Dandouras, Alain Barthe, Sylvain Brunato CLUSTER ACTIVE ARCHIVE April 2012

Data Quality Index: Context CAA User Guide:

 Five new datasets : four for CODIF (separate for each ion species) and one for HIA.  Separate index values, for each instrument, for each of the four dataset families :  moments  3D distributions  PADs  omni-directional fluxes  When the value of the index is below a given threshold, the corresponding data will be flagged.  When the data are completely useless (e.g. instrument resets), they will be removed (data filtering), or substituted by filler data.  In addition to the CAA-defined quality index, a CIS-specific flag referring to the type of caveat. CIS Data Quality Principle

-1: Remove data (CIS specific, for internal use) 0 : Not applicable (not used by CIS) 1: Known problems, use at your own risk 2: Survey data, not for publication (not used by CIS) 3: Good for publication, subject to PI approval 4: Excellent data which has received special treatment  Default CIS Data Quality Index: 3 unless overwritten by another value, by software or manually  A CIS-specific flag (ASCII string) when Data Quality Index < 3  More than one flags might apply to a given data interval; the data quality index is then the minimum of the values relevant to each flag  CIS Data Quality Index: Does not concern raw particle counts data sets and ancillary data datasets (by nature uncalibrated) CAA Data Quality Index

CIS Data Caveats Database CIS Data Quality Index < 3  Magnetospheric region - CIS mode mismatch  Poor counting statistics  etc.  Data gap, or CIS off  Operational incidents with no effect on data quality (for the given dataset family)  etc. CIS Data Quality Index set to < 3 from Caveats Database

CIS Caveats Database Example

Data CaveatIdentificationCIS Flag CODIF Quality Index HIA Quality Index 3DPAD1DMo men ts 3DPAD1DMo men ts Limitations related to operation incidents Wrong HIA discriminator levels Caveats DatabaseDISC RI Wrong HIA MCP HV level Caveats Database MCP Wrong CODIF MCP HV level Caveats Database MCP HIA MCP HV discharge Caveats Database MCP _DC CODIF MCP HV discharge Caveats Database MCP _DC

Data CaveatIdentificationCIS Flag CODIF Quality Index HIA Quality Index 3DPAD1DMo men ts 3DPAD1DMo men ts Limitations related to operation incidents (or scheduled special operations) CODIF post- acceleration HV discharge Caveats DatabasePACC _DC Instrument- spacecraft telemetry mode mismatch Caveats DatabaseTM CODIF onboard calibrations Caveats DatabaseCALI B HIA onboard calibrations Caveats DatabaseCALI B

CODIF s/c 4 post-acceleration high-voltage discharge

Data CaveatIdentificationCIS Flag CODIF Quality Index HIA Quality Index 3DPAD1DMo men ts 3DPAD1DMo men ts Limitations related to operation incidents (or scheduled special operations) Instrument resetInstrument Command History + Δt RESE T EclipseCaveats Database (DSH param. + Δt) ECLI PSE 131 Incomplete CODIF TM packets Instrument telemetry packets PACK ET 1 For the concerned dataset 3333 Incomplete HIA TM packets Instrument telemetry packets PACK ET For the concerned dataset cf. presentation by A. Barthe on these Data Caveats

Data CaveatIdentificationCIS Flag CODIF Quality Index HIA Quality Index 3DPAD1DMo men ts 3DPAD1DMo men ts Limitations related to sampling of ion distributions Poor CODIF counting statistics CODIF density value threshold : ~0.01 cm -3 LOW _CO UNTS Poor HIA counting statistics HIA density value threshold : ~0.05 cm -3 LOW _CO UNTS He ++ contamination from H + All He ++ dataHE O + contamination when high H + CODIF H + density > 5 cm -3 and HS O CODIF on sc3 deficient anodes All CODIF sc3 data after 23 Feb 2003 DEF_ ANO DES

Low HIA and CODIF counting statistics example

Example of CODIF O + data contamination from very high H + fluxes in the magnetosheath

Data CaveatIdentificationCIS Flag CODIF Quality Index HIA Quality Index 3DPAD1DMo men ts 3DPAD1DMo men ts Limitations related to sampling of ion distributions Finite gyroradius / gyroperiod effects B-field intensity: 8s) GYR ORA D

Data CaveatIdentificationCIS Flag CODIF Quality Index HIA Quality Index 3DPAD1DMo men ts 3DPAD1DMo men ts Limitations related to magnetospheric region – CIS mode mismatch Magnetosheath or magnetosphere when CIS is in a solar wind mode Cluster magnetospheric regions dataset SW_ MOD E Solar wind mode & CODIF on HS CIS Modes datasetSW_ HS Mode 12 or 14 & CODIF on HS (for data after 1 Nov, 2003) CIS Modes datasetMSH _HS Solar wind when CIS is in a magnetospheric mode Cluster magnetospheric regions dataset MAG _MO DE

CODIF High / Low Sensitivity SW / MAG Modes Example Magnetospheric Mode Solar Wind Mode SW_HS MAG_MODE

Data CaveatIdentificationCIS Flag CODIF Quality Index HIA Quality Index 3DPAD1DMo men ts 3DPAD1DMo men ts Limitations related to a magnetospheric region Radiation Belts background (does not concern cleaned CODIF datasets) Cluster magnetospheric regions dataset RAD_ BELT

Outer RB B1B2B3B4B5B6 Outer RBInner RB HIA and CODIF background counts in the Radiation Belts