ROSA – ROSSA Validation results R. Notarpietro, G. Perona, M. Cucca

COSMIC Data - COSMIC 1: 75 events (10 rising) well distributed in time (2 days for each season) and space - COSMIC 2: data related 31/12/2007 (1120 events) CHAMP Data setting events related to 22/01/2004 observations: INPUT DATA

- COSMIC 2: data related 31/12/2007 (> 1200 events) 90°  65°  North Polar regions 65°  35°  North Temperate regions 35°   35°  Tropics  35°   65°  South Temp. regions  65°   90°  South Polar regions R S TOT* * These figures are related to data couples compared at different levels after outliers removal

CHAMP Data ROSA-ROSSA CDAAC (COSMIC) ISDC (CHAMP) COSMIC Data We can quantify differences due to different algorithm implementations (CHAMP Data, COSMIC Data or future ROSA-ROSSA products ARE NOT First Level Benchmark) This analysis has been carried out even if it is not an absolute validation of ROSA-ROSSA software 1 Validation considering Third Level Benchmarks (output of other RO SWs)

COSMIC 1/2 Data 2006/2007 N e (h) COSMIC 2 Data 31/12/2007 T(h) Specific humidity (h) p wet (h)  (a) stratosph. optimized  (a) iono-free COSMIC 2 Data 31/12/2007 n(h) CHAMP Data 22/01/04 Orbits Excess phases 1 Validation considering Third Level Benchmarks (output of other RO SWs)

2 Validation considering Second Level Benchmarks (ECMWF Re-analysis) ROSA-ROSSA CDAAC (COSMIC) ISDC (CHAMP) N RSA (h) N COS (h) T RSA (h) T COS (h) WV RSA (h) WV COS (h) Dati COSMIC 2 31/12/2007

2 Validation considering Second Level Benchmarks (ECMWF Re-analysis) ROSA-ROSSA CDAAC (COSMIC) ISDC (CHAMP) N RSA (h) N COS (h) ECMWF Re-analysis spatially and temporally co-located N ECM (h) T RSA (h) T COS (h) T ECM (h) WV RSA (h) WV COS (h) WV ECM (h) following Tangent Points Dati COSMIC 2 31/12/2007

2 Validation considering Second Level Benchmarks (ECMWF Re-analysis) ROSA-ROSSA CDAAC (COSMIC) ISDC (CHAMP) N RSA (h) N COS (h) ECMWF Re-analysis spatially and temporally co-located N ECM (h) T RSA (h) T COS (h) T ECM (h) WV RSA (h) WV COS (h) WV ECM (h) following Tangent Points Dati COSMIC 2 31/12/2007

2 Validation considering Second Level Benchmarks (ECMWF Re-analysis) ROSA-ROSSA CDAAC (COSMIC) ISDC (CHAMP) N RSA (h) N COS (h) ECMWF Re-analysis spatially and temporally co-located N ECM (h) T RSA (h) T COS (h) T ECM (h) WV RSA (h) WV COS (h) WV ECM (h) following Tangent Points Outliers identification and removal and Mean Fractional Error evaluation Dati COSMIC 2 31/12/2007

Statistic definition

Outlier Identification through T- Student test (  3  threshold) and rejection Mean + Std Mean - Std mean Statistic definition

OPEN PROBLEMS WITH THE FIRST ROSA-ROSSA RELEASE Cosmic Raw Excess-phase profiles filtering

OPEN PROBLEMS WITH THE FIRST ROSA-ROSSA RELEASE Cosmic Raw Excess-phase profiles filtering

OPEN PROBLEMS WITH THE FIRST ROSA-ROSSA RELEASE Cosmic Raw Excess-phases filtering Statospheric Bending optimization (we are actually using CIRA- Q climatology; ROSA-ROSSA VE will adopt data coming from Numerical Weather Prediction Models) Wave Optics techniques for Bending angle extraction in low troposphere (foreseen for ROSA-ROSSA VE). Actually DG_ATMO is validated giving COSMIC data in input. Electron Density profile extraction through ROSA observations is critical given ROSA configuration and observation scheduling

 RSA (a) CDAAC (COSMIC)  COS (a) 1 Validation considering Third Level Benchmarks (output of other RO SWs) BENDING LEVEL

SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA Rising Setting North Pole North Temperate Tropics South Temperate South Pole Number of events

 (a) North Pole North Temperate Tropics South Temperate South Pole SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA

 (a) North Pole North Temperate Tropics South Temperate South Pole SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA

 (a) North Pole North Temperate Tropics South Temperate South Pole SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA

 (a) North Pole North Temperate Tropics South Temperate South Pole SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA

N RSA (h) CDAAC (COSMIC) N COS (h) 1 REFRACTIVITY LEVEL Validation considering Third Level Benchmarks (output of other RO SWs)

N (h) North Pole North Temperate Tropics South Temperate South Pole SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA

N (h) North Pole North Temperate Tropics South Temperate South Pole SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA

Validation considering Third Level Benchmarks (output of other RO SWs) T RSA (h) CDAAC (COSMIC) T COS (h) 1 TEMPERATURE and humidity LEVEL DG_ATMO q RSA (h) q COS (h) e RSA (h) e COS (h)

DG_ATMO is a 1-D VAR scheme developed for retrieving temperature, humidity and pressure (only as dependent variable) for the ROSA observations. The Background profile is extracted by NCEP long-term mean (365 days) reanalysis. Simplified version of error covariance matrices DG_ATMO

SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA T(h)

SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA e(h)

SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA q(h)

Our scheme differs from the COSMIC one. –Formulation of hypotheses to develop the 1D-VAR scheme –Formulation of error covariance matrices –Background fields Results are not any different! DG_ATMO

Validation considering Third Level Benchmarks (output of other RO SWs) Ne RSA (h) CDAAC (COSMIC) Ne COS (h) 1 ELECTRON DENSITY LEVEL DG_DELN

The DG_DELN Data Generator evaluates the electron density profile in the ionosphere, using the Onion Peeling algorithm. Since the ray bending in the ionosphere is small enough, the straight- line propagation from GPS to LEO satellites has been assumed for the GPS signals. As required by the inversion technique adopted, the spherical symmetry for the electron density of the ionosphere has been assumed. Excess phase measurements at L1 and L2 GPS frequencies during one occultation event are used to compute the TEC in the shell determined by the LEO orbit (calibrated TEC). DG_DELN

COSMIC SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA Ne(h)

DG_DELN COSMIC SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA Ne(h)

DG_DELN COSMIC SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA

DG_DELN COSMIC SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA

DG_DELN COSMIC SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA Ne(h)

DG_DELN COSMIC SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA Ne(h)

DG_DELN COSMIC SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA Ne(h)

DG_DELN COSMIC SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA Ne(h)

DG_DELN COSMIC SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA Ne(h)

DG_DELN COSMIC SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA Ne(h)

average +/- st.dev. average SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA Ne(h)

ROSA-ROSSA CDAAC (COSMIC) N RSA (h) N COS (h) ECMWF Re-analysis spatially and temporally co-located N ECM (h) 2 Validation considering Second Level Benchmarks (ECMWF Re-analysis) REFRACTIVITY LEVEL

North Pole North Temperate Tropics South Temperate South Pole RISING Number of events SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF

N (h) North Pole North Temperate Tropics South Temperate South Pole RISING Height [km] 25 SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF

N (h) North Pole North Temperate Tropics South Temperate South Pole RISING Height [km] 25 SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF

North Pole North Temperate Tropics South Temperate South Pole SETTING Number of events SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF

N (h) North Pole North Temperate Tropics South Temperate South Pole Height [km] 25 SETTING SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF

N (h) North Pole North Temperate Tropics South Temperate South Pole Height [km] 25 SETTING SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF

2 TEMPERATURE and Spec. Humidity LEVEL ROSA-ROSSA T RSA (h) ECMWF Re-analysis spatially and temporally co-located T ECM (h) DG_ATMO q RSA (h) q ECM (h) Validation considering Second Level Benchmarks (ECMWF Re-analysis)

Use the closest horizontal grid point (in the space-time) domain per each vertical level, this means reconstructing an ECMWF “slanted” vertical profile Interpolation of ECMWF and ROSA on a common vertical grid (100 m vertical resolution like the COSMIC one). 25 Pressure levels ECMWF data, 0.25 degree horizontal resolution DG_ATMO

SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF T(h)

SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF q(h)

2 ELECTRON DENSITY LEVEL ROSA-ROSSA Ne RSA (h) IONOGRAMS Ne true (h) DG_DELN Validation considering Second Level Benchmarks (ECMWF Re-analysis)

DG_DELN derived profiles are compared with ionosonde derived (bottomside) profiles. The distance between the Ionosonde location and the DG_DELN derived peak location has been chosen to be less than [2.5° x 2.5°] in [lat. x lon.] and 15 min in time. The ionograms have been selected and scaled by K. Alazo of the Instituto Geofisica y Astronomia, La Habana, Cuba in the framework of the STEP program of ICTP. DG_DELN

IONOSONDE SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF Ne(h)

DG_DELN IONOSONDE SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF Ne(h)

DG_DELN IONOSONDE SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF Ne(h)

DG_DELN IONOSONDE SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF Ne(h)

DG_DELN IONOSONDE SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF Ne(h)

DG_DELN IONOSONDE SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF Ne(h)

DG_DELN IONOSONDE SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF Ne(h)

DG_DELN IONOSONDE SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF Ne(h)

DG_DELN IONOSONDE SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF Ne(h)

DG_DELN IONOSONDE SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF Ne(h)

DG_DELN IONOSONDE SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF Ne(h)

DG_DELN IONOSONDE SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF Ne(h)

DG_DELN IONOSONDE SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF Ne(h)

DG_DELN IONOSONDE SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF Ne(h)

DG_DELN IONOSONDE SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF Ne(h)

DG_DELN IONOSONDE SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF Ne(h)

Statistic definition from Kursinsky et al., JGR1997

Mean + Std Mean - Std mean Statistic definition Outlier Identification through T- Student test (  3  threshold) and rejection

N (h) North Pole North Temperate Tropics South Temperate South Pole SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA

N (h) North Pole North Temperate Tropics South Temperate South Pole RISING Height [km] 25 SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF

N (h) North Pole North Temperate Tropics South Temperate South Pole Height [km] 25 SETTING SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF