1. evaluation aerosol CCI satellite retrievals MACC assimilations Reading 2012

2. the participants / the task AATSR F v142 AATSR O v202/v2q2 AATSR S v040/v031 MERIS A v21 MERIS B v11 MERIS E 802 PARASOL v30 MODIS_aqua c5.1 MODIS_terra c5.1 SEAWIFS MISR v31 FBOV  AOD (MODIS) FMNG  AOD & fine-fr evaluate for the year 2008 daily global AOD and Angstrom data of –aerosol-CCI retrievals –MACC assimilations compare to –AERONET / MAN –MODIS (AOD)

3. the scoring concept rescale all data to a common 1x1 lat/lon grid –establish 1x1 gridded AERONET daily data) identify local data pairs (satellite/model test data versus AERONET reference data) require 10+ days with 10+ sites (spatial test) or 10+ sites with 10+ temporal records (time test) to evaluate bias and correlation in any region both, a valid spatial score and a valid temporal score, are required for a valid regional score

4. scoring steps establish regional scores (1: best, 0: poor) –step1regional spatial score for each day (rank) correlation and (rank) bias –step2regional temporal score for each 1x1 (rank) correlation and (rank) biast –step3combined regional score total score = bias * spat.corr * temp.corr –step4combine regional to one global score ‘single score’ from regional total scores investigated properties: AOD550, Angstrom

5. error / bias evaluation explore –total error = (1 - |score, total |) –bias error= (1 - |score, bias |) –spatial error= (1 - score, space ) –temporal error= (1 - score, time ) score, total = score, bias * score, space * score, time –bias general direction ( + > test-data / - < test-data ) absolute bias (IQ test-data minus IQ reference) test vs AERONET:AOD, Angstrom test vs MODIS, terra:AOD

6. AOD scores vs AERONET global land ocean MODIS A/T.63.59.66 AATSR S v40-.60.63-.61 FMNG-.59-.54-.62 FBOV.57.55.59 AATSR O v202-.56-.56-.58 MISR.53.58.53 AATSR F v142-.52-.56-.53 AATSR S v31-.48-.56-.47 MERIS ESA 802.45.48 MERIS B v11.42.35.46 SEAWIFS-.41-.37-.45 PARASOL.64 MERIS A 21.49 based on a 10+ sample statistics absolute larger score is better +/- sign for overall bias

7. AOD score detail vs AERONET global land ocean FBOV –total score.57.55.59 –seasonal score.83.82.84 –bias score.84.86.84 –spatial score.82.77.84 FMNG –total score-.59 -.54-.62 –seasonal score.82.81.84 –bias score-.88 -.86-.91 –spatial score.81.77.81 10 + events

8. Angstrom scores vs AERONET global land ocean AATSR S v40.60.56.65 FBOV.56.55.55 FMNG.48-.49.48 AATSR S v31.52.47.57 AATSR F v142.47.51.47 AATSR O v202.41.38.43 MISR.38.43.37 MERIS ESA 802. 38.34.37 PARASOL.44 MERIS A 21.33 based on a 10+ sample statistics absolute larger score is better +/- sign for overall bias

9. ANG score detail vs AERONET global land ocean FBOV –total score.56.55.55 –seasonal score.82.80.82 –bias score.81.84.80 –spatial score.84.83.85 FMNG –total score.48 -.49.48 –seasonal score.73.73.72 –bias score.85 -.85.86 –spatial score.77.79.77 10 + events

10. assimilation data performance regional error assessment –vs AERONET AOD –vs MODIS-AOD –vs AERONET Angstrom

11. ECMWF AOD FBOV (single assim.) FMNG (dual assim.)

12. FBOV AOD performance total error –bias –spatial –temporal bias –tendency –absolute

13. FMNG AOD performance total error –bias –spatial –temporal bias –tendency –absolute

14. 2ass … minus … 1 ass  improvement deteriation 

15. FBOV AOD performance total error –bias –spatial –temporal bias –tendency –absolute

16. FMNG AOD performance total error –bias –spatial –temporal bias –tendency –absolute

17. 2ass … minus … 1 ass  improvement deteriation 

18. ECMWF Angstrom FBOV (single assim.) FMNG (dual assim.)

19. FBOV ANG performance total error –bias –spatial –temporal bias –tendency –absolute

20. FNMG ANG performance total error –bias –spatial –temporal bias –tendency –absolute

21. 2ass … minus … 1 ass  improvement deteriation 

22. satellite data performance regional error assessment –vs AERONET AOD –vs MODIS-AOD

23. the participants / the task AATSR F v142 AATSR O v202/v2q2 AATSR S v040/v031 MERIS A v21 MERIS B v11 MERIS E 802 PARASOL v30 MODIS_aqua c5.1 MODIS_terra c5.1 SEAWIFS MISR v31 evaluate daily global ‘CCI-aerosol’ retrievals –for the entire year 2008 AOD 550nm Angstrom (if offered) versus AERONET / MAN performance in context of established retrievals

24. data content AOD year 2008 MISR MODIS TERRA PARASOL MERIS-ESA MERIS-BAER MERIS-ALAMO ATSR-SU ATSR ORAC ATSR ADV

25. data volume AOD 1/1/2008 MODIS AQUA MISR PARASOL MERIS-ESA MERIS-BAER MERIS-ALAMO ATSR-SU ATSR ORAC ATSR ADV MODIS TERRA

26. MODIS TERRA AOD performance total error –bias –spatial –temporal bias –tendency –albsolute

27. MODIS AQUA AOD performance total error –bias –spatial –temporal bias –tendency –absolute

28. MISR AOD performance total error –bias –spatial –temporal bias –tendency –absolute

29. POLDER AOD performance total error –bias –spatial –temporal bias –tendency –absolute

30. MERIS ESA AOD performance total error –bias –spatial –temporal bias –tendency –absolute

31. MERIS BEAR AOD performance total error –bias –spatial –temporal bias –tendency –absolute

32. MERIS ALAMO AOD performance total error –bias –spatial –temporal bias –tendency –absolute

33. AATSR SU40 AOD performance total error –bias –spatial –temporal bias –tendency –absolute

34. AATSR SU31 AOD performance total error –bias –spatial –temporal bias –tendency –absolute

35. AATSR O202 AOD performance total error –bias –spatial –temporal bias –tendency –absolute

36. AATSR O202iq AOD performance total error –bias –spatial –temporal bias –tendency –absolute effectively ‘identical to O202

37. AATSR ADV142 AOD performance total error –bias –spatial –temporal bias –tendency –absolute

38. AATSR SU40 AOD performance total error –bias –spatial –temporal bias –tendency –absolute MODIS terra

39. AATSR O202 AOD performance total error –bias –spatial –temporal bias –tendency –absolute MODIS terra

40. AATSR ADV142 AOD performance total error –bias –spatial –temporal bias –tendency –absolute MODIS terra

41. POLDER AOD performance total error –bias –spatial –temporal bias –tendency –absolute

42. MERIS ESA AOD performance total error –bias –spatial –temporal bias –tendency –absolute

43. MERIS BEAR AOD performance total error –bias –spatial –temporal bias –tendency –absolute

44. MERIS ALAMO AOD performance total error –bias –spatial –temporal bias –tendency –absolute