evaluation aerosol CCI satellite retrievals MACC assimilations Reading 2012

the participants / the task AATSR F v142 AATSR O v202/v2q2 AATSR S v040/v031 MERIS A v21 MERIS B v11 MERIS E 802 PARASOL v30 MODIS_aqua c5.1 MODIS_terra c5.1 SEAWIFS MISR v31 FBOV  AOD (MODIS) FMNG  AOD & fine-fr evaluate for the year 2008 daily global AOD and Angstrom data of –aerosol-CCI retrievals –MACC assimilations compare to –AERONET / MAN –MODIS (AOD)

the scoring concept rescale all data to a common 1x1 lat/lon grid –establish 1x1 gridded AERONET daily data) identify local data pairs (satellite/model test data versus AERONET reference data) require 10+ days with 10+ sites (spatial test) or 10+ sites with 10+ temporal records (time test) to evaluate bias and correlation in any region both, a valid spatial score and a valid temporal score, are required for a valid regional score

scoring steps establish regional scores (1: best, 0: poor) –step1regional spatial score for each day (rank) correlation and (rank) bias –step2regional temporal score for each 1x1 (rank) correlation and (rank) biast –step3combined regional score total score = bias * spat.corr * temp.corr –step4combine regional to one global score ‘single score’ from regional total scores investigated properties: AOD550, Angstrom

error / bias evaluation explore –total error = (1 - |score, total |) –bias error= (1 - |score, bias |) –spatial error= (1 - score, space ) –temporal error= (1 - score, time ) score, total = score, bias * score, space * score, time –bias general direction ( + > test-data / - < test-data ) absolute bias (IQ test-data minus IQ reference) test vs AERONET:AOD, Angstrom test vs MODIS, terra:AOD

AOD scores vs AERONET global land ocean MODIS A/T AATSR S v FMNG FBOV AATSR O v MISR AATSR F v AATSR S v MERIS ESA MERIS B v SEAWIFS PARASOL.64 MERIS A based on a 10+ sample statistics absolute larger score is better +/- sign for overall bias

AOD score detail vs AERONET global land ocean FBOV –total score –seasonal score –bias score –spatial score FMNG –total score –seasonal score –bias score –spatial score events

Angstrom scores vs AERONET global land ocean AATSR S v FBOV FMNG AATSR S v AATSR F v AATSR O v MISR MERIS ESA PARASOL.44 MERIS A based on a 10+ sample statistics absolute larger score is better +/- sign for overall bias

ANG score detail vs AERONET global land ocean FBOV –total score –seasonal score –bias score –spatial score FMNG –total score –seasonal score –bias score –spatial score events

assimilation data performance regional error assessment –vs AERONET AOD –vs MODIS-AOD –vs AERONET Angstrom

ECMWF AOD FBOV (single assim.) FMNG (dual assim.)

FBOV AOD performance total error –bias –spatial –temporal bias –tendency –absolute

FMNG AOD performance total error –bias –spatial –temporal bias –tendency –absolute

2ass … minus … 1 ass  improvement deteriation 

FBOV AOD performance total error –bias –spatial –temporal bias –tendency –absolute

FMNG AOD performance total error –bias –spatial –temporal bias –tendency –absolute

2ass … minus … 1 ass  improvement deteriation 

ECMWF Angstrom FBOV (single assim.) FMNG (dual assim.)

FBOV ANG performance total error –bias –spatial –temporal bias –tendency –absolute

FNMG ANG performance total error –bias –spatial –temporal bias –tendency –absolute

2ass … minus … 1 ass  improvement deteriation 

satellite data performance regional error assessment –vs AERONET AOD –vs MODIS-AOD

the participants / the task AATSR F v142 AATSR O v202/v2q2 AATSR S v040/v031 MERIS A v21 MERIS B v11 MERIS E 802 PARASOL v30 MODIS_aqua c5.1 MODIS_terra c5.1 SEAWIFS MISR v31 evaluate daily global ‘CCI-aerosol’ retrievals –for the entire year 2008 AOD 550nm Angstrom (if offered) versus AERONET / MAN performance in context of established retrievals

data content AOD year 2008 MISR MODIS TERRA PARASOL MERIS-ESA MERIS-BAER MERIS-ALAMO ATSR-SU ATSR ORAC ATSR ADV

data volume AOD 1/1/2008 MODIS AQUA MISR PARASOL MERIS-ESA MERIS-BAER MERIS-ALAMO ATSR-SU ATSR ORAC ATSR ADV MODIS TERRA

MODIS TERRA AOD performance total error –bias –spatial –temporal bias –tendency –albsolute

MODIS AQUA AOD performance total error –bias –spatial –temporal bias –tendency –absolute

MISR AOD performance total error –bias –spatial –temporal bias –tendency –absolute

POLDER AOD performance total error –bias –spatial –temporal bias –tendency –absolute

MERIS ESA AOD performance total error –bias –spatial –temporal bias –tendency –absolute

MERIS BEAR AOD performance total error –bias –spatial –temporal bias –tendency –absolute

MERIS ALAMO AOD performance total error –bias –spatial –temporal bias –tendency –absolute

AATSR SU40 AOD performance total error –bias –spatial –temporal bias –tendency –absolute

AATSR SU31 AOD performance total error –bias –spatial –temporal bias –tendency –absolute

AATSR O202 AOD performance total error –bias –spatial –temporal bias –tendency –absolute

AATSR O202iq AOD performance total error –bias –spatial –temporal bias –tendency –absolute effectively ‘identical to O202

AATSR ADV142 AOD performance total error –bias –spatial –temporal bias –tendency –absolute

AATSR SU40 AOD performance total error –bias –spatial –temporal bias –tendency –absolute MODIS terra

AATSR O202 AOD performance total error –bias –spatial –temporal bias –tendency –absolute MODIS terra

AATSR ADV142 AOD performance total error –bias –spatial –temporal bias –tendency –absolute MODIS terra

POLDER AOD performance total error –bias –spatial –temporal bias –tendency –absolute

MERIS ESA AOD performance total error –bias –spatial –temporal bias –tendency –absolute

MERIS BEAR AOD performance total error –bias –spatial –temporal bias –tendency –absolute

MERIS ALAMO AOD performance total error –bias –spatial –temporal bias –tendency –absolute