1. Joint OSSE data set at NASA Portal
DBL91 profile data for T511
Simulated prepbufr data
Simulated ozone data
Observation template data
Jack Woollen and Michiko Masutani
December 2009

2. Joint OSSE Nature Run data http://portal. nccs. nasa
Joint OSSE Nature Run data   Password protected
The complete data for T511NR and T799NR. Model level data and surface data are saved as a reduced gaussian grid.   Regular lat-lon grid data for pressure levels, isentropic levels and surface data are also provided for verification purposes.
For more detail visit:
Access to the complete data is available from the NASA/GSFC portal system:
Requires a user name and password.
Contact person Harper Pryor
Gradsdods access:
T511NR model resolution data are also available from the OPeNDAP server
Gradsdods access is available for T511 NR. The data can be down loaded  in grib1, NetCDF,  binary.  The data can be retrieved  globally or selected region. 
            Provide IP number to :Arlindo da Silva

3. Product from Joint OSSE team
This site is not password protected
Joint OSSE Data Usage and Credit This data must not be used for commercial purposes and redistribution rights are not given. Originating institutes must be given credit in any publications in which this data is used. If you are interested in using the data or need assistance please contact the originating institute. For more information about Joint OSSE and the data sets, please visit the Joint OSSE website (

4. NCEP-NESDIS data posted in December 2009
Dataset Originating Institute Contact
NCEP Obs NOAA/NCEP Michiko Masutani
NCEP-NESDIS NOAA/NCEP Michiko Masutani
NOAA/NESDIS
Subdirectories under each data set
NCEP-NESDIS
osbuvb.n_t511.v0906
prepbufr.n_t511.v0903
thinsats.n_t511.dbl91.v0909
NCEP_Obs
thinsats_rad.gdas.mask.v0909
thinsats_rad.gdas.v0905

5. NCEP-NESDIS
Simulated data from T511 Nature Run May2,2005-August31, 2005
osbuvb.n_t511.v0906 (BUFR)
Ozone data. More detail?
prepbufr.n_t511.v0903 (BUFR)
Conventional data which is included in prepbufr data at NCEP
thinsats.n_t511.dbl91.v0909
DBL91 data explained after slide 6
NCEP_Obs
thinsats_rad.gdas.mask.v0909 (BUFR)
Template file for DBL91. Foot print used by NCEPGDAS. QC info for each channel. Values 0 for unused channel
thinsats_rad.gdas.v0905
Template file for DBL91 with available Observed Brightness temperature.

6. Flexile Radiance data Simulation strategies at NCEP
Jack Woollen of NCEP developed more flexible strategies for data bases, nicknamed DBL91.This system consists of two data files per synoptic time.
DBL91(binary): These files contain all the relevant background and satellite location and geometry information needed for the radiance simulation. This includes NR surface, upper air, climatology interpolated to the thinned satellite observation locations reported in the operational GDAS “radstat” diagnostic files.
OBS-Template(BUFR): The program read the data base which contains information about observation including location. The radiance data records include a mask indicating which channel was assimilated in the operational GDAS.
Simulation of radiance requires only DBL 91. After radiance is simulated, OBS-Template supplies addition observation specific information to recreate the satellite BUFR files correctly with the simulated values installed, and, if desired, to mask out channels not used in the GDAS.
The first set of DBL91 was generated for existing satellite data used in Data are processed at foot print used by NCEP operational data assimilation. The mask for used and unused channel is included. AIRS, HIRS2, HIRS3, AMSUA, AMSUB, MSU, GOES are processed. OBS-template was generated in bufr format. This may be good enough for calibration and testing additional future observation.
When GMAO produces a set of data locations, that can also be used as a template to generate DBL91 based on the GMAO sampling. DBL91 can be generated for future observation as well, maintaining a consistent interface for the simulation programs being developed at NCEP. It is option whether DBL91 to be saved and exchange among various project, or DBL91 to be treated as temporary file produced in simulation process, depending on size of DBL91 compare to the Nature Run.

7. Running Simulation program (RTM)
Nature Run
(grib1 reduced Gaussian)
91 level 3-D data (12 Variables)
2-D data (71 Variables)
Climatological data
Observation template
Geometry
Location
Mask
Need complete NR (3.5TB)
Random access to grib1 data
Need Data Experts
Decoding grib1
Horizontal Interpolation
DBL91
Need large cpu
Need Radiation experts
Need Data Experts but this will be small program
Running Simulation program (RTM)
Post Processing (Add mask for channel, Packing to BUFR)
Simulated Radiance Data 7

8. DBL91
Experts for data handling and experts of RTM are different people.
Content of DBL91
Nature Run data at foot print
91 level 3-D data (12 Variables)
2-D data (71 Variables)
Climatological data
All information to simulate Radiances
DBL91
The DBL91 also used for development of RTM.
DBL91 can be processed for other sampling such as GMAO sampling
DBL91 can be processed for new observation
It is an option whether DBL91 to be saved and exchange among various project, or DBL91 to be treated as temporary file produced in simulation process. This depends on size of DBL91 compare to the Nature Run. 8

9. Possible template for radiance data
Sampling for template for Calibration
A. Foot print used by NCEP GDAS
B A with mask for channel
Let DAS to select channel
C Simple thinning 100km etc and simulate cloudy radiance
Let DAS to select foot print.
D. Sampling based on nature run cloud
GMAO can provide template file.
save undef or 0 for unused channel
does not have to run CRTM
Template for OSSE experiment
A. Instrument designer have to simulate foot print location using orbit generators
Sampling based on Nature Run has to be designed
This is major work to be performed by instrument designers 9

10. Application for DBL91 The DBL91 also used for development of RTM.
DBL91 can be processed for other sampling such as GMAO sampling
DBL91 can be processed for new observation
DWL91 with sampling based on GDAS usage will be posted from NASA portal.
In actual simulation, it is optional whether DBL91 to be saved and exchange among various project, or DBL91 to be treated as temporary file produced in simulation process. This depends on size of DBL91 compare to the Nature Run.

11. DBL91 file structure – information for simulating radstat satellites
Record used foot print and channel
BUFR
Observd radiance
NATURE RUN
Template file with TB (BUFR)
Thinsats_rad.gdas.v0905
Template file with QC (BUFR)
Thinsats_rad.gdas.mask.v0909
DWL91 (Binary)
Thinsats.n_t511.dbl91.v0909
Sat location and geometry
Surface type/veg from NCEP
Surface and 2D diagnostics quantities from NR
91 level upper air from NR
Complete BUFR report
Foot print used by NCEPGDAS
Available Observed Brightness temperature are saved including channel which was not used by GDAS
Complete BUFR report
Foot print used by NCEPGDAS
QC info for each channel. Values 0 for unused channel

12. Contents of DBL91 binary file
From BUFR satellite file
YEAR YEAR YEAR
MNTH MONTH MONTH
DAYS DAY DAY
HOUR HOUR HOUR
MINU MINUTE MINUTE
SECO SECOND SECOND
CLON DEGREES LONGITUDE
CLAT DEGREES LATITUDE
SAID CODE TABLE SAT IDENTIFIER
SIID CODE TABLE SAT INSTRUMENTS
FOVN NUMERIC BEAM POSITION
LSQL CODE TABLE LAND/SEA QUALIFIER
SAZA DEGREE SAT ZENITH ANGLE
SOZA DEGREE SOLAR ZENITH ANGLE
HOLS METER HEIGHT OF LAND SURFACE
HMSL METER HEIGHT OR ALTITUDE
These variable are sufficient for most of simulation. However further variable required for assimilation will be added from template file.
From NCEP Climatology
iv=27 ! low vegetation cover
iv=28 ! high vegetation cover
iv=29 ! low vegetation type
iv=30 ! high vegetation type

13. Vegetation type ECMWF vegetation types were saved in DBL91L
Convertion from 20 ECMWF surface type to CRTM surface type
DATA ecmwf_match2_crtm/ & 5 , & ! CROPS 10 , & ! SHORT GRASS 12 , & ! EVERGREEN NEEDLELEAF 12 , & ! DECIDUOUS NEEDLELEAF 11 , & !DECIDUOUS BROADLEAF 11 , & ! EVERGREEN BROADLEAF 20, & ! TALL GRASS 0 , & ! DESERT 13 , & ! TUNDRA 5 , & ! IRRIGATED CROPS 22 , & ! SEMIDESERT 24 , & ! ICE CAPS AND GLACIERS 20 , & ! BOGS AND MARSHES 0 , & ! INLAND WATER 0 , & ! OCEAN 10 , & ! EVERGREEN SHRUBS 10 , & ! DECIDUOUS SHRUBS 23, & ! MIXED FOREST / WOODLAND 23, & ! INTERRUPTED FOREST 0 / ! WATER AND LAND MIXTURES ! ! !
! ! ! The 24 surface types are: ! water old snow fresh snow ! compacted soil tilled soil sand ! rock irrigated low vegetation meadow grass ! scrub broadleaf forest pine forest ! tundra grass soil broadleaf pine forest ! grass scrub oil grass urban concrete ! pine brush broadleaf brush wet soil ! scrub soil broadleaf 70-pine new ice ! !
Written by Ron Vogel of NCEP

14. Surface quantities from Nature Run
Grib ID
Sea-ice cover [(0-1)]
Snow albedo [(0-1)]
Snow density [kg m**-3]
Sea surface temperature [K]
Snow evaporation [m of water]
Snowmelt [m of water]
Large-scale precipitation fraction [s]
Downward uv radiation at the surface [w m**-2 s]
Photosynthetically active radiation [w m**-2 s]
Convective available potential energy [J kg**-1]
Total column liquid water [kg m**-2]
Total column ice water [kg m**-2]
Geopotential [m**2 s**-2]
Total column water [kg m**-2]
Total column water vapour [kg m**-2]
NR 91 levels of: pres cloudcov cloudice cloudh2o ozone mmr temperature spfhumid

15. 141 16 Snow depth [m of water equivalent]
Stratiform precipitation [m]
Convective precipitation [m]
Snowfall (convective + stratiform) [m of water equ
Boundary layer dissipation [W m**-2 s]
Surface sensible heat flux [W m**-2 s]
Surface latent heat flux [W m**-2 s]
Charnock
Mean sea-level pressure [Pa]
Surface pressure {pa]
Boundary layer height [m]
Total cloud cover [(0 - 1)]
metre U wind component [m s**-1]
metre V wind component [m s**-1]
metre temperature [K]
metre dewpoint temperature [K]
Surface solar radiation downwards [W m**-2 s]
Land/sea mask [(0, 1)]
Surface thermal radiation downwards [W m**-2 s]
Surface solar radiation [W m**-2 s]
Surface thermal radiation [W m**-2 s]
Top solar radiation [W m**-2 s]
Top thermal radiation [W m**-2 s]
East/West surface stress [N m**-2 s]
North/South surface stress [N m**-2 s]

16. 182 41 Evaporation [m of water]
Low cloud cover [(0 - 1)]
Medium cloud cover [(0 - 1)]
High cloud cover [(0 - 1)]
Sunshine duration [s]
Lat. component of gravity wave stress [N m**-2 s]
Meridional component of gravity wave stress [N m**
Gravity wave dissipation [W m**-2 s]
Skin reservoir content [m of water]
Runoff [m]
Total column ozone [Dobson]
Top net solar radiation, clear sky [W m**-2]
Top net thermal radiation, clear sky [W m**-2]
Surface net solar radiation, clear sky [W m**-2]
Surface net thermal radiation, clear sky [W m**-2]
Skin temperature [K]
Temperature of snow layer [K]
Forecast albedo [(0 - 1)]
Forecast surface roughness [m]
Forecast log of surface roughness for heat

17. 91 level data Pressure (Pa) Cloud cover (0-1)
Cloud ice water content (kg/kg)
Cloud liquid water content (Kg/kg)
Ozone mass mixing ratio (kg/kg)
Temperature (K)
Specific Humidity (Kg/Kg)
91 levels are defined
Program to read DBL91 and list of surface data are posted from
Under “Data Distribution”

18. Simulation of HIRS3 radiance from NOAA16 from DBL91
CRTM posted from JCSDA web site was used for simulation
DBL 91 was generated at foot print used by NCEP GDAS
All information in GDAS bufr files are copied to simulated radiance file.
Channel which are not used by GDAS was marked in diag file. Masked out to generate masked radiance data.

19. Long wave Simulated where Channel 4 is used
Observed radiance where any channel is used
Long wave
Simulated where any channel is used

20. Radiance Data Simulation strategies at NCEP
Step 1. Thinning of radiance data based on real use
► GOES and SBUV are simulated as they are missing from GMAO dataset.
► Prepbufr is simulated based on CDAS prepqc distribution.
► AMSUA, AMSUB, GOES data have been simulated for entire T511 NR period.
► DBL91 for AMSUA, AMSUB, GOES, HIRS2, HIRS3, AIRS,MSU are generated at foot print used by NCEP operational analysis and will be posted from NASA portal.
► Some limited calibration and validation will be conducted by NCEP and NESDIS for their own use. However, users are expected to perform their own calibrations and validation.
Step 2. Simulation of radiance data using cloudy radiance
Cloudy radiance is still under development. Accuracy of GMAO data sampling will be between Step1 and Step2.