Joint Center for Satellite Data Assimilation Overview of activities Lars Peter Riishojgaard, JCSDA Director Sid Boukabara, JCSDA Executive Deputy Director Jim Yoe, JCSDA Chief Administrative Officer NOAA Satellite Science Meeting March 21, 20131

Outline JCSDA Overview Background, structure, accomplishments Current activities Future plans Summary NOAA Satellite Science Meeting March 21, 20132

JCSDA Overview NOAA Satellite Science Meeting March 21, 20133

NASA/Earth Science Division US Navy/Oceanographer and Navigator of the Navy and NRL NOAA/NESDISNOAA/NWS NOAA/OAR US Air Force/Director of Weather Mission: …to accelerate and improve the quantitative use of research and operational satellite data in weather, ocean, climate and environmental analysis and prediction models. Vision: An interagency partnership working to become a world leader in applying satellite data and research to operational goals in environmental analysis and prediction JCSDA Partners, Vision, Mission NOAA Satellite Science Meeting March 21, 20134

NOAA Satellite Science Meeting JCSDA Science Priorities Radiative Transfer Modeling (CRTM) Preparation for assimilation of data from new instruments Clouds and precipitation Assimilation of land surface observations Assimilation of ocean surface observations Atmospheric composition; chemistry and aerosol Driving the activities of the Joint Center since 2001, approved by the Science Steering Committee Overarching goal: Help the operational services improve the quality of their prediction products via improved and accelerated use of satellite data and related research March 21, 20135

Executive Team Director (Riishojgaard) Deputy Director (Boukabara) Partner Associate Directors (Lapenta, Rienecker, Phoebus, Zapotocny, Benjamin) Chief Administrative Officer (Yoe) Management Oversight Board NOAA / NWS / NCEP (Uccellini) NASA/GSFC/Earth Sciences Division (Hildebrand) NOAA / NESDIS / STAR (Powell) NOAA / OAR (Atlas) Dept. of the Air Force / Air Force Director of Weather (Edwards) Dept.of the Navy / N84 and NRL (Chang, Curry) Agency Executives NASA, NOAA, Department of the Navy, and Department of the Air Force Advisory Panel Co-chairs: Jim Purdom, Tom Vonder Haar, CSU Science Steering Committee (Chair: Craig Bishop, NRL) JCSDA Management Structure NOAA Satellite Science Meeting March 21, 20136

JCSDA Mode of operation NOAA Satellite Science Meeting Directed research Carried out by the partners Mixture of appropriated and leveraged funding NOAA appropriation comes through NESDIS/STAR JCSDA plays a coordinating role External research Grants or contracts awarded to by one of the JCSDA parent agencies on a rotating basis Open to the broader research community Funding awarded competitively, based on peer-reviewed proposals Visiting Scientist program March 21, 20137

NOAA Satellite Science Meeting JCSDA accomplishments Common assimilation infrastructure (NOAA, GMAO, AFWA) Community radiative transfer model (all partners) Common NOAA/NASA land data assimilation system (NOAA, GSFC, AFWA) Numerous new satellite data assimilated operationally, e.g. MODIS (Winds and AOD), AIRS and IASI hyperspectral IR radiances, GPSRO sensors (COSMIC, GRAS, GRACE), SSMI/S, Windsat, Jason- 2,…) Advanced sensors tested for operational readiness, e.g. ASCAT, MLS, SEVIRI (radiances),… Ongoing methodology improvement for sensors already assimilated, e.g. AIRS, GPSRO, SSMI/S,… Improved physically based SST analysis Adjoint sensitivity diagnostics March 21, 20138

NOAA Satellite Science Meeting JCSDA accomplishments (II) OSSE capability in support of COSMIC-2, JPSS, GOES-R, Decadal Survey and other missions Comprehensive suite of data impact experiments for all major observing systems using NCEP GFS New supercomputer at GSFC (jointly funded by NASA and NOAA, installed and operated by NASA for the Joint Center) Part of NOAA/NESDIS-funded supercomputer (S4) located at UW Madison available for JCSDA investigators ATMS data assimilation capability (collaboration between EMC, NESDIS, NASA, JCSDA); implemented in operations on May March 21, 20139

Current Activities NOAA Satellite Science Meeting March 21,

JCSDA Computing Lack of JCSDA computing “major obstacle to success” (JCSDA Advisory Panel Jan 2009) Review of past JCSDA-funded external projects revealed lack of computer resources as significant limitation R2O requires O2R Research community needs access to operational codes and adequate computer resources in order to help Some resources available on NOAA R&D computer No projected growth for JCSDA NASA made initial investment in JCSDA supercomputer to address this problem IBM Linux cluster; 576 Intel Westmere processors Immediately augmented by NOAA (GOES-R) to 3456 processors Located at Goddard, operated by NCCS for the Joint Center NOAA/NESDIS provides scientific software support NOAA Satellite Science Meeting March 21,

Jibb (“Joint Center in a Big Box”) Total System Capabilities Compute – IBM iDataPlex 3,456 total cores; 37.8 TF Peak Computing 288 Compute Nodes Dual-socket, hex-core 2.8 GHz Intel Westmere with 24 GB of RAM Quad Data Rate Infiniband Network (32 Gbps) in a 2-to-1 blocking fabric Storage 8 IBM x3650 Storage Servers 2 IBM DS3512 Storage Subsystems 400 TB Total IBM GPFS File System Ancillary Nodes 2 Login Nodes 2 Management Nodes NOAA Satellite Science Meeting March 21,

Jibb (II) System first open to JCSDA users 01/2011 As of 08/2012 ~50 JCSDA users; many JCSDA applications have been ported on to this system GDAS porting completed late 2011; NCEP verified scientific integrity of forecast result (comparable to to forecasts run on NOAA R&D platform “vapor”) Hybrid DA system ported immediately after initial GDAS port Code management plan between NCEP and JCSDA under development to facilitate two-way code transfers (“R2O and O2R”) NOAA Satellite Science Meeting March 21,

R2O requires O2R In order to facilitate R2O, JCSDA has to make “operational” assimilation systems available to the research community GDAS/GFS ported to Jibb and S4, skill is benchmarked against NCEP operational platform and NOAA R&D machine Available to internal and external researchers Currently T-574 hybrid system being benchmarked on jibb and S4 NOAA Satellite Science Meeting March 21,

JCSDA/NCEP intercomparison VAPOR – NOAA R&D (Identical to NCEP Operations) S4 – JCSDA / NESDIS / UW Linux cluster JIBB – JCSDA / NASA Linux Cluster From Jung et al 2012, submitted as NESDIS Technical Report, pp 66 NOAA Satellite Science Meeting March 21,

500 hPa Anomaly Correlations 15 Aug – 30 Sep 2010 No Satellite / No Conventional Data Northern Hemisphere Southern Hemisphere Example of OSE diagnostics (J. Jung, 5 th WMO Impact Workshop, Sedona 2012) NOAA Satellite Science Meeting March 21,

Aim High…Fly, Fight, Win GSI-WRF Integration  Establish working GSI prototype on AFWA HPC Currently running on Dev 8 Producing a 48-hr forecast at 12Z cycle 6-hr init from 6Z cycle Full DA for 6Z and 12Z run  GSI based WRF initial satellite data assimilation Initially planned: COSMIC and AMSU-A -- completed Additionally added: HIRS3, HIRS4, AIRS – completed Actively working: IASI, WINDSAT, and ASCAT (expect inclusion before IOC) 17

Community Radiative Transfer Model (CRTM) Joint Center for Satellite Data Assimilation CRTM Mission Satellite radiance simulation and assimilation for passive MW, IR, and Visible sensors of NOAA,NASA,DoD satellites, and others(200 sensors) CRTM Applications Data assimilation in supporting of weather forecasting Physical retrieval algorithm for satellite products Stability and accuracy monitoring of satellite observations Education and Research: reanalysis, climate studies, air quality forecasting, and a radiative tool for students CRTM Future Development SBUV for ozone data, JPSS ATMS,CrIS,VIIRS,OMPS, GPM,Fy3,Studying feasibility of active sensors including Radar and Lidar space measurements Derber et al., 2007 Courtesy of Quanhua Liu, NESDIS/STAR

500 hPa geopotential height anomaly correction from 01/09/ /22/2008 Example of data impact study (CRTM v. 1 to v. 2 upgrade) NOAA Satellite Science Meeting New implementation meets basic “do no harm” criterion Large impact in the SH (more sensitive to satellite data) Courtesy of Fuzhong Weng, NESDIS/STAR March 21,

500hPa Forecast Geopotential Height 0 to 5 Day Anomaly Correlation Degradation from removal of PM orbit Degradation slightly mitigated by adding SSMIS (not significant) Northern Hemisphere (20°-80°N)Southern Hemisphere (20°-80°S) Southern Hemisphere is mostly neutral 15 Jan to 31 Mar 2012 (00Z cycles only) Control Degrade Mitigate Control Degrade Mitigate NOAA Satellite Science MeetingMarch 21,

Impact is not significant in northern hemisphere Marginally significant positive impact in southern hemisphere Impact of Assimilating SSMIS into Current Operational System 15 Jan to 30 Mar 2012 (00Z cycles only) Control Enhance Control Enhance Northern Hemisphere 500 hPa Geopotential Height Anomaly Correlation Southern Hemisphere 500 hPa Geopotential Height Anomaly Correlation NOAA Satellite Science MeetingMarch 21,

Summary of SSM/IS experiments Weakness of SSMIS from a data assimilation perspective:  Only microwave channels– No IR  Variable biases due to poor instrument design and/or build  Redundant information with other AM data Loss of all radiance data from PM satellite orbits will likely have a statistically significant negative impact on operational NOAA numerical guidance skill Assimilation of SSMIS observations mitigates a small (not statistically significant) fraction of the negative impact of removing all satellite radiances in the PM orbit SSMIS radiances can be used to improve (statistically significant for some variables) current day operational numerical weather prediction at NOAA after successful removal of calibration artifacts SSMIS will be considered for inclusion in the next operational upgrade (FY14) NOAA Satellite Science MeetingMarch 21,

NOAA Satellite Science Meeting Preparation for data from new sensors Goal is to have operational users ready to assess data from new sensors from day 1 assimilate data from new sensors within one year from launch Current activities include NPP (ATMS, CrIS, VIIRS, OMPS) in close collaboration with NESDIS/STAR, NCEP/EMC, NRL/FNMOC Aquarius SMAP GPM GOES-R (ABI, GLM) March 21,

March 21, 2013 NOAA Satellite Science Meeting 24 Proposal NumberTitleInstitutionPI 1 Radiative Transfer Modeling Support to the JCSDA (Applic. # ) Atmospheric & Environmental Research (AER) Jean-Luc Moncet, PI Vivianne Payne, Co-PI 22 Techniques for Assimilating Geostationary Lightning Mapper Data & Assessment of the Resulting Impact on Forecasts NOAA/National Severe Storms Lab. Don MacGorman, PI Edward Mansell, Co-PI Conrad Ziegler, Co-PI 11 Research in support of Radiance Assimilation of Clouds & PrecipitationUniversity of Wisconsin Tom Greenwald, PI Ralf Bennartz, Co-PI 3 Data Assimilation of Lighting in WRF 4-D VAR Using Observation Operators (Applic. # )Florida State Univ. Henry Fuelberg, PI I. Michael Navon, Co-PI 16 Utility of GOES-R Instruments for Hurricane Data Assimilation & ForecastingColorado State University Milija Zupanski, PI Louis Grasso, Co-PI Dusanka, Zupanski, Co-PI 4 Evaluation & Further Improvement of Land Surface Temperature… (Applic. # )Univ. of Arizona Xubin Zeng, PI Michael Barlage, PI Zhou Wang, Co-PI Fei Chen, Co-PI 14 CIMSS Participation in the Utility of GOES-R Instruments for Hurricane Data Assimilation & ForecastingUniversity of Wisconsin Jun Li, PI Milija Zupanski, PI Dusanska Zupanski, Co-PI Louis Grasso, Co-PI 10 MODIS & AVHRR-derived Polar Winds Experiments-using the NCEP GDAS/GFSUniversity of Wisconsin David Santek, PI James Jung, Co-PI GOES-R funded 2010 FFO Selection

Outreach to Other Testbeds, PGs JCSDA Annual Science Workshop Two or three day meeting taking place each May or June in the DC area Report progress in JCSDA funded projects and in-kind investigations by partners Joint/International Scientific Workshops ECMWF-JCSDA Workshop on Clouds and Precipitation, Reading June 2010 JCSDA-HFIP Workshop on Satellite Data Assimilation for Hurricane Forecasting Fifth WMO Workshop on the Impact of Various Observing Systems on NWP, May 2012 in Sedona, AZ, USA Upcoming Joint JCSDA/DTC GSI Tutorial & Workshops 1 st DTC-JCSDA GSI tutorial and science workshop, NCWCP, August 2013 JPSS and GOES-R interactions: Co-leveraging resources (IT, expertise, funding) to perform GOES-R, JPSS –related data assimilation activities (example of S4, FFO, JPSS data gap mitigation efforts, etc) NOAA Satellite Science Meeting March 21,

Future plans (I) Hyperspectral IR water vapor radiances in NCEP operations CrIS implementation (S-NPP and JPSS) GOES-R Better utilization of SATWINDs MetOp-B preparation SMAP GPM NOAA Satellite Science Meeting March 21,

Future Plans (II) Additional Impact Assessments (OSEs) Additional OSSEs New high-resolution Nature Run required External research announcement by NOAA in FY2013 New model for rotation of External Research Announcement Reviews complete and selection package in preparation Pursuing possibilities for updating JIBB/S4 to new high-resolution DA systems JCSDA Symposium at 2014 AMS Annual Meeting NOAA Satellite Science Meeting March 21,

Summary JCSDA activities have had clear impact on operational activities of all partners, including NWS/NCEP Joint systems and code (CRTM, LIS, GSI) Additional sensors (AIRS, MODIS, COSMIC, IASI, SSMI/S, ATMS) Ongoing improvements to assimilation methodology and diagnostics (observation operators, adjoint sensitivity) Major improvements in forecast skill result from adding large number of small improvements Increased collaboration both internally (between partners), nationally, and internationally Preparation for new sensors critical for NOAA and JCSDA partners NOAA Satellite Science Meeting March 21,