Datasets for evaluating climate models and their projections: Obs4MIPs Robert Ferraro Jet Propulsion Laboratory Presented at the CCI CMUG Fourth Integration.

Slides:



Advertisements
Similar presentations
2010 update of GCOS IP in support of UNFCCC Paul Mason and Stephan Bojinski GCOS Steering Committee September 2010.
Advertisements

Integrated Earth System Analysis Workshop Report Held November 2010, Baltimore MD Details at 2PM – POS Panel.
BG CRG‘s ESA CCI 4th integration meeting Exeter, UK.
CMIP5: Overview of the Coupled Model Intercomparison Project Phase 5
Preparing CMOR for CMIP6 and other WCRP Projects
An update on obs4MIPs A very brief review and status report of CMIP (a WGCM activity) Progress with obs4MIPs since.
Obs4MIPs: An Overview and Update Obs4MIPs Obs4MIPs is a pilot effort to improve the connection between data experts and scientists involved in climate.
Data Quality Screening Service Christopher Lynnes, Bruce Vollmer, Richard Strub, Thomas Hearty Goddard Earth Sciences Data and Information Sciences Center.
Ana4MIPS Update for WDAC3 Michael Bosilovich. Ana4MIPs Project Original Goal tracks Obs4MIPS – Repackage variables to conform to CMIP standard format.
On average TES exhibits a small positive bias in the middle and lower troposphere of less than 15% and a larger negative bias of up to 30% in the upper.
Integrated Earth Observations - Building the Bridges - IGOL Theme Team Meeting Sept 2004 Jeff Tschirley Chief, SDRN.
Global Climate Change Monitoring Ron Birk Director, Mission Integration, Northrop Grumman Member, Alliance for Earth Observations Responding to Emerging.
11-12 June 2015, Bari-Italy Coordinating an Observation Network of Networks EnCompassing saTellite and IN-situ to fill the Gaps in European Observations.
CEOS Plenary, Lucca, Italy, November 2011 CEOS Response to the Updated GCOS IP & Satellite Supplement Mitchell D. Goldberg CEOS Climate SBA Coordinator.
Determining the accuracy of MODIS Sea- Surface Temperatures – an Essential Climate Variable Peter J. Minnett & Robert H. Evans Meteorology and Physical.
PCMDI Facilitating the Use of Satellite Observations for Evaluating CMIP5/IPCC Simulations “Confronting Models with Observations” Robert Ferraro, Duane.
CEOS-CGMS Working Group on Climate John Bates, NOAA SIT-30 Agenda Item #11 Climate Monitoring, Research, and Services 30 th CEOS SIT Meeting CNES Headquarters,
Committee on Earth Observation Satellites John Bates Chair, Joint CEOS-CGMS Working Group on Climate 3 rd WCRP Data Advisory Committee.
(a selection of) Important data and modeling activities sponsored by WCRP in Major findings, recommendations and actions.
Components of the climate system, interactions, and changes (Source: IPCC AR4 WG1 Ch.1, FAQ 1.2, Figure 1)
Data Matters from Sessions 8, 9 and 11 WOAP-4 Task Group 1 Contributors: H Cattle, E Kent, J Key, T Koike, C Kummerow, M Manton, K Taylor, C von Savigny,
Slide: 1 27 th CEOS Plenary |Montréal | November 2013 Agenda item: 29 Adrian Simmons, Chair of the GCOS Steering Committee Update from the Global.
WGClimate John Bates NOAA SIT Workshop Agenda Item #8 WGClimate Work Plan progress & Issues CEOS SIT Technical Workshop CNES, Montpellier, France 17 th.
WCRP update WDAC3 Galway, Ireland, 6-7 May 2014 M. Rixen, WCRP JPS.
1 Some in situ data matters considered by AOPC From the Progress Report: “Developed Countries have improved many of their climate observation capabilities,
Inter-comparison and Validation Task Team Breakout discussion.
Joint WMO-IOC Technical Commission for Oceanography and Marine Meteorology Contributions to WIGOS David Meldrum, vice chair, JCOMM OPA.
Enhancing the Value of GRACE for Hydrology
Slide: 1 Osamu Ochiai Water SBA Coordinator The GEO Water Strategy Report – The CEOS Contribution Presentation to the 26 th CEOS Plenary at Bengaluru,
Translation to the New TCO Panel Beverly Law Prof. Global Change Forest Science Science Chair, AmeriFlux Network Oregon State University.
Reducing Canada's vulnerability to climate change - ESS J28 Earth Science for National Action on Climate Change Canada Water Accounts AET estimates for.
1 1 Scope of Climate Change Related Statistics Meeting on climate change related statistics for producers and users UNECE Task Force Geneva, Switzerland,
Innovative Program of Climate Change Projection for the 21st century (KAKUSHIN Program) Innovative Program of Climate Change Projection for the 21st century.
JCSDA Summer Colloquium Erica Dolinar 4 August 2015.
Modern Era Retrospective-analysis for Research and Applications: Introduction to NASA’s Modern Era Retrospective-analysis for Research and Applications:
Research Needs for Decadal to Centennial Climate Prediction: From observations to modelling Julia Slingo, Met Office, Exeter, UK & V. Ramaswamy. GFDL,
Introduction to CMUG assessments, SST and plans for phase 2 Roger Saunders 4 th Integration Meeting.
Data for Model Evaluations Karl E. Taylor Program for Climate Model Diagnosis and Intercomparison (PCMDI) Presented to the Fourth WCRP Observation and.
ISCCP at 30, April 2013 Backup Slides. ISCCP at 30, April 2013 NVAP-M Climate Monthly Average TPW Animation Less data before 1993.
SL BoG: Main topics 1.Summary of CCI Papers 2.Open Issues from previous meeting 3.Plans of CCI teams for the coming year 4.Obs4MIPs 5.CORE-CLIMAX 6.SAF-CCI.
Regional Climate Model Evaluation System based on satellite and other observations for application to CMIP/AR downscaling Peter Lean 1, Jinwon Kim 1,3,
WDAC background material for JSC34. Mission act as a single entry point for all WCRP data, information, and observation activities with its sister programmes,
WGISS and GEO Activities Kathy Fontaine NASA March 13, 2007 eGY Boulder, CO.
WCRP update and feedback CEOS-CGMS WG Climate EUMETSAT 5-7 March 2014 M. Rixen.
Ocean Analysis and Reanalysis: Phil Arkin, ESSIC, University of Maryland Background Concept and Implementation Issues.
Evapotranspiration Estimates over Canada based on Observed, GR2 and NARR forcings Korolevich, V., Fernandes, R., Wang, S., Simic, A., Gong, F. Natural.
An update on Obs4MIPs: Opportunities and requirements Peter J. Gleckler ESGF F2F Monterey, October 7-11, 2015.
Page 1 Andrew Lorenc WOAP 2006 © Crown copyright 2006 Andrew Lorenc Head of Data Assimilation & Ensembles Numerical Weather Prediction Met Office, UK Data.
Figure 3. Overview of system architecture for RCMES. A Regional Climate Model Evaluation System based on Satellite and other Observations Peter Lean 1.
WCRP Data Advisory Council May 6-7, 2014 Overview.
Paris, March 7, 2016 WDAC Paris, March 7, Mission act as a single entry point for all WCRP data, information, and observation activities with its.
May 27, 2014 National Central University, Jhongli, Taiwan Tsengdar Lee, Ph.D. With inputs from Duane Waliser, Karl Taylor, Veronika Eyring, Peter Gleckler.
The International Ocean Colour Coordinating Group International Network for Sensor Inter- comparison and Uncertainty assessment for Ocean Color Radiometry.
NOAA Council on Long-Term Climate Monitoring (CLTCM) Presentation to NOAA Science Advisory Board November 5 – 7, 2002 Chair: Tom Karl Executive Secretary:
Atmosphere Clouds Aerosols Ozone GHG Issues and remarks (synthesis after presentations and discussion)
Users Requirements The inconsistencies between the UR and GCOS-2006 identified in some of the URDs will be reduced with the new iteration of the GCOS.
In-situ Data and obs4MIPs
OOPC’s connections to WCRP
Update on obs4MIP (and ana4MIPs)
WMO Space Programme Update
Observing Climate Variability and Change
Committee on Earth Observation Satellites
WORLD CLIMATE RESEARCH PROGRAMME
CRG BoG: Main topics Consistency CCI data
Fourth International Workshop on Space-based Snowfall Measurement
Carbon Actions for WGCV
WCRP Data Advisory Council April 7, 2016 Overview
Task 5 : Supporting CCI Contributions to Obs4MIPs
The Global Observing System for Climate Carolin Richter, Director
Task Team for Intercomparison of ReAnalysis
Presentation transcript:

Datasets for evaluating climate models and their projections: Obs4MIPs Robert Ferraro Jet Propulsion Laboratory Presented at the CCI CMUG Fourth Integration Meeting Met Office, Exeter, 2-3 June 2014 Obs4MIPs Jet Propulsion Laboratory California Institute of Technology

Initial Sentiments Behind obs4MIPS Under-Exploited Observations for Model Evaluation How to bring as much observational scrutiny as possible to the CMIP/IPCC process? How to best utilize the wealth of satellite observations for the CMIP/IPCC process?

Model and Observation Overlap Where to Start? For what quantities are comparisons viable? Example: NASA – Current Missions ~14 Total Missions Flown ~ 60 Many with multiple instruments Most with multiple products (e.g s) Many cases with the same products Over 1000 satellite- derived quantities ~120 ocean ~60 land ~90 atmos ~50 cryosphere Over 300 Variables in (monthly) CMIP Database Taylor et al. 2008

1.Use the CMIP5 simulation protocol (Taylor et al. 2009) as guideline for selecting observations. 1.Observations to be formatted the same as CMIP Model output (e.g. NetCDF files, CF Convention) 2.Include a Technical Note for each variable describing observation and use for model evaluation (at graduate student level). 3.Hosted side by side on the ESGF with CMIP model output. obs4MIPs: The 4 Commandments Model Output Variables Satellite Retrieval Variables Target Quantities Modelers Observation Experts Analysis Community Initial Target Community

obs4MIPs “Technical Note” Content Intent of the Document Data Field Description Data Origin Validation and Uncertainty Estimate Considerations for use in Model Evaluation Instrument Overview References Revision History POC

Evolution and Status of obs4MIPs Pilot Phase - CMIP5 Initial protocols – variables, sources & documentation Compatibility with CMIP file formats and ESGF PCMDI Science & GSFC IT Workshops Identified and provided ~ 15 variables Expanding the Pilot Additional data types, sources, variables (e.g., CFMIP, CMUG, CEOS, reanalysis) Reconsidering the initial guidelines/boundaries Some partial oversight & governance: NASA+ Working Group  Planning Ahead – CMIP6 Identify additional data sources / remaining variable gap across Earth System Judicious/expanded model output considerations, including satellite simulators Increasing community input on objectives and on implementation contributions Broadening awareness & governance: WDAC obs4MIPs Task Team

obs4MIPs: Current Set of Observations CMIP Protocol VariablesData SourceTime PeriodComments ta, hus - Atm Temp, Specific HumidityAIRS (≥ 300 hPa)9/02 – 5/11 AIRS +MLS needed to cover all required pressure levels ta, hus - Atm Temp, Specific HumidityMLS ( < 300 hPa)8/ /10 2 x 5 degrees Lat-Lon AIRS +MLS needed to cover all required pressure levels tos - Sea Surface TemperatureAMSR-E6/ /10 rlut, rlutcs, rsdt, rsut, rsutcs - TOA outgoing LW & SW Radiation, Incident SW RadiationCERES3/00 - 6/11 rlds, rldscs, rlus, rsds, rsdscs, rsus, rsuscs - Surface down- and upwelling LW & SW RadiationCERES3/00 - 2/10 Some isolated inconsistent data values. An update is in progress. clt – Total Cloud FractionMODIS3/00 - 9/11 zos - Sea Surface Height Above GeoidTOPEX/JASON series10/ /10AVISO Product pr - Precip fluxTRMM1/ /12.25 x 2.5 degree, 50 N - 50 S Monthly Ave & 3 Hourly snapshots pr - Precip fluxGPCP1Oct Jul11Daily Ave pr - Precip fluxGPCP01/79 - 7/112.5 x 2.5 degree sfcWind, uas, vas - near surface windsQuikSCAT8/99 –10/09Oceans only, excluding sea ice regions. fpar - Fract Abs Photo Active RadiationMODIS2/ /09.5 x.5 degree, Not a CMIP5 variable lai - Leaf Area IndexMODIS2/ /09.5 x.5 degree tro3 – Mole Fract of Ozone TES (standard pressure levels) 7/ /09 2 x 2.5 degree Lat-Lon Some unresolved issues od550aer - AOD 550 nmMISR3/ /12 Over Land only some isolated inconsistent data values. od550aer - AOD 550 nmMODIS3/ /12 Over Ocean only some isolated inconsistent data values ua, va - near surface windsECMWF Reanalysis1/79 - 3/13.75 x.75 degrees tos - Sea Surface Temperature ARC SST (ATSR, AATSR) 1/ /11 clisccp ; albisccp ; cltisccp ; cttisccp ; pctisccpISCCP7/83 - 6/08 cfad2Lidarsr532 ; cfad2Lidarsr532 ; cfadLidarsr532 ; clrcalipso ; uncalipso ; clcalipso ; clccalipso ; clhcalipso ; cllcalipso ; clmcalipso ; cltcalipso CALIPSO6/ /10mon & day/night parasolRefl ; parasolRefl ; szaPARASOL3/ /08mon & day overpasses ; missingdatafraction ; cfadDbze94 ; cltcloudsatCloudSat6/ /12

(NASA datasets only) * “Unique” counts unique user ID downloads of a complete dataset, not individual files. Repeat downloads of the same dataset by the same user were counted only once. 119 unique* users from 16 countries 641 dataset downloads in obs4MIPs: Access Statistics As of Nov 2013 (NASA Datasets Only)

Evolution and Plans of obs4MIPs Pilot Phase - CMIP5 Initial protocols – variables, sources & documentation Compatibility with CMIP file formats and ESGF PCMDI Science & GSFC IT Workshops Identified and provided ~ 15 variables Expanding the Pilot Additional data types, sources, variables (e.g., CFMIP, CMUG, CEOS, reanalysis) Reconsidering the initial guidelines/boundaries Some partial oversight & governance: NASA+ Working Group  Present: Planning Ahead – CMIP6 Identify additional data sources / remaining variable gap across Earth System Judicious/expanded model output considerations, including satellite simulators Increasing community input on objectives and on implementation contributions Broadening awareness & governance: WDAC obs4MIPs Task Team  Future More synergistic feedbacks between model development/improvements and new mission/observation definitions and prioritization

obs4MIPs-CMIP6 Planning Meeting Apr 29 – May 1, 2014 WDAC Obs4MIPs Task Team Constituted under the auspices of the WCRP Data Advisory Council (WDAC) Established to “internationalize” NASA & DOE initiatives (obs4MIPS, ana4MIPS, etc.) Potential contributions from within and outside WCRP Users: from weather to climate, global to regional Challenge for obs4MIPs (and ESGF in general): adding flexibility beyond the “global climate model/data” initial standard Challenge for the Task Team – sort through the competing interests in the future direction of obs4MIPs, and provide guidance …

obs4MIPs - CMIP6 Planning Meeting April 29 - May 1, 2014 NASA Headquarters, 300 E Street SW, Washington, DC Obs4MIPs Jet Propulsion Laboratory California Institute of Technology Meeting Organizers Robert Ferraro, Duane Waliser – NASA Jet Propulsion Laboratory Peter Gleckler, Karl Taylor – Lawrence Livermore National Laboratory Veronika Eyring – German Aerospace Center

obs4MIPs-CMIP6 Planning Meeting Apr 29 – May 1, 2014 Obs4MIPs – CMIP6 Planning Meeting An opportune moment to consider how to coordinate osb4MIPs with the CMIP6 planning activities Over 90 experts in modeling or data products invited – 60 attended Meeting objectives: What’s working well so far? What’s not working? What’s missing (or can be done better)? Sessions covered the major elements of Earth System Models Atmospheric Composition & Radiation Atmospheric Physics Terrestrial Water & Energy Exchange, Land Cover/Use Carbon Cycle Oceanography & Cryosphere Special Topics

obs4MIPs-CMIP6 Planning Meeting Apr 29 – May 1, 2014 Obs4MIPs – CMIP6 Planning Meeting Report to be published on the obs4MIPs CoG site (soon..) Major findings – Expand the inventory Include higher frequency datasets, and higher frequency model output. Reliable and defendable error characterization/estimation of observations Include datasets in support of off-line simulators (aka observation proxies). Reanalysis serves many useful purposes, but reanalysis fields should not be used when observations are available. Inclusion of reanalysis fields in obs4MIPs should be done with considerable care and forethought. Collocated observations are particularly valuable for diagnosing certain processes. Consideration should be given to arranging for collocated datasets, including sparser in situ data, of known value to specific evaluations. Precise definitions of data products, including biases, and precise definitions of the model output variables are required.

obs4MIPs-CMIP6 Planning Meeting Apr 29 – May 1, 2014 Obs4MIPs – CMIP6 Planning Meeting Additional Recommendations (not consensus) – Relax the “model-equivalent” criteria for inclusion in obs4MIPs. Requiring averaging kernels for the retrieval observations. Evolve to address process diagnostics and model development, in addition to evaluation. Sparse In-Situ datasets – where to start, how far to go? Inclusion of more Satellite Simulators (aka Observation Proxies) in the CMIP experiments. No gatekeeping … Just format enforcement ….

obs4MIPs-CMIP6 Planning Meeting Apr 29 – May 1, 2014 Obs4MIPs – CMIP6 Planning Meeting Alignment with CMIP Model Output (& Used for Evaluation) No Requirem ent / No obvious near-term use for Evaluation Indirect or via complex processing steps Alignment via simulator or operational operator Alignment via simple steps e.g. ratio, column average Strict Alignment Evidence for Data Quality? None Significant No Influence from models Demonstrated via robust cal/val activity Subjective Objective error estimates Large Small error/uncertainties Demonstrated via N? uses in peer-reviewed literature WDAC Task Team to be charged with sorting this out ….

obs4MIPs-CMIP6 Planning Meeting Apr 29 – May 1, 2014 Conclusion Obs4MIPs is evolving under the guidance of the WDAC Task Team Looking forward to adding CCI datasets as they become available Many issues to sort out going forward … Find obs4MIPs at its new digs … Or Google “obs4MIPs”