J. Kim 1, D. Waliser 2, C. Mattmann 2, P. Ramirez 2, H. Lee 2, P. Loikith 2, M. Bounstani 2, C. Goodale 2, A. Hart 2, J. Sanjay 3, M.V.S. Rama Rao 3, R.

Slides:



Advertisements
Similar presentations
Improved CanSIPS Initialization from Offline CLASS Simulation and Data Assimilation Aaron Berg CanSISE Workshop.
Advertisements

Integrated Earth System Analysis Workshop Report Held November 2010, Baltimore MD Details at 2PM – POS Panel.
Scientific Applications of the Regional Climate Model Evaluation System (RCMES) Paul C. Loikith, Duane E. Waliser, Chris Mattmann, Jinwon Kim, Huikyo Lee,
Tim Smyth and Jamie Shutler Assessment of analysis and forecast skill Assessment using satellite data.
Scaling Laws, Scale Invariance, and Climate Prediction
TOA radiative flux diurnal cycle variability Patrick Taylor NASA Langley Research Center Climate Science Branch NEWS PI Meeting.
Task: (ECSK06) Regional downscaling Regional modelling with HadGEM3-RA driven by HadGEM2-AO projections National Institute of Meteorological Research (NIMR)/KMA.
Jiangfeng Wei Center for Ocean-Land-Atmosphere Studies Maryland, USA.
Mechanistic crop modelling and climate reanalysis Tom Osborne Crops and Climate Group Depts. of Meteorology & Agriculture University of Reading.
Jinwon Kim and Paul Ramirez and RCMES Science and IT Teams led by Duane Waliser (JPL), Science Leader Chris Mattmann (JPL), IT Leader Regional Climate.
Evaluation of diurnal scale precipitation and associated cloud and dynamical processes in observations and models over central India Presented by Malay.
Interannual Variability in Summer Hydroclimate over North America in CAM2.0 and NSIPP AMIP Simulations By Alfredo Ruiz–Barradas 1, and Sumant Nigam University.
Menglin Jin Department of Atmospheric & Oceanic Science University of Maryland, College park Observed Land Impacts on Clouds, Water Vapor, and Rainfall.
CLIMATE SCIENTISTS’ BIG CHALLENGE: REPRODUCIBILITY USING BIG DATA Kyo Lee, Chris Mattmann, and RCMES team Jet Propulsion Laboratory (JPL), Caltech.
The Regional Climate Model Evaluation System (RCMES): A Training Session Paul C. Loikith, Paul Ramirez, Huikyo Lee, and the RCMES Climate and Computer.
Duane Waliser Jet Propulsion Laboratory/Caltech & University of California, Los Angeles Chris Mattmann, Paul Loikith, Huikyo Lee, etc, JPL Jinwon Kim,
NARCCAP Users' Workshop April 2012 Boulder, Colorado J. Kim 1, Waliser 2, C. Mattmann 2, L. Mearns 3, C. Goodale 2 A. Hart 2. Crichton 2, S. Mcginnis.
NCPP – needs, process components, structure of scientific climate impacts study approach, etc.
International Conference on Regional Climate – CORDEX 2013, 4-8 November 2013, Brussels, Belgium Systematic Biases in the CORDEX-Africa and NARCCAP Multi-RCM.
Regional Climate Modeling in the Source Region of Yellow River with complex topography using the RegCM3: Model validation Pinhong Hui, Jianping Tang School.
Grigory Nikulin and Colin Jones Rossby Centre Swedish Meteorological and Hydrological Institute and CORDEX-Africa modeling groups Simulated precipitation.
© Crown copyright Met Office Climate Projections for West Africa Andrew Hartley, Met Office: PARCC national workshop on climate information and species.
Agriculture and Agri-Food Canada’s National Agroclimate Information Service’s Drought Monitoring Trevor Hadwen Agriculture and Agri-Food Canada, Agri-Environmental.
NARCCAP Users Meeting April 2011 Results from NCEP-driven RCMs Overview Based on Mearns et al. (BAMS, 2011) Results from NCEP-driven RCMs Overview Based.
Introduction to Hands On Training in CORDEX South Asia Data Analysis
C. Mattmann 1, C. Goodale 1, J. Kim 2, D.E. Waliser 1,2, D. Crichton 1, A. Hart 1, P. Zimdars 1 and Peter Lean* The International Workshop on CORDEX-East.
UMAC data callpage 1 of 11NLDAS EMC Operational Models North American Land Data Assimilation System (NLDAS) Michael Ek Land-Hydrology Team Leader Environmental.
GHP and Extremes. GHP SCIENCE ISSUES 1995 How do water and energy processes operate over different land areas? Sub-Issues include: What is the relative.
A Regional Climate Model Evaluation System: Facilitating the Use of Contemporary Satellite and Other Observations for Evaluating Regional Climate Model.
A Comparison of the Northern American Regional Reanalysis (NARR) to an Ensemble of Analyses Including CFSR Wesley Ebisuzaki 1, Fedor Mesinger 2, Li Zhang.
Evaluation of CMIP5 Simulated Clouds and TOA Radiation Budgets in the SMLs Using NASA Satellite Observations Erica K. Dolinar Xiquan Dong and Baike Xi.
International Centre for Integrated Mountain Development Validation of satellite rainfall estimation in the summer monsoon dominated area of the Hindu.
Synoptic variability of cloud and TOA radiative flux diurnal cycles Patrick Taylor NASA Langley Research Center Climate Science Branch
Regional Climate Simulations of summer precipitation over the United States and Mexico Kingtse Mo, Jae Schemm, Wayne Higgins, and H. K. Kim.
1 The Asian-Australian Monsoon System: Recent Evolution, Current Status and Prediction Update prepared by Climate Prediction Center / NCEP May 31, 2011.
Building Asian Climate Change Scenarios by Multi-Regional Climate Models Ensemble S. Wang, D. Lee, J. McGregor, W. Gutowski, K. Dairaku, X. Gao, S. Hong,
West African Monsoon Modeling and Evaluation (WAMME) Project Yongkang Xue, Bill Lau, Kerry Cook With contributions from many collaborators C20C Workshop.
How much do different land models matter for climate simulation? Jiangfeng Wei with support from Paul Dirmeyer, Zhichang Guo, Li Zhang, Vasu Misra, and.
Assessment of the Usefulness of Atmospheric Satellite Sounder-Based Cloud Retrievals for Climate Studies Gyula I. Molnar Joel.
The Regional Climate Model Evaluation System (RCMES): Introduction and Demonstration Paul C. Loikith, Duane E. Waliser, Chris Mattmann, Jinwon Kim, Huikyo.
Modern Era Retrospective-analysis for Research and Applications: Introduction to NASA’s Modern Era Retrospective-analysis for Research and Applications:
The Indian Monsoon A monsoon seasonal change is characterized by a variety of physical mechanisms which produce strong seasonal winds, a wet summer.
11 Predictability of Monsoons in CFS V. Krishnamurthy Center for Ocean-Land-Atmosphere Studies Institute of Global Environment and Society Calverton, MD.
Pg. 1 Using the NASA Land Information System for Improved Water Management and an Enhanced Famine Early Warning System Christa Peters-Lidard Chief, Hydrological.
ISCCP at 30, April 2013 Backup Slides. ISCCP at 30, April 2013 NVAP-M Climate Monthly Average TPW Animation Less data before 1993.
Status and Plans of the Global Precipitation Climatology Centre (GPCC) Bruno Rudolf, Tobias Fuchs and Udo Schneider (GPCC) Overview: Introduction to the.
Thomas R. Karl Director, National Climatic Data Center, NOAA Editor, Journal of Climate, Climatic Change & IPCC Climate Monitoring Panel Paul D. Try, Moderator.
Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.
A Preliminary Evaluation of the Global Water and Energy Budgets in an Upcoming NASA Reanalysis Junye Chen (1,2) and Michael G. Bosilovich (2) 1 ESSIC,
Regional Climate Model Evaluation System based on satellite and other observations for application to CMIP/AR downscaling Peter Lean 1, Jinwon Kim 1,3,
Yuying Zhang, Jim Boyle, and Steve Klein Program for Climate Model Diagnosis and Intercomparison Lawrence Livermore National Laboratory Jay Mace University.
NARCCAP Meeting September 2009 Results from NCEP-driven RCMs ~ Overview ~ Results from NCEP-driven RCMs ~ Overview ~ William J. Gutowski, Jr. & Raymond.
The NTU-GCM'S AMIP Simulation of the Precipitation over Taiwan Area Wen-Shung Kau 1, Yu-Jen Sue 1 and Chih-Hua Tsou 2 1 Department of Atmospheric Sciences.
Evaluating RCM Experiments PRECIS Workshop Tanzania Meteorological Agency, 29 th June – 3 rd July 2015.
ISCCP SO FAR (at 30) GOALS ►Facilitate "climate" research ►Determine cloud effects on radiation exchanges ►Determine cloud role in global water cycle ▬
A Brief Introduction to CRU, GHCN, NCEP2, CAM3.5 Yi-Chih Huang.
Role of Soil Moisture Coupling on the Surface Temperature Variability Over the Indian Subcontinent J. Sanjay M.V.S Rama Rao and R. Krishnan Centre for.
One-year re-forecast ensembles with CCSM3.0 using initial states for 1 January and 1 July in Model: CCSM3 is a coupled climate model with state-of-the-art.
Indo-Pacific Sea Surface Temperature Influences on Failed Consecutive Rainy Seasons over Eastern Africa** Andy Hoell 1 and Chris Funk 1,2 Contact:
Surface Net SW Radiation Latitude Clouds Albedo Source Reanalysis for
Figure 3. Overview of system architecture for RCMES. A Regional Climate Model Evaluation System based on Satellite and other Observations Peter Lean 1.
EVALUATION OF A GLOBAL PREDICTION SYSTEM: THE MISSISSIPPI RIVER BASIN AS A TEST CASE Nathalie Voisin, Andy W. Wood and Dennis P. Lettenmaier Civil and.
Consistent Earth System Data Records for Climate Research: Focus on Shortwave and Longwave Radiative Fluxes Rachel T. Pinker, Yingtao Ma and Eric Nussbaumer.
NAME SWG th Annual NOAA Climate Diagnostics and Prediction Workshop State College, Pennsylvania Oct. 28, 2005.
NOAA Northeast Regional Climate Center Dr. Lee Tryhorn NOAA Climate Literacy Workshop April 2010 NOAA Northeast Regional Climate.
1 The Asian-Australian Monsoon System: Recent Evolution, Current Status and Prediction Update prepared by Climate Prediction Center / NCEP 6 October 2008.
1 The Asian-Australian Monsoon System: Recent Evolution, Current Status and Prediction Update prepared by Climate Prediction Center / NCEP June 27, 2011.
A Brief Introduction to CRU, GHCN, NCEP2, CAM3.5
RCM workshop, Meteo Rwanda, Kigali
University of Washington Center for Science in the Earth System
Presentation transcript:

J. Kim 1, D. Waliser 2, C. Mattmann 2, P. Ramirez 2, H. Lee 2, P. Loikith 2, M. Bounstani 2, C. Goodale 2, A. Hart 2, J. Sanjay 3, M.V.S. Rama Rao 3, R. Krishnan 3, M. Mujumdar 3, S. Ingle 3 1 University of California Los Angeles 2 Jet Propulsion Laboratory/NASA 3 Center for Climate Change Research, Indian Institute of Tropical Meteorology

Introduction Precipitation is among the most important climate variables for the Indian subcontinent region. Water resources, natural disasters, agriculture, ecosystems. Evaluation of models' capability in simulating regional precipitation is a crucial part of the application of climate projections to local impact assessments. Sparse observation network in the mountainous regions can introduce significant uncertainties in the “observational” data against which model performance is measured. This study examines the observed and simulated precipitation over the Indian subcontinent, fundamental in applying the model results to climate change impact assessment. Uncertainties in the observational datasets Model performance in various parts of the Indian subcontinent.

Data Multiple observations are used for model evaluation CRU3.1: Raingauge-based gridded analysis, land surfaces, 0.5deg resolutions UDEL: Raingauge-based gridded analysis, land surfaces, 0.5deg resolutions TRMM: Satellite- and raingauge-based gridded analysis, 0.25deg resolutions GPCP: Satellite- and raingauge-based gridded analysis, 2.5deg resolutions Models Model simulations were performed by the IITM authors RCM3 with Emanuel or Grell convection scheme WRF3 with Betts-Miller-Janjic or Kain-Frisch scheme Evaluation period January 1998 – December 2006 (9 years) The period of evaluation is limited by the TRMM data (beginning) and the simulation period. Evaluation for a longer period using three observations (excluding TRMM) yields qualitatively similar results as the shorter one presented here.

Indian subdomain Domain and the Model Terrain: Model precipitation is evaluated over the Indian subcontinent part of the CORDEX-South Asia simulation domain using Regional Climate Model Evaluation System (RCMES).

Observed Annual-mean Precipitation Observational data are the key information for model evaluation. Wide variations amongst datasets, especially in the regions of complex terrain: northern India, Nepal, Bhutan, Tibetan Plateau, west coast of India (facing the Arabian Sea). The large disagreement amongst these observation data may originate from: the lack of observation stations in the northern mountain region coarse horizontal resolution (GPCP) Observation Ensemble % of Observation ensemble mean (mm/day) Observation ensemble mean

Spatial Variability of the Observed Annual-mean Precipitation Uncertainties in the observed spatial variability of the annual- mean precipitation due to different observation datasets are examined using the Taylor diagram. Compared against the ensemble of the four observation datasets: Magnitude of the spatial variability of individual datasets is similar ( ) The pattern correlation with the observation ensemble ranges UDEL data are the most noticeable outlier among the four observations.

Observed Precipitation Annual Cycle: Northern Mountains R06 R01 R04 R05 R01R04 R05 R06 Huge inter-dataset variations in the observed precipitation annual cycle over the northern mountain regions, especially the southern slope of the Hindu Kush Mountains.

Precipitation Annual Cycles: Northern Plains R07 R08 R03 R07 R08 Observations are much more consistent over the northern plains regions compared to the northern mountain regions. Still, their exist noticeable differences in the observed precipitation amongst datasets.

Observed Precipitation Annual Cycle: Southern India R09 R10 R09 R10 Inter-dataset variations in the observed precipitation annual cycle is also large, although not as large as over the northern mountain regions. The most noticeable inter-observation variation occurs in the early (June - Aug) monsoon season over the southwestern coastal mountain regions (R10). Similar problem also occurs for R09. For both regions, GPCP is the most serious outlier and overestimates precipitation throughout the year. May be a problem related with horizontal resolution

Observed Precipitation Data over the Indian Subcontinent Region There exist noticeable differences amongst ‘observed’ precipitation datasets that are popularly used in climate research. Observational uncertainties vary strongly according to regions and terrains. The largest observational uncertainties occur in the mountain regions The Himalayas and the Hindu Kush Mountains, Tibetan Plateau. Southwestern India with steep coastal terrain. Not shown, but observational uncertainties are larger for the Sept – February period than the March – August period Thus, observational uncertainties must be kept in mind when evaluating model precipitation in this region. Now, evaluate the RCM-simulated precipitation …

Annual-mean Precipitation Biases from the Observation Ensemble The simulated annual-mean precipitation is compared against the four-observation ensemble. The most noticeable model errors, both in terms of absolute amounts and relative to the climatological mean, occur in the region of steep terrain over the southern slope of the Himalayas and the Hindu Kush Mountains. The large errors in the northern mountain regions occur regardless of RCMs and convection schemes used in this study. Models generate large wet/dry biases over the Myanmar region. These model biases are not systematic (2 wet and 2 dry). Not clear if model performance vary systematically according to models and/or convection schemes. mm/day ensOBS

Models Observations Spatial Variability of the Simulated Annual-mean Precipitation All RCMs used in this study overestimate the observed spatial variability by 50% - 100% of the observation ensemble. Spatial pattern correlation between the simulated annual- mean precipitation and observation ensemble ranges from 0.6 to 0.8. Model ensemble outperforms individual models measured in terms of RMSE. Models and observations are clearly separated Observational uncertainties are large, but may not be crucial in model evaluation.

Precipitation Annual Cycle: Northern Mountains R01 R04 R05 R06 R04 R05R06 R01 No RCM nor the model ensemble show any skill in simulating precipitation annual cycle over the southern Hindu Kush regions. For other regions, a majority of models and the model ensemble generate correct phase of the observed annual cycle. The model ensemble performs better in the eastern Himalayas than in the western part.

Precipitation Annual Cycles: Northern Plains R02 R07 R08 R03 R07R08 R02 RCMs perform more consistently for these regions than for the northern mountain regions. Inter-model variability is still large Model ensemble performs well in the regions 3, 7, and 8. RCMs generally show better performance in wetter regions than drier regions.

Precipitation Annual Cycles: South-Central India R10 R09 R10 Similarly as other regions, inter-RCM variations are large in these regions. The model ensemble is also similar to the observation ensemble in both the phase and magnitude of the annual cycle.

Annual Cycle Evaluation – Summary for all subregions RCM performance varies widely among models and regions. Not very pronounced, but some regional structures exist: No models/model ensemble performs well for the arid NW India/SE Pakistan and the southern Hindu Kush Mountains (Kashmir). In terms of RMSE, models generally performs better for the NE (R06, R07, R08) and the SW (R09, R10) parts of the Indian subcontinent than for the NW part of the region. Overall, it is difficult to stratify model performance. The model ensemble shows better skill than individual models. R02 R04 R03 R05 R06 R10 R01 R07 R08 R09 Sub-regions within the domain

Summary RCMs' performance in simulating the annual-mean precipitation over the Indian subcontinent region has been examined using multiple observation datasets for January 1998 – December 2006 (9 years). TRMM, GPCP, CRU, UDEL 2 RCM3 runs using two different convection schemes (Emanuel, Grell) 2 WRF3 runs using two different convection schemes (Betts-Miller Janjic, Kain-Frisch) Uncertainties related with observation data can be large Spread among the observational data are large, especially in the mountainous regions, arid regions in the northwestern India/eastern Pakistan regions, and Tibetan Plateau. Model performance vary widely amongst regions: May not be able to expect useful skill in simulating the annual-mean precipitation in the southern Hindu Kush Mountains, west-central Himalayas (Nepal), and the northwestern India/eastern Pakistan regions. All RCMs also show substantial spread in all seasons for all regions. But the model ensemble may be useful for the plains and west coastal regions. The performance of RCM3 and WRF3 for the Indian subcontinent region is similar.

Works to Follow – Climate science component Interannual variability of monsoon precipitation: Onsets & terminations, and wet/dry monsoons (daily observation and model data). Radiation budget Biases in OLR and the warm-season convective precipitation, TOA radiation budget Hydrology cycle Precipitable water; Water vapor fluxes during the monsoon season, condensed hydrometeors. Extreme rainfall and heat episodes Daily model data, TRMM; Local gauge data(?) Drought conditions Identify and use the most suitable drought index for the region (soil moisture, precipitation) Surface fluxes Additional metrics

Characterization of temperature variability using Cluster analysis An example of future metrics under development More details are available from: Loikith et al., 2013, Geophysical Research Letters. Dr. Paul Loikith, JPL K-means clustering used to group the January surface temperature PDFs over the NARCCAP domain into 5 categories. (Top) Mean PDFs ofr each cluster. Shading indicates ±1 . Cluster assignments The red curve is the average of all PDFs shaded in red on map, etc. Cluster assignments primarily reflect variance, with some skewness Cluster analysis can provide a basis for identifying regions of common PDF morphology

P. Ramirez 1, D. Waliser 1, C. Mattmann 1, J. Kim 2, H. Lee 1, P. Loikith 1, M. Bounstani 1, C. Goodale 1, A. Hart 1, M. Joyce 1, S. Khudikyan 1, J. Sanjay 3, M.V.S. Rama Rao 3, R. Krishnan 3, M. Mujumdar 3, S. Ingle 3 1 Jet Propulsion Laboratory/NASA 2 University of California Los Angeles 3 Center for Climate Change Research, Indian Institute of Tropical Meteorology

RCMES Goals Deliver a software suite for facilitating the evaluation of regional climate models Bring NASA observational datasets to aid in RCM evaluation Free scientists to focus on their science, not data management Focus and enhance the evaluation workflow Download (Models, Observations), Preprocessing (Subsetting, Regridding), Evaluation (Statistical metrics), Visualization (Plot Results), Analysis and Interpretation (Scientist) Reduce the time and effort required to get to analysis and interpretation of results Collaborate with as many efforts as possible to improve adoption and reuse Support CORDEX community through collaborative science, software, and publications

RCMES Architecture ( Powered by Apache Open Climate Workbench ) Raw Data: Various sources, formats, Resolutions, Coverage RCMED (Regional Climate Model Evaluation Database) A large scalable database to store data from variety of sources in a common format RCMET (Regional Climate Model Evaluation Tool) A library of code for extracting data from RCMED and model and for calculating evaluation metrics Metadata Data Table Common Format, Native grid, Efficient architecture Common Format, Native grid, Efficient architecture Cloud Database Extractor for various data formats TRMM MODIS AIRS CERES ETC Soil moisture Extract OBS data Extract model data User input Regridder (Put the OBS & model data on the same time/space grid) Regridder (Put the OBS & model data on the same time/space grid) Analyzer Calculate evaluation metrics & assessment model input data Analyzer Calculate evaluation metrics & assessment model input data Visualizer (Plot the metrics) Visualizer (Plot the metrics) URL Use the re-gridded data for user’s own analyses and VIS. Data extractor (Binary or netCDF) Model data Other Data Centers (ESGF, DAAC, ExArch Network) Other Data Centers (ESGF, DAAC, ExArch Network) Assess. modeling

RCMES Workflow TRMM observations Bias Against URD URD gridded rain gauge obs. WRF model Bias Against TRMM Climate ModelObservational DataMetricsResults - Metrics calculation - Plotting/visualization (RCMED)(RCMET) - Spatial and temporal regridding for model to obs. Alignment - Subsetting, masking, and averaging

Demonstration Overview Command Line Walk through configuration and running of toolkit Show how to create all the plots you’ve seen Contour Map, Portrait Diagram, Taylor Diagram, XY Line Plot (Time Series) Demonstrate features and how to tailor an evaluation Show the different metrics available through the toolkit Create your own version by building on the code we have available Version shown today available at Browser Based (Web) UI Provide visual queues for model and observation overlap Assume as many defaults as possible History of evaluations to visit previous results and build new evaluations from Shared configuration with command line to provide seamless integration Screencast available for later viewing

Live Demonstration

Ongoing and Future Efforts Link to Earth System Grid Federation (ESGF) Import model data directly from ESGF for processing Made-to-order System Distribution of RCMES in a virtual machine packaged with python code and observation data as specified by users Data Processing and Metrics Multiple re-gridding routines for irregularly distributed data Improve handling of very large data sets by moving processing towards server Develop metrics for evaluating PDF characteristics (e.g. variance, skewness) Cluster analysis Reproducible Evaluations Expand configuration to capture evaluation information and metadata Allow import and export of configuration Expand on history functionality to support building off of an existing evaluation Collaborative Development through Open Source Leverage a well known open source software community and team expertise at Apache Software Foundation Apache Open Climate Workbench effort built on meritocracy (invite collaborators and retain relationship with CORDEX communities and students) Bring in other open source climate tools and link to other open source efforts across CORDEX and other climate communities (e.g. OpenClimateGIS, ESMPy)

Summary The Regional Climate Model Evaluation System (RCMES) was developed to facilitate model evaluation via easy access to key observational datasets especially from satellite and remote sensing data sets RCMES is being used in evaluation studies for several climate experiments including CORDEX SA (seen today), NARCCAP, and other CORDEX domains RCMES includes a growing number of metrics and plots useful for model evaluation and is continuously being improved The RCMES team is building collaborations by attending and working with the climate community through workshop and conferences, jointly developing and publishing evaluations, and openly developing climate tools RCMES is working to make material used in publications easy to produce and have fellow scientist reproduce

Contact Information RCMES Team Website – Mailing List – Latest Demo – Apache Open Climate Workbench Website – Mailing List – Project Proposal – Source Code – Issue Tracking – Documentation – Apache Software Foundation –

Backup Slides

RCMED Datasets: Satellite retrievals, Surface analysis, Reanalysis, Assimilations MODIS (satellite cloud fraction): [daily 2000 – 2010] TRMM (satellite precipitation): 3B42 [daily 1998– 2010]‏ AIRS (satellite surface + T & q profiles) [daily 2002 – 2010] CERES and GEWEX-SRB radiation – Surface and Top of the atmosphere NCEP CPC Rain Gauge analysis (gridded precipitation): [daily 1948 – 2010] CRU TS 3.1: precipitation, Tavg, Tmax, Tmin [monthly means, 1901 – 2006] University of Delaware precipitation and temperature analysis Snow Water Equivalent over Sierra Nevada Mts [monthly ] NASA MERRA Land Surface Assimilation & pressure-level data [daily, ] ERA-Interim (reanalysis): [daily 1989 – 2010] AVISO sea-level height [ ] (In progress) CloudSat atmospheric ice and liquid, Satellite-based snow (Himalayas), ISCCP cloud fraction, Fine-scale SST, etc. RCMET Metrics: Bias (e.g. seasonal means or variance) RMS error (e.g. interannual variability) Anomaly Correlation (spatial patterns of variability) PDFs (likelihoods, extremes and their changes) Taylor Plots & Portrait Diagrams (overall model performance) Statistical Tests User-defined regions (e.g. water shed, desert, sea, political) Datasets and metrics are continuously updated.