Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.

Slides:



Advertisements
Similar presentations
National Aeronautics and Space Administration Jet Propulsion Laboratory California Institute of Technology Pasadena, California Challenges of Analyzing.
Advertisements

Chapter 13 – Weather Analysis and Forecasting
The National Climate Predictions and Projections (NCPP) Platform: Development of Capacity to Support Planning and Management NCPP Core Team Richard B.
Matthew Hendrickson, and Pascal Storck
A Web-based Community Approach to Model Evaluation using AMET Saravanan Arunachalam 1, Nathan Rice 2 and Pradeepa Vennam 1 1 Institute for the Environment.
Scientific Applications of the Regional Climate Model Evaluation System (RCMES) Paul C. Loikith, Duane E. Waliser, Chris Mattmann, Jinwon Kim, Huikyo Lee,
Tim Smyth and Jamie Shutler Assessment of analysis and forecast skill Assessment using satellite data.
Jinwon Kim and Paul Ramirez and RCMES Science and IT Teams led by Duane Waliser (JPL), Science Leader Chris Mattmann (JPL), IT Leader Regional Climate.
Excel: Pivot Tables Computer Information Technology Section 6-18.
National Aeronautics and Space Administration Jet Propulsion Laboratory California Institute of Technology Pasadena, California Facilitating Distributed.
NCAR GIS Program : Bridging Gaps
Detecting and Tracking of Mesoscale Oceanic Features in the Miami Isopycnic Circulation Ocean Model. Ramprasad Balasubramanian, Amit Tandon*, Bin John,
RCMES team at Jet Propulsion Laboratory
CLIMATE SCIENTISTS’ BIG CHALLENGE: REPRODUCIBILITY USING BIG DATA Kyo Lee, Chris Mattmann, and RCMES team Jet Propulsion Laboratory (JPL), Caltech.
The Regional Climate Model Evaluation System (RCMES): A Training Session Paul C. Loikith, Paul Ramirez, Huikyo Lee, and the RCMES Climate and Computer.
Duane Waliser Jet Propulsion Laboratory/Caltech & University of California, Los Angeles Chris Mattmann, Paul Loikith, Huikyo Lee, etc, JPL Jinwon Kim,
Office of Research and Development National Exposure Research Laboratory, Atmospheric Modeling Division, Applied Modeling Research Branch October 8, 2008.
NARCCAP Users' Workshop April 2012 Boulder, Colorado J. Kim 1, Waliser 2, C. Mattmann 2, L. Mearns 3, C. Goodale 2 A. Hart 2. Crichton 2, S. Mcginnis.
International Conference on Regional Climate – CORDEX 2013, 4-8 November 2013, Brussels, Belgium Systematic Biases in the CORDEX-Africa and NARCCAP Multi-RCM.
Coordinated Energy and water-cycle Observations Peroject A Well Organized Data Archive System Data Integrating/Archiving Center at University of Tokyo.
AIRNow Web Services Data to Go! Prepared by Steven A. Ludewig, Timothy S. Dye Sonoma Technology, Inc. Petaluma, CA John E. White U.S. Environmental Protection.
Introduction to Hands On Training in CORDEX South Asia Data Analysis
C. Mattmann 1, C. Goodale 1, J. Kim 2, D.E. Waliser 1,2, D. Crichton 1, A. Hart 1, P. Zimdars 1 and Peter Lean* The International Workshop on CORDEX-East.
NERC DataGrid Vocabulary Server Access Vocabulary Workshop, RAL, February 25, 2009.
Web Services for Earth Science Data Edward Armstrong, Thomas Huang, Charles Thompson, Nga Quach, Richard Kim, Zhangfan Xing Winter ESIP 2014 Washington.
Distributed Indexing of Web Scale Datasets for the Cloud {ikons, eangelou, Computing Systems Laboratory School of Electrical.
Climate data sets: introduction two perspectives: A. What varieties of data are available? B. What data helps you to identify...
Regional Climate Centers ACIS Update Keith Eggleston Northeast Regional Climate Center Cornell University.
Barcelona, 06 May 2015 s2dverification Seasonal to decadal forecast verification in R Overview Nicolau Manubens.
A Regional Climate Model Evaluation System: Facilitating the Use of Contemporary Satellite and Other Observations for Evaluating Regional Climate Model.
EÖTVÖS UNIVERSITY BUDAPEST Department of Physics of Complex Systems VO Spectroscopy Workshop, ESAC Spectrum Services 2007 László Dobos (ELTE)
NOAA RESEARCH EARTH SYSTEM RESEARCH LABORATORY PHYSICAL SCIENCES DIVISION NOAA Climate Change Web Portal James Scott, Michael Alexander, Don Murray, Dustin.
Understanding and Comparing Remote Sensing Data to Model Output Chris A. Mattmann Senior Computer Scientist, NASA Jet Propulsion Laboratory Adjunct Assistant.
Meteorological Data Analysis Urban, Regional Modeling and Analysis Section Division of Air Resources New York State Department of Environmental Conservation.
The Regional Climate Model Evaluation System (RCMES): Introduction and Demonstration Paul C. Loikith, Duane E. Waliser, Chris Mattmann, Jinwon Kim, Huikyo.
Justin Glisan Iowa State University Department of Geological and Atmospheric Sciences RACM Project Update: ISU Atmospheric Modeling Component: Part 1 3rd.
NQuery: A Network-enabled Data-based Query Tool for Multi-disciplinary Earth-science Datasets John R. Osborne.
Regional Climate Model Evaluation System based on satellite and other observations for application to CMIP/AR downscaling Peter Lean 1, Jinwon Kim 1,3,
A Computationally Efficient Platform to Examine the Efficacy of Regional Downscaling Methods AGU Fall Meeting Abstract GC12C-04 AGU Fall Meeting Abstract.
Python for: Data Science. Python  Python is an open source scripting language.  Developed by Guido Van Rossum in late 1980s  Named after Monty Python.
Interoperability = Leverage + Collaboration  Chris Lynnes  GES DISC.
National Aeronautics and Space Administration Jet Propulsion Laboratory California Institute of Technology Tropospheric Emission Spectrometer Studying.
CESD 1 SAGES Scottish Alliance for Geoscience, Environment & Society The challenges of geo-simulation data Centre For Earth System Dynamics
Data Storage System, Model Output and Analysis Tools PRECIS Workshop Tanzania Meteorological Agency 29 th June – 3 rd July 2015.
Research & Development Building a science foundation for sound environmental decisions Remote Sensing Information Gateway (RSIG)
Arctic terrestrial water storage changes from GRACE satellite estimates and a land surface hydrology model Fengge Su a Douglas E. Alsdorf b, C.K. Shum.
Exascale Climate Data ANalysis From the Inside Out Frédéric Laliberté Paul Kushner University of Toronto ExArch WP3.
Evaluating RCM Experiments PRECIS Workshop Tanzania Meteorological Agency, 29 th June – 3 rd July 2015.
WCRP Extremes Workshop Sept 2010 Detecting human influence on extreme daily temperature at regional scales Photo: F. Zwiers (Long-tailed Jaeger)
National Aeronautics and Space Administration Jet Propulsion Laboratory California Institute of Technology Pasadena, California Part of the AIST Framework.
Cal/Val for physics MED-MFC internal meeting CMCC-INGV-SOCIB Lecce E. Clementi, INGV.
Module 17 MM5: Climate Simulation BREAK. Regional Climate Simulation for the Pan-Arctic using MM5 William J. Gutowski, Jr., Helin Wei, Charles Vörösmarty,
Figure 3. Overview of system architecture for RCMES. A Regional Climate Model Evaluation System based on Satellite and other Observations Peter Lean 1.
CLIMATE GRAPHS. Temp In °C Precipitation In mm OTTAWA LABELS! CITY AT TOP TEMPERATURE ON LEFT IN °C PRECIPITATION ON RIGHT MONTHS ACROSS THE BOTTOM.
Testing of Objective Analysis of Precipitation Structures (Snowbands) using the NCAR Developmental Testbed Center (DTC) Model Evaluation Tools (MET) Software.
Times on Tuesday (Click the Speaker) A Brief Tutorial.
A41I-0105 Supporting Decadal and Regional Climate Prediction through NCAR’s EaSM Data Portal Doug Schuster and Steve Worley National Center for Atmospheric.
Verify WRF Forecast using MET
By: Samuel Oswald Hunter Supervisor: Mr Barry Irwin
REVIEW AND GOING FORWARD
Repository Cross-Linking
MERRA Data Access and Services
Remote Sensing ET Online Tool Ted W. Sammis1, Junming Wang1, Vince P
Phil Jones CRU, UEA, Norwich, UK
PREDICTING THE WEATHER
Where is this station/location?
Хайр ба хорсол love and hate
Research Data Archives at NCAR
Tour of NCL Website Modified by R. Grotjahn
Python for Data Analysis
Presentation transcript:

Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX workshop on Arctic climate modeling results and needs, March 20-21, 2012

Using Satellite & Other Observations For Regional Model Evaluation

We are building the Regional Climate Model Evaluation System (RCMES) RCMED and RCMET Caveats Certain parts of this tool are still in development Portions of the tool are difficult to install Things I hate love: NCL, PyNIO, PyNGL, matplotlib, scipy, numpy Good news We’re trying to make the tool easier to install – you’ll hear about this today We are building the tool as an open source system – if you want to contribute, you can!

We started with MySQL …and then broke it at 6B data points …and then federated it, and broke it again Then we experimented with Hadoop/HIVE Query times scaled with the amount of nodes we added Currently evaluating

The RCMED API: - Search the entire database - Space/Time box - Simple RESTful URL - Simple ASCII result format

Use web service from RCMED Regrid onto obs or model grid Seasonal, monthly or annual temporal compositing Perform metric (bias, RMSE, etc.) Output plot using NCAR NCL Bottle Python web services PHP Wizard Front End

Config A Centralized RCMED VM-based RCMET Config B Centralized RCMET and RCMED

ftp://ftp.cccma.ec.gc.ca/pub/yjiao/CanRCM4/ Worked with Melanie Cookie/Paul Kushner Compared Near-Surface Air Temperature with ERA 2 Metre Temp Selected time range: 2008/01/01 00: /02/01 00:00 Use Model grid Calculate time mean for full period. Bias: mean bias across full time range

[K]

Thank you! Contact information: Chris A. Mattmann – IT Duane Waliser – Science Jinwon Kim – Science