Geocenter, Copenhagen 13-15 September 2007 Instructors: Mary C. Hill (US Geological Survey, USA) Matthew Tonkin (SS Papadopulos and Associates, USA) Calibration,

Slides:



Advertisements
Similar presentations
List of Nominations Connecting User Needs with Weather Research and Forecasts Rebecca E. Morss National Center for Atmospheric Research Boulder, Colorado,
Advertisements

Team 6 Lesson 3 Gary J Brumbelow Matt DeMonbrun Elias Lopez Rita Martin.
Model calibration using. Pag. 5/3/20152 PEST program.
February Offerred by: C.E. Brockway Brockway Engineering Jim Brannon Leonard Rice Engineers, Inc John Koreny HDR Inc Willem Schreuder Principia.
1 Annual Report by Work Group 2 on Uncertainty Analysis and Parameter Estimation Tom Nicholson, U.S. Nuclear Regulatory Commission Mary Hill, U.S. Geological.
Groundwater Flow Model of the Southern Willamette Valley Groundwater Management Area Jeremy Craner and Roy Haggerty Department of Geosciences.
Hydrological Modelling of Small Scale Processes in a Wetland Habitat O. M. JOHANSEN, J.B. JENSEN & M.L. PEDERSEN Aalborg University, Department of Civil.
Lowering the Barriers of Entry to Inverse Modeling: PEST++ Dave Welter, Computational Water Resource Engineering John Doherty, Watermark Numerical Computing.
Incorporation of Magnetic Resonance Sounding data into groundwater models through coupled and joint inversion 8th Annual Meeting of DWRIP 2014 JANUARY.
Gizem ALAGÖZ. Simulation optimization has received considerable attention from both simulation researchers and practitioners. Both continuous and discrete.
Funen County HarmoniRib Workshop, Sept 21, 2006 Bruxelles Accounting for uncertainty in water management: why and how do we Dirk-I. Müller-Wohlfeil Funen.
Final Project I. Calibration II.Drawdown Prediction III.Particle Tracking IV.Presentation of Results.
Schedule April 22, 24: Particle tracking and Profile Models (PS6). Work on Part III of Final Project. April 24: 30 min in-class, closed book quiz. April.
I DENTIFICATION OF main flow structures for highly CHANNELED FLOW IN FRACTURED MEDIA by solving the inverse problem R. Le Goc (1)(2), J.-R. de Dreuzy (1)
1 Working Group 2 Report: Uncertainty & Parameter Estimation Tom Nicholson, Co-Chair Mary Hill, Co-Chair Annual ISCMEM Public Meeting November 29, 2011.
Groundwater modeling using GIS technology
Interdisciplinary Modeling of Aquatic Ecosystems Curriculum Development Workshop July 18, 2005 Groundwater Flow and Transport Modeling Greg Pohll Division.
Hydrologic/Watershed Modeling Glenn Tootle, P.E. Department of Civil and Environmental Engineering University of Nevada, Las Vegas
Subsurface Hydrology Unsaturated Zone Hydrology Groundwater Hydrology (Hydrogeology )
Multi-Agency Radiological Laboratory Analytical Protocols Manual: MARLAP Presentation to the Radiation Advisory Committee/Science Advisory Board April.
Groundwater Hydraulics
An Efficient Reliability-Based Approach to Aquifer Remediation Design Howard W. Reeves U.S. Geological Survey Michigan District, Water Resources Discipline.
Quantify prediction uncertainty (Book, p ) Prediction standard deviations (Book, p. 180): A measure of prediction uncertainty Calculated by translating.
Uses of Modeling A model is designed to represent reality in such a way that the modeler can do one of several things: –Quickly estimate certain aspects.
What is UCODE_2005?. Model Calibration Trial and Error Data Model Output Model Design Boundary conditions Geometry Transmissivity Recharge “Intelligent”
MODFLOW – Introduction Organization & Main Packages
1 The Initial Report Preparation Guidelines. 2 The Initial Report u Definition of project scope u Project aims and objectives u Initial project plan.
Calibration Guidelines 1. Start simple, add complexity carefully 2. Use a broad range of information 3. Be well-posed & be comprehensive 4. Include diverse.
IV. Sensitivity Analysis for Initial Model 1. Sensitivities and how are they calculated 2. Fit-independent sensitivity-analysis statistics 3. Scaled sensitivities.
Uncertainty Analysis and Model “Validation” or Confidence Building.
Testing modeling frameworks or… how can we improve predictive skill from our data? Mary C. Hill, University of Kansas; Emeritus, U.S. Geological Survey.
Public Participation and the Advisory Committee Process A Collaborative Partnership For Water Resources Toni M. Johnson, Chief Water Information Coordination.
Identify Parameters Important to Predictions using PPR & Identify Existing Observation Locations Important to Predictions using OPR.
III. Ground-Water Management Problem Used for the Exercises.
Using Ground-Water Model Predictions and the ppr and opr Statistics to Guide Data Collection.
Overview of WEAP. Water Evaluation and Planning System WEAP A generic, object-oriented, programmable, integrated water resources management modelling.
Here you are at your computer, but you don’t have internet connections. Your ISP becomes your link to the internet. In order to get access you need to.
(Zheng and Bennett) Steps in Transport Modeling Calibration step (calibrate flow model & transport model) Adjust parameter values Traditional approach.
VI. Evaluate Model Fit Basic questions that modelers must address are: How well does the model fit the data? Do changes to a model, such as reparameterization,
Calibration Guidelines 1. Start simple, add complexity carefully 2. Use a broad range of information 3. Be well-posed & be comprehensive 4. Include diverse.
Modflow, GWVistas MODular three-dimensional finite- difference ground-water FLOW model
VIII: Methods for Evaluating Model Predictions 1. Define predictive quantity and calculate sensitivities and standard deviations (Ex8.1a) 2. Assess data.
A More Accurate and Powerful Tool for Managing Groundwater Resources and Predicting Land Subsidence: an application to Las Vegas Valley Zhang, Meijing.
Center for Radiative Shock Hydrodynamics Fall 2011 Review Assessment of predictive capability Derek Bingham 1.
StatisticSpelled outCalculated for each.. LeverageObs DSSDimensionless SSObs and parameter CSSComposite SSParameter PCCParam. Cor. Coef.Parameter pair.
3. Scale needed for numerical accuracy Even if the grid can closely reproduce features, accurate solution can require further refinement. Generally achievable.
Calibration Guidelines 1. Start simple, add complexity carefully 2. Use a broad range of information 3. Be well-posed & be comprehensive 4. Include diverse.
1 Introduction Description of the video series Meta-analysis in R with Metafor.
Integrated Ecological Assessment February 28, 2006 Long-Term Plan Annual Update Carl Fitz Recovery Model Development and.
Regional Integrated Science Projects - Opequon Creek/Shenandoah River Basins Agencies Involved – USGS Water, Geology, GIO/ Geography, and Biology Disciplines,
SUBCOMMITTEE ON HYDROLOGY Overall Goal – from purpose statement: “To improve the availability and reliability of (surface water) information needed for.
IX. Transient Model Nonlinear Regression and Statistical Analysis.
Modflow utilization for the Saharan aquifers management M. Zammouri September 2013.
Colleague Review GW Reports January Colleague Review of Ground-Water Reports n Mapping Reports n Ground-Water Modeling Reports n Geochemistry Reports.
Goal Oriented Hydrogeological Site Characterization: A Framework and Case Study in Contaminant Arrival Time Bradley Harken 1,2 Uwe Schneidewind 3 Thomas.
1-1 Copyright © 2014, 2011, and 2008 Pearson Education, Inc.
Calibration & Sensitivity Analysis. Head measured in an observation well is known as a target. Baseflow measurements or other fluxes (e.g., ET) are also.
1 Groundwater Modeling. 2 Introduction 3 Lecture Outline What Is A Model? Modeling Axioms Guiding Thoughts and Protocol Governing Equations Practical.
Using the Model to Evaluate Observation Locations and Parameter Information in the Context of Predictions.
Partition Calibration Strategy for A Fully- Coupled Hydrologic Model---PIHM Xuan Yu, Chris Duffy, Gopal Bhatt Anna Lamacova, Pavel Kram Civil & Environmental.
Conversion of river basin action plans into river basin management plans Conversion of river basin action plans into river basin management plans 9 th.
AUTOMATED PARAMETER ESTIMATION Model Parameterization, Inverse Modeling, PEST.
Ground Water Modeling Concepts
Chapter 6 Calibration and Application Process
Uses of Modeling A model is designed to represent reality in such a way that the modeler can do one of several things: Quickly estimate certain aspects.
Quarterly Journal of Engineering Geology and Hydrogeology
Monte Carlo Simulation
The Islamic University of Gaza Faculty of Engineering Civil Engineering Department Water Resources Msc. Tools for Water Resources Management ENGC 6037.
Accounting Discipline Overview
A Modeling Approach to Assess the Feasibility of Water Injection, Storage, and Recovery  ASR Recoverability Guidance Project Reinaldo E. Alcalde Dr. Charles.
Presentation transcript:

Geocenter, Copenhagen September 2007 Instructors: Mary C. Hill (US Geological Survey, USA) Matthew Tonkin (SS Papadopulos and Associates, USA) Calibration, Sensitivity Analysis and Uncertainty of Groundwater Models

These slides were developed for classes coordinated by Mary Hill or Claire Tiedeman since The slides are freely available from the web site for the text book by Hill and Tiedeman (2007, Wiley) at Contributors to the slides include Mary C. Hill Claire R. Tiedeman U.S. Richard L. Cooley (retired) Geological Edward Banta Survey Marshall Gannett D. Matthew Ely Arlen Harbaugh Howard Reeves Steffen Mehl (now at California State Univ, Chico) Evan Anderman, formerly Calibra Consultants, McDonald Morrissey Matt Tonkin, SS Papadopulos and Associates Gilbert Barth, SS Papadopulos and Associates Heidi Christensen Barlebo, GEUS Frank Smits, Dutch hydrologist Willem Jan Zaadnoordijk, Royal Haskoning, the Netherlands

Instructors Mary Hill – US Geological Survey, Boulder, CO, USA. Focus: Improve how we simulate ground-water systems and evaluate model uncertainty. Wrote MODFLOWP, PCG2 solver, co-author of, for example, MODFLOW-2000, HUF, UCODE_2005, MMA, OPR-PPR. BA, Geology and Business Administration, Hope College, Holland, MI. PhD, Water Resources, Civil Engineering, Princeton University Matt Tonkin – Hydrogeologist, SS Papadopulos & Assoc, Inc. PhD student, U. of Queensland, Australia Focus: Computationally efficient predictive analysis through regularized inversion Co-author – MOD-PREDICT, OPR-PPR Host – PEST technical support forum BA, Applied and Environmental Geology, Birmingham University, UK MS, Hydrogeology, Birmingham University, UK

You! Student introductions Name Your country and, briefly, major national ground-water problems Employer/school Experience in ground-water modeling inverse methods statistics Graphical interface experience/preference What do you want to obtain from this course? To what modeling project(s) do you plan to apply the methods?

Primary Documents Used in the Course Effective Groundwater Model Calibration, with Analysis of Data, Sensitivity, Predictions, and Uncertainty (Hill and Tiedeman, 2007, Wiley). Program Documentation for MODFLOW-2005, MODPATH, UCODE_2005, OPR-PPR, MMA, PEST For all programs, documentation PDF files are provided and also can be downloaded from the internet. Additional MODFLOW documentation can be found on:

Computer Software Parameter-estimation with UCODE_2005 Class provides much of the background needed to use MODFLOW- 2000, UCODE_2005, PEST, OSTRICH or any other inverse modeling code  MODFLOW USGS three-dimensional, transient, ground-water flow computer program.  UCODE-2005: - USGS Universal inverse modeling CODE - Constructed using the JUPITER API - Use with any model. - If used with perturbation sensitivities, consequences investigated by Hill and Østerby, 2003; Mehl and Hill, Parameter-estimation method expanded from that in MODFLOW  PEST – Parameter ESTimation software - Model independent like UCODE_ Includes additional very useful parameterization and regularization capabilities.

Perspective The methods and guidelines are broadly applicable, but taught using ground-water modeling examples. There are about as many opinions about how to construct and use models as there are people working with models. There are a number of ongoing methods to standardize ground- water model construction and use. For example, HarmoniQua (€5 million over 5 years), Germany, Australia, New Zeeland, USEPA, USGS, ASTM, …See review by Hill et al. (2004, conf. proceedings, FEM-MODFLOW) No set of methods and ideas is best in all circumstances, but we are hoping that by learning one set of methods and ideas, you will improve how you develop models, and be in a position to improvise using new ideas as you come across new, useful ideas.

Methods for sensitivity analysis, data assessment, model calibration, and evaluation of model uncertainty. These methods take advantage of the quantitative connections provided models between: observations – parameters - predictions Guidelines that describe how to use the methods presented, with emphasis on applications to ground-water models. Purpose of Course

Major steps of ground-water modeling Hydrologic and hydrogeologic data Relate to model inputs Dependent variable observations Relate to model outputs -- calibration Ground-Water Model -- parameters Predictions Prediction uncertainty Societal decisions

Major steps of ground-water modeling Hydrologic and hydrogeologic data Relate to model inputs Dependent variable observations Relate to model outputs -- calibration Ground-Water Model -- parameters Predictions Prediction uncertainty Societal decisions

We consider calibration with analysis of data, sensitivities, predictions, and uncertainty observations – parameters - predictions Estimate parameters with observations using a gradient-based method (versus global optimization). Gradient methods are much faster but can get stuck in local minima. Use sensitivity analysis to investigate relations between observations, parameters, and predictions.

Sensitivity analysis measures taught Observations – Parameters - Predictions dss pss css ppr pcc leverage Parameter cv AIC BIC DFBETAS Cook’s D opr Observations Predictions

Field and synthetic examples Field examples are used to demonstrate how the methods and guidelines are used in practice. –We begin the class with a study of the Death Valley regional ground-water system in California and Nevada, USA. A synthetic example is used to investigate the methods and guidelines in a situation for which the truth is known. –A synthetic test case with a model development phase followed by a predictions phase is developed over the length of the course.

Common questions that can be addressed by the methods taught here How much and what model complexity can the observations support? Are any of the estimated parameter values dominated by a single observation? What model parameters are important to the things I need to predict? What data should be collected to improve the predictions? Which conceptual model of the system is likely to produce better predictions? How certain are the predictions?