Adjoint based gradient calculation

Slides:



Advertisements
Similar presentations
1 -Classification: Internal Uncertainty in petroleum reservoirs.
Advertisements

A.M. Alonso, C. García-Martos, J. Rodríguez, M. J. Sánchez Seasonal dynamic factor model and bootstrap inference: Application to electricity market forecasting.
Evaluation of River Flood Regulation using Model Predictive Control K. U. LEUVEN Patrick Willems Toni Barjas Blanco P.K. Chiang Bart De Moor Jean Berlamont.
Asset Management Optimization using model based decision support Speaker: Francesco Verre SPE Dinner Meeting – 25 th October 2011 – London.
Pattern Recognition and Machine Learning
Dynamic Bayesian Networks (DBNs)
Nonlinear Optimization for Optimal Control
IAAC International Symposium in Systems & Control, 7-8 October 2013, Technion, Haifa, Israel P-O Gutman: Constrained control of uncertain linear time-invariant.
1 Finding good models for model-based control and optimization Paul Van den Hof Okko Bosgra Delft Center for Systems and Control 17 July 2007 Delft Center.
Energy Balance Analysis Reference Paper: Beard et al. Energy Balance for Analysis of Complex Metabolic Networks. Biophysical Journal 83, (2002) Presented.
Sensitivity Analysis for Complex Models Jeremy Oakley & Anthony O’Hagan University of Sheffield, UK.
A COMPUTER BASED TOOL FOR THE SIMULATION, INTEGRATED DESIGN, AND CONTROL OF WASTEWATER TREAMENT PROCESSES By P. Vega, F. Alawneh, L. González, M. Francisco,
Efficient Estimation of Emission Probabilities in profile HMM By Virpi Ahola et al Reviewed By Alok Datar.
Lecture 10 Comparison and Evaluation of Alternative System Designs.
Value of Information for Complex Economic Models Jeremy Oakley Department of Probability and Statistics, University of Sheffield. Paper available from.
Introducing Information into RM to Model Market Behavior INFORMS 6th RM and Pricing Conference, Columbia University, NY Darius Walczak June 5, 2006.
Slide 1 Tutorial: Optimal Learning in the Laboratory Sciences Working with nonlinear belief models December 10, 2014 Warren B. Powell Kris Reyes Si Chen.
6. Experimental Analysis Visible Boltzmann machine with higher-order potentials: Conditional random field (CRF): Exponential random graph model (ERGM):
1 Hybrid methods for solving large-scale parameter estimation problems Carlos A. Quintero 1 Miguel Argáez 1 Hector Klie 2 Leticia Velázquez 1 Mary Wheeler.
1 Coordinator MPC for maximization of plant throughput Elvira Marie B. Aske* &, Stig Strand & and Sigurd Skogestad* * Department of Chemical Engineering,
A Framework for Distributed Model Predictive Control
Modelling tutorial – ESCTAIC 2012 Stephen E. Rees Center for Model-based Medical Decision Support, Aalborg University, Denmark.
Slide 1 Tutorial: Optimal Learning in the Laboratory Sciences The knowledge gradient December 10, 2014 Warren B. Powell Kris Reyes Si Chen Princeton University.
Adaptive CSMA under the SINR Model: Fast convergence using the Bethe Approximation Krishna Jagannathan IIT Madras (Joint work with) Peruru Subrahmanya.
Paper review of ENGG*6140 Optimization Techniques Paper Review -- Interior-Point Methods for LP for LP Yanrong Hu Ce Yu Mar. 11, 2003.
Outline What Neural Networks are and why they are desirable Historical background Applications Strengths neural networks and advantages Status N.N and.
Optimal Power Flow: Closing the Loop over Corrupted Data André Teixeira, Henrik Sandberg, György Dán, and Karl H. Johansson ACCESS Linnaeus Centre, KTH.
© 2010 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other AT&T marks contained herein are trademarks of AT&T Intellectual.
Stochastic Multicast with Network Coding Ajay Gopinathan, Zongpeng Li Department of Computer Science University of Calgary ICDCS 2009, June , Montreal.
Fast Simulators for Assessment and Propagation of Model Uncertainty* Jim Berger, M.J. Bayarri, German Molina June 20, 2001 SAMO 2001, Madrid *Project of.
Managerial Economics Demand Estimation & Forecasting.
1 Markov Decision Processes Infinite Horizon Problems Alan Fern * * Based in part on slides by Craig Boutilier and Daniel Weld.
1 Markov Decision Processes Infinite Horizon Problems Alan Fern * * Based in part on slides by Craig Boutilier and Daniel Weld.
FastOpt Quantitative Design of Observational Networks M. Scholze, R. Giering, T. Kaminski, E. Koffi P. Rayner, and M. Voßbeck Future GHG observation WS,
A Software Framework for Distributed Services Michael M. McKerns and Michael A.G. Aivazis California Institute of Technology, Pasadena, CA Introduction.
Quality of model and Error Analysis in Variational Data Assimilation François-Xavier LE DIMET Victor SHUTYAEV Université Joseph Fourier+INRIA Projet IDOPT,
- 1 - Overall procedure of validation Calibration Validation Figure 12.4 Validation, calibration, and prediction (Oberkampf and Barone, 2004 ). Model accuracy.
Primbs1 Receding Horizon Control for Constrained Portfolio Optimization James A. Primbs Management Science and Engineering Stanford University (with Chang.
MPC in Statoil. 2 In-house tool Septic, Statoil Estimation and Prediction Tool for Identification and Control Developed and maintained by the process.
Chance Constrained Robust Energy Efficiency in Cognitive Radio Networks with Channel Uncertainty Yongjun Xu and Xiaohui Zhao College of Communication Engineering,
Mean Field Methods for Computer and Communication Systems Jean-Yves Le Boudec EPFL Network Science Workshop Hong Kong July
-- Interior-Point Methods for LP
Coordinator MPC with focus on maximizing throughput
Introducing Information into RM to Model Market Behavior INFORMS 6th RM and Pricing Conference, Columbia University, NY Darius Walczak June 5, 2006.
Lecture 7: Constrained Conditional Models
Bounded Nonlinear Optimization to Fit a Model of Acoustic Foams
Project Management Operations -- Prof. Juran.
Carnegie Mellon University
Problem statement: parametrized weak form
Module 11: File Structure
C. Kiekintveld et al., AAMAS 2009 (USC) Presented by Neal Gupta
Lecture 07: Soft-margin SVM
Adjoint modeling and applications
Reinforcement Learning in POMDPs Without Resets
Announcements HW4 due today (11:59pm) HW5 out today (due 11/17 11:59pm)
Two-level strategy Vertical decomposition Optimal process operation
Optimal control T. F. Edgar Spring 2012.
Jincong He, Louis Durlofsky, Pallav Sarma (Chevron ETC)
Ensemble variance loss in transport models:
CS5321 Numerical Optimization
Lecture 07: Soft-margin SVM
Assimilating Tropospheric Emission Spectrometer profiles in GEOS-Chem
MPC in Statoil Stig Strand, specialist MPC Statoil Research Center 93  SINTEF Automatic Control Dr. ing 1991: Dynamic Optimisation in State.
Linear Model Selection and regularization
Feifei Li, Ching Chang, George Kollios, Azer Bestavros
Energy Resources Engineering Department Stanford University, CA, USA
Backpropagation Disclaimer: This PPT is modified based on
Set-point Optimization in Refrigeration Systems -Minimization of Power Consumption Lars Sloth Larsen Central R&D-Refrigeration and Air Conditioning,
CS249: Neural Language Model
Constraints.
Presentation transcript:

Adjoint based gradient calculation - advantantages and challenges Bjarne Foss, Ruben Ringset The Norwegian University of Science & Technology – NTNU IO center Outline Motivation A simple example to illustrate the potential of adjoints Where are the hurdles? Conclusions

Motivation Model Norne field StatoilHydro Eni, Petoro Data

Motivation + now now time history Parameter estimation well schedule model simulator forecast for k=1 to N ...simulate(k) end + Optimize Let us take a look at some important workflows Uncertainty

Optimization requires a large number of gradient calculations Motivation Inlet separator Pipelines/tankers Market Reservoir Wells Pipelines Process Utilities Reservoir and well models (Eclipse) Network model (GAP, MaxPro, OLGA) Process model (HYSIS) Application Value chain optimization Optimization requires a large number of gradient calculations Efficient gradient computations are important

A simple example

A simple example

A simple example

The explicit Jacobian exists A simple example The explicit Jacobian exists

Adjoint gradient computation

Adjoint gradient computation Forward simulation

Adjoint gradient computation One forward simulation One reverse simulation

Forward method N forward simulations (nested loops)

The output constraint challenge – possible remedies Reducing the number of constraints Enforcing them on parts of a prediction horizon Lumping output constraints together One interesting application of this is found in the Standford GPRS reservoir simulator (Sarma et al, 2006)

The output constraint challenge The feasible cone for the lumped constraints will be at least as large as the true feasible cone given by the null space of the active constraints In GPRS they found a way to recover from such a situation by exploiting information about the structure of the model, in particular u->z

The output constraint challenge – possible remedies Reducing the number of constraints Enforcing them on parts of a prediction horizon Lumping output constraints together One interesting application of this is found in the Standford GPRS reservoir simulator (Sarma et al, 2006) Taking advantage of barrier or interior point optimization methods Removing output constraints without introducing slack variables Model constraints (i.e. equality constraints) can be removed by a single shooting method (in eg. MPC)

Adjoint based gradient calculation - advantantages and challenges Conclusions Adjoint based gradient calculation may give huge improvements in run-time Output constraints is a challenge

Once again - A very simple example Let Lagrangian function and assume that is the independent variable, i.e. Compute the gradient wrt Choose (”reverse simulation”)