Chess Review November 21, 2005 Berkeley, CA Edited and presented by Optimal Control of Stochastic Hybrid Systems Robin Raffard EECS Berkeley.

Slides:



Advertisements
Similar presentations
Chp.4 Lifetime Portfolio Selection Under Uncertainty
Advertisements

David Rosen Goals  Overview of some of the big ideas in autonomous systems  Theme: Dynamical and stochastic systems lie at the intersection of mathematics.
IEOR 4004: Introduction to Operations Research Deterministic Models January 22, 2014.
P. Venkataraman Mechanical Engineering P. Venkataraman Rochester Institute of Technology DETC2013 – 12269: Continuous Solution for Boundary Value Problems.
Who is Afraid of Black Scholes A Gentle Introduction to Quantitative Finance Day 2 July 12 th 13 th and 15 th 2013 UNIVERSIDAD NACIONAL MAYOR DE SAN MARCOS.
P. Venkataraman Mechanical Engineering P. Venkataraman Rochester Institute of Technology DETC2014 – 35148: Continuous Solution for Boundary Value Problems.
Decision Making: An Introduction 1. 2 Decision Making Decision Making is a process of choosing among two or more alternative courses of action for the.
Workshop on Stochastic Differential Equations and Statistical Inference for Markov Processes Day 1: January 19 th, Day 2: January 28 th Lahore University.
Presenter: Yufan Liu November 17th,
Pricing Derivative Financial Products: Linear Programming (LP) Formulation Donald C. Williams Doctoral Candidate Department of Computational and Applied.
Outline Formulation of Filtering Problem General Conditions for Filtering Equation Filtering Model for Reflecting Diffusions Wong-Zakai Approximation.
Chess Review November 21, 2005 Berkeley, CA Edited and presented by Trading Latency for Composability Slobodan Matic UC Berkeley.
Bruno Dupire Bloomberg LP CRFMS, UCSB Santa Barbara, April 26, 2007
Chess Review November 21, 2005 Berkeley, CA Edited and presented by Hybrid Geometric Mechanics: Reduction and Going Beyond Zeno Aaron D. Ames UC Berkeley.
Chess Review November 21, 2005 Berkeley, CA Edited and presented by A New Course in Hybrid and Embedded Systems Claire J. Tomlin UC Berkeley.
How to prepare yourself for a Quants job in the financial market?   Strong knowledge of option pricing theory (quantitative models for pricing and hedging)
Chess Review November 21, 2005 Berkeley, CA Edited and presented by Platform Based Design for Wireless Sensor Networks Alvise Bonivento UC Berkeley.
Chess Review May 10, 2004 Berkeley, CA A stability criterion for Stochastic Hybrid Systems A. Abate, L. Shi, S. Simic and S.S. Sastry University of California.
Stochastic Model of a Micro Agents population Dejan Milutinovic
Chess Review November 21, 2005 Berkeley, CA Edited and presented by Efficient Simulation Model for Hybrid Bond Graphs Christopher Beers ISIS, Vanderbilt.
Finding Genes based on Comparative Genomics Robin Raffard November, 30 th 2004 CS 374.
Efficient Methodologies for Reliability Based Design Optimization
Chess Review November 21, 2005 Berkeley, CA Edited and presented by Advances in Hybrid System Theory: Overview Claire J. Tomlin UC Berkeley.
Motivations In a deterministic setting: Difficult to assess global properties (stability, reachability) Model glitches: Zenoness De-abstaction is the solution?
Hybrid Systems: Model Identification and State Estimation Hamsa Balakrishnan, David Culler, Edward A. Lee, S. Shankar Sastry, Claire Tomlin (PI) University.
Scenario Generation for the Asset Allocation Problem Diana Roman Gautam Mitra EURO XXII Prague July 9, 2007.
Chess Review November 21, 2005 Berkeley, CA Edited and presented by Identity Management in Sensor Networks Hamsa Balakrishnan Stanford University.
NSF Foundations of Hybrid and Embedded Software Systems UC Berkeley: Chess Vanderbilt University: ISIS University of Memphis: MSI Program Review May 10,
1 Modeling and Simulating Networking Systems with Markov Processes Tools and Methods of Wide Applicability ? Jean-Yves Le Boudec
1 Solving problems by searching Chapter 3. 2 Why Search? To achieve goals or to maximize our utility we need to predict what the result of our actions.
Monte Carlo Methods in Partial Differential Equations.
Revenue Management under a Markov Chain Based Choice Model
Numerical methods for PDEs PDEs are mathematical models for –Physical Phenomena Heat transfer Wave motion.
13-1 Introduction to Quadratic Equations  CA Standards 14.0 and 21.0  Quadratic Equations in Standard Form.
Seth Weinberg Acknowledgements: Xiao Wang, Yan Hao, Gregory Smith
Hyunggyu Park 박 형 규 Starting … Active …. Hyunggyu Park 박 형 규 Starting … Active …
18th Inter-Institute Seminar, September 2011, Budapest, Hungary 1 J. Lógó, D. B. Merczel and L. Nagy Department of Structural Mechanics Budapest.
An Approach of Artificial Intelligence Application for Laboratory Tests Evaluation Ş.l.univ.dr.ing. Corina SĂVULESCU University of Piteşti.
Book Adaptive control -astrom and witten mark
MEIE811D Advanced Topics in Finance Optimum Consumption and Portfolio Rules in a Continuous-Time Model Yuna Rhee Seyong Park Robert C. Merton (1971) [Journal.
Derivative Financial Products Donald C. Williams Doctoral Candidate Department of Computational and Applied Mathematics, Rice University Thesis Advisors.
Computational Methods for Design Lecture 4 – Introduction to Sensitivities John A. Burns C enter for O ptimal D esign A nd C ontrol I nterdisciplinary.
Workshop on Stochastic Differential Equations and Statistical Inference for Markov Processes Day 3: Numerical Methods for Stochastic Differential.
Chp.5 Optimum Consumption and Portfolio Rules in a Continuous Time Model Hai Lin Department of Finance, Xiamen University.
Research Topics The Centre has a broad research base and is inherently interdisciplinary in its research agenda. The following themes identify our 5 main.
CERN – European Organization for Nuclear Research Administrative Support - Internet Development Services CET and the quest for optimal implementation and.
Dynamic Program Analysis with Partial Execution and Summary Thomas Huining Feng CHESS, UC Berkeley May 8, 2007 CS.
The Logistic Growth SDE. Motivation  In population biology the logistic growth model is one of the simplest models of population dynamics.  To begin.
TheoryApplication Discrete Continuous - - Stochastic differential equations - - Ito’s formula - - Derivation of the Black-Scholes equation - - Markov processes.
Chapter 61 Continuous Time Markov Chains Birth and Death Processes,Transition Probability Function, Kolmogorov Equations, Limiting Probabilities, Uniformization.
© K.Cuthbertson, D. Nitzsche FINANCIAL ENGINEERING: DERIVATIVES AND RISK MANAGEMENT (J. Wiley, 2001) K. Cuthbertson and D. Nitzsche Lecture Asset Price.
Theory of Computations III CS-6800 |SPRING
Uses of the 1 st Derivative – Word Problems.
Stochastic Methods in Mathematical Finance 15 September The Integrated Brownian Motion for the study of the atomic clock error Gianna Panfilo Istituto.
Monte-Carlo based Expertise A powerful Tool for System Evaluation & Optimization  Introduction  Features  System Performance.
Bayesian Brain: Probabilistic Approaches to Neural Coding Chapter 12: Optimal Control Theory Kenju Doya, Shin Ishii, Alexandre Pouget, and Rajesh P.N.Rao.
OSiL: An XML-based schema for stochastic programs H.I. Gassmann, R. Fourer, J. Ma, R.K. Martin SP XI Vienna, August 2007.
A study of simulated annealing variants Ana Pereira Polytechnic Institute of Braganca, Portugal Edite Fernandes University of Minho,
Parametric Quadratic Optimization Oleksandr Romanko Joint work with Alireza Ghaffari Hadigheh and Tamás Terlaky McMaster University January 19, 2004.
Applications of Stochastic Processes in Asset Price Modeling Preetam D’Souza.
FTCS Explicit Finite Difference Method for Evaluating European Options
Policy Gradient in Continuous Time
What is the future of applied mathematics? Chris Budd.
6.1: Antiderivatives and Indefinite Integrals
1.2 The Modeling Process.
Optimal Control and Reachability with Competing Inputs
Random WALK, BROWNIAN MOTION and SDEs
Biointelligence Laboratory, Seoul National University
Energy Resources Engineering Department Stanford University, CA, USA
Using Microsoft Excel to model a tennis match
Presentation transcript:

Chess Review November 21, 2005 Berkeley, CA Edited and presented by Optimal Control of Stochastic Hybrid Systems Robin Raffard EECS Berkeley

Chess Review, Nov. 21, 2005Control of Stochastic Hybrid Systems, Robin Raffard2 Introduction - Motivations: Present a new method for optimal control of Stochastic Hybrid Systems. More flexible than Hamilton-Jacobi, because handles more problem formulations. In implementation, up to dimension 4-5 in the continuous state.

Chess Review, Nov. 21, 2005Control of Stochastic Hybrid Systems, Robin Raffard3 Problem Formulation: standard Brownian motion. continuous state. Solves an SDE whose jumps are governed by the discrete state. discrete state: continuous time Markov chain. control.

Chess Review, Nov. 21, 2005Control of Stochastic Hybrid Systems, Robin Raffard4 Applications: Engineering: Maintain dynamical system in safe domain for maximum time. Systems biology: Parameter identification. Finance: Optimal portfolio selection

Chess Review, Nov. 21, 2005Control of Stochastic Hybrid Systems, Robin Raffard5 Method: 1 st step 1.Derive a PDE satisfied by the objective function in terms of the generator: Example 1: If then Example 2: If then

Chess Review, Nov. 21, 2005Control of Stochastic Hybrid Systems, Robin Raffard6 Method: 2.Rewrite original problem as deterministic PDE optimization program 3.Solve PDE optimization program using adjoint method Simple and robust…