School of something FACULTY OF OTHER “Complementary parameterization and forward solution method” Robert G Aykroyd University of Leeds,

Slides:



Advertisements
Similar presentations
CSCE643: Computer Vision Bayesian Tracking & Particle Filtering Jinxiang Chai Some slides from Stephen Roth.
Advertisements

METHODS FOR HAPLOTYPE RECONSTRUCTION
Electrical Resistance Tomography Quak Foo Lee Department of Chemical and Biological Engineering The University of British Columbia.
Bayesian statistics – MCMC techniques
Bayesian Image Super-resolution, Continued Lyndsey C. Pickup, David P. Capel, Stephen J. Roberts and Andrew Zisserman, Robotics Research Group, University.
Bayesian estimation Bayes’s theorem: prior, likelihood, posterior
CS 589 Information Risk Management 6 February 2007.
Motion Analysis (contd.) Slides are from RPI Registration Class.
CSci 6971: Image Registration Lecture 4: First Examples January 23, 2004 Prof. Chuck Stewart, RPI Dr. Luis Ibanez, Kitware Prof. Chuck Stewart, RPI Dr.
1/55 EF 507 QUANTITATIVE METHODS FOR ECONOMICS AND FINANCE FALL 2008 Chapter 10 Hypothesis Testing.
Effective gradient-free methods for inverse problems Jyri Leskinen FiDiPro DESIGN project.
Business Statistics: A Decision-Making Approach, 7e © 2008 Prentice-Hall, Inc. Chap 9-1 Business Statistics: A Decision-Making Approach 7 th Edition Chapter.
Business Statistics: A Decision-Making Approach, 6e © 2005 Prentice-Hall, Inc. Chap 8-1 Business Statistics: A Decision-Making Approach 6 th Edition Chapter.
End of Chapter 8 Neil Weisenfeld March 28, 2005.
Computer vision: models, learning and inference Chapter 10 Graphical Models.
The Calibration Process
Chemical Process Controls: PID control, part II Tuning
1 D r a f t Life Cycle Assessment A product-oriented method for sustainability analysis UNEP LCA Training Kit Module k – Uncertainty in LCA.
Image Analysis and Markov Random Fields (MRFs) Quanren Xiong.
Binary Variables (1) Coin flipping: heads=1, tails=0 Bernoulli Distribution.
Muhammad Moeen YaqoobPage 1 Moment-Matching Trackers for Difficult Targets Muhammad Moeen Yaqoob Supervisor: Professor Richard Vinter.
Chapter 10 Hypothesis Testing
Confidence Intervals and Hypothesis Testing - II
Introduction to MCMC and BUGS. Computational problems More parameters -> even more parameter combinations Exact computation and grid approximation become.
Priors, Normal Models, Computing Posteriors
Stochastic Algorithms Some of the fastest known algorithms for certain tasks rely on chance Stochastic/Randomized Algorithms Two common variations – Monte.
Prof. Dr. S. K. Bhattacharjee Department of Statistics University of Rajshahi.
1 Introduction to Hypothesis Testing. 2 What is a Hypothesis? A hypothesis is a claim A hypothesis is a claim (assumption) about a population parameter:
Lecture 7 Introduction to Hypothesis Testing. Lecture Goals After completing this lecture, you should be able to: Formulate null and alternative hypotheses.
SOES6002: Modelling in Environmental and Earth System Science Geophysical modelling Tim Henstock School of Ocean & Earth Science University of Southampton.
1 Lesson 8: Basic Monte Carlo integration We begin the 2 nd phase of our course: Study of general mathematics of MC We begin the 2 nd phase of our course:
CSC321: 2011 Introduction to Neural Networks and Machine Learning Lecture 11: Bayesian learning continued Geoffrey Hinton.
Bayesian Inversion of Stokes Profiles A.Asensio Ramos (IAC) M. J. Martínez González (LERMA) J. A. Rubiño Martín (IAC) Beaulieu Workshop ( Beaulieu sur.
Operated by Los Alamos National Security, LLC for the U.S. Department of Energy’s NNSA U N C L A S S I F I E D Slide 1 Practical Considerations for Analysis.
Mixture Models, Monte Carlo, Bayesian Updating and Dynamic Models Mike West Computing Science and Statistics, Vol. 24, pp , 1993.
Fast Simulators for Assessment and Propagation of Model Uncertainty* Jim Berger, M.J. Bayarri, German Molina June 20, 2001 SAMO 2001, Madrid *Project of.
Progress in identification of damping: Energy-based method with incomplete and noisy data Marco Prandina University of Liverpool.
Modal Analysis of Rigid Microphone Arrays using Boundary Elements Fabio Kaiser.
Image Modeling & Segmentation Aly Farag and Asem Ali Lecture #2.
Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 8-1 Chapter 8 Fundamentals of Hypothesis Testing: One-Sample Tests Statistics.
Chap 8-1 A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. A Course In Business Statistics 4 th Edition Chapter 8 Introduction to Hypothesis.
Experiences in assessing deposition model uncertainty and the consequences for policy application Rognvald I Smith Centre for Ecology and Hydrology, Edinburgh.
Sampling distributions rule of thumb…. Some important points about sample distributions… If we obtain a sample that meets the rules of thumb, then…
Optical Flow. Distribution of apparent velocities of movement of brightness pattern in an image.
Sampling and estimation Petter Mostad
Motion Estimation using Markov Random Fields Hrvoje Bogunović Image Processing Group Faculty of Electrical Engineering and Computing University of Zagreb.
Machine Learning 5. Parametric Methods.
1 Chapter 8: Model Inference and Averaging Presented by Hui Fang.
Introduction to Sampling Methods Qi Zhao Oct.27,2004.
CS Statistical Machine learning Lecture 25 Yuan (Alan) Qi Purdue CS Nov
GENERATION OF PARAMETRIC IMAGES PROSPECTS PROBLEMS Vesa Oikonen Turku PET Centre
Lecture 9: PID Controller.
Anders Nielsen Technical University of Denmark, DTU-Aqua Mark Maunder Inter-American Tropical Tuna Commission An Introduction.
NASSP Masters 5003F - Computational Astronomy Lecture 4: mostly about model fitting. The model is our estimate of the parent function. Let’s express.
Ch 1. Introduction Pattern Recognition and Machine Learning, C. M. Bishop, Updated by J.-H. Eom (2 nd round revision) Summarized by K.-I.
1 Life Cycle Assessment A product-oriented method for sustainability analysis UNEP LCA Training Kit Module k – Uncertainty in LCA.
Generalization Performance of Exchange Monte Carlo Method for Normal Mixture Models Kenji Nagata, Sumio Watanabe Tokyo Institute of Technology.
Biointelligence Laboratory, Seoul National University
Lesson 8: Basic Monte Carlo integration
T. E. Dyhoum1, D. Lesnic 1 and R. G. Aykroyd 2
The Calibration Process
Unfolding Problem: A Machine Learning Approach
More about Posterior Distributions
Filtering and State Estimation: Basic Concepts
Kristopher Innanen** and Arthur Weglein* *University of Houston
Where did we stop? The Bayes decision rule guarantees an optimal classification… … But it requires the knowledge of P(ci|x) (or p(x|ci) and P(ci)) We.
CHAPTER 12 STATISTICAL METHODS FOR OPTIMIZATION IN DISCRETE PROBLEMS
Unfolding with system identification
Bayesian Statistics on a Shoestring Assaf Oron, May 2008
Scalable light field coding using weighted binary images
Presentation transcript:

School of something FACULTY OF OTHER “Complementary parameterization and forward solution method” Robert G Aykroyd University of Leeds,

Introduction Image reconstruction and analysis Image problems are everywhere, for example: Geophysics Industrial process monitoring Medicine with an enormous range of modalities, for example: Electrical Magnetic Seismic 2

Introduction Ingredients of imaging problems Data collection style: Direct or projection Focused or blurred Low noise or high noise 3

Introduction Problem solution (by least squares) Inverse problems Well posed if: 1. A solution exists 2.The solution is unique 3.The solution depends continuously on the data otherwise it is an inverse problem. 4

Introduction Problem solution (regularized least squares) Standard image reconstruction aims to: Find a single solution Use smallest amount of regularization 5

Bayesian paradigm Equivalent statistical model 6

Bayesian paradigm Links between approaches: 7 So, what has been gained? Some new notation, vocabulary… A statistical interpretation… Confidence/credible intervals etc. Option of using other modelling and estimation approaches

Bayesian paradigm Ten good reasons: Flexible approach Driven by practical issues Different model parameterization options Wide choice of prior descriptions Alternative numerical methods Stochastic optimization Sampling approaches, e.g. Markov chain Monte Carlo Varied solution summaries Credible intervals Hypothesis testing Fun! 8

Case study: liquid mixing 9 Perspex cylinder: 14cm diameter 30cm high Three rings of 16 electrodes: 30mm high 6mm wide Here only bottom ring used and only alternate electrodes The reference electrode is earthed Contact impedances created on electrodes

Case study: liquid mixing 10 Aim: Given boundary voltages estimate interior conductivity pattern These are related by: This, forward, problem is very difficult requiring substantial numerical calculations Traditionally use pixel-based solvers, e.g. Finite element method Large numbers of elements lead to large computational burden but proven solvers available – e.g. EIDORS Still scope for novel prior models and output summary

Case study: liquid mixing 11 Other priors: contact impedances, flow movement etc. Prior models: Outputs: An image (plus contact impedances etc.)

Case study: liquid mixing 12 Prior knowledge: True conductivity distribution: Not smooth, piecewise constant Object and background Model as a binary object: Two conductivities Object grown around a centre Numerical methods: Still use mesh-based FEM (what about BEM?) Output: Centre and size — plus an image

Case study: liquid mixing 13 Posterior reconstructions though time

Case study: liquid mixing 14 Posterior estimates though time Conductivity contrastSize of object Centre

Case study: hydrocyclone 15 A hydrocyclone can be used to separate liquid-phase substances of differing densities, e.g. water and oil. Centrifuges the less dense material (water) to the outside, leaving the denser oil in the core Water and oil now separate entities and are removed from hydrocyclone If conditions on output purity are not met, the output is recycled to achieve optimum water/oil separation System may also intervene by changing input pressure to optimize separation effectiveness

Case study: hydrocyclone 16 Feed Overflow Underflow Model parameters Core centre Core size Electrical conductivity Ideal for boundary element method

Case study: hydrocyclone 17 True conductivity distribution Model parameters Core centre Core size Electrical conductivity BEM has few elements compared to FEM — hence fast and simple!

Case study: hydrocyclone 18 Centre: radius and angle Conductivity and size Image from posterior estimates

Case study: hydrocyclone 19 Conductivity and size Posterior credible regions Centre: radius and angle

Case study: hydrocyclone 20 Posterior credible regions for the boundary

Conclusions 21 Intelligent and flexible parameterisation Pixelization not always appropriate Incorporating a priori knowledge avoids solving full problem Dependence on regularization removed Regularization included in model, not inverse solution Further prior information can still be included Well-matched forward solver Exploiting parameterization Leads to faster and simpler algorithms

Conclusions 22 Final message: It is sometimes said that, “regularization introduces bias” — this is not a true statement! Remember, “all models are wrong” (GEP Box). Similarly, all regularization is wrong—then we might say that it is best to use the smallest amount of regularization possible… Alternatively, we can say that “all models are approximations” (T Tarpey), adding that all regularization introduces further approximation does not sound too bad? Using a good model and good regularization is better than using a bad model. Some models are useful... and some regularization is useful… but some combinations are more useful than others…

School of something FACULTY OF OTHER The End… Robert G Aykroyd University of Leeds,