Fitting models to data. Step 5) Express the relationships mathematically in equations Step 6)Get values of parameters Determine what type of model you.

Slides:



Advertisements
Similar presentations
Modeling of Data. Basic Bayes theorem Bayes theorem relates the conditional probabilities of two events A, and B: A might be a hypothesis and B might.
Advertisements

Design of Experiments Lecture I
Slides from: Doug Gray, David Poole

Correlation and regression
1 Statistical Modeling  To develop predictive Models by using sophisticated statistical techniques on large databases.
FTP Biostatistics II Model parameter estimations: Confronting models with measurements.
Hazırlayan NEURAL NETWORKS Least Squares Estimation PROF. DR. YUSUF OYSAL.
6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.
CITS2401 Computer Analysis & Visualisation
Date:2011/06/08 吳昕澧 BOA: The Bayesian Optimization Algorithm.
Estimation of Distribution Algorithms Ata Kaban School of Computer Science The University of Birmingham.
Resampling techniques Why resampling? Jacknife Cross-validation Bootstrap Examples of application of bootstrap.
Chapter 10 Simple Regression.
Statistical Methods Chichang Jou Tamkang University.
Neural Networks Marco Loog.
End of Chapter 8 Neil Weisenfeld March 28, 2005.
Active Appearance Models Suppose we have a statistical appearance model –Trained from sets of examples How do we use it to interpret new images? Use an.
Chapter 11 Multiple Regression.
THE IDENTIFICATION PROBLEM
Physics 114: Lecture 15 Probability Tests & Linear Fitting Dale E. Gary NJIT Physics Department.
Inference for regression - Simple linear regression
CHAPTER 12 ADVANCED INTELLIGENT SYSTEMS © 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang.
Inductive learning Simplest form: learn a function from examples
COMP3503 Intro to Inductive Modeling
Evolving a Sigma-Pi Network as a Network Simulator by Justin Basilico.
Artificial Neural Networks (ANN). Output Y is 1 if at least two of the three inputs are equal to 1.
1 Local search and optimization Local search= use single current state and move to neighboring states. Advantages: –Use very little memory –Find often.
Data Mining Techniques in Stock Market Prediction
Cognitive Computer Vision Kingsley Sage and Hilary Buxton Prepared under ECVision Specific Action 8-3
5.2 Input Selection 5.3 Stopped Training
1 SUPPORT VECTOR MACHINES İsmail GÜNEŞ. 2 What is SVM? A new generation learning system. A new generation learning system. Based on recent advances in.
WB1440 Engineering Optimization – Concepts and Applications Engineering Optimization Concepts and Applications Fred van Keulen Matthijs Langelaar CLA H21.1.
McGraw-Hill/Irwin Copyright © 2007 by The McGraw-Hill Companies, Inc. All rights reserved. 1 Simulation.
Curve-Fitting Regression
Conceptual Modelling and Hypothesis Formation Research Methods CPE 401 / 6002 / 6003 Professor Will Zimmerman.
Applying Neural Networks Michael J. Watts
Lesson Multiple Regression Models. Objectives Obtain the correlation matrix Use technology to find a multiple regression equation Interpret the.
Multiple Regression Petter Mostad Review: Simple linear regression We define a model where are independent (normally distributed) with equal.
Mathematical Models & Optimization?
Neural Nets: Something you can use and something to think about Cris Koutsougeras What are Neural Nets What are they good for Pointers to some models and.
Warm Up. Any Questions on the Homework? Are we ok with solving complex equations?
Neural Networks Presented by M. Abbasi Course lecturer: Dr.Tohidkhah.
Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display. 1 Part 4 Chapter 15 General Least Squares and Non- Linear.
CSCI 121 Special Topics: Bayesian Networks Lecture #4: Learning in Bayes Nets.
Chapter 2-OPTIMIZATION G.Anuradha. Contents Derivative-based Optimization –Descent Methods –The Method of Steepest Descent –Classical Newton’s Method.
Nonlinear differential equation model for quantification of transcriptional regulation applied to microarray data of Saccharomyces cerevisiae Vu, T. T.,
Regression Analysis1. 2 INTRODUCTION TO EMPIRICAL MODELS LEAST SQUARES ESTIMATION OF THE PARAMETERS PROPERTIES OF THE LEAST SQUARES ESTIMATORS AND ESTIMATION.
Downscaling of European land use projections for the ALARM toolkit Joint work between UCL : Nicolas Dendoncker, Mark Rounsevell, Patrick Bogaert BioSS:
Neural Networks The Elements of Statistical Learning, Chapter 12 Presented by Nick Rizzolo.
Overfitting, Bias/Variance tradeoff. 2 Content of the presentation Bias and variance definitions Parameters that influence bias and variance Bias and.
Multiple Regression Reference: Chapter 18 of Statistics for Management and Economics, 7 th Edition, Gerald Keller. 1.
An Evolutionary Algorithm for Neural Network Learning using Direct Encoding Paul Batchis Department of Computer Science Rutgers University.
Modelling Complex Systems Video 4: A simple example in a complex way.
Introduction We consider the data of ~1800 phenotype measurements Each mouse has a given probability distribution of descending from one of 8 possible.
PSY 626: Bayesian Statistics for Psychological Science
Journal club Jun , Zhen.
Physics 114: Lecture 13 Probability Tests & Linear Fitting
Chapter 7. Classification and Prediction
Applying Neural Networks
Data Mining Lecture 11.
PSY 626: Bayesian Statistics for Psychological Science
Machine Learning Today: Reading: Maria Florina Balcan
1 Department of Engineering, 2 Department of Mathematics,
Bayesian Models in Machine Learning
Collaborative Filtering Matrix Factorization Approach
1 Department of Engineering, 2 Department of Mathematics,
1 Department of Engineering, 2 Department of Mathematics,
Boltzmann Machine (BM) (§6.4)
Product moment correlation
Presentation transcript:

Fitting models to data

Step 5) Express the relationships mathematically in equations Step 6)Get values of parameters Determine what type of model you will make - functional or mechanistic Use ”standard” equations if possible Analyse relationships with a statistical software

Approaches used for different types of mathematical models ApproachDerive data directly from measured data Derive data from scientific understanding Combined approach Type of modelDescriptive, functional Mechanistic, descriptive, non- functional Predictive, mechanistic, functional

Form of Equation Which techniques should be used to develop your mathematical model? Potential candidate equations known Unknown Known Complexity of system Not complex Complex Availability of data Extensive Limited Extensive Limited Statistical fitting Neural networks Bayesian statistics Parameter optimisation Cellular automata Simulated annealing Evolutionary algorithm

Form of equation: unknown. System: not complex. Data: Extensive Neural networks Input nodes ar set up, analogous to the neural nodes in the brain Through a iterative ”training” process different weights are given to the different connections in the network dent/weblinks/ch02/smith_smith_box2b.pdf

Potential candidated equations known Bayesian statistics (or Bayesian inference) Estimates the probability of different hypothesis (candidate models) instead of rejection of hypothesis which is the more common approach dent/weblinks/ch02/smith_smith_box2c.pdf

Form of equation: known. System: complex but can be simplified. Data: Limited Cellular automata For processes that have a spatial dimension (2D or 3D) Equations for the interaction between neighboring cells are fitted dent/weblinks/ch02/smith_smith_box2e.pdf

Form of equation: known. System: complex. Data: Extensive Simulated annealing Simulated annealing: used to locate a good approximation to the global optimum of a given function in a large search space The process is iterated until a satisfactory level of accuracy is achieved. dent/weblinks/ch02/smith_smith_box2f.pdf

Form of equation: known. System: complex. Data: Extensive Evolutionary algorithm Evolutionary algorithms: are similar to what is used in simulated annealing, but instead of mutating parameter values the rules themselves are altered. Fitness of the rule set is measured in terms of both how well the model fits the data, and how complex the model is. A simple model, which gives the same results as a complex one is preferable. dent/weblinks/ch02/smith_smith_box2f.pdf

Form of equation: known. System: not complex Parameter optimisation of known equations Example of curve fitting tools Excel - Only functions that can be solved analytically with least square methods Statistical software, e.g. SPSS Matlab Special curve fitting tools, e.g. TabelCurve Form of equation: unknown. System: not complex Statistical fitting

Additive or multiplicative functions Additive Y = f(A) + f(B)Y 0-1 If equal weight: f(A) 0-0.5, f(B) If f(A) = 0 and f(B) = 0 then y = 0 If f(A) = 0 and f(B) = 0.5 then y = 0.5 If f(A) = 0.5 and f(B) = 0 then y = 0.5 If f(A) = 0.5 and f(B) = 0.5 then y = 1 Multiplicative Y = f(A) × f(B)Y 0-1 If equal weight: f(A) 0-1, f(B) 0-1 If f(A) = 0 and f(B) = 0 then y = 0 If f(A) = 0 and f(B) = 1 then y = 0 If f(A) = 1 and f(B) = 0 then y = 0 If f(A) = 1 and f(B) = 1 then y = 1

Additive or multiplicative functions

Example - stepwise fitting of a multiplicative function Model of transpiration Lagergren and Lindroth 2002

Example - stepwise fitting of a multiplicative function Lagergren and Lindroth 2002 First try to find a theorethical base for the model (r)(r) (θ)(θ) (T)(T) (D VPD )

Example - stepwise fitting of a multiplicative function Envelope fitting of the first dependency (Alternately: Select a period when you expect no limitation from r, T or θ) Gives: g max and f(D VPD )

Example - stepwise fitting of a multiplicative function Select a period when you expect no limitation from T or θ

Example - stepwise fitting of a multiplicative function Select a period when you expect no limitation from θ

Example - stepwise fitting of a multiplicative function The remaining deviation should be explained by θ

Example - stepwise fitting of a multiplicative function The modelled was controlled by applying it for the callibration year And validated against a different year