Detecting Parameter Redundancy in Complex Ecological Models Diana Cole and Byron Morgan University of Kent.

Slides:



Advertisements
Similar presentations
Ordinary Least-Squares
Advertisements

General Linear Model With correlated error terms  =  2 V ≠  2 I.
7.1Variable Notation.
Workshop on Parameter Redundancy Part II Diana Cole.
The Problem with Parameter Redundancy Diana Cole, University of Kent.
Detecting Parameter Redundancy in Ecological State-Space Models Diana Cole and Rachel McCrea National Centre for Statistical Ecology, University of Kent.
Parameter Redundancy and Identifiability in Ecological Models Diana Cole, University of Kent.
Localization of Piled Boxes by Means of the Hough Transform Dimitrios Katsoulas Institute for Pattern Recognition and Image Processing University of Freiburg.
Parameter Redundancy and Identifiability Diana Cole and Byron Morgan University of Kent Initial work supported by an EPSRC grant to the National Centre.
Maximum likelihood estimates What are they and why do we care? Relationship to AIC and other model selection criteria.
Estimation A major purpose of statistics is to estimate some characteristics of a population. Take a sample from the population under study and Compute.
Resampling techniques Why resampling? Jacknife Cross-validation Bootstrap Examples of application of bootstrap.
Statistics for Managers Using Microsoft® Excel 5th Edition
Parameter Redundancy in Ecological Models Diana Cole, University of Kent Byron Morgan, University of Kent Rachel McCrea, University of Kent Ben Hubbard,
Monthly Analysis of Teal Ring- Recovery Data Diana Cole, Takis Besbeas, and Byron Morgan.
Determining Parameter Redundancy of Multi-state Mark- Recapture Models for Sea Birds Diana Cole University of Kent.
Linear and generalised linear models
Linear and generalised linear models Purpose of linear models Least-squares solution for linear models Analysis of diagnostics Exponential family and generalised.
Matrix Mathematics in MATLAB and Excel
Classification and Prediction: Regression Analysis
2010 New Math Standards. Mathematical Practices 1. Attend to precision 2. Construct viable arguments and critique the reasoning of others 3. Make sense.
Today Wrap up of probability Vectors, Matrices. Calculus
Introduction Information in science, business, and mathematics is often organized into rows and columns to form rectangular arrays called “matrices” (plural.
Yuan Chen Advisor: Professor Paul Cuff. Introduction Goal: Remove reverberation of far-end input from near –end input by forming an estimation of the.
Properties of Logarithms
Algebra 2: Lesson 5 Using Matrices to Organize Data and Solve Problems.
Autumn 2008 EEE8013 Revision lecture 1 Ordinary Differential Equations.
Copyright 2006 Hal Caswell Applications of Markov chains in demography and population ecology Hal Caswell Biology Department Woods Hole Oceanographic Institution.
Algorithms for a large sparse nonlinear eigenvalue problem Yusaku Yamamoto Dept. of Computational Science & Engineering Nagoya University.
Adding individual random effects results in models that are no longer parameter redundant Diana Cole, University of Kent Rémi Choquet, Centre d'Ecologie.
Basics of Matrix Algebra The Roots are in the tricks and tribulations of solving linear equations Nethra Sambamoorthi, PhD.
Radicals Review 4 April Parts Coefficient Radical Sign Radicand – the number underneath the radical sign Radical Pronounced: 2 times the square.
Stochastic Linear Programming by Series of Monte-Carlo Estimators Leonidas SAKALAUSKAS Institute of Mathematics&Informatics Vilnius, Lithuania
Multinomial Distribution
Closed Vs. Open Population Models Mark L. Taper Department of Ecology Montana State University.
Detecting Parameter Redundancy in Integrated Population Models Diana Cole and Rachel McCrea National Centre for Statistical Ecology, School of Mathematics,
A Hybrid Symbolic-Numerical Method for Determining Model Structure Diana Cole, NCSE, University of Kent Rémi Choquet, Centre d'Ecologie Fonctionnelle et.
Solution of a Partial Differential Equations using the Method of Lines
Channel Independent Viterbi Algorithm (CIVA) for Blind Sequence Detection with Near MLSE Performance Xiaohua(Edward) Li State Univ. of New York at Binghamton.
Inverse of a Matrix Multiplicative Inverse of a Matrix For a square matrix A, the inverse is written A -1. When A is multiplied by A -1 the result is the.
ILC Main Linac Alignment Simulations John Dale 2009 Linear Collider Workshop of the Americas.
Estimating age-specific survival rates from historical ring-recovery data Diana J. Cole and Stephen N. Freeman Mallard Dawn Balmer (BTO) Sandwich Tern.
Advanced Engineering Mathematics, 7 th Edition Peter V. O’Neil © 2012 Cengage Learning Engineering. All Rights Reserved. CHAPTER 4 Series Solutions.
1 Chapter 4: Introduction to Predictive Modeling: Regressions 4.1 Introduction 4.2 Selecting Regression Inputs 4.3 Optimizing Regression Complexity 4.4.
Inverse Laplace Transforms (ILT)
Status of Reference Network Simulations John Dale ILC-CLIC LET Beam Dynamics Workshop 23 June 2009.
Optimization in Engineering Design 1 Introduction to Non-Linear Optimization.
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION EKF and Observability ASEN 5070 LECTURE 23 10/21/09.
Parameter Redundancy in Mark-Recapture and Ring-Recovery Models with Missing Data Diana Cole University of Kent.
Hongjie Zhu,Chao Zhang,Jianhua Lu Designing of Fountain Codes with Short Code-Length International Workshop on Signal Design and Its Applications in Communications,
Equations Inequalities = > 3 5(8) - 4 Numerical
Multistate models UF Outline  Description of the model  Data structure and types of analyses  Multistate with 2 and 3 states  Assumptions 
Capture-recapture Models for Open Populations “Single-age Models” 6.13 UF-2015.
Spatially Explicit Capture-recapture Models for Density Estimation 5.11 UF-2015.
Matrix Population Models for Wildlife Conservation and Management 27 February - 5 March 2016 Jean-Dominique LEBRETON Jim NICHOLS Madan OLI Jim HINES.
ELEC692 VLSI Signal Processing Architecture Lecture 12 Numerical Strength Reduction.
Computacion Inteligente Least-Square Methods for System Identification.
Combining Like Terms and the Distributive Property Objectives: Students will be able to explain the difference between algebraic equations and expressions.
1 SYSTEM OF LINEAR EQUATIONS BASE OF VECTOR SPACE.
Comparing survival estimates from a radio-tag mark-recapture study. L. Cowen and C.J. Schwarz Department of Statistics and Actuarial Sciences, Simon Fraser.
Deep Feedforward Networks
Homework Assistance Guide
LECTURE 03: DECISION SURFACES
Introduction Mathcad is a product of mathSoft inc. The Mathcad can help us to calculate, graph, and communicate technical ideas. It lets us work with.
Extension to the Hybrid Symbolic-Numeric Method for Investigating Identifiability Diana Cole, University of Kent, UK Rémi Choquet, CEFE, CNRS, France.
Parameter Redundancy and Identifiability in Ecological Models
Jamming Resistant Encoding
Multistate models Lecture 10.
PRELIMINARY MATHEMATICS
ECE 352 Digital System Fundamentals
Presentation transcript:

Detecting Parameter Redundancy in Complex Ecological Models Diana Cole and Byron Morgan University of Kent

Introduction If a model is parameter redundant or non-identifiable if you cannot estimate all the parameter in the model. Parameter redundancy can be detected by symbolic algebra. Ecological models are getting more complex – then computers cannot do the symbolic algebra and numerical methods are used instead. In this talk we show some of the tools that can be used to overcome this problem.

Example 1- Cormack Jolly Seber (CJS) Model Herring Gulls (Larus argentatus) capture-recapture data for 1983 to 1987 (Lebreton, et al 1995)  i – probability a bird survives from occasion i to i+1 p i – probability a bird is recaptured on occasion i  = [  1,  2,  3, p 2, p 3, p 4 ]

Derivative Method (Catchpole and Morgan, 1997) Calculate the derivative matrix D rank(D) = 5 rank(D) = 5 Number estimable parameters = rank(D). Deficiency = q – rank(D) no. est. pars = 5, deficiency = 6 – 5 = 1

Exhaustive Summaries An exhaustive summary, , is a vector that uniquely defines the model (Walter and Lecoutier, 1982). The exhaustive summary is the starting point for finding the derivative matrix. More than one exhaustive summary exists for a model Choosing a simpler exhaustive summary will simplify the derivative matrix Computer packages, such as Maple can find the symbolic rank of the derivative matrix. Exhaustive summaries can be simplified by any one-one transformation such as multiplying by a constant, taking logs, and removing repeated terms. For multinomial models and product-multinomial models the more complicated 1   Q ij can be removed (Catchpole and Morgan, 1997), as long as there are no missing values.

Other tools to use with exhaustive summaries What can you estimate? (Generalisation from Catchpole et al, 1998.) Solve  T D = 0. Zeros in  indicate estimable pars. Solve PDE to find full set of estimable pars. Extension theorem (Generalised from Catchpole and Morgan, 1997.) Usefully for generalising capture-recapture and ring- recovery models. PLUR Decomposition. (Cole and Morgan, 2008) Useful for detecting points at which the model is parameter redundant or near parameter redundant, or sub models that are parameter redundant.

Reparameterisation Method (Cole and Morgan, 2008) 1.Choose a reparameterisation, s, that simplifies the model structure 2.Rewrite the exhaustive summary,  (  ), in terms of the reparameterisation -  (s).

Reparameterisation Method 3.Calculate the derivative matrix D s 4.The no. of estimable parameters = min(q,rank(D s )) rank(D s ) = 5, no. est. pars = min(6,5) = 5 5.If D s is full rank s = s re is a reduced-form exhaustive summary. If D s is not full rank solve set of PDE to find a reduced-form exhaustive summary, s re D s is full rank, so s is a reduced-form exhaustive summary

Reparameterisation Method 6.Use s re as an exhaustive summary A reduced-form exhaustive summary is adding an extra year of capture and an extra year of recapture adds the extra exhaustive summary terms: Then the extension theorem can be applied to show that the CJS is always parameter redundant with deficiency 1.

Example 2 – Multi-state mark- recapture models for Seabirds Hunter and Caswell (2008) examine parameter redundancy of multi- state mark-recapture models, but cannot evaluate the symbolic rank of the derivative matrix (developed numerical method) 4 state breeding success model: survival breeding given survival successful breeding capture Wandering Albatross (Diomedea exulans)

Reparameterisation Method 1.Choose a reparameterisation, s, that simplifies the model structure 2.Rewrite the exhaustive summary,  (  ), in terms of the reparameterisation -  (s).

Reparameterisation Method 3.Calculate the derivative matrix D s 4.The no. of estimable parameters = min(p,rank(D s )) rank(D s ) = 12, no. est. pars = min(14,12) = 12 5.If D s is full rank s = s re is a reduced-form exhaustive summary. If D s is not full rank solve set of PDE to find a reduced-form exhaustive summary, s re

Reparameterisation Method 6.Use s re as an exhaustive summary Breeding Constraint Survival Constraint  1 =  2 =  3 =  4  1 =  3,  2 =  4  1 =  2,  3 =  4  1,  2,  3,  4  1 =  2 =  3 =  4 0 (8)0 (9)1 (9)1 (11)  1 =  3,  2 =  4 0 (9)0 (10) 2 (12)  1 =  2,  3 =  4 0 (9)0 (10)1 (10)1 (12)  1,  2,  3,  4 0 (11)0 (12) 2 (14)

Conclusion Exhaustive summaries can be used to detect parameter redundancy. The key to more complex problems is to find the exhaustive summary with the simplest structure. The most powerful method of finding an exhaustive summary is the reparameterisation method – which examines the basic building blocks of the model. These methods can be applied to any parametric model.

References Catchpole, E. A. and Morgan, B. J. T. (1997) Detecting parameter redundancy. Biometrika, 84, Catchpole, E. A., Morgan, B. J. T. and Freeman, S. N. (1998) Estimation in parameter redundant models. Biometrika, 85, Hunter, C.M. and Caswell, H. (2008). Parameter redundancy in multistate mark-recapture models with unobservable states. Ecological and Environmental Statistics - in press Cole, D. J. and Morgan, B. J. T (2008) Parameter Redundancy and Identifiability. University of Kent Technical Report UKC/IMS/08/022 Lebreton, J. Morgan, B. J. T., Pradel R. and Freeman, S. N. (1995) A simultaneous survival rate analysis of dead recovery and live recapture data. Biometrics, 51, Walter, E. and Lecoutier, Y (1982) Global approaches to identifiability testing for linear and nonlinear state space models. Mathematics and Computers in Simulations, 24,