Adding individual random effects results in models that are no longer parameter redundant Diana Cole, University of Kent Rémi Choquet, Centre d'Ecologie.

Slides:

Advertisements

Similar presentations

Statistical perturbation theory for spectral clustering Harrachov, 2007 A. Spence and Z. Stoyanov.

Advertisements

STATISTIC & INFORMATION THEORY (CSNB134) MODULE 12 ERROR DETECTION & CORRECTION.

General Linear Model With correlated error terms  =  2 V ≠  2 I.

Linear Regression.

1 Non-Linear and Smooth Regression Non-linear parametric models: There is a known functional form y=  x,  derived from known theory or from previous.

Workshop on Parameter Redundancy Part II Diana Cole.

Lwando Kondlo Supervisor: Prof. Chris Koen University of the Western Cape 12/3/2008 SKA SA Postgraduate Bursary Conference Estimation of the parameters.

The Problem with Parameter Redundancy Diana Cole, University of Kent.

Dynamics of Learning VQ and Neural Gas Aree Witoelar, Michael Biehl Mathematics and Computing Science University of Groningen, Netherlands in collaboration.

08/30/00 Dinesh Manocha, COMP258 Hermite Curves A mathematical representation as a link between the algebraic & geometric form Defined by specifying the.

Cox Model With Intermitten and Error-Prone Covariate Observation Yury Gubman PhD thesis in Statistics Supervisors: Prof. David Zucker, Prof. Orly Manor.

Detecting Parameter Redundancy in Ecological State-Space Models Diana Cole and Rachel McCrea National Centre for Statistical Ecology, University of Kent.

Bayesian Robust Principal Component Analysis Presenter: Raghu Ranganathan ECE / CMR Tennessee Technological University January 21, 2011 Reading Group (Xinghao.

Parameter Redundancy and Identifiability in Ecological Models Diana Cole, University of Kent.

Parameter Redundancy and Identifiability Diana Cole and Byron Morgan University of Kent Initial work supported by an EPSRC grant to the National Centre.

Detecting Parameter Redundancy in Complex Ecological Models Diana Cole and Byron Morgan University of Kent.

The Mean Square Error (MSE):. Now, Examples: 1) 2)

Resampling techniques Why resampling? Jacknife Cross-validation Bootstrap Examples of application of bootstrap.

Maximum likelihood (ML)

Parameter Redundancy in Ecological Models Diana Cole, University of Kent Byron Morgan, University of Kent Rachel McCrea, University of Kent Ben Hubbard,

1/30 Stochastic Models for Yeast Prion Propagation Diana Cole 1, Lee Byrne 2, Byron Morgan 1, Martin Ridout 1, Mick Tuite Institute of Mathematics,

10-603/15-826A: Multimedia Databases and Data Mining SVD - part I (definitions) C. Faloutsos.

Lecture 11 Multivariate Regression A Case Study. Other topics: Multicollinearity  Assuming that all the regression assumptions hold how good are our.

Determining Parameter Redundancy of Multi-state Mark- Recapture Models for Sea Birds Diana Cole University of Kent.

Lecture 14-2 Multinomial logit (Maddala Ch 12.2)

Linear and generalised linear models

Linear and generalised linear models Purpose of linear models Least-squares solution for linear models Analysis of diagnostics Exponential family and generalised.

Maximum likelihood (ML)

Matrix Approach to Simple Linear Regression KNNL – Chapter 5.

Low-Rank Solution of Convex Relaxation for Optimal Power Flow Problem

Bootstrap spatobotp ttaoospbr Hesterberger & Moore, chapter 16 1.

Feng Lu Chuan Heng Foh, Jianfei Cai and Liang- Tien Chia Information Theory, ISIT IEEE International Symposium on LT Codes Decoding: Design.

Linear Recurrence Relations in Music By Chris Hall.

Sampling Theory Determining the distribution of Sample statistics.

Adding Vectors, Rules When two vectors are added, the sum is independent of the order of the addition. This is the Commutative Law of Addition.

Number Sense Standards Measurement and Geometry Statistics, Data Analysis and Probability CST Math 6 Released Questions Algebra and Functions 0 Questions.

Computing a posteriori covariance in variational DA I.Gejadze, F.-X. Le Dimet, V.Shutyaev.

Basics of Matrix Algebra The Roots are in the tricks and tribulations of solving linear equations Nethra Sambamoorthi, PhD.

Multinomial Distribution

Closed Vs. Open Population Models Mark L. Taper Department of Ecology Montana State University.

Detecting Parameter Redundancy in Integrated Population Models Diana Cole and Rachel McCrea National Centre for Statistical Ecology, School of Mathematics,

A Hybrid Symbolic-Numerical Method for Determining Model Structure Diana Cole, NCSE, University of Kent Rémi Choquet, Centre d'Ecologie Fonctionnelle et.

Progress in identification of damping: Energy-based method with incomplete and noisy data Marco Prandina University of Liverpool.

Introduction to Matrices and Matrix Approach to Simple Linear Regression.

Contrasts & Statistical Inference

Statistics: Unlocking the Power of Data Lock 5 STAT 101 Dr. Kari Lock Morgan Multiple Regression SECTION 10.3 Variable selection Confounding variables.

Chapter 20 Classification and Estimation Classification – Feature selection Good feature have four characteristics: –Discrimination. Features.

Systems Realization Laboratory The Role and Limitations of Modeling and Simulation in Systems Design Jason Aughenbaugh & Chris Paredis The Systems Realization.

Estimating age-specific survival rates from historical ring-recovery data Diana J. Cole and Stephen N. Freeman Mallard Dawn Balmer (BTO) Sandwich Tern.

Slide Copyright © 2009 Pearson Education, Inc. Unit 1 Number Theory MM-150 SURVEY OF MATHEMATICS – Jody Harris.

Data Mining and Decision Support

Status of Reference Network Simulations John Dale ILC-CLIC LET Beam Dynamics Workshop 23 June 2009.

Parameter Redundancy in Mark-Recapture and Ring-Recovery Models with Missing Data Diana Cole University of Kent.

Measurements and Their Analysis. Introduction Note that in this chapter, we are talking about multiple measurements of the same quantity Numerical analysis.

Multistate models UF Outline  Description of the model  Data structure and types of analyses  Multistate with 2 and 3 states  Assumptions 

Capture-recapture Models for Open Populations “Single-age Models” 6.13 UF-2015.

Sampling Theory Determining the distribution of Sample statistics.

Neural Network Approximation of High- dimensional Functions Peter Andras School of Computing and Mathematics Keele University

Standard Errors Beside reporting a value of a point estimate we should consider some indication of its precision. For this we usually quote standard error.

Applying Neural Networks

Approximation of the Propagator for the Harmonic Oscillator

Matrices Definition: A matrix is a rectangular array of numbers or symbolic elements In many applications, the rows of a matrix will represent individuals.

Extension to the Hybrid Symbolic-Numeric Method for Investigating Identifiability Diana Cole, University of Kent, UK Rémi Choquet, CEFE, CNRS, France.

6. Introduction to nonparametric clustering

Parameter Redundancy and Identifiability in Ecological Models

Bootstrap - Example Suppose we have an estimator of a parameter and we want to express its accuracy by its standard error but its sampling distribution.

Jamming Resistant Encoding

Rank-Sparsity Incoherence for Matrix Decomposition

Presentation transcript:

Adding individual random effects results in models that are no longer parameter redundant Diana Cole, University of Kent Rémi Choquet, Centre d'Ecologie Fonctionnelle et Evolutive

2/12 Cormack Jolly Seber (CJS) Model A model is parameter redundant (or non-identifiable) if you cannot estimate all the parameters. Consider the CJS model with time dependent survival probabilities,  t, and time dependent recapture probabilities, p t. This model is parameter redundant.

3/12 Detecting Parameter Redundancy Symbolic Method (see for example Cole et al, 2010): Let  denote the parameters. Let  denote an exhaustive summary for a model, where an exhaustive summary is a vector that provides a unique representation of the model, for example the probabilities of life- histories. Form a derivative matrix Rank D gives the number of parameters in a model. Rank D < no. of parameters model is parameter redundant (or non- identifiable). Rank D = no. of parameters model is full rank. Extensions to more complex models using reparameterisation. Hybrid-Symbolic-Numerical Method (Choquet and Cole, 2012) Derivative matrix formed symbolically, rank evaluated at about 5 random points.

4/12 CJS Model with random effects Consider adding individual random effects to the time dependent CJS model. Survival parameter: where As b i appears in all  i,t there is now separation between  T-1 and p T Is the model still parameter redundant? How do we investigate parameter redundancy in models with random effects? Statistics are defined by a one dimensional integral. Impossible to manage them exactly. => approximation.

5/12 Theory for detecting parameter redundancy in models with individual random effects Exhaustive summary,  : where probability of history i evaluated at. Easiest to use with hybrid-symbolic method and with results for specific data sets. Simpler exhaustive Summary,  : Can be used with symbolic method to get general results. (Results generalise for multiple random effects.)

6/12 European Dipper Example has rank 13, so can theoretically estimate all the parameters. (Can also show using the simpler exhaustive summary that the CJS model with individual random effects is always full rank.)

7/12 European Dipper Example EstimateStandard Error  1 = logit -1 (  1 )  2 = logit -1 (  2 )  3 = logit -1 (  3 )  4 = logit -1 (  4 )  5 = logit -1 (  5 )  6 = logit -1 (  6 ) p2p p3p p4p p5p p6p p7p  1.32  lowest Eigen value 8.49  10 -8

8/12 Near Redundancy A near redundant model behaves similarly to a parameter redundant model because it is close to a model that is parameter redundant (Catchpole, et al, 2001). In a near redundant model the smallest Eigen value of the hessian matrix will be close to zero (Catchpole, et al, 2001). Potential near redundancy can be found using a PLUR decomposition of D. Det(U) = 0 indicates parameter redundancy and near redundancy (Cole, et al, 2010). Dipper example: Will be parameter redundant if  = 0. Will be near redundant if  is close to 0.

9/12 Simulation Example (100 simulations) TrueMeanStd 1 2 3 4 5 6 p2p p3p p4p p5p p6p p7p  lowest Eigen value

10/12 Near Redundancy Simulation

11/12 Conclusion The time dependent CJS model is no longer parameter redundant when there are individual random effects, but there are potential problems with near redundancy. Smallest Eigen value of Hessian can be used to detect near redundancy (if the Hessian is reasonably well approximated). Theory is applicable to any model with individual random effects, if the life-history probabilities can be written down.

12/12 References This talk: Cole, D.J. and Choquet, R. (2012) Parameter Redundancy in Models with Individual Random Effects, University of Kent technical report. References: Catchpole, E. A., Kgosi, P. M. and Morgan,B. J. T. (2001) On the Near-Singularity of Models for Animal Recovery Data. Biometrics, 57, Choquet, R. and Cole, D.J. (2012) A Hybrid Symbolic- Numerical Method for Determining Model Structure. Mathematical Biosciences, 236, Cole, D.J. and Morgan, B.J.T. and Titterington, D.M (2010) Determining the parametric structure of models. Mathematical Biosciences, 228,16-30.