Evaluation of a practical method to estimate the variance parameter of random effects for time varying selectivity Hui-Hua Lee, Mark Maunder, Alexandre.

Slides:



Advertisements
Similar presentations
Modeling Recruitment in Stock Synthesis
Advertisements

An exploration of alternative methods to deal with time-varying selectivity in the stock assessment of YFT in the eastern Pacific Ocean CAPAM – Selectivity.
Statistical Techniques I EXST7005 Start here Measures of Dispersion.
Hypothesis testing Another judgment method of sampling data.
Sheng-Ping Wang 1,2, Mark Maunder 2, and Alexandre Aires-Da-Silva 2 1.National Taiwan Ocean University 2.Inter-American Tropical Tuna Commission.
An evaluation of alternative binning approaches for composition data in integrated stock assessments Cole Monnahan, Sean Anderson, Felipe Hurtado, Kotaro.
Growth in Age-Structured Stock Assessment Models R.I.C. Chris Francis CAPAM Growth Workshop, La Jolla, November 3-7, 2014.
Modeling Selectivity in Stock Synthesis Modeling population processes 2009 IATTC workshop.
The current status of fisheries stock assessment Mark Maunder Inter-American Tropical Tuna Commission (IATTC) Center for the Advancement of Population.
Reporter: Hsu Hsiang-Jung Modelling stochastic fish stock dynamics using Markov Chain Monte Carlo.
1 Statistical Inference H Plan: –Discuss statistical methods in simulations –Define concepts and terminology –Traditional approaches: u Hypothesis testing.
Resampling techniques Why resampling? Jacknife Cross-validation Bootstrap Examples of application of bootstrap.
Barents Sea fish modelling in Uncover Daniel Howell Marine Research Institute of Bergen.
Multi-server Optimal Bandwidth Monitoring for QoS based Multimedia Delivery Anup Basu, Irene Cheng and Yinzhe Yu Department of Computing Science U. of.
Hui-Hua Lee 1, Kevin R. Piner 1, Mark N. Maunder 2 Evaluation of traditional versus conditional fitting of von Bertalanffy growth functions 1 NOAA Fisheries,
Discussing the student measurements of building height. Letting them originate concepts for: Multiple measures Mean Standard Deviation Outliers / identifying.
The (potential) value and use of empirical estimates of selectivity in integrated assessments John Walter, Brian Linton, Will Patterson and Clay Porch.
R. Sharma*, A. Langley ** M. Herrera*, J. Geehan*
Modeling Parameters in Stock Synthesis Modeling population processes 2009 IATTC workshop.
Maximum likelihood estimates of North Pacific albacore tuna ( Thunnus alalunga ) von Bertalanffy growth parameters using conditional-age-at-length data.
1 Theoretical Physics Experimental Physics Equipment, Observation Gambling: Cards, Dice Fast PCs Random- number generators Monte- Carlo methods Experimental.
Bayesian inference review Objective –estimate unknown parameter  based on observations y. Result is given by probability distribution. Bayesian inference.
University of Ottawa - Bio 4118 – Applied Biostatistics © Antoine Morin and Scott Findlay 08/10/ :23 PM 1 Some basic statistical concepts, statistics.
Normal Distributions Z Transformations Central Limit Theorem Standard Normal Distribution Z Distribution Table Confidence Intervals Levels of Significance.
ASSESSMENT OF BIGEYE TUNA (THUNNUS OBESUS) IN THE EASTERN PACIFIC OCEAN January 1975 – December 2006.
Modeling Natural Mortality in Stock Synthesis Modeling population processes 2009 IATTC workshop.
The Stock Synthesis Approach Based on many of the ideas proposed in Fournier and Archibald (1982), Methot developed a stock assessment approach and computer.
Limits to Statistical Theory Bootstrap analysis ESM April 2006.
Workshop on Stock Assessment Methods 7-11 November IATTC, La Jolla, CA, USA.
Probability = Relative Frequency. Typical Distribution for a Discrete Variable.
Understanding Your Data Set Statistics are used to describe data sets Gives us a metric in place of a graph What are some types of statistics used to describe.
1 Topic 5 - Joint distributions and the CLT Joint distributions –Calculation of probabilities, mean and variance –Expectations of functions based on joint.
Surplus Production Models
PCB 3043L - General Ecology Data Analysis. PCB 3043L - General Ecology Data Analysis.
U.S. Department of Commerce | National Oceanic and Atmospheric Administration | NOAA Fisheries | Page 1 Model Misspecification and Diagnostics and the.
1 Yi-Jay Chang 2 Brian Langseth 3 Mark Maunder 1 Felipe Carvalho Performance of a stock assessment model with misspecified time-varying growth 1 – JIMAR,
Estimation of growth within stock assessment models: implications when using length composition data Jiangfeng Zhu a, Mark N. Maunder b, Alexandre M. Aires-da-Silva.
Quality Control  Statistical Process Control (SPC)
Simulation analysis using stock synthesis Maunder, Piner, and Lee.
Simulation of methods to account for spatial effects in the stock assessment of Pacific bluefin tuna Cast by: Hui-hua Lee (NOAA Fisheries, SWFSC) Kevin.
Using distributions of likelihoods to diagnose parameter misspecification of integrated stock assessment models Jiangfeng Zhu * Shanghai Ocean University,
Estimation of selectivity in Stock Synthesis: lessons learned from the tuna stock assessment Shigehide Iwata* 1 Toshihde Kitakado* 2 Yukio Takeuchi* 1.
Lecture 8: Measurement Errors 1. Objectives List some sources of measurement errors. Classify measurement errors into systematic and random errors. Study.
CAN DIAGNOSTIC TESTS HELP IDENTIFY WHAT MODEL STRUCTURE IS MISSPECIFIED? Felipe Carvalho 1, Mark N. Maunder 2,3, Yi-Jay Chang 1, Kevin R. Piner 4, Andre.
Some Insights into Data Weighting in Integrated Stock Assessments André E. Punt 21 October 2015 Index-1 length-4.
Yellowfin Tuna Major Changes Catch, effort, and length-frequency data for the surface fisheries have been updated to include new data for 2005.
Systematics in Hfitter. Reminder: profiling nuisance parameters Likelihood ratio is the most powerful discriminant between 2 hypotheses What if the hypotheses.
Data weighting and data conflicts in fishery stock assessments Chris Francis Wellington, New Zealand CAPAM workshop, “ Data conflict and weighting, likelihood.
Influence of selectivity and size composition misfit on the scaling of population estimates and possible solutions: an example with north Pacific albacore.
Estimating Uncertainty. Estimating Uncertainty in ADMB Model parameters and derived quantities Normal approximation Profile likelihood Bayesian MCMC Bootstrap.
Chapter 9 Sampling Distributions 9.1 Sampling Distributions.
MONTE CARLO SIMULATION MODEL. Monte carlo simulation model Computer based technique length frequency samples are used for the model. In addition randomly.
Recommended modeling approach Version 2.0. The law of conflicting data Axiom Data is true Implication Conflicting data implies model misspecification.
Is down weighting composition data adequate to deal with model misspecification or do we need to fix the model? Sheng-Ping Wang, Mark N. Maunder National.
PCB 3043L - General Ecology Data Analysis Organizing an ecological study What is the aim of the study? What is the main question being asked? What are.
Introduction We consider the data of ~1800 phenotype measurements Each mouse has a given probability distribution of descending from one of 8 possible.
Chapter 7 Estimation. Chapter 7 ESTIMATION What if it is impossible or impractical to use a large sample? Apply the Student ’ s t distribution.
Missing data: Why you should care about it and what to do about it
More on Inference.
ESTIMATION.
Pacific-Wide Assessment of Bigeye Tuna
ASAP Review and Discussion
Statistical Methods Carey Williamson Department of Computer Science
More on Inference.
Sampling Distribution
Sampling Distribution
SAFS Quantitative Seminar
Effects of Catch-at-Age Sample Size on Gulf of Mexico Gray Triggerfish Spawning Stock Biomass Estimates Jeff Isely SEFSC Miami.
Daily Warm-up Tuesday, April 29th
MULTIFAN-CL implementation of deterministic and stochastic projections
Presentation transcript:

Evaluation of a practical method to estimate the variance parameter of random effects for time varying selectivity Hui-Hua Lee, Mark Maunder, Alexandre Aires-da-Silva Kevin Piner, and...

PurposesPurposes  A practical method to estimate the variance parameter of random effects for time varying selectivity  Evaluation the time-varying selectivity using simulation approach

Time varying selectivity using functional forms with time varying parameters implemented using random effects

Options in SS LOHIINITPR_typePRIORSDPHASEenv- var use_ dev dev_ minyr dev_ maxyr dev_ stddev BlockBlock_ Fxn

IssuesIssues True likelihoods require integrating across the random effects (dev y ) Integration is computationally intensive Integration is not available in Stock Synthesis unless Bayesian MCMC is used The standard deviation needs to be estimated The MLE of the standard deviation estimated using penalized likelihood is not statistically consistent and is degenerative towards zero

Grant Thompson’s method using penalized likelihood 1.Estimate the parameter deviates with as little penalty as possible: σ 1. 1.Set the standard deviation of the distributional penalty to a large number and estimate deviates 2.Remove outliers 3.Estimate the standard deviation of the deviates. 2.Iteratively estimate the standard deviation σ 2 a.Set the standard deviation at a reasonable value b.Estimate the deviates c.Estimate the standard deviation of the deviates d.Repeat b and c by using the new standard deviation from c until the standard deviation converges 3.Calculate the standard deviation as

BET application Stock Synthesis Simplified version of the stock assessment model Two fisheries – Longline – Purse Seine Starts in 1975 (modeled as seasonal time step) Data – CPUE for longline fishery – Length composition for both fisheries – Age-at-length for purse seine fisheries Fixed growth, natural mortality, and steepness of the stock- recruitment relationship (h = 1) Fishing mortality by fishery and year as parameters (avoids population crash issues when using random recruitment in simulator)

Simplified BET : Selectivity Purse seine – Double normal length based – Estimate Peak Ascending width Descending width – Fixed Smallest length = 0 Largest length = 0 Plateau size small Longline – Logistic P2 fixed P2 estimated

Purse seine Peak: multiplicative normal sd = ? Ascending width: additive lognormal sd = ? Descending width : additive lognormal sd = ? Parameters that were transformed were used additive deviations and parameter that was not transformed was used multiplicative deviations. Grant Thompson’s method to estimate actual σ Simplified BET : Time varying

Grant Thompson’s method: Iteratively estimate the standard deviation σ2 How little penalty is for σ 1 ? Depend on parameter

Grant Thompson’s method: Calculate the standard deviation σ

Time varying Constant

Simulation approach 1.Fit model with time varying selectivity or constant selectivity to original data 2.Use estimated parameters and random recruitment deviates to randomly simulate data with same characteristics as original data 3.Fit the model to the simulated data with time varying selectivity, constant selectivity, 4.Repeat 2-3 many times

Simulator S1: operating model with constant selectivity Simulator S2: operating model with time varying selectivity Estimator E1: estimate models with constant selectivity Estimator E2: estimate models with time varying selectivity Estimator F1: estimate models with original weighting on effective sample size for pure seine fleets Estimator F2: estimate models with down weighting on effective sample size for pure seine fleets Simulation approach

S1: constant selectivity S2: time varying selectivity Corrected specified models S1E1F1S2E2F1 Effect of time varying selectivity S1E2F1S2E1F1 Effect of down weighting on effective sample size S1E1F2S2E2F2

Misspecify selectivity as time-varying when selectivity is constant in true model may not be too bad. It is not the case for misspecifying selectivity as constant when selectivity is time-varying in true model. In particular, B 0, B 2012, B 2012 /B 0, C 2012_F1, terminal recruitments. Effect of time varying selectivity

Misspecify lower effect on effective sample size may not be too bad except for 1. C 2012_F1, SSB 0, SSB MSY when selectivity is constant in true model. 2. MSY, SSB MSY when selectivity is time-varying in true model. Effect of down weighting on effective sample size

Comments, thoughts, criticism? Get rid of the age-at-length data Add random selectivity deviations in the simulation process other?