Simulation analysis using stock synthesis Maunder, Piner, and Lee.

Slides:



Advertisements
Similar presentations
Modeling Recruitment in Stock Synthesis
Advertisements

Econometric Modeling Through EViews and EXCEL
CHAPTER Basic Definitions and Properties  P opulation Characteristics = “Parameters”  S ample Characteristics = “Statistics”  R andom Variables.
Modeling fisheries and stocks spatially for Pacific Northwest Chinook salmon Rishi Sharma, CRITFC Henry Yuen, USFWS Mark Maunder, IATTC.
An evaluation of alternative binning approaches for composition data in integrated stock assessments Cole Monnahan, Sean Anderson, Felipe Hurtado, Kotaro.
Introduction to statistics in medicine – Part 1 Arier Lee.
The current status of fisheries stock assessment Mark Maunder Inter-American Tropical Tuna Commission (IATTC) Center for the Advancement of Population.
Lecture 4 Econ 488. Ordinary Least Squares (OLS) Objective of OLS  Minimize the sum of squared residuals: where Remember that OLS is not the only possible.
Resampling techniques Why resampling? Jacknife Cross-validation Bootstrap Examples of application of bootstrap.
458 More on Model Building and Selection (Observation and process error; simulation testing and diagnostics) Fish 458, Lecture 15.
Factorial ANOVA 2-Way ANOVA, 3-Way ANOVA, etc.. Factorial ANOVA One-Way ANOVA = ANOVA with one IV with 1+ levels and one DV One-Way ANOVA = ANOVA with.
CHAPTER 4 ECONOMETRICS x x x x x Multiple Regression = more than one explanatory variable Independent variables are X 2 and X 3. Y i = B 1 + B 2 X 2i +
An Overview of Today’s Class
Lecture 9: One Way ANOVA Between Subjects
One-way Between Groups Analysis of Variance
Hui-Hua Lee 1, Kevin R. Piner 1, Mark N. Maunder 2 Evaluation of traditional versus conditional fitting of von Bertalanffy growth functions 1 NOAA Fisheries,
How many conditional age-at-length data are needed to estimate growth in stock assessment models? Xi He, John C. Field, Donald E. Pearson, and Lyndsey.
Bootstrapping applied to t-tests
Bootstrap spatobotp ttaoospbr Hesterberger & Moore, chapter 16 1.
Statistical hypothesis testing – Inferential statistics I.
Item response modeling of paired comparison and ranking data.
1 Advances in Statistics Or, what you might find if you picked up a current issue of a Biological Journal.
Moderation in Structural Equation Modeling: Specification, Estimation, and Interpretation Using Quadratic Structural Equations Jeffrey R. Edwards University.
Chapter 12 Multiple Regression and Model Building.
Modeling Parameters in Stock Synthesis Modeling population processes 2009 IATTC workshop.
Returning to Consumption
Model Building III – Remedial Measures KNNL – Chapter 11.
1 Chapter 6. Section 6-1 and 6-2. Triola, Elementary Statistics, Eighth Edition. Copyright Addison Wesley Longman M ARIO F. T RIOLA E IGHTH E DITION.
Population All members of a set which have a given characteristic. Population Data Data associated with a certain population. Population Parameter A measure.
Bootstrapping – the neglected approach to uncertainty European Real Estate Society Conference Eindhoven, Nederlands, June 2011 Paul Kershaw University.
1 Theoretical Physics Experimental Physics Equipment, Observation Gambling: Cards, Dice Fast PCs Random- number generators Monte- Carlo methods Experimental.
Montecarlo Simulation LAB NOV ECON Montecarlo Simulations Monte Carlo simulation is a method of analysis based on artificially recreating.
ASSESSMENT OF BIGEYE TUNA (THUNNUS OBESUS) IN THE EASTERN PACIFIC OCEAN January 1975 – December 2006.
Phylogenetic Analysis. General comments on phylogenetics Phylogenetics is the branch of biology that deals with evolutionary relatedness Uses some measure.
Rasch trees: A new method for detecting differential item functioning in the Rasch model Carolin Strobl Julia Kopf Achim Zeileis.
Using Resampling Techniques to Measure the Effectiveness of Providers in Workers’ Compensation Insurance David Speights Senior Research Statistician HNC.
Evaluation of a practical method to estimate the variance parameter of random effects for time varying selectivity Hui-Hua Lee, Mark Maunder, Alexandre.
Ensembles. Ensemble Methods l Construct a set of classifiers from training data l Predict class label of previously unseen records by aggregating predictions.
WP 2.4 Evaluation of NMFS Toolbox Assessment Models on Simulated Groundfish Data Sets Comparative Simulation Tests Overview Brooks, Legault, Nitschke,
Resampling techniques
Reserve Variability – Session II: Who Is Doing What? Mark R. Shapland, FCAS, ASA, MAAA Casualty Actuarial Society Spring Meeting San Juan, Puerto Rico.
1 Experimental Statistics - week 14 Multiple Regression – miscellaneous topics.
Limits to Statistical Theory Bootstrap analysis ESM April 2006.
Bootstraps and Jackknives Hal Whitehead BIOL4062/5062.
Empirically Based Characteristics of Effect Sizes used in ANOVA J. Jackson Barnette, PhD Community and Behavioral Health College of Public Health University.
1 Chapter 6. Section 6-1 and 6-2. Triola, Elementary Statistics, Eighth Edition. Copyright Addison Wesley Longman M ARIO F. T RIOLA E IGHTH E DITION.
Simulated data sets Extracted from:. The data sets shared a common time period of 30 years and age range from 0 to 16 years. The data were provided to.
Weka Just do it Free and Open Source ML Suite Ian Witten & Eibe Frank University of Waikato New Zealand.
Update on groundfish stock trends for the Gulf of Alaska
The effect of variable sampling efficiency on reliability of the observation error as a measure of uncertainty in abundance indices from scientific surveys.
Classification Ensemble Methods 1
1 Chapter 8: Model Inference and Averaging Presented by Hui Fang.
Using distributions of likelihoods to diagnose parameter misspecification of integrated stock assessment models Jiangfeng Zhu * Shanghai Ocean University,
CAN DIAGNOSTIC TESTS HELP IDENTIFY WHAT MODEL STRUCTURE IS MISSPECIFIED? Felipe Carvalho 1, Mark N. Maunder 2,3, Yi-Jay Chang 1, Kevin R. Piner 4, Andre.
Hypothesis Testing. Statistical Inference – dealing with parameter and model uncertainty  Confidence Intervals (credible intervals)  Hypothesis Tests.
BIOL 582 Lecture Set 2 Inferential Statistics, Hypotheses, and Resampling.
Data weighting and data conflicts in fishery stock assessments Chris Francis Wellington, New Zealand CAPAM workshop, “ Data conflict and weighting, likelihood.
Bootstrapping James G. Anderson, Ph.D. Purdue University.
NWFSC A short course on data weighting and process error in Stock Synthesis Allan Hicks CAPAM workshop October 19, 2015.
Statistical Concepts Basic Principles An Overview of Today’s Class What: Inductive inference on characterizing a population Why : How will doing this allow.
Is down weighting composition data adequate to deal with model misspecification or do we need to fix the model? Sheng-Ping Wang, Mark N. Maunder National.
A Study on Speaker Adaptation of Continuous Density HMM Parameters By Chin-Hui Lee, Chih-Heng Lin, and Biing-Hwang Juang Presented by: 陳亮宇 1990 ICASSP/IEEE.
Data Science Credibility: Evaluating What’s Been Learned
BA 275 Quantitative Business Methods
Simulation: Sensitivity, Bootstrap, and Power
Bootstrap - Example Suppose we have an estimator of a parameter and we want to express its accuracy by its standard error but its sampling distribution.
Ch13 Empirical Methods.
SAFS Quantitative Seminar
Rachael Bedford Mplus: Longitudinal Analysis Workshop 23/06/2015
MULTIFAN-CL implementation of deterministic and stochastic projections
Presentation transcript:

Simulation analysis using stock synthesis Maunder, Piner, and Lee

Objective Use the SS2/SS3 program as a simulator to test the ability to estimate key model parameters

SS2 bootstrap Built in bootstrap procedure to generate artificial data files Data files have randomly generated data based on the same characteristics of the real data Data file in the SS2 format and can be used directly to run the model Data files are in a single file one on top of the other and need to be separated Use data files to run bootstraps, and estimate uncertainty and bias Can also be used to generate data based on fixed parameter values (note in SS3 first data set is the actual and second is with no error)

Simulation algorithm for estimating M (based on Ian Stewart’s R code) Run the original model to generate the bootstrap files (M fixed) –Set the number of bootstrap files to 500 in the starter.ss file Split out the data files into separate files, put them in separate directories with the model files –Set the bootstrap files to 0 –Set M to a positive phase –Set it to start from par file in the starter.ss file to make it run faster Run the assessment in each directory –Do this by creating a batch file that moves through the directories and runs the model Read in the results from each run

Show R code

Methods Use current peer reviewed SS2 assessments Use the exact setup used in the assessment, including model assumptions, parameters estimated, and data Estimate any Ms that are different (e.g. old/young, male/female)

Species Arrowtooth flounder Black rockfish-North Black rockfish-South Chilly pepper rockfish Pacific cod Cowcod Dark blotch rockfish English sole Hake Longnose skate Blue rockfish Sablefish Yelloweye rockfish

Good estimates

Biased estimates

Estimating male and female

Estimating old and young

Indication of model miss-specification

Indication of statistical assumption violation (incorrect sample size or residual patterns)

Modification for estimating steepness of the stock recruitment relationship 1.Run the original model 2.Set the maximum phase to 0 in the starter file and use the par file (i.e. simulate data from fixed parameter values) 3.Replace the recruitment deviates in the par file with a N(0,Rsd) 4.Run one bootstrap 5.Estimate the model parameters 6.Repeat times 7.Summarize results

Results for Pacific cod Estimates of steepness equal to one Even if h=0.5 Only gets estimates < 1 if h=0.5 and Rsd = 0.2 Need to try on the other stocks

Other examples Estimating the growth parameters Does iterative reweighting improve the results Can observation error adjust for process error MSE

Simon, talk about Condor

Acknowledgements Stacey Millar and all the assessment authors