JABBA-Select: Performance evaluation of JABBA-Select against and an age-structured simulator and estimation model Henning Winker* MARAM International.

Slides:



Advertisements
Similar presentations
Modeling of Data. Basic Bayes theorem Bayes theorem relates the conditional probabilities of two events A, and B: A might be a hypothesis and B might.
Advertisements

Interfacing physical experiments and computer models Preliminary remarks Tony O’Hagan.
Irwin/McGraw-Hill © Andrew F. Siegel, 1997 and l Chapter 12 l Multiple Regression: Predicting One Factor from Several Others.
Sheng-Ping Wang 1,2, Mark Maunder 2, and Alexandre Aires-Da-Silva 2 1.National Taiwan Ocean University 2.Inter-American Tropical Tuna Commission.
Modeling fisheries and stocks spatially for Pacific Northwest Chinook salmon Rishi Sharma, CRITFC Henry Yuen, USFWS Mark Maunder, IATTC.
Model time step and species biology considerations for growth estimation in integrated stock assessments P. R. Crone and J. L. Valero Southwest Fisheries.
The current status of fisheries stock assessment Mark Maunder Inter-American Tropical Tuna Commission (IATTC) Center for the Advancement of Population.
458 More on Model Building and Selection (Observation and process error; simulation testing and diagnostics) Fish 458, Lecture 15.
Multivariate Data Analysis Chapter 11 - Structural Equation Modeling.
Hui-Hua Lee 1, Kevin R. Piner 1, Mark N. Maunder 2 Evaluation of traditional versus conditional fitting of von Bertalanffy growth functions 1 NOAA Fisheries,
Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 7-1 Chapter 7 Confidence Interval Estimation Statistics for Managers.
Ch 6 Introduction to Formal Statistical Inference
Evaluation of a practical method to estimate the variance parameter of random effects for time varying selectivity Hui-Hua Lee, Mark Maunder, Alexandre.
Exam Covers everything not covered by the last exam. Starts with simulation If you cant’ get the optimal solution – get a pretty good one. You may run.
WP 2.4 Evaluation of NMFS Toolbox Assessment Models on Simulated Groundfish Data Sets Comparative Simulation Tests Overview Brooks, Legault, Nitschke,
Confidence intervals. Estimation and uncertainty Theoretical distributions require input parameters. For example, the weight of male students in NUS follows.
Simulated data sets Extracted from:. The data sets shared a common time period of 30 years and age range from 0 to 16 years. The data were provided to.
Data Mining and Decision Support
PROGRESS IN THE SIMULATION TESTING OF PENGUIN CLOSURE EFFECT RESPONSE An Introduction.
Simulation of methods to account for spatial effects in the stock assessment of Pacific bluefin tuna Cast by: Hui-hua Lee (NOAA Fisheries, SWFSC) Kevin.
Sampling Design and Analysis MTH 494 Lecture-21 Ossam Chohan Assistant Professor CIIT Abbottabad.
Using distributions of likelihoods to diagnose parameter misspecification of integrated stock assessment models Jiangfeng Zhu * Shanghai Ocean University,
Evaluation of structural equation models Hans Baumgartner Penn State University.
CAN DIAGNOSTIC TESTS HELP IDENTIFY WHAT MODEL STRUCTURE IS MISSPECIFIED? Felipe Carvalho 1, Mark N. Maunder 2,3, Yi-Jay Chang 1, Kevin R. Piner 4, Andre.
Yellowfin Tuna Major Changes Catch, effort, and length-frequency data for the surface fisheries have been updated to include new data for 2005.
An Illustrative Example of a Management Procedure for Eastern North Atlantic Bluefin Tuna. Rebecca Rademeyer and Doug Butterworth NB: This is intended.
Recommended modeling approach Version 2.0. The law of conflicting data Axiom Data is true Implication Conflicting data implies model misspecification.
Is down weighting composition data adequate to deal with model misspecification or do we need to fix the model? Sheng-Ping Wang, Mark N. Maunder National.
Chapter 8 Confidence Interval Estimation Statistics For Managers 5 th Edition.
Statistics for Business and Economics 7 th Edition Chapter 7 Estimation: Single Population Copyright © 2010 Pearson Education, Inc. Publishing as Prentice.
Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall Statistics for Business and Economics 7 th Edition Chapter 9 Hypothesis Testing: Single.
Rainer Froese HOSST-TOSST Seminar 07 April 2016 GEOMAR, Kiel, Germany
Brian Irwin Atlantic Herring MSE Workshop 2 Portsmouth, NH 7 Dec. 2016
Chapter 7 Confidence Interval Estimation
New Zealand Orange Roughy Fisheries and assessments SPRFMO THIRD WORKSHOP - DEEP WATER WORKING GROUP Alistair Dunn 23 May 2017.
Workshop on Demographic Analysis
Carina Omoeva, FHI 360 Wael Moussa, FHI 360
MARAM International Stock Assessment Workshop
Pacific-Wide Assessment of Bigeye Tuna
Sardine Two-Stock Hypothesis: Results at the Posterior Mode
Copyright 2012 John Wiley & Sons, Inc. Chapter 7 Budgeting: Estimating Costs and Risks.
ASAP Review and Discussion
Monte Carlo Simulation Managing uncertainty in complex environments.
CONCEPTS OF HYPOTHESIS TESTING
Current developments on steepness for tunas:
Estimating
INTERNATIONAL REVIEW PANEL REPORT FOR THE 2012 INTERNATIONAL FISHERIES STOCK ASSESSMENT WORKSHOP November 2012, UCT NON TECHNICAL SUMMARY.
Budgeting: Estimating Costs and Risks
JABBA-Select: Addressing the Panels Requests Henning Winker
9 Tests of Hypotheses for a Single Sample CHAPTER OUTLINE
Detecting the Learning Value of Items In a Randomized Problem Set
Distribution of the Sample Proportion
2. Stratified Random Sampling.
Characteristics of mixed stock
Day 4 Session 2 Biological reference points
The European Statistical Training Programme (ESTP)
SAFS Quantitative Seminar
Key features Predator and prey species considered:
Addressing uncertainty in a transshipment problem
Simple Linear Regression
JABBA-Select: Simulation-Testing Henning Winker
Demographic Analysis and Evaluation
Chapter 9 Hypothesis Testing: Single Population
Data Processing, Errors, Propagation of Uncertainty
Chapter 13: Item nonresponse
Bristol Bay Red King Crab Assessment in Spring 2019
Dr. Arslan Ornek MATHEMATICAL MODELS
MULTIFAN-CL implementation of deterministic and stochastic projections
U.S. NMFS contracts the CIE to review assessments
Uncertainty Propagation
Presentation transcript:

JABBA-Select: Performance evaluation of JABBA-Select against and an age-structured simulator and estimation model Henning Winker* MARAM International Stock Assessment Workshop 2017 *Henning.winker@gmail.com

Simulation experiment

Simulation experiment The simulation follows four general steps: Development of the OM, and use of the OM to generate datasets. Resulting parameter estimates from the OM are taken as the ‘true' values for the simulation. The estimation models (EMs) are fit to each generated dataset. Estimates of relevant quantities from each EM are compared with their “true” values. Performance evaluation of EMs against the simulated (known) stock status values

Operating Model for silver kob

Scenarios Base-Case: All input parameters correctly specified JABBA-Select: priors for HMSY and m from random deviates of M and h BASPM: M prior and h fixed. ‘how M’: natural mortality M misspecified ‘high M’: natural mortality M misspecified ‘low h’: ‘steepness’ h misspecified ‘high h’: ‘steepness’ h misspecified

Prior specifications

JABBA-Select demo runs 1-10

Performance Evaluation

Control OM to EM base-case run

Example run inspection BASPM

Concluding remarks JABBA-Select performed better than the BASPM in terms of the adequate representation of uncertainty and robustness to input prior misspecifications. ` JABBA-Select was able to approximate selectivity-depend reference points H40,s and Y40,s and to separate the absolute quantity of SB40 from the biomass aggregated abundance information. This could assist to make ASM and SPM stock status results more comparable. The better performance of the JABBA-Select base-case may partially attributed to the advantage of accounting for process error in the JABBA-Select, versus the assumption of deterministic recruitment in the BASPM. The results of this simulation experiment reiterate the difficulties of estimating the key parameters M and h and related FRPs in data-limited age-structured assessments JABBA-Select can provide a more parsimonious solution than conventional ASPMs in similar situations by providing a means to better account process and parameter uncertainty.

The End Part II…Thank you