1 Yi-Jay Chang 2 Brian Langseth 3 Mark Maunder 1 Felipe Carvalho Performance of a stock assessment model with misspecified time-varying growth 1 – JIMAR,

Slides:



Advertisements
Similar presentations
Modeling Recruitment in Stock Synthesis
Advertisements

An exploration of alternative methods to deal with time-varying selectivity in the stock assessment of YFT in the eastern Pacific Ocean CAPAM – Selectivity.
Are the apparent rapid declines in top pelagic predators real? Mark Maunder, Shelton Harley, Mike Hinton, and others IATTC.
Sheng-Ping Wang 1,2, Mark Maunder 2, and Alexandre Aires-Da-Silva 2 1.National Taiwan Ocean University 2.Inter-American Tropical Tuna Commission.
Gavin Using size increment data in age-structured stock assessment models CAPAM growth workshop: Nov 2014.
Modeling fisheries and stocks spatially for Pacific Northwest Chinook salmon Rishi Sharma, CRITFC Henry Yuen, USFWS Mark Maunder, IATTC.
Estimating Growth Within Size-Structured Fishery Stock Assessments ( What is the State of the Art and What does the Future Look Like? ) ANDRÉ E PUNT, MALCOLM.
An evaluation of alternative binning approaches for composition data in integrated stock assessments Cole Monnahan, Sean Anderson, Felipe Hurtado, Kotaro.
An Overview of the Key Issues to be Discussed Relating to South African Sardine MARAM International Stock Assessment Workshop 1 st December 2014 Carryn.
Growth in Age-Structured Stock Assessment Models R.I.C. Chris Francis CAPAM Growth Workshop, La Jolla, November 3-7, 2014.
Model time step and species biology considerations for growth estimation in integrated stock assessments P. R. Crone and J. L. Valero Southwest Fisheries.
Dealing with interactions between area and year Mark Maunder IATTC.
Black Sea Bass – Northern Stock Coastal-Pelagic/ASMFC Working Group Review June 15, 2010.
The current status of fisheries stock assessment Mark Maunder Inter-American Tropical Tuna Commission (IATTC) Center for the Advancement of Population.
458 More on Model Building and Selection (Observation and process error; simulation testing and diagnostics) Fish 458, Lecture 15.
Using CWT’s to assess survival, ocean distribution and maturation for Chinook stocks across the Pacific Northwest: Are there any predictive capabilities.
Are pelagic fisheries managed well? A stock assessment scientists perspective Mark Maunder and Shelton Harley Inter-American Tropical Tuna Commission
Case Study - Dover Sole Range from Baja California to the Bering Sea. On mud or muddy-sand, at 35 to 1400 m depths. Feed on polychaete worms, shrimp, brittle.
Hui-Hua Lee 1, Kevin R. Piner 1, Mark N. Maunder 2 Evaluation of traditional versus conditional fitting of von Bertalanffy growth functions 1 NOAA Fisheries,
Hierarchical Bayesian Analysis of the Spiny Lobster Fishery in California Brian Kinlan, Steve Gaines, Deborah McArdle, Katherine Emery UCSB.
Time-Varying vs. Non-Time- Varying Growth in the Gulf of Mexico King Mackerel Stock Assessment: a Case Study Southeast Fisheries Science Center Jeff Isely,
R. Sharma*, A. Langley ** M. Herrera*, J. Geehan*
WP4: Models to predict & test recovery strategies Cefas: Laurence Kell & John Pinnegar Univ. Aberdeen: Tara Marshall & Bruce McAdam.
Maximum likelihood estimates of North Pacific albacore tuna ( Thunnus alalunga ) von Bertalanffy growth parameters using conditional-age-at-length data.
ASSESSMENT OF BIGEYE TUNA (THUNNUS OBESUS) IN THE EASTERN PACIFIC OCEAN January 1975 – December 2006.
Where does my data go? Preparation of files for the assessments of IOTC stocks and use of data for the assessments of IOTC species Mauritius, March.
Kevin Kappenman Rishi Sharma Shawn Narum Benefit-Risk Analysis of White Sturgeon in the Lower Snake River Molly Webb Selina Heppell.
Use of multiple selectivity patterns as a proxy for spatial structure Felipe Hurtado-Ferro 1, André E. Punt 1 & Kevin T. Hill 2 1 University of Washington,
Spatial issues in WCPO stock assessments (bigeye and yellowfin tuna) Simon Hoyle SPC.
Modeling growth for American lobster Homarus americanus Yong Chen, Jui-Han Chang School of Marine Sciences, University of Maine, Orono, ME
A retrospective investigation of selectivity for Pacific halibut CAPAM Selectivity workshop 14 March, 2013 Ian Stewart & Steve Martell.
Evaluation of a practical method to estimate the variance parameter of random effects for time varying selectivity Hui-Hua Lee, Mark Maunder, Alexandre.
1 II-Main scientific and management results expected from the tagging programme 1) Stock structure and migrations 2) Tuna growth 3) Natural mortality as.
ALADYM (Age-Length Based Dynamic Model): a stochastic simulation tool to predict population dynamics and management scenarios using fishery-independent.
FTP Yield per recruit models. 2 Objectives Since maximizing effort does not maximize catch, the question is if there is an optimum fishing rate that would.
The Stock Synthesis Approach Based on many of the ideas proposed in Fournier and Archibald (1982), Methot developed a stock assessment approach and computer.
Workshop on Stock Assessment Methods 7-11 November IATTC, La Jolla, CA, USA.
Simulated data sets Extracted from:. The data sets shared a common time period of 30 years and age range from 0 to 16 years. The data were provided to.
USING INDICATORS OF STOCK STATUS WHEN TRADITIONAL REFERENCE POINTS ARE NOT AVAILABLE: EVALUATION AND APPLICATION TO SKIPJACK TUNA IN THE EASTERN PACIFIC.
Flexible estimation of growth transition matrices: pdf parameters as non-linear functions of body length Richard McGarvey and John Feenstra CAPAM Workshop,
M.S.M. Siddeeka*, J. Zhenga, A.E. Puntb, and D. Pengillya
U.S. Department of Commerce | National Oceanic and Atmospheric Administration | NOAA Fisheries | Page 1 Model Misspecification and Diagnostics and the.
What is the likelihood that your model is wrong? Generalized tests and corrections for overdispersion during model fitting and exploration James Thorson,
The effect of variable sampling efficiency on reliability of the observation error as a measure of uncertainty in abundance indices from scientific surveys.
Extending length-based models for data-limited fisheries into a state-space framework Merrill B. Rudd* and James T. Thorson *PhD Student, School of Aquatic.
SEDAR 42: US Gulf of Mexico Red grouper assessment Review Workshop Introduction SEFSC July , 2015.
Estimation of growth within stock assessment models: implications when using length composition data Jiangfeng Zhu a, Mark N. Maunder b, Alexandre M. Aires-da-Silva.
ASSESSMENT OF BIGEYE TUNA (THUNNUS OBESUS) IN THE EASTERN PACIFIC OCEAN January 1975 – December 2005.
Modeling biological-composition time series in integrated stock assessments: data weighting considerations and impact on estimates of stock status P. R.
Simulation of methods to account for spatial effects in the stock assessment of Pacific bluefin tuna Cast by: Hui-hua Lee (NOAA Fisheries, SWFSC) Kevin.
Using distributions of likelihoods to diagnose parameter misspecification of integrated stock assessment models Jiangfeng Zhu * Shanghai Ocean University,
CAN DIAGNOSTIC TESTS HELP IDENTIFY WHAT MODEL STRUCTURE IS MISSPECIFIED? Felipe Carvalho 1, Mark N. Maunder 2,3, Yi-Jay Chang 1, Kevin R. Piner 4, Andre.
1 Climate Change and Implications for Management of North Sea Cod (Gadus morhua) L.T. Kell, G.M. Pilling and C.M. O’Brien CEFAS, Lowestoft.
Some Insights into Data Weighting in Integrated Stock Assessments André E. Punt 21 October 2015 Index-1 length-4.
Yellowfin Tuna Major Changes Catch, effort, and length-frequency data for the surface fisheries have been updated to include new data for 2005.
Lecture 10 review Spatial sampling design –Systematic sampling is generally better than random sampling if the sampling universe has large-scale structure.
Empirical comparison of historical data and age- structured assessment models for Prince William Sound and Sitka Sound Pacific herring Peter-John F. Hulson,
Modelling population dynamics given age-based and seasonal movement in south Pacific albacore Simon Hoyle Secretariat of the Pacific Community.
Data weighting and data conflicts in fishery stock assessments Chris Francis Wellington, New Zealand CAPAM workshop, “ Data conflict and weighting, likelihood.
Influence of selectivity and size composition misfit on the scaling of population estimates and possible solutions: an example with north Pacific albacore.
NWFSC A short course on data weighting and process error in Stock Synthesis Allan Hicks CAPAM workshop October 19, 2015.
Day 4, Session 1 Abundance indices, CPUE, and CPUE standardisation
Recommended modeling approach Version 2.0. The law of conflicting data Axiom Data is true Implication Conflicting data implies model misspecification.
Is down weighting composition data adequate to deal with model misspecification or do we need to fix the model? Sheng-Ping Wang, Mark N. Maunder National.
Pacific-Wide Assessment of Bigeye Tuna
Policy Evaluation II (Feedback strategies)
ASAP Review and Discussion
Current developments on steepness for tunas:
SAFS Quantitative Seminar
JABBA-Select: Simulation-Testing Henning Winker
Presentation transcript:

1 Yi-Jay Chang 2 Brian Langseth 3 Mark Maunder 1 Felipe Carvalho Performance of a stock assessment model with misspecified time-varying growth 1 – JIMAR, PIFSC, NOAA (JIMAR) 2 – PIFSC, NOAA 3 – IATTC CAPAM, 3-7 Nov, 2014

Overview Examples of time-varying growth in fish populations Objectives of this study Operating model (Individual-based model) – Cohort-specific and year-specific time-varying growth Stock assessment model Results – Cohort-specific K vs Linf – Cohort-specific vs year-specific – Comparison of time-varying methods Discussion 2

3 Clark et al. (1999) CJAFS Pacific halibut (Hippoglossus stenolepis) Francis (1997) NZ Mar Freshw Res Elephantfish (Callorhinchus milii) Common sardine (Strangomera bentincki) Feltrim & Ernst (2010) Fish Res Examples of time-varying growth

Static growth Time-varying growth Impact of time-varying growth on stock assessment Athol Whitten et al. (2013) Fish Res Blue hake (grenadier), Macruronus novaezelandiae Further study should focus on comparing alternative methods for dealing with temporal variability in growth in stock assessment models by using simulation analyses.

Objectives of this study 1.To develop an operating model (OM) to simulate population dynamics and possible time-varying growth of the swordfish in the North Pacific Ocean 2.To evaluate the performance of a stock assessment model with mis-specified time-varying growth by using simulation testing analysis 3.To explore the implications of various ways of handling time- varying growth in a stock assessment model 5

6 Previous assessments ISC (2009); ISC (2014) SS3; Bayesian production model Data used: Catch WCNPO SWO CPUE indices: Japan longline TW longline HW longline WCNPO Swordfish Source:

Is it fished? Time-varying Growth End of year Start of year Recruitment Die? Bookkeeping More fish? Landing Die naturally NO YES NO Individual-based model Applications of IBM: Chen et al. (2005) Maine lobster size‐structured stock assessment model Kim et al. (2002) New Zealand abalone assessment model Labelle (2005) yellowfin tuna MULTIFAN-CL iPopSim Individual-based Population Simulator YES NO Population model: N t+1 = N t e -Z Individual-based model: r 1 ~U(0,1); r 2 ~U(0,1) If r 1 ≤ exp(Z(L i )), dies; survives If r 2 ≤F(L i )/Z(L i ), fished; died naturally Features: Included the tagging module Generates SS3.dat file Modified from Chang et al. (2011) CJFAS, 68: 122–136

Single area, sex combined Initialization – 40 years M only ( ); – 62 years M+F (fishing period, ) Fishery – One combined fleet, fixed q, logistic selectivity (size-based) Life history parameters: maturity, length-weight (size-based) Beverton-Holt SR relationship Growth uncertainty – Individual growth variability – Time-varying growth variability 8 Individual-based model - II

Time-varying growth scenarios in IBM 30% decrease Linf 30% increase K Linf We modeled the time-varying K and Linf patterns for 1.Cohort-specific growth variability 2.Year-specific growth variability Period 1 Period 2 c y time age Size

One fishery Starts in 1951 (modeled as non-seasonal) IBM’s Data for all years ( ) – Abundance index – Length composition in fishery – Age composition in fishery Fixed, natural mortality, and steepness of the stock- recruitment relationship (h = 0.9) Estimated parameters: – Length at a 1 (L 1 ), Length at a 2 (L 2 ), K, CV_L 1, CV_L 2, R 0, Selectivity (SEL 50, SEL 95 ) Stock Synthesis estimation model

11 1.Constant growth 2.Yearly multiplicative deviation Par’ y =par*e ε y Yearly random walk deviation Par’ y =Par’ y-1 + ε y Cohort growth deviation L a+1,c =L a,c +∆L*e v c Time blocks Par’ = blockpar Every 10 years block ; ; ; ; , Methot and Wetzel (2013) Fish Res Stock Synthesis estimation model - II 6. Empirical weight-at-age Taylor (Friday)

Simulation testing scenarios Simulation scenarioEstimation model Constant growth (base-level) SS3_const Time-varying K (Cohort)SS3_const SS3_mult_dev SS3_ranwk SS3_CGdev SS3_Blocks Time-varying K (Year)5 SS3 models Time-varying Linf (Cohort)5 SS3 models Time-varying Linf (Year)5 SS3 models 12 We compared: SSB y Fy, SSBtyr, Ftyr, Weight-at-age (not shown in this presentation)

Result 13

Constant growth scenario Cohort-specific time-varying Linf scenario Cohort-specific time-varying K scenario Comparison of time-series of SSB by different estimation models

Time-varying K vs Time-varying Linf Time-varying KTime-varying Linf Mean size EFL (cm) Year age (Cohort-specific) (Kg)

Model performance Average absolute relative error 16 k is the number of years; The E t is the estimated value of SSB in year t; T t is the “true” SSB in year t; Larger value -> higher estimation error

SS3 estimation models: Estimation error of spawning stock biomass Base-level (self-test error) 100% Time-varying K Time-varying Linf SSB

Constant growth Base-level Time-varying K (cohort-specific) Time-varying Linf (cohort-specific) SS3 constant growth Simulation scenario SS3 constant growth SS3 multiplicative dev in K SS3 multiplicative dev in Linf Pearson residuals bubble plot of size composition

Cohort-specific vs Year-specific time-varying growth Mean size Age Year (Cohort-specific) (Year-specific) % Base-level SS3 estimation models: SSB

Which time-varying method is better?

1.Mis-specified time-varying growth can affect model output For example, estimation error in SSB Reason: time-varying growth -> mean size-at-age -> exploitable population (via selectivity) -> catch (young-big or old-small) -> population abundance, SSB (via L-Maturity & L-W functions) -> Recruitment -> … -> 2.Higher time-varying growth variation -> more complication in dynamics and data -> poor fits by stock assessment model -> higher estimation error 3.Time-varying Linf has a larger impact than time-varying K Big change in size scale across all ages 4.Year-specific time-varying growth has a larger impact than cohort- specific time-varying growth Year-specific has higher variations in mean size-at-age Findings of the simulation study

1.Can we include time-varying growth in stock assessment? – In our case, Yes! SSB RE 18% -> less 5% (time-varying K) SSB RE 150% -> 20% (time-varying Linf) 2.Default method for dealing with time-varying growth? Yearly multiplicative deviation and cohort growth deviation methods perform better Reason: greater flexibility to model the variation 3.Which one is worse? – Constant growth; time blocks; random walk method (low flexibility) 4.Do the models with time-varying growth work well when true growth is constant? Yes! Reason: greater flexibility; more parameters Include it as a candidate run. Check model if it makes a difference. 22 Findings of the simulation study -II

23 Acknowledgments CAPAM workshop conveners ISC Billfish Working Group Jon Brodziak Rick Methot Yong Chen Hui-Hua Lee Questions??

Examples of time-varying growth – II Pelagic billfish ParameterPosterior mean μ∞μ∞ μKμK L∞,jL∞,j 311; 241; 221; 309 KjKj 0.09; 0.32; 0.20; 0.11 Pacific blue marlin Chang et al. (2013) ISC/13/BILLWG-1/02

Estimation error of time-series of weight-at-age Time-varying K Time-varying Linf SS3 estimation models: Base-level Weight Age Year 100%

26 Mult_dev RanwkCGDev Blocks time-series of mean size-at-age

27 Parameter (units)IBMEstimated in SS3 Natural mortality (yr -1 )0.25No Reference age1 (yr)0No Reference age2 (yr)15No Length at a 1 (cm)62.69Yes Length at a 2 (cm)216.72Yes Growth rate (yr -1 )0.258Yes IBM growth error CV; SS3 CV L ; 0.01Yes SS3 CV L 2 0.1Yes Length-weight scaling1.35E-06No Allometric factor3.4297No Maturity slope No Length-at-50% maturity (cm)143.68No Log mean virgin recruitment Yes Steepness0.9No SigmaR0No Logistic size-based selectivity, SEL 50 (cm)140Yes Logistic size-based selectivity, SEL 95 (cm)160Yes Catchability0.1No CPUE observation error s.d.0.1No Effective N in size comp.100No Effective N in age comp.100No Ageing error s.d.0.001No Time-varying par. CV0.25 No Mortality Growth Other life history SR relationship Selectivity Observation error

28 Match up IBM with SS3 We compared: 1.Total mortality by age 2.Catch number-at-age 3.Population abundace-at-age 4.SSB 5.Growth curve 6.etc.

Total mortality of IBM and SS3

1.How does fish’s growth change through time? 2.What is the major impact of time-varying growth on population dynamics? 3.Can we include time-varying growth in stock assessment? – How do we include time-varying growth in stock assessment? 4.What kind of data do we need for estimating time-varying growth? – CPUE, Size composition, conditional age composition, tagging data 5.How many the above data do we need for estimating time-varying growth? 6.What is the relationship between time-varying growth and time- varying selectivity? 7.How does the time-varying growth affect the recruitment’s estimation? 8.What is the combined impact of both recruitment deviation and time- varying growth on population dynamics? 30 Discussion points

Stock assessment and model selection Issue: The estimated quantities important for management can be sensitive to the model structure. Consequences: Overconfident inferences and decisions that may be more risky than expected. Assessment data Best model Stock status Alternative hypotheses/ models NRC, Spatial (Punt et al., 2000) Sex-specific (Wang et al., 2005) Time-varying mortality (Deroba & Schueller, 2013), selectivity (Martell & Stewart, 2014), growth (Whitten et al., 2013), etc.