Recommended modeling approach Version 2.0. The law of conflicting data Axiom Data is true Implication Conflicting data implies model misspecification.

Slides:



Advertisements
Similar presentations
Multiple Regression.
Advertisements

Autocorrelation and Heteroskedasticity
Sardine Two-Stock Hypothesis: Results at the Posterior Mode SPSWG Meeting 28 th August 2013 Carryn de Moor Doug Butterworth Marine Resource Assessment.
11-1 Empirical Models Many problems in engineering and science involve exploring the relationships between two or more variables. Regression analysis.
Qualitative predictor variables
Regression and correlation methods
Computational Statistics. Basic ideas  Predict values that are hard to measure irl, by using co-variables (other properties from the same measurement.
The Simple Regression Model
Structural Equation Modeling
NOTATION & ASSUMPTIONS 2 Y i =  1 +  2 X 2i +  3 X 3i + U i Zero mean value of U i No serial correlation Homoscedasticity Zero covariance between U.
BA 275 Quantitative Business Methods
Irwin/McGraw-Hill © Andrew F. Siegel, 1997 and l Chapter 12 l Multiple Regression: Predicting One Factor from Several Others.
CHAPTER 21 Inferential Statistical Analysis. Understanding probability The idea of probability is central to inferential statistics. It means the chance.
6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.
Time Series Building 1. Model Identification
Simple Linear Regression. Start by exploring the data Construct a scatterplot  Does a linear relationship between variables exist?  Is the relationship.
Education 793 Class Notes Joint Distributions and Correlation 1 October 2003.
The current status of fisheries stock assessment Mark Maunder Inter-American Tropical Tuna Commission (IATTC) Center for the Advancement of Population.
LINEAR REGRESSION: Evaluating Regression Models Overview Assumptions for Linear Regression Evaluating a Regression Model.
LINEAR REGRESSION: Evaluating Regression Models. Overview Assumptions for Linear Regression Evaluating a Regression Model.
LINEAR REGRESSION: Evaluating Regression Models. Overview Standard Error of the Estimate Goodness of Fit Coefficient of Determination Regression Coefficients.
458 Fitting models to data – II (The Basics of Maximum Likelihood Estimation) Fish 458, Lecture 9.
Multivariate Data Analysis Chapter 4 – Multiple Regression.
Topic 3: Regression.
The Simple Regression Model
Violations of Assumptions In Least Squares Regression.
Hui-Hua Lee 1, Kevin R. Piner 1, Mark N. Maunder 2 Evaluation of traditional versus conditional fitting of von Bertalanffy growth functions 1 NOAA Fisheries,
Part 18: Regression Modeling 18-1/44 Statistics and Data Analysis Professor William Greene Stern School of Business IOMS Department Department of Economics.
Dr. Mario MazzocchiResearch Methods & Data Analysis1 Correlation and regression analysis Week 8 Research Methods & Data Analysis.
Meta-Analysis and Meta- Regression Airport Noise and Home Values J.P. Nelson (2004). “Meta-Analysis of Airport Noise and Hedonic Property Values: Problems.
Lecture 5 Correlation and Regression
Regression and Correlation Methods Judy Zhong Ph.D.
Correlation and Regression
Class 4 Ordinary Least Squares SKEMA Ph.D programme Lionel Nesta Observatoire Français des Conjonctures Economiques
Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 12-1 Chapter 12 Simple Linear Regression Statistics for Managers Using.
Quantitative Methods Heteroskedasticity.
1 FORECASTING Regression Analysis Aslı Sencer Graduate Program in Business Information Systems.
Slide 1 Estimating Performance Below the National Level Applying Simulation Methods to TIMSS Fourth Annual IES Research Conference Dan Sherman, Ph.D. American.
B AD 6243: Applied Univariate Statistics Repeated Measures ANOVA Professor Laku Chidambaram Price College of Business University of Oklahoma.
VI. Evaluate Model Fit Basic questions that modelers must address are: How well does the model fit the data? Do changes to a model, such as reparameterization,
Evaluation of a practical method to estimate the variance parameter of random effects for time varying selectivity Hui-Hua Lee, Mark Maunder, Alexandre.
1 Review of ANOVA & Inferences About The Pearson Correlation Coefficient Heibatollah Baghi, and Mastee Badii.
Why Model? Make predictions or forecasts where we don’t have data.
Copyright ©2011 Nelson Education Limited Linear Regression and Correlation CHAPTER 12.
8 Sampling Distribution of the Mean Chapter8 p Sampling Distributions Population mean and standard deviation,  and   unknown Maximal Likelihood.
Quick and Simple Statistics Peter Kasper. Basic Concepts Variables & Distributions Variables & Distributions Mean & Standard Deviation Mean & Standard.
Workshop on Stock Assessment Methods 7-11 November IATTC, La Jolla, CA, USA.
G Lecture 81 Comparing Measurement Models across Groups Reducing Bias with Hybrid Models Setting the Scale of Latent Variables Thinking about Hybrid.
Multiple Regression. Simple Regression in detail Y i = β o + β 1 x i + ε i Where Y => Dependent variable X => Independent variable β o => Model parameter.
© 2006 by The McGraw-Hill Companies, Inc. All rights reserved. 1 Chapter 12 Testing for Relationships Tests of linear relationships –Correlation 2 continuous.
Correlation & Regression Analysis
U.S. Department of Commerce | National Oceanic and Atmospheric Administration | NOAA Fisheries | Page 1 Model Misspecification and Diagnostics and the.
The effect of variable sampling efficiency on reliability of the observation error as a measure of uncertainty in abundance indices from scientific surveys.
Copyright © 2010 Pearson Education, Inc Chapter Seventeen Correlation and Regression.
Using distributions of likelihoods to diagnose parameter misspecification of integrated stock assessment models Jiangfeng Zhu * Shanghai Ocean University,
Evaluation of structural equation models Hans Baumgartner Penn State University.
CAN DIAGNOSTIC TESTS HELP IDENTIFY WHAT MODEL STRUCTURE IS MISSPECIFIED? Felipe Carvalho 1, Mark N. Maunder 2,3, Yi-Jay Chang 1, Kevin R. Piner 4, Andre.
Quantitative Methods. Bivariate Regression (OLS) We’ll start with OLS regression. Stands for  Ordinary Least Squares Regression. Relatively basic multivariate.
Data weighting and data conflicts in fishery stock assessments Chris Francis Wellington, New Zealand CAPAM workshop, “ Data conflict and weighting, likelihood.
Is down weighting composition data adequate to deal with model misspecification or do we need to fix the model? Sheng-Ping Wang, Mark N. Maunder National.
Model Comparison. Assessing alternative models We don’t ask “Is the model right or wrong?” We ask “Do the data support a model more than a competing model?”
Inference about the slope parameter and correlation
The simple linear regression model and parameter estimation
I271B Quantitative Methods
BA 275 Quantitative Business Methods
Regression Computer Print Out
Simple Linear Regression
JABBA-Select: Performance evaluation of JABBA-Select against and an age-structured simulator and estimation model Henning Winker* MARAM International.
Product moment correlation
Section 6.2 Prediction.
Presentation transcript:

Recommended modeling approach Version 2.0

The law of conflicting data Axiom Data is true Implication Conflicting data implies model misspecification Caveat Data conflict needs to be interpreted in the context of random sampling error Significance Down weighting or dropping conflicting data is not necessarily appropriate because it may not resolve the model misspecification

Preventing data conflict Estimate random sampling variance outside the stock assessment model Use likelihood functions based on the sampling design to represent the fit to the data Account for correlations in the data Model annual recruitment variation with a distributional penalty. Estimate the variance of the penalty if possible. Divide data into fleets so that selectivity is relatively constant over time within a fleet Model fishery selectivity using a flexible and time varying method Ensure that surveys/fisheries used for developing indices of relative abundance have time invariant selectivity Use robust MVN with covariance from data (realistic estimates) A problem Only use the main data that is representative Use Anders’ S-S Model with more Fishery structure Identify what quantities are of interest and which can be estimated

Or account for Process error In the likelihood (estimate sd in MVN) Consider adding other data Present alternative model structures that eliminate Inconsistencies and consider eliminating conflicting (index) data and have alternative data runs If the index does not provide absolute abundance information, give up and go home Look at correlations In residuals

Preventing data conflict Estimate random sampling variance outside the stock assessment model Use likelihood functions based on the sampling design to represent the fit to the data Account for correlations in the data Model annual recruitment variation with a distributional penalty. Estimate the variance of the penalty if possible. Divide data into fleets so that selectivity is relatively constant over time within a fleet Model fishery selectivity using a flexible and time varying method Ensure that surveys/fisheries used for developing indices of relative abundance have time invariant selectivity