G89.2247 Lecture 51 Estimation details Testing Fit Fit indices Arguing for models.

Slides:



Advertisements
Similar presentations
Writing up results from Structural Equation Models
Advertisements

Multilevel analysis with EQS. Castello2004 Data is datamlevel.xls, datamlevel.sav, datamlevel.ess.
1 Regression as Moment Structure. 2 Regression Equation Y =  X + v Observable Variables Y z = X Moment matrix  YY  YX  =  YX  XX Moment structure.
Structural Equation Modeling. What is SEM Swiss Army Knife of Statistics Can replicate virtually any model from “canned” stats packages (some limitations.
Structural Equation Modeling Using Mplus Chongming Yang Research Support Center FHSS College.
Structural Equation Modeling
Lecture (11,12) Parameter Estimation of PDF and Fitting a Distribution Function.
Confirmatory factor analysis GHQ 12. From Shevlin/Adamson 2005:
1 SSS II Lecture 1: Correlation and Regression Graduate School 2008/2009 Social Science Statistics II Gwilym Pryce
SOC 681 James G. Anderson, PhD
Structural Equation Modeling
Statistics II: An Overview of Statistics. Outline for Statistics II Lecture: SPSS Syntax – Some examples. Normal Distribution Curve. Sampling Distribution.
Multivariate Data Analysis Chapter 11 - Structural Equation Modeling.
Structural Equation Modeling
Example of EQS with ‘raw data’ Sintaxis generator Method = robust Multiple group Mean and covariances (MACS)
GRA 6020 Multivariate Statistics Confirmatory Factor Analysis Ulf H. Olsson Professor of Statistics.
Lecture 16 – Thurs, Oct. 30 Inference for Regression (Sections ): –Hypothesis Tests and Confidence Intervals for Intercept and Slope –Confidence.
BCOR 1020 Business Statistics Lecture 21 – April 8, 2008.
LECTURE 16 STRUCTURAL EQUATION MODELING.
Factor Analysis Ulf H. Olsson Professor of Statistics.
The General (LISREL) SEM model Ulf H. Olsson Professor of statistics.
G Lect 31 G Lecture 3 SEM Model notation Review of mediation Estimating SEM models Moderation.
Stages in Structural Equation Modeling
G Lecture 61 G SEM Lecture 6 An Example Measures of Fit Complex nonrecursive models How can we tell if a model is identified? Direct and.
Multiple Sample Models James G. Anderson, Ph.D. Purdue University.
Confirmatory factor analysis
AM Recitation 2/10/11.
Structural Equation Modeling 3 Psy 524 Andrew Ainsworth.
Moderation in Structural Equation Modeling: Specification, Estimation, and Interpretation Using Quadratic Structural Equations Jeffrey R. Edwards University.
Structural Equation Modeling
Confirmatory Factor Analysis Psych 818 DeShon. Purpose ● Takes factor analysis a few steps further. ● Impose theoretically interesting constraints on.
CJT 765: Structural Equation Modeling Class 7: fitting a model, fit indices, comparingmodels, statistical power.
10 SEM is Based on the Analysis of Covariances! Why?Analysis of correlations represents loss of information. A B r = 0.86r = 0.50 illustration.
Rasch trees: A new method for detecting differential item functioning in the Rasch model Carolin Strobl Julia Kopf Achim Zeileis.
Estimation Kline Chapter 7 (skip , appendices)
CJT 765: Structural Equation Modeling Class 8: Confirmatory Factory Analysis.
1 General Structural Equations (LISREL) Week 1 #4.
Measurement Models: Exploratory and Confirmatory Factor Analysis James G. Anderson, Ph.D. Purdue University.
Assessing Hypothesis Testing Fit Indices
Measures of Fit David A. Kenny January 25, Background Introduction to Measures of Fit.
Multivariate Statistics Confirmatory Factor Analysis I W. M. van der Veld University of Amsterdam.
Measurement Models: Identification and Estimation James G. Anderson, Ph.D. Purdue University.
CHEMISTRY ANALYTICAL CHEMISTRY Fall Lecture 6.
G Lecture 81 Comparing Measurement Models across Groups Reducing Bias with Hybrid Models Setting the Scale of Latent Variables Thinking about Hybrid.
Multiple Regression. Simple Regression in detail Y i = β o + β 1 x i + ε i Where Y => Dependent variable X => Independent variable β o => Model parameter.
Environmental Modeling Basic Testing Methods - Statistics III.
G Lecture 3 Review of mediation Moderation SEM Model notation
Assessing Hypothesis Testing Fit Indices Kline Chapter 8 (Stop at 210) Byrne page
CJT 765: Structural Equation Modeling Class 8: Confirmatory Factory Analysis.
I271B QUANTITATIVE METHODS Regression and Diagnostics.
Chapter 13.  Both Principle components analysis (PCA) and Exploratory factor analysis (EFA) are used to understand the underlying patterns in the data.
SEM Model Fit: Introduction David A. Kenny January 12, 2014.
Estimation Kline Chapter 7 (skip , appendices)
Examples. Path Model 1 Simple mediation model. Much of the influence of Family Background (SES) is indirect.
ALISON BOWLING CONFIRMATORY FACTOR ANALYSIS. REVIEW OF EFA Exploratory Factor Analysis (EFA) Explores the data All measured variables are related to every.
The general structural equation model with latent variates Hans Baumgartner Penn State University.
G Lecture 71 Revisiting Hierarchical Mixed Models A General Version of the Model Variance/Covariances of Two Kinds of Random Effects Parameter Estimation.
The SweSAT Vocabulary (word): understanding of words and concepts. Data Sufficiency (ds): numerical reasoning ability. Reading Comprehension (read): Swedish.
Model Comparison. Assessing alternative models We don’t ask “Is the model right or wrong?” We ask “Do the data support a model more than a competing model?”
Measures of Fit David A. Kenny.
Structural Equation Modeling using MPlus
Correlation, Regression & Nested Models
CJT 765: Structural Equation Modeling
Writing about Structural Equation Models
Simple Linear Regression and Correlation
Statistics II: An Overview of Statistics
Confirmatory Factor Analysis
SOC 681 – Causal Models with Directly Observed Variables
Causal Relationships with measurement error in the data
Testing Causal Hypotheses
Presentation transcript:

G Lecture 51 Estimation details Testing Fit Fit indices Arguing for models

G Lecture 52 A simulated example EQS makes it easy to simulate an example  Y2Y2 Y1Y1 X2X2       X1X1 

G Lecture 53 EQS Syntax

G Lecture 54 Estimating the Recursive Example Specify parameters to be estimated in model (  Compute sample variance/covariance S Construct expected representation of variance covariance under model [  Choose estimates that make representation as close as possible according to a fitting function

G Lecture 55 Form of  The form of  can be worked out with expectation operators

G Lecture 56 Fitting Functions ML minimizes ULS minimizes GLS minimizes ADF minimizes a weighted least squares criterion, but with a weight different than GLS

G Lecture 57 Estimation Example using Excel

G Lecture 58 Measures of Fit: Chi Square If model is not saturated, and If residuals of Y have multivariate normal distribution  ML*(N-1) and GLS*(N-1) have large sample chi squared distributions  Degrees of freedom given by difference in number of parameters in model compared to saturated model

G Lecture 59 Chi Square Test Issues Appeal of Chi Square Test  Makes model fit appear confirmatory  Can reject an ill fitting model  Can compare nested models  Can calculate power Problems with Chi Square Test  Global test will reject a good model if data are not multivariate normal  Usual issues of significance testing

G Lecture 510 Global Fit Measures A host of measures have been developed to provide an index of fit  Many scaled between 0 and 1 Analogous to R-square in regression Began to be used as test of model fit oConventional cut point: >.90  Some focus on residuals Conventional cut point <.05  All measures look at global rather than specific fit

G Lecture 511 Hu and Bentler (1995) Found that fit measures were not robust  Different answers for different sample sizes  Affected by distribution and independence of latent variables  Gave different answers depending on which fitting algorithm is used. When ML is used, N>250, and latent variables are independent, H&B recommend  NNFI, Bollen89(IFI), CFI, MacDonald (MFI)  Best for comparing models rather than for rigid test >.90

G Lecture 512 Details of Fit Statistics Measures based on Relative Fit  Define a “strawman” model that is point of comparison Usually model that assumes that all variables are uncorrelated with each other Compute LR test statistic, T B on df B  Construct credible “target” model Compute LR test statistic, T T on df T

G Lecture 513 Type I Comparative Index Bentler and Bonett NFI  “Normed Fit Index”  Falls in range 0,1. Interpreted as amount of available discrepancy accounted by target model  Apparently is affected by N, and estimation method when sample size is small

G Lecture 514 Type II Comparative Index: (refined by central chi square) Tucker-Lewis (NNFI) Reaches 1.0 if T T equals its expected value Not normed in range 0,1 Seems to be less affected by N, and relatively stable across GLS and ML  Hu and Bentler recommend it

G Lecture 515 Type III Comparative Index (refined by noncentral chi square) The Comparative Fit Index (CFI) CFI=BFI (if BFI≥0) CFI=0 (otherwise) Appears more stable for small samples (n>250) and relatively stable from ML to GLS when latent variables are independent.  Hu and Bentler recommend

G Lecture 516 Absolute Fit Measures: GFI and AGFI Jöreskog suggested two measures based on multivariate variance expressions AGFI adjusts for parsimony given r=(p+q) variables Hu and Bentler report that GFI and AGFI accept many models when N is large, and they do not perform well when latent variables are associated.

G Lecture 517 Other Absolute Fit Measures Akaike AIC=T T +2f  Where T T is the ML chi square and f is the number of parameters estimated by the model  Models with smaller AIC are preferred Root Mean Square Error of Approximation  where F is the minimized fitting function Look for values less than.05 See Browne and Cudeck(1993)

G Lecture 518 Error of Approximation vs. Errors of Estimation Browne, M. W. and Cudeck, R. (1993) Alternative ways of assessing model fit. In Bollen, K.A. & Long, J.S. (eds) Testing structural equation models. Newbury Park, CA: Sage. When measurement models are considered along with structural models, almost all SEM models are misspecified to some extent  We should ask about that extent  We should distinguish between how close the model approximates the true covariance structure and how fuzzy is our estimate of the model.  They find support for RMSEA as an index

G Lecture 519 Arguing for Models People report many fit statistics and claim that a model fits if values exceed.90. Be skeptical about global fit statistics – The fit can be great in one part of model and awful in another Most impressive is a series of models, with one fitting better than another If model is developed with a data set, then the fit statistics should be calculated with a replication data set.