G89.2247 Lecture 11 G89.2247 Session 12 Analyses with missing data What should be reported?  Hoyle and Panter  McDonald and Moon-Ho (2002)

Slides:



Advertisements
Similar presentations
Handling attrition and non- response in longitudinal data Harvey Goldstein University of Bristol.
Advertisements

Writing up results from Structural Equation Models
Treatment of missing values
CountrySTAT Team-I November 2014, ECO Secretariat,Teheran.
Missing Data Analysis. Complete Data: n=100 Sample means of X and Y Sample variances and covariances of X Y
Some birds, a cool cat and a wolf
CJT 765: Structural Equation Modeling Class 3: Data Screening: Fixing Distributional Problems, Missing Data, Measurement.
Adapting to missing data
How to Handle Missing Values in Multivariate Data By Jeff McNeal & Marlen Roberts 1.
Missing Data in Randomized Control Trials
Before doing comparative research with SEM … Prof. Jarosław Górniak Institute of Sociology Jagiellonian University Krakow.
How to deal with missing data: INTRODUCTION
Modeling Achievement Trajectories When Attrition is Informative Betsy J. Feldman & Sophia Rabe- Hesketh.
Psych 524 Andrew Ainsworth Data Screening 2. Transformation allows for the correction of non-normality caused by skewness, kurtosis, or other problems.
Statistical Methods for Missing Data Roberta Harnett MAR 550 October 30, 2007.
G Lect 31 G Lecture 3 SEM Model notation Review of mediation Estimating SEM models Moderation.
PEAS wprkshop 2 Non-response and what to do about it Gillian Raab Professor of Applied Statistics Napier University.
Multiple imputation using ICE: A simulation study on a binary response Jochen Hardt Kai Görgen 6 th German Stata Meeting, Berlin June, 27 th 2008 Göteborg.
ANCOVA Lecture 9 Andrew Ainsworth. What is ANCOVA?
CFA Rationale: Adjust, repair measurement model as needed without violating the integrity of the structural model test. Often we.
Causal inferences During the last two lectures we have been discussing ways to make inferences about the causal relationships between variables. One of.
1 Introduction to Survey Data Analysis Linda K. Owens, PhD Assistant Director for Sampling & Analysis Survey Research Laboratory University of Illinois.
Trends in Inequality of Educational Opportunity in the Netherlands : The Effect of Missing Data Maarten L. Buis & Harry B.G. Ganzeboom Department.
1 Introduction to Survey Data Analysis Linda K. Owens, PhD Assistant Director for Sampling & Analysis Survey Research Laboratory University of Illinois.
Confirmatory Factor Analysis Psych 818 DeShon. Construct Validity: MTMM ● Assessed via convergent and divergent evidence ● Convergent – Measures of the.
Measurement Models: Exploratory and Confirmatory Factor Analysis James G. Anderson, Ph.D. Purdue University.
CJT 765: Structural Equation Modeling Class 12: Wrap Up: Latent Growth Models, Pitfalls, Critique and Future Directions for SEM.
SW 983 Missing Data Treatment Most of the slides presented here are from the Modern Missing Data Methods, 2011, 5 day course presented by the KUCRMDA,
© John M. Abowd 2007, all rights reserved General Methods for Missing Data John M. Abowd March 2007.
G Lecture 81 Comparing Measurement Models across Groups Reducing Bias with Hybrid Models Setting the Scale of Latent Variables Thinking about Hybrid.
1 G Lect 13W Imputation (data augmentation) of missing data Multiple imputation Examples G Multiple Regression Week 13 (Wednesday)
Roghayeh parsaee  These approaches assume that the study sample arises from a homogeneous population  focus is on relationships among variables 
The Impact of Missing Data on the Detection of Nonuniform Differential Item Functioning W. Holmes Finch.
1 G Lect 13M Why might data be missing in psychological studies? Missing data patterns Overview of statistical approaches Example G Multiple.
Missing Values Raymond Kim Pink Preechavanichwong Andrew Wendel October 27, 2015.
Special Topics in Educational Data Mining HUDK5199 Spring term, 2013 March 13, 2013.
A shared random effects transition model for longitudinal count data with informative missingness Jinhui Li Joint work with Yingnian Wu, Xiaowei Yang.
D/RS 1013 Data Screening/Cleaning/ Preparation for Analyses.
Tutorial I: Missing Value Analysis
INFO 4470/ILRLE 4470 Visualization Tools and Data Quality John M. Abowd and Lars Vilhuber March 16, 2011.
Pre-Processing & Item Analysis DeShon Pre-Processing Method of Pre-processing depends on the type of measurement instrument used Method of Pre-processing.
Advanced Methods and Analysis for the Learning and Social Sciences PSY505 Spring term, 2012 April 9, 2012.
CJT 765: Structural Equation Modeling Final Lecture: Multiple-Group Models, a Word about Latent Growth Models, Pitfalls, Critique and Future Directions.
Chapter 17 STRUCTURAL EQUATION MODELING. Structural Equation Modeling (SEM)  Relatively new statistical technique used to test theoretical or causal.
Using Latent Variable Models in Survey Research Roger E. Millsap Arizona State University Contact: (480)
Plausible Values of Latent Variables: A Useful Approach of Data Reduction for Outcome Measures in Pediatric Studies Jichuan Wang, Ph.D. Children’s National.
DATA STRUCTURES AND LONGITUDINAL DATA ANALYSIS Nidhi Kohli, Ph.D. Quantitative Methods in Education (QME) Department of Educational Psychology 1.
Best Practices for Handling Missing Data
HANDLING MISSING DATA.
Missing data: Why you should care about it and what to do about it
Structural Equation Modeling using MPlus
Rachael Bedford Mplus: Longitudinal Analysis Workshop 26/09/2017
MISSING DATA AND DROPOUT
CJT 765: Structural Equation Modeling
Maximum Likelihood & Missing data
Introduction to Survey Data Analysis
Multiple Imputation.
Multiple Imputation Using Stata
Dealing with missing data
Writing about Structural Equation Models
Presenter: Ting-Ting Chung July 11, 2017
The bane of data analysis
The European Statistical Training Programme (ESTP)
CH2. Cleaning and Transforming Data
Missing Data Mechanisms
Analysis of missing responses to the sexual experience question in evaluation of an adolescent HIV risk reduction intervention Yu-li Hsieh, Barbara L.
The European Statistical Training Programme (ESTP)
Rachael Bedford Mplus: Longitudinal Analysis Workshop 23/06/2015
Clinical prediction models
Chapter 13: Item nonresponse
Presentation transcript:

G Lecture 11 G Session 12 Analyses with missing data What should be reported?  Hoyle and Panter  McDonald and Moon-Ho (2002)

G Lecture 12 Missing Data in SEM Data can be missing for a variety of reasons  Study Design (planned nesting)  Longitudinal Studies  Random events Accidents, fire alarms, blackouts  Systematic nonresponse Refusals Dropouts

G Lecture 13 Missing Data Mechanisms Terms suggested by Rubin  Rubin (1976), Little & Rubin (1987) MISSING COMPLETELY AT RANDOM (MCAR)  Which data point is missing cannot be predicted by any variable, measured or unmeasured. Prob(M|Y)=Prob(M)  The missing data pattern is ignorable. Analyzing available complete data is just fine.

G Lecture 14 Missing Data Mechanisms MISSING AT RANDOM (MAR)  Which data point is missing is systematically related to subject characteristics, but these are all measured Conditional on observed variables, missingness is random Prob(M|Y)=Prob(M|Y observed )  E.g. Lower educated respondents might not answer a certain question.  Missingness can be treated as ignorable

G Lecture 15 Missing Data Mechanisms NOT MISSING AT RANDOM (NMAR)  Data are missing because of process related to value that is unavailable Someone was too depressed to come report about depression Abused woman is not allowed to meet interviewer  Missing data pattern is not ignorable.  Whether missing data are MAR or NMAR can not usually be established empirically.

G Lecture 16 Approaches to Missing Data Listwise deletion  If a person is missing on any analysis variable, he is dropped from the analysis. Pairwise deletion  Correlations/Covariances are computed using all available pairs of data. Imputation of missing data values. Model-based use of complete data  E-M (estimation-maximization approach) SEM-based FIML

G Lecture 17 EM and FIML Use available data to infer sample moment matrix. Uses information from assumed multivariate distribution Patterns of associations can be structured or unstructured. Now implemented in AMOS, EQS, Mplus

G Lecture 18 Example of CFA with Means Model

G Lecture 19 Missing Pattern Group Approach Suppose that one group is missing a whole set of items related to a latent variable. This group can be defined as separate stratum  The effects for the missing variables can be constrained to be equal to the effects estimated in the group with complete data. This can be tedious, but it gives FIML results. See Enders & Bandalos (2001) The relative performance of FIML for missing data in SEM. Structural Equation Modeling, 8:

G Lecture 110 Multiple Imputation Substitute expected values plus noise for missing values. Repeat >5 times. Combine estimates and standard errors using formulas described by Rubin (1987). See also Schafer & Grahm (2002) Missing data: Our view of the state of the art. Psychological Methods, 7:

G Lecture 111 Inference from Multiple Imputation Rubin (1987) recommends computing for each regression weight  An average across the K imputations An estimate of the standard error that takes into account the variation over imputations

G Lecture 112 Communicating SEM Results Keeping up with the expert recommendations  Psychological Methods  Specialty journals Structural Equation Models Multivariate Behavioral Research Applied Psychological Measurement Psychometrika Two kinds of audiences  Researchers interested in the substance of the empirical contribution  Experts in SEM

G Lecture 113 Talking Points of Hoyle&Panter, McDonald&Ho Model specification  Theoretical justification  Identifiability Measurement Model Structural Model Model estimation  Characteristics of data Distribution form Sample size Missing data

G Lecture 114 Talking Points of Hoyle&Panter, McDonald&Ho Model estimation  Estimation method: ML, GLS, ULS, ADF  Goodness of estimates and standard errors Model Selection and Fit Statistics Alternative and Equivalent Models Reporting Results  Path diagrams  Tabular information  Use software conventions?