Gra6036- Multivartate Statistics with Econometrics (Psychometrics) Distributions Estimators Ulf H. Olsson Professor of Statistics.

Slides:



Advertisements
Similar presentations
Generalized Method of Moments: Introduction
Advertisements

StatisticalDesign&ModelsValidation. Introduction.
How Should We Assess the Fit of Rasch-Type Models? Approximating the Power of Goodness-of-fit Statistics in Categorical Data Analysis Alberto Maydeu-Olivares.
ECE 8443 – Pattern Recognition LECTURE 05: MAXIMUM LIKELIHOOD ESTIMATION Objectives: Discrete Features Maximum Likelihood Resources: D.H.S: Chapter 3 (Part.
Christopher Dougherty EC220 - Introduction to econometrics (chapter 10) Slideshow: introduction to maximum likelihood estimation Original citation: Dougherty,
Nguyen Ngoc Anh Nguyen Ha Trang
GRA 6020 Multivariate Statistics Confirmatory Factor Analysis Ulf H. Olsson Professor of Statistics.
GRA 6020 Multivariate Statistics Ulf H. Olsson Professor of Statistics.
Met 2651 Serial Correlation and Asymptotic theory Ulf H. Olsson Professor of Statistics.
Factor Analysis Ulf H. Olsson Professor of Statistics.
Maximum likelihood (ML) and likelihood ratio (LR) test
Different chi-squares Ulf H. Olsson Professor of Statistics.
1 Econometrics 1 Lecture 7 Multicollinearity. 2 What is multicollinearity.
GRA 6020 Multivariate Statistics The regression model OLS Regression Ulf H. Olsson Professor of Statistics.
GRA 6020 Multivariate Statistics; The Linear Probability model and The Logit Model (Probit) Ulf H. Olsson Professor of Statistics.
The General LISREL MODEL Ulf H. Olsson Professor of Statistics.
GRA 6020 Multivariate Statistics Confirmatory Factor Analysis Ulf H. Olsson Professor of Statistics.
Statistical Inference Chapter 12/13. COMP 5340/6340 Statistical Inference2 Statistical Inference Given a sample of observations from a population, the.
Økonometri The regression model OLS Regression Ulf H. Olsson Professor of Statistics.
GRA 6020 Multivariate Statistics Ulf H. Olsson Professor of Statistics.
The General LISREL MODEL and Non-normality Ulf H. Olsson Professor of Statistics.
GRA 6020 Multivariate Statistics Ulf H. Olsson Professor of Statistics.
The General (LISREL) SEM model Ulf H. Olsson Professor of statistics.
Statistics 350 Lecture 14. Today Last Day: Matrix results and Chapter 5 Today: More matrix results and Chapter 5 Please read Chapter 5.
GRA 6020 Multivariate Statistics The Structural Equation Model Ulf H. Olsson Professor of Statistics.
GRA 6020 Multivariate Statistics; The Linear Probability model and The Logit Model (Probit) Ulf H. Olsson Professor of Statistics.
Met 2212 Multivariate Statistics
Today Today: Chapter 9 Assignment: 9.2, 9.4, 9.42 (Geo(p)=“geometric distribution”), 9-R9(a,b) Recommended Questions: 9.1, 9.8, 9.20, 9.23, 9.25.
The General LISREL MODEL and Non-normality Ulf H. Olsson Professor of Statistics.
Different chi-squares Ulf H. Olsson Professor of Statistics.
Measurement Models Ulf H. Olsson Professor of Statistics.
GRA 6020 Multivariate Statistics; The Logit Model Introduction to Multilevel Models Ulf H. Olsson Professor of Statistics.
GRA 6020 Multivariate Statistics The regression model OLS Regression Ulf H. Olsson Professor of Statistics.
Met 2212 Multivariate Statistics Path Analysis Ulf H. Olsson Professor of Statistics.
GRA 6020 Multivariate Statistics Ulf H. Olsson Professor of Statistics.
Factor Analysis Ulf H. Olsson Professor of Statistics.
Useful Statistical Distributions for Econometrics Econometrics is usually concerned with the estimation of equations of the form: The normal distribution.
GRA 6020 Multivariate Statistics Confirmatory Factor Analysis Ulf H. Olsson Professor of Statistics.
Ulf H. Olsson Professor of Statistics
GRA 6020 Multivariate Statistics Confirmatory Factor Analysis Ulf H. Olsson Professor of Statistics.
GRA 6020 Multivariate Statistics Factor Analysis Ulf H. Olsson Professor of Statistics.
GRA 6020 Multivariate Statistics Regression examples Ulf H. Olsson Professor of Statistics.
The General LISREL Model Ulf H. Olsson Professor of statistics.
GRA 6020 Multivariate Statistics; The Linear Probability model and The Logit Model (Probit) Ulf H. Olsson Professor of Statistics.
The General LISREL MODEL and Non-normality Ulf H. Olsson Professor of Statistics.
Factor Analysis Ulf H. Olsson Professor of Statistics.
The General LISREL MODEL and Non-normality Ulf H. Olsson Professor of Statistics.
Factor Analysis Ulf H. Olsson Professor of Statistics.
Maximum likelihood (ML)
The General (LISREL) SEM model Ulf H. Olsson Professor of statistics.
GRA 6020 Multivariate Statistics Probit and Logit Models Ulf H. Olsson Professor of Statistics.
9. Binary Dependent Variables 9.1 Homogeneous models –Logit, probit models –Inference –Tax preparers 9.2 Random effects models 9.3 Fixed effects models.
Statistics in Food and Resource Economics Lecture I.
Part 0 -- Introduction Statistical Inference and Regression Analysis: Stat-GB , C Professor William Greene Stern School of Business IOMS.
Chapter 7 Point Estimation
MEGN 537 – Probabilistic Biomechanics Ch.5 – Determining Distributions and Parameters from Observed Data Anthony J Petrella, PhD.
Likelihood Methods in Ecology November 16 th – 20 th, 2009 Millbrook, NY Instructors: Charles Canham and María Uriarte Teaching Assistant Liza Comita.
1 Lecture 16: Point Estimation Concepts and Methods Devore, Ch
Lecture 2: Statistical learning primer for biologists
Review of Probability. Important Topics 1 Random Variables and Probability Distributions 2 Expected Values, Mean, and Variance 3 Two Random Variables.
M.Sc. in Economics Econometrics Module I Topic 4: Maximum Likelihood Estimation Carol Newman.
New Information Technologies in Learning Statistics M. Mihova, Ž. Popeska Institute of Informatics Faculty of Natural Sciences and Mathematics, Macedonia.
The Probit Model Alexander Spermann University of Freiburg SS 2008.
Instructor: R. Makoto 1richard makoto UZ Econ313 Lecture notes.
Lecture 32 Summary of previous lecture PANEL DATA SIMULTANEOUS EQUATION MODELS.
Stat 223 Introduction to the Theory of Statistics
Parameter Estimation 主講人:虞台文.
Lecture 2 Interval Estimation
Stat 223 Introduction to the Theory of Statistics
Parametric Methods Berlin Chen, 2005 References:
Presentation transcript:

Gra6036- Multivartate Statistics with Econometrics (Psychometrics) Distributions Estimators Ulf H. Olsson Professor of Statistics

Ulf H. Olsson Two Courses in Multivariate Statistics Gra 6020 Multivariate Statistics Applied with focus on data analysis Non-technical Gra 6036 Multivariate Statistics with Econometrics Technical – focus on both application and understanding “basics” Mathematical notation and Matrix Algebra

Ulf H. Olsson Course outline Gra 6036 Basic Theoretical (Multivariate) Statistics mixed with econometric (psychometric) theory Matrix Algebra Distribution theory (Asymptotical) Application with focus on regression type models Logit Regression Analyzing panel data Factor Models Simultaneous Equation Systems and SEM Using statistics as a good researcher should Research oriented

Ulf H. Olsson Evaluation Term paper (up to three students) 75% 1 – 2 weeks Multipple choice exam (individual) 25% 2 – 3 hours

Ulf H. Olsson Teaching and communication Lecturer 2 – 3 weeks: 3 hours per week (UHO) Theory and demonstrations Exercises 1 week: 2 hours (DK) Assignments and Software applications (SPSS/EVIEWS/LISREL) Blackboard and Homepage Assistance: David Kreiberg (Dep.of economics)

Ulf H. Olsson Week hoursRead 2Basic Multivariate Statistical Analysis. Asymptotic Theory 3Lecture notes 3Logit and Probit Regression3Compendium: Logistic Regression 4Logit and Probit Regression3Compendium: Logistic Regression 5Exercises2 6Panel Models3Book chapter (14): Analyzing Panel Data: Fixed – and Random-Effects Models 7Panel Models3Book chapter (14): Analyzing Panel Data: Fixed – and Random-Effects Models 8Exercises2

Ulf H. Olsson 9Factor Analysis/ Exploratory Factor Analysis 3Structural Equation Modeling. David Kaplan, Confirmatory Factor Analysis3Structural Equation Modeling. David Kaplan, Confirmatory Factor Analysis3Structural Equation Modeling. David Kaplan, Exercises2 13Simultaneous Equations3Structural Equation Modeling. David Kaplan, Structural Equations Models3Structural Equation Modeling. David Kaplan, Structural Equations Models3Structural Equation Modeling. David Kaplan, Exercises2

Ulf H. Olsson Any Questions ?

Ulf H. Olsson Univariate Normal Distribution

Ulf H. Olsson Cumulative Normal Distribution

Ulf H. Olsson Normal density functions

Ulf H. Olsson The Chi-squared distributions

Ulf H. Olsson The Chi-squared distributions

Ulf H. Olsson Bivariate normal distribution

Ulf H. Olsson Standard Normal density functions

Ulf H. Olsson Estimator An estimator is a rule or strategy for using the data to estimate the parameter. It is defined before the data are drawn. The search for good estimators constitutes much of econometrics (psychometrics) Finite/Small sample properties Large sample or asymptotic properties An estimator is a function of the observations, an estimator is thus a sample statistic- since the x’s are random so is the estimator

Ulf H. Olsson Small sample properties

Ulf H. Olsson Large-sample properties

Ulf H. Olsson Introduction to the ML-estimator

Ulf H. Olsson Introduction to the ML-estimator The value of the parameters that maximizes this function are the maximum likelihood estimates Since the logarithm is a monotonic function, the values that maximizes L are the same as those that minimizes ln L

Ulf H. Olsson Introduction to the ML-estimator In sampling from a normal (univariate) distribution with mean  and variance  2 it is easy to verify that: MLs are consistent but not necessarily unbiased

Two asymptotically Equivalent Tests Likelihood ration test Wald test

Ulf H. Olsson The Likelihood Ratio Test

Ulf H. Olsson The Wald Test

Ulf H. Olsson Example of the Wald test Consider a simpel regression model

Ulf H. Olsson Likelihood- and Wald. Example from Simultaneous Equations Systems N=218; # Vars.=9; # free parameters = 21; Df = 24; Likelihood based chi-square = Wald Based chi-square =

Assessing Normality and Multivariate Normality (Continuous variables) Skewness Kurtosis Mardias test

Ulf H. Olsson Bivariate normal distribution

Ulf H. Olsson Positive vs. Negative Skewness Exhibit 1 These graphs illustrate the notion of skewness. Both PDFs have the same expectation and variance. The one on the left is positively skewed. The one on the right is negatively skewed.

Ulf H. Olsson Low vs. High Kurtosis Exhibit 1 These graphs illustrate the notion of kurtosis. The PDF on the right has higher kurtosis than the PDF on the left. It is more peaked at the center, and it has fatter tails.

Ulf H. Olsson J-te order Moments Skewness Kurtosis

Ulf H. Olsson Skewness and Kurtosis

Ulf H. Olsson To Next week Down load LISREL 8.8. Adr.: Read: David Kaplan: Ch.3 (Factor Analysis) Read: Lecture Notes