Multivariate Statistics Introduction W. M. van der Veld University of Amsterdam.

Slides:



Advertisements
Similar presentations
The Robert Gordon University School of Engineering Dr. Mohamed Amish
Advertisements

Kin 304 Regression Linear Regression Least Sum of Squares
Regression analysis Relating two data matrices/tables to each other Purpose: prediction and interpretation Y-data X-data.
FTP Biostatistics II Model parameter estimations: Confronting models with measurements.
The General Linear Model Or, What the Hell’s Going on During Estimation?
Multiple Regression Fenster Today we start on the last part of the course: multivariate analysis. Up to now we have been concerned with testing the significance.
Basic Mathematics for Portfolio Management. Statistics Variables x, y, z Constants a, b Observations {x n, y n |n=1,…N} Mean.
Basics of regression analysis
REGRESSION Predict future scores on Y based on measured scores on X Predictions are based on a correlation from a sample where both X and Y were measured.
Statistics for the Social Sciences Psychology 340 Spring 2005 Course Review.
Chapter 2 Simple Linear Regression – What is it, Why do we do it?
Chapter 6 (cont.) Regression Estimation. Simple Linear Regression: review of least squares procedure 2.
1 D r a f t Life Cycle Assessment A product-oriented method for sustainability analysis UNEP LCA Training Kit Module k – Uncertainty in LCA.
9 - 1 Intrinsically Linear Regression Chapter Introduction In Chapter 7 we discussed some deviations from the assumptions of the regression model.
Chapter 13: Inference in Regression
Introductory Statistical Concepts. Disclaimer – I am not an expert SAS programmer. – Nothing that I say is confirmed or denied by Texas A&M University.
1 1 Slide © 2007 Thomson South-Western. All Rights Reserved OPIM 303-Lecture #9 Jose M. Cruz Assistant Professor.
1 1 Slide © 2012 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole.
1 1 Slide Multiple Regression n Multiple Regression Model n Least Squares Method n Multiple Coefficient of Determination n Model Assumptions n Testing.
Review of Matrices Or A Fast Introduction.
Multivariate Statistics Matrix Algebra II W. M. van der Veld University of Amsterdam.
1 1 Slide © 2008 Thomson South-Western. All Rights Reserved Chapter 15 Multiple Regression n Multiple Regression Model n Least Squares Method n Multiple.
LECTURE 2. GENERALIZED LINEAR ECONOMETRIC MODEL AND METHODS OF ITS CONSTRUCTION.
Chapter 16 The Elaboration Model Key Terms. Descriptive statistics Statistical computations describing either the characteristics of a sample or the relationship.
MTH 161: Introduction To Statistics
Various topics Petter Mostad Overview Epidemiology Study types / data types Econometrics Time series data More about sampling –Estimation.
Business Statistics for Managerial Decision Farideh Dehkordi-Vakil.
Multivariate Statistics Matrix Algebra I W. M. van der Veld University of Amsterdam.
Multiple Regression and Model Building Chapter 15 Copyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved.McGraw-Hill/Irwin.
IGCSE Solving Equations Dr J Frost Last modified: 23 rd August 2015 Objectives: From the specification:
Canonical Correlation Psy 524 Andrew Ainsworth. Matrices Summaries and reconfiguration.
Chapter 13 Multiple Regression
Business Statistics: A Decision-Making Approach, 6e © 2005 Prentice-Hall, Inc. Chap 13-1 Introduction to Regression Analysis Regression analysis is used.
Multivariate Data Analysis Chapter 2 – Examining Your Data
Multivariate Statistics Matrix Algebra I Solutions to the exercises W. M. van der Veld University of Amsterdam.
Copyright © 2011, 2005, 1998, 1993 by Mosby, Inc., an affiliate of Elsevier Inc. Chapter 19: Statistical Analysis for Experimental-Type Research.
LESSON 6: REGRESSION 2/21/12 EDUC 502: Introduction to Statistics.
Multivariate Statistics Matrix Algebra I Exercises Alle proofs veranderen in show by example W. M. van der Veld University of Amsterdam.
Regression Analysis Intro to OLS Linear Regression.
Principal Component Analysis
Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Multiple Regression Chapter 14.
Multiple Linear Regression An introduction, some assumptions, and then model reduction 1.
Computer Graphics Mathematical Fundamentals Lecture 10 Taqdees A. Siddiqi
Psychology 202a Advanced Psychological Statistics November 3, 2015.
Regression and Correlation of Data Correlation: Correlation is a measure of the association between random variables, say X and Y. No assumption that one.
Methods of multivariate analysis Ing. Jozef Palkovič, PhD.
An Introduction to Matrix Algebra Math 2240 Appalachian State University Dr. Ginn.
Howard Community College
Lecture Slides Elementary Statistics Twelfth Edition
RESEARCH – Module 1 Introduction
Regression Analysis AGEC 784.
Bivariate & Multivariate Regression Analysis
Review Problems Matrices
Comparing Exponential and Linear Functions
Regression Chapter 6 I Introduction to Regression
Kin 304 Regression Linear Regression Least Sum of Squares
Essentials of Modern Business Statistics (7e)
Multiple Regression and Model Building
BPK 304W Regression Linear Regression Least Sum of Squares
BPK 304W Correlation.
Simple Linear Regression - Introduction
Lecture Slides Elementary Statistics Thirteenth Edition
Regression Analysis Week 4.
REGRESSION.
Matrix Algebra - Overview
Multivariate Statistics
ENM 310 Design of Experiments and Regression Analysis Chapter 3
Cases. Simple Regression Linear Multiple Regression.
Matrices and Determinants
Presentation transcript:

Multivariate Statistics Introduction W. M. van der Veld University of Amsterdam

Course Overview Matrix Algebra Multivariate Methods and Models Seminar

Matrix Algebra Why Matrix Algebra? –The mathematics in which multivariate analysis is cast is matrix algebra. –Basic knowledge of matrix algebra is also essential for those students going on to the advanced courses in structural equation modeling or regression analysis. What is Matrix Algebra? –Matrix algebra is a branch of mathematics –We will look on it simply as a tool that enables us to work with matrices. –Matrices, for our purposes, are nothing but systematic collections of observed data. –Generally, in multivariate analysis, we have observations on a certain number of variables.

Multivariate Methods and Models y = a + bx Linear equation If written in matrix form: Y = Xb+e, then it is known as the general linear model (GLIM), of which most multivariate models are a special case. Some examples: (0,a) (b,0)

Multivariate Methods and Models Simple Regression: y= α+βx+ε Or in deviation scores: y= βx+ε And normally the error term is not included in the presentation of the formula: y= βx

Multivariate Methods and Models Multiple Regression: y = α + β 1 x 1 + β 2 x 2 + …+ β n x n + ε Or in deviation scores: y = β 1 x 1 + β 2 x 2 + …+ β n x n + ε And normally the error term is not included in the presentation of the formula: y = β 1 x 1 + β 2 x 2 + …+ β n x n

Multivariate Methods and Models Multivariate Regression: y 1 = α + β 1 x 1 + β 2 x 2 + β 3 x 3 + ε y 2 = α + β 2 x 2 + ε …… y n = α + β 1 x 1 + β 3 x 3 + ε Or in deviation scores: without the alpha’s. Here we normally do include the error term.

Multivariate Methods and Models Principal component analysis: ξ = α + β 1 x 1 + β 2 x 2 + …+ β n x n Or in deviation scores: ξ = β 1 x 1 + β 2 x 2 + …+ β n x n Note, that this is a form of multiple regression with an unmeasured y variable.

Multivariate Methods and Models Factor analysis: x = α 1 + λ 1 ξ 1 + ε 1 x = α 2 + λ 2 ξ 1 + ε 2 …. x= α n + λ n ξ 1 + ε n Or in deviation scores: without the alpha’s Note, that this is a form of multivariate regression with an unmeasured x variable.

Multivariate Methods and Models These multivariate models have two common assumptions? –The dependent variable(s) are not nominal. –The relation between the variables is linear! –So these models can be solved using linear matrix algebra. There are also situations where the dependent variable is nominal. What to do? –Use different models (eg. correspondence analysis). There are however situations in which linearity does not hold. What to do? –Sometimes it is possible to transform the relationship so that the transformed relation is linear (eg. loglinear analysis).

Multivariate Methods and Models Please be aware that this description and the suggestions are far from exhaustive, but merely serve as an illustration of multivariate approaches discussed in this course.

Seminar During the course you will write a paper (in a group of 3 to 4 people) on a subject of your own choice. However using the tools handed in this course. This paper will be presented in the last meeting, when you will organize a seminar. When possible, I will invite scholars on the topics that you have studied, and ask them to also give a presentation. Otherwise, I will present some of my own work, and ask some colleagues to present some of their own work.