Statistics 350 Lecture 14. Today Last Day: Matrix results and Chapter 5 Today: More matrix results and Chapter 5 Please read Chapter 5.

Slides:



Advertisements
Similar presentations
The Simple Linear Regression Model Specification and Estimation Hill et al Chs 3 and 4.
Advertisements

Topic 12: Multiple Linear Regression
Copula Regression By Rahul A. Parsa Drake University &
Chapter 12 Simple Linear Regression
The General Linear Model. The Simple Linear Model Linear Regression.
Simple Linear Regression
Chapter 10 Simple Regression.
Statistics 350 Lecture 15. Today Last Day: More matrix results and Chapter 5 Today: Start Chapter 6.
1 Chapter 3 Multiple Linear Regression Ray-Bing Chen Institute of Statistics National University of Kaohsiung.
GRA 6020 Multivariate Statistics Ulf H. Olsson Professor of Statistics.
Statistics 350 Lecture 16. Today Last Day: Introduction to Multiple Linear Regression Model Today: More Chapter 6.
Statistics 200b. Chapter 5. Chapter 4: inference via likelihood now Chapter 5: applications to particular situations.
Probability theory 2011 The multivariate normal distribution  Characterizing properties of the univariate normal distribution  Different definitions.
Multivariate Data Analysis Chapter 4 – Multiple Regression.
The Simple Regression Model
NOTES ON MULTIPLE REGRESSION USING MATRICES  Multiple Regression Tony E. Smith ESE 502: Spatial Data Analysis  Matrix Formulation of Regression  Applications.
Statistics 350 Lecture 11. Today Last Day: Start Chapter 3 Today: Section 3.8 Mid-Term Friday…..Sections ; ; (READ)
GRA 6020 Multivariate Statistics Ulf H. Olsson Professor of Statistics.
Today Today: More Chapter 3 Reading: –Please read Chapter 3 –Suggested Problems: 3.2, 3.9, 3.12, 3.20, 3.23, 3.24, 3R5, 3R9.
1 MF-852 Financial Econometrics Lecture 6 Linear Regression I Roy J. Epstein Fall 2003.
Probability & Statistics for Engineers & Scientists, by Walpole, Myers, Myers & Ye ~ Chapter 11 Notes Class notes for ISE 201 San Jose State University.
Topic4 Ordinary Least Squares. Suppose that X is a non-random variable Y is a random variable that is affected by X in a linear fashion and by the random.
This Week Continue with linear regression Begin multiple regression –Le 8.2 –C & S 9:A-E Handout: Class examples and assignment 3.
Probability theory 2008 Outline of lecture 5 The multivariate normal distribution  Characterizing properties of the univariate normal distribution  Different.
Statistics 350 Lecture 17. Today Last Day: Introduction to Multiple Linear Regression Model Today: More Chapter 6.
Factor Analysis Ulf H. Olsson Professor of Statistics.
The Multivariate Normal Distribution, Part 2 BMTRY 726 1/14/2014.
Matrix Approach to Simple Linear Regression KNNL – Chapter 5.
Separate multivariate observations
Maximum Likelihood Estimation
Stats for Engineers Lecture 9. Summary From Last Time Confidence Intervals for the mean t-tables Q Student t-distribution.
Statistics for Business and Economics Dr. TANG Yu Department of Mathematics Soochow University May 28, 2007.
Regression Analysis Week 8 DIAGNOSTIC AND REMEDIAL MEASURES Residuals The main purpose examining residuals Diagnostic for Residuals Test involving residuals.
Introduction to Matrices and Matrix Approach to Simple Linear Regression.
Prediction, Goodness-of-Fit, and Modeling Issues Prepared by Vera Tabakova, East Carolina University.
Chapter 6 Simple Regression Introduction Fundamental questions – Is there a relationship between two random variables and how strong is it? – Can.
Geology 5670/6670 Inverse Theory 21 Jan 2015 © A.R. Lowry 2015 Read for Fri 23 Jan: Menke Ch 3 (39-68) Last time: Ordinary Least Squares Inversion Ordinary.
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION Probability and statistics review ASEN 5070 LECTURE.
Ch14: Linear Least Squares 14.1: INTRO: Fitting a pth-order polynomial will require finding (p+1) coefficients from the data. Thus, a straight line (p=1)
Geology 6600/7600 Signal Analysis 02 Sep 2015 © A.R. Lowry 2015 Last time: Signal Analysis is a set of tools used to extract information from sequences.
Chapter 11: Linear Regression and Correlation Regression analysis is a statistical tool that utilizes the relation between two or more quantitative variables.
1 1 Slide The Simple Linear Regression Model n Simple Linear Regression Model y =  0 +  1 x +  n Simple Linear Regression Equation E( y ) =  0 + 
Statistics 350 Lecture 13. Today Last Day: Some Chapter 4 and start Chapter 5 Today: Some matrix results Mid-Term Friday…..Sections ; ;
1 Ka-fu Wong University of Hong Kong A Brief Review of Probability, Statistics, and Regression for Forecasting.
1 AAEC 4302 ADVANCED STATISTICAL METHODS IN AGRICULTURAL RESEARCH Part II: Theory and Estimation of Regression Models Chapter 5: Simple Regression Theory.
Statistics 350 Lecture 2. Today Last Day: Section Today: Section 1.6 Homework #1: Chapter 1 Problems (page 33-38): 2, 5, 6, 7, 22, 26, 33, 34,
The simple linear regression model and parameter estimation
Chapter 11: Linear Regression and Correlation
Lecture 11: Simple Linear Regression
Lecture #26 Thursday, November 17, 2016 Textbook: 14.1 and 14.3
Decomposition of Sum of Squares
Multiple Linear Regression
REGRESSION (CONTINUED)
Inference for the mean vector
Regression.
Slope of the regression line:
Matrices Definition: A matrix is a rectangular array of numbers or symbolic elements In many applications, the rows of a matrix will represent individuals.
Review of Chapter 3 where Multiple Linear Regression Model:
Linear Regression.
Review of Chapter 2 Some Basic Concepts: Sample center
The Multivariate Normal Distribution, Part 2
Ch11 Curve Fitting II.
数据的矩阵描述.
Multivariate Methods Berlin Chen, 2005 References:
Statistics 350 Lecture 18.
DRQ #11 – October 22, (4 pts) (1/2 pt)
Topic 11: Matrix Approach to Linear Regression
Inference about the Slope and Intercept
DRQ #11 – October 22, (4 pts) (1/2 pt)
Decomposition of Sum of Squares
Presentation transcript:

Statistics 350 Lecture 14

Today Last Day: Matrix results and Chapter 5 Today: More matrix results and Chapter 5 Please read Chapter 5

Multivariate Normal Distribution Suppose have a random vector Y, with elements Y i E(Y)=  2 (Y)=  =

Multivariate Normal Distribution Suppose have a random vector Y, with elements Y i Y is said to have a multivariate normal distribtuion if it has density The density for each Y i is

Multivariate Normal Distribution and Simple Linear Regression For the simple linear regression model, Y has a multivariate normal distribution:

Multivariate Normal Distribution and Simple Linear Regression Distribution of b:

Multivariate Normal Distribution and Simple Linear Regression Suppose we could choose the X i ’s where we observe the Y’s What does covariance matrix tell us about the choice of X’s

Fitted Values and Residuals Fitted values: Hat matrix: Properties of the hat-matrix

Fitted Values and Residuals Residuals: Covariance of residuals Estimated covariance:

Fitted Values and Residuals Geometric interpretation of residuals:

Fitted Values and Residuals Geometric interpretation of residuals:

Analysis of Variance Results SSTO SSE

Analysis of Variance Results SSR

Analysis of Variance Results Quadratic Forms: