Download presentation
Presentation is loading. Please wait.
Published byAlexis Hodge Modified over 9 years ago
1
Regression Analysis1
2
2 INTRODUCTION TO EMPIRICAL MODELS LEAST SQUARES ESTIMATION OF THE PARAMETERS PROPERTIES OF THE LEAST SQUARES ESTIMATORS AND ESTIMATION OF s 2 HYPOTHESIS TESTING IN LINEAR REGRESSION CONFIDENCE INTERVALS IN LINEAR REGRESSION PREDICTION OF NEW OBSERVATIONS ASSESSING THE ADEQUACY OF THE REGRESSION MODEL CHAPTER OUTLINE
3
Regression Analysis3 Definitions Regress The act of reasoning backward Regression A functional relationship between two or more correlated variables that is often empirically determined from data and is used esp. to predict values of one variable when given values of the others.
4
Regression Analysis4 Models Abstraction/simplification of the system used as a proxy for the system itself Can try wide-ranging ideas in the model Make your mistakes on the computer where they don ’ t count, rather for real where they do count Issue of model validity Two types of models Physical (iconic) Logical/Mathematical -- quantitative and logical assumptions, approximations
5
Regression Analysis5 What Do You Do with a Logical Model? If model is simple enough, use traditional mathematics (queueing theory, differential equations, linear programming) to get “ answers ” Nice in the sense that you get “ exact ” answers to the model But might involve many simplifying assumptions to make the model analytically tractable -- validity?? Many complex systems require complex models for validity — simulation needed
6
Regression Analysis6 models theoretical (mechanical) model empirical model scatter diagram INTRODUCTION TO EMPIRICAL MODELS
7
Regression Analysis7
8
8
9
9 linear model (equation) probabilistic linear model simple linear regression model regression coefficients
10
Regression Analysis10 multiple regression model multiple linear regression model intercept partial regression coefficients contour plot
11
Regression Analysis11 dependent variable or response y may be related to k independent or regressor variables interaction any regression model that is linear in parameters (the b’s) is a linear regression model, regardless of the shape of the surface that it generates.
12
Regression Analysis12
13
Regression Analysis13
14
Regression Analysis14 LEAST SQUARES ESTIMATION OF THE PARAMETERS Simple Linear Regression
15
Regression Analysis15 method of least squares least squares normal equations fitted or estimated regression line residual
16
Regression Analysis16
17
Regression Analysis17 Example 10-1, pp. 436
18
Regression Analysis18
19
Regression Analysis19
20
Regression Analysis20 Multiple Linear Regression
21
Regression Analysis21
22
Regression Analysis22
23
Regression Analysis23
24
Regression Analysis24 PROPERTIES OF THE LEAST SQUARES ESTIMATORS AND ESTIMATION OF s 2 unbiased estimators covariance matrix estimated standard error residual mean square (or error mean square)
25
Regression Analysis25 Hypothesis Testing on 0 and 1, pp. 447
26
Regression Analysis26 HYPOTHESIS TESTING IN LINEAR REGRESSION
27
Regression Analysis27
28
Regression Analysis28 * k = p - 1
29
Regression Analysis29
30
Regression Analysis30 Tests on Individual Regression Coefficients
31
Regression Analysis31 Confidence Intervals on Individual Regression Coefficients
32
Regression Analysis32
33
Regression Analysis33 Confidence Interval on the Mean Response
34
Regression Analysis34
35
Regression Analysis35
36
Regression Analysis36 PREDICTION OF NEW OBSERVATIONS
37
Regression Analysis37
38
Regression Analysis38 simple linear regression
39
Regression Analysis39
40
Regression Analysis40 ASSESSING THE ADEQUACY OF THE REGRESSION MODEL normal probability plot of residuals standardize outlier
41
Regression Analysis41
42
Regression Analysis42
43
Regression Analysis43
44
Regression Analysis44
45
Regression Analysis45
46
Regression Analysis46
47
Regression Analysis47
48
Regression Analysis48
49
Regression Analysis49 Coefficient of Multiple Determination
50
Regression Analysis50
51
Regression Analysis51 Influential Observations
52
Regression Analysis52
53
Regression Analysis53
54
Regression Analysis54
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.