1 Econ 240A Power 7. 2 This Week, So Far §Normal Distribution §Lab Three: Sampling Distributions §Interval Estimation and Hypothesis Testing.

Slides:



Advertisements
Similar presentations
Chapter 12 Simple Linear Regression
Advertisements

CmpE 104 SOFTWARE STATISTICAL TOOLS & METHODS MEASURING & ESTIMATING SOFTWARE SIZE AND RESOURCE & SCHEDULE ESTIMATING.
6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.
Econ 140 Lecture 81 Classical Regression II Lecture 8.
Chapter 10 Curve Fitting and Regression Analysis
Linear regression models
Ch11 Curve Fitting Dr. Deshi Ye
Topic 3: Simple Linear Regression. Outline Simple linear regression model –Model parameters –Distribution of error terms Estimation of regression parameters.
Chapter 10 Simple Regression.
Linear Regression with One Regression
1 Regression Econ 240A. 2 Outline w A cognitive device to help understand the formulas for estimating the slope and the intercept, as well as the analysis.
1 Econ 240A Power 7. 2 This Week, So Far §Normal Distribution §Lab Three: Sampling Distributions §Interval Estimation and HypothesisTesting.
Descriptive statistics Experiment  Data  Sample Statistics Experiment  Data  Sample Statistics Sample mean Sample mean Sample variance Sample variance.
1 Econ 240A Power Outline Review Projects 3 Review: Big Picture 1 #1 Descriptive Statistics –Numerical central tendency: mean, median, mode dispersion:
1 Final Review Econ 240A. 2 Outline The Big Picture Processes to remember ( and habits to form) for your quantitative career (FYQC) Concepts to remember.
1 Economics 240A Power Eight. 2 Outline Lab Four Lab Four Maximum Likelihood Estimation Maximum Likelihood Estimation The UC Budget Again The UC Budget.
1 Economics 240A Power Eight. 2 Outline n Maximum Likelihood Estimation n The UC Budget Again n Regression Models n The Income Generating Process for.
Chapter 11 Multiple Regression.
Probability & Statistics for Engineers & Scientists, by Walpole, Myers, Myers & Ye ~ Chapter 11 Notes Class notes for ISE 201 San Jose State University.
1 Final Review Econ 240A. 2 Outline The Big Picture Processes to remember ( and habits to form) for your quantitative career (FYQC) Concepts to remember.
1 Econ 240A Power 7. 2 Last Week §Normal Distribution §Lab Three: Sampling Distributions §Interval Estimation and HypothesisTesting.
1 Econ 240A Power 7. 2 This Week, So Far §Normal Distribution §Lab Three: Sampling Distributions §Interval Estimation and Hypothesis Testing.
1 Final Review Econ 240A. 2 Outline The Big Picture Processes to remember ( and habits to form) for your quantitative career (FYQC) Concepts to remember.
1 Regression Econ 240A. 2 Retrospective w Week One Descriptive statistics Exploratory Data Analysis w Week Two Probability Binomial Distribution w Week.
Simple linear regression Linear regression with one predictor variable.
5.1 Basic Estimation Techniques  The relationships we theoretically develop in the text can be estimated statistically using regression analysis,  Regression.
CPE 619 Simple Linear Regression Models Aleksandar Milenković The LaCASA Laboratory Electrical and Computer Engineering Department The University of Alabama.
BPS - 3rd Ed. Chapter 211 Inference for Regression.
Prof. Dr. S. K. Bhattacharjee Department of Statistics University of Rajshahi.
Random Sampling, Point Estimation and Maximum Likelihood.
Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display. 1 Part 4 Curve Fitting.
Basic Probability (Chapter 2, W.J.Decoursey, 2003) Objectives: -Define probability and its relationship to relative frequency of an event. -Learn the basic.
7-1 Introduction The field of statistical inference consists of those methods used to make decisions or to draw conclusions about a population. These.
Chapter 11 Linear Regression Straight Lines, Least-Squares and More Chapter 11A Can you pick out the straight lines and find the least-square?
1 Chapter 12 Simple Linear Regression. 2 Chapter Outline  Simple Linear Regression Model  Least Squares Method  Coefficient of Determination  Model.
1 Economics 240A Power Eight. 2 Outline n Maximum Likelihood Estimation n The UC Budget Again n Regression Models n The Income Generating Process for.
Inference for Regression Simple Linear Regression IPS Chapter 10.1 © 2009 W.H. Freeman and Company.
1Spring 02 First Derivatives x y x y x y dy/dx = 0 dy/dx > 0dy/dx < 0.
Inference for Regression Chapter 14. Linear Regression We can use least squares regression to estimate the linear relationship between two quantitative.
1 Forecasting Formulas Symbols n Total number of periods, or number of data points. A Actual demand for the period (  Y). F Forecast demand for the period.
Chapter 20 Statistical Considerations Lecture Slides The McGraw-Hill Companies © 2012.
1 1 Slide The Simple Linear Regression Model n Simple Linear Regression Model y =  0 +  1 x +  n Simple Linear Regression Equation E( y ) =  0 + 
ESTIMATION METHODS We know how to calculate confidence intervals for estimates of  and  2 Now, we need procedures to calculate  and  2, themselves.
BPS - 5th Ed. Chapter 231 Inference for Regression.
Simple linear regression. What is simple linear regression? A way of evaluating the relationship between two continuous variables. One variable is regarded.
Statistics 350 Lecture 2. Today Last Day: Section Today: Section 1.6 Homework #1: Chapter 1 Problems (page 33-38): 2, 5, 6, 7, 22, 26, 33, 34,
Simple linear regression. What is simple linear regression? A way of evaluating the relationship between two continuous variables. One variable is regarded.
Chapter 11 Linear Regression and Correlation. Explanatory and Response Variables are Numeric Relationship between the mean of the response variable and.
Bivariate Regression. Bivariate Regression analyzes the relationship between two variables. Bivariate Regression analyzes the relationship between two.
Inference about the slope parameter and correlation
The simple linear regression model and parameter estimation
Regression and Correlation of Data Summary
Chapter 4 Basic Estimation Techniques
Economics 240A Power Eight.
Simple Linear Regression - Introduction
Correlation and Simple Linear Regression
Statistical Methods For Engineers
CHAPTER 29: Multiple Regression*
Linear regression Fitting a straight line to observations.
Correlation and Simple Linear Regression
Statistical Process Control
Elementary Statistics: Looking at the Big Picture
Basic Practice of Statistics - 3rd Edition Inference for Regression
Discrete Least Squares Approximation
Simple Linear Regression and Correlation
Linear Regression and Correlation
Linear Regression and Correlation
Linear Regression and Correlation
Correlation and Simple Linear Regression
Correlation and Simple Linear Regression
Presentation transcript:

1 Econ 240A Power 7

2 This Week, So Far §Normal Distribution §Lab Three: Sampling Distributions §Interval Estimation and Hypothesis Testing

3 Outline §Distribution of the sample variance §The California Budget: Exploratory Data Analysis §Trend Models §Linear Regression Models §Ordinary Least Squares

4 Population Random variable x Distribution f(    f ? Sample Sample Statistic: Sample Statistic Pop.

5 The Sample Variance, s 2 Is distributed with n-1 degrees of freedom (text, 12.2 “inference about a population variance) (text, pp , Chi-Squared distribution)

6 Text Chi-Squared Distribution

7 Text Chi-Squared Table 5 Appendix p. B-10

8 Example: Lab Three §50 replications of a sample of size 50 generated by a Uniform random number generator, range zero to one, seed =20. l expected value of the mean: 0.5 l expected value of the variance: 1/12

9 Histogram of 50 Sample Means, Uniform, U(0.5, 1/12) Average of the 50 sample means:

10 Histogram of 50 sample variances, Uniform, U(0.5, ) Average sample variance:

11 Confidence Interval for the first sample variance of §A 95 % confidence interval Where taking the reciprocal reverses the signs of the inequality

12

13 The UC Budget

14 The UC Budget §The part of the UC Budget funded by the state from the general fund

15

16

17 Total General Fund Expenditures Appendix, p.11 Schedule 6

18 UC General Fund Expenditures, Appendix p , General fund actual, $2,901,257, , estimated $2,175,205, , estimated $2,806,267,000

19 UC General Fund Expenditures, Appendix p. 46

20

21

22

23

24

25

26

27

28 How to Forecast the UC Budget? §Linear Trendline?

29 Trend Models

30

31

32 Slope: increase of Million $ per year Governor’s Proposed Increase Million $

33 Linear Regression Trend Models §A good fit over the years of the data sample may not give a good forecast

34 How to Forecast the UC Budget? §Linear trendline? §Exponential trendline ?

35

36 Trend Models

37 An Application

38

39 Time Series Trend Analysis §Two Steps l Select a trend model l Fit the trend model Graphically algebraically

40 Trend Models §Linear Trend: y(t) = a + b*t +e(t) l dy(t)/dt = b §Exponential trend: z(t) = exp(c + d*t + u(t)) ln z(t) = c + d*t + u(t) l (1/z)*dz/dt = d

41 Linear Trend Model Fitted to UC Budget UCBUDB(t) = *t, R 2 = 0.943

42 Time Series Models §Linear l UCBUD(t) = a + b*t + e(t) l where the estimate of a is the intercept: $ Billion in l where the estimate of b is the slope: $ billion/yr l where the estimate of e(t) is the the difference between the UC Budget at time t and the fitted line for that year §Exponential

43 Exponential Trend Model Fitted to UC Budget

44

45 lnUCBudB(t) = a-hat + b-hat*time lnUCBudB(t) = *time Exp( ) = B ( ) intercept

46

47 Time Series Models §Exponential l UCBUD(t) = UCBUD(68-69)*e b*t e u(t) l UCBUD(t) = UCBUD(68-69)*e b*t + u(t) l where the estimate of UCBUD(68-69) is the estimated budget for l where the estimate of b is the exponential rate of growth

48 Linear Regression Time Series Models §Linear: UCBUD(t) = a + b*t + e(t) §How do we get a linear form for the exponential model?

49 Time Series Models §Linear transformation of the exponential l take natural logarithms of both sides l ln[UCBUD(t)] = ln[UCBUD(68-69)*e b*t + u(t) ] l where the logarithm of a product is the sum of logarithms: l ln[UCBUD(t)] = ln[UCBUD(68-69)]+ln[e b*t + u(t) ] l and the logarithm is the inverse function of the exponential: l ln[UCBUD(t)] = ln[UCBUD(68-69)] + b*t + u(t) l so ln[UCBUD(68-69)] is the intercept “a”

50 Naïve Forecasts §Average §forecast next year to be the same as this year

51

52 UC Budget Forecasts for * 1.068x$2,806,207,000; exponential trendline forecast ~$4.5 B Actual:$2,806,207,000 in Governor’s Budget Summary for 05-06

53 Time Series Forecasts §The best forecast may not be a regression forecast §Time Series Concept: time series(t) = trend + cycle + seasonal + noise(random or error) §fitting just the trend ignores the cycle §UCBUD(t) = a + b*t + e(t)

54 Application of Bivariate Plot §O-Ring Failure §Plot zeros (no failure) and the ones (failure) versus launch temperature for the 24 launches prior to Challenger

55

56 Linear Approximation to Backward Sigmoid

57 Ordinary Least Squares

58 Criterion for Fitting a Line §Minimize the sum of the absolute value of the errors? §Minimize the sum of the square of the errors l easier to use §error is the difference between the observed value and the fitted value l example UCBUD(observed) - UCBUD(fitted)

59 §The fitted value: §The fitted value is defined in terms of two parameters, a and b (with hats), that are determined from the data observations, such as to minimize the sum of squared errors

60 Minimize the Sum of Squared Errors

61 How to Find a-hat and b-hat? §Methodology l grid search l differential calculus l likelihood function

62 Grid Search, a-hat=0, b-hat=80

63 Grid Search a-hat b-hat Find the point where the sum of squared errors is minimum

64 Differential Calculus §Take the derivative of the sum of squared errors with respect to a-hat and with respect to b-hat and set to zero. §Divide by -2*n §or

65 Least Squares Fitted Parameters §So, the regression line goes through the sample means. §Take the other derivative: §divide by -2

66 Ordinary Least Squares(OLS) §Two linear equations in two unknowns, solve for b-hat and a-hat.

67

68 O-Ring Failure Versus launch temperature

69