Multivariate Analysis Regression

Slides:



Advertisements
Similar presentations
AP Statistics Section 3.2 C Coefficient of Determination
Advertisements

Kin 304 Regression Linear Regression Least Sum of Squares
Copyright © 2006 The McGraw-Hill Companies, Inc. Permission required for reproduction or display. 1 ~ Curve Fitting ~ Least Squares Regression Chapter.
Regresi Linear Sederhana Pertemuan 01 Matakuliah: I0174 – Analisis Regresi Tahun: Ganjil 2007/2008.
Regression Analysis Module 3. Regression Regression is the attempt to explain the variation in a dependent variable using the variation in independent.
Learning Objectives Copyright © 2004 John Wiley & Sons, Inc. Bivariate Correlation and Regression CHAPTER Thirteen.
Definition  Regression Model  Regression Equation Y i =  0 +  1 X i ^ Given a collection of paired data, the regression equation algebraically describes.
Chapter 10 Regression. Defining Regression Simple linear regression features one independent variable and one dependent variable, as in correlation the.
EGR 105 Foundations of Engineering I
Excel Part III Curve-Fitting, Regression Section 8 Fall 2013 EGR 105 Foundations of Engineering I.
Regression Regression: Mathematical method for determining the best equation that reproduces a data set Linear Regression: Regression method applied with.
The Best-Fit Line Linear Regression. PGCC CHM 103 Sinex How do you determine the best-fit line through data points? x-variable y-variable Fortunately.
LINEAR REGRESSION: What it Is and How it Works Overview What is Bivariate Linear Regression? The Regression Equation How It’s Based on r.
LINEAR REGRESSION: What it Is and How it Works. Overview What is Bivariate Linear Regression? The Regression Equation How It’s Based on r.
EGR 105 Foundations of Engineering I Fall 2007 – week 7 Excel part 3 - regression.
Chapter 12a Simple Linear Regression
EGR 105 Foundations of Engineering I Fall 2007 – week 7 Excel part 3 - regression.
Probability & Statistics for Engineers & Scientists, by Walpole, Myers, Myers & Ye ~ Chapter 11 Notes Class notes for ISE 201 San Jose State University.
Business Statistics - QBM117 Least squares regression.
Introduction to Linear and Logistic Regression. Basic Ideas Linear Transformation Finding the Regression Line Minimize sum of the quadratic residuals.
1 Relationships We have examined how to measure relationships between two categorical variables (chi-square) one categorical variable and one measurement.
Regression in EXCEL r2 SSE b0 b1 SST.
Regression Analysis What is regression ?What is regression ? Best-fit lineBest-fit line Least squareLeast square What is regression ?What is regression.
Introduction to Linear Regression and Correlation Analysis
12b. Regression Analysis, Part 2 CSCI N207 Data Analysis Using Spreadsheet Lingma Acheson Department of Computer and Information Science,
12a. Regression Analysis, Part 1 CSCI N207 Data Analysis Using Spreadsheet Lingma Acheson Department of Computer and Information Science,
Section 5.2: Linear Regression: Fitting a Line to Bivariate Data.
Statistical Methods Statistical Methods Descriptive Inferential
Regression. Population Covariance and Correlation.
Thomas Knotts. Engineers often: Regress data  Analysis  Fit to theory  Data reduction Use the regression of others  Antoine Equation  DIPPR.
Regression Regression relationship = trend + scatter
10B11PD311 Economics REGRESSION ANALYSIS. 10B11PD311 Economics Regression Techniques and Demand Estimation Some important questions before a firm are.
Revision: Pivot Table 1. Histogram 2. Trends 3. Linear 4. Exponential
Correlation – Recap Correlation provides an estimate of how well change in ‘ x ’ causes change in ‘ y ’. The relationship has a magnitude (the r value)
Math 4030 – 11b Method of Least Squares. Model: Dependent (response) Variable Independent (control) Variable Random Error Objectives: Find (estimated)
© 2001 Prentice-Hall, Inc.Chap 13-1 BA 201 Lecture 18 Introduction to Simple Linear Regression (Data)Data.
Regression Analysis. 1. To comprehend the nature of correlation analysis. 2. To understand bivariate regression analysis. 3. To become aware of the coefficient.
1 Simple Linear Regression and Correlation Least Squares Method The Model Estimating the Coefficients EXAMPLE 1: USED CAR SALES.
STATISTICS 12.0 Correlation and Linear Regression “Correlation and Linear Regression -”Causal Forecasting Method.
Regression Analysis Deterministic model No chance of an error in calculating y for a given x Probabilistic model chance of an error First order linear.
Correlation and Regression Chapter 9. § 9.2 Linear Regression.
Method 3: Least squares regression. Another method for finding the equation of a straight line which is fitted to data is known as the method of least-squares.
Chapters 8 Linear Regression. Correlation and Regression Correlation = linear relationship between two variables. Summarize relationship with line. Called.
Chapter 14 Introduction to Regression Analysis. Objectives Regression Analysis Uses of Regression Analysis Method of Least Squares Difference between.
Simple linear regression and correlation Regression analysis is the process of constructing a mathematical model or function that can be used to predict.
Plotting in Excel Ken youssefi Engineering 10.
Regression and Correlation of Data Summary
Linear Regression.
Part 5 - Chapter
Part 5 - Chapter 17.
Linear Regression Special Topics.
Practice. Practice Practice Practice Practice r = X = 20 X2 = 120 Y = 19 Y2 = 123 XY = 72 N = 4 (4) 72.
Kin 304 Regression Linear Regression Least Sum of Squares
Equations of Lines.
CHM 103 Sinex The Best-Fit Line Linear Regression.
BPK 304W Regression Linear Regression Least Sum of Squares
Correlation and Regression-II
Regression Analysis Week 4.
AP Stats: 3.3 Least-Squares Regression Line
Part 5 - Chapter 17.
Linear regression Fitting a straight line to observations.
Least-Squares Regression
Lesson 2.2 Linear Regression.
Correlation and Regression
Correlation and Regression
y = mx + b Linear Regression line of best fit REMEMBER:
Ch 4.1 & 4.2 Two dimensions concept
Slope-intercept Form of Equations of Straight Lines
Algebra Review The equation of a straight line y = mx + b
Chapter 14 Multiple Regression
Presentation transcript:

Multivariate Analysis Regression Regression: Mathematical method for determining the best equation that reproduces a data set Linear Regression: Regression method applied with a linear model (straight line) Uses Prediction of new X,Y values Understanding data behavior Verification of hypotheses/physical laws

Multivariate Analysis Regression The Linear Model Y = mX + b Y = Dependent variable X = Independent variable m = slope = DY/DX b = y-intercept (point where line crosses y-axis at x=0) X1=1, Y1=2.4 X2=20, Y2=10 DX DY

Multivariate Analysis Regression Fitting the data: finding the equation for the straight line that does the best job of reproducing the data.

Multivariate Analysis Regression Residual: Difference between measured and calculated Y-values

Multivariate Analysis Regression Residuals: Represents error in the fit for each data point. But the sum of the residuals tends to approach zero so it will not work for finding the overall error in the fit. SSE: Sum of squared residuals (SSE) used to represent the error in the fit. Minimize SSE and you have the best straight line for the data set.

Multivariate Analysis Regression Prediction: Once the best fit line has been determined, the equation can be used to predict new values of Y for any given X and vice versa. (Interpolation/Extapolation) y = 772.03x + 10810 If a states % of the population with a college degree is 20%, then they can expect an average income level of y = 772.03(20) + 10810 = $26,250 If a states average income level is $30,000, then what % of its population has a college degree? x = (30,000 – 10810)/772.03 = 24.9%

Multivariate Analysis Regression Non-Linear Models: Power y = p1• x p2 Polynomial y = p1 + p2• x + p3 • x2 + p4 • x3 + … Exponential y = p1• e p2 • x Logarithmic y = p1• Ln(x) + p2 User-defined

Multivariate Analysis Method of Least-Squares Process first outlined by Gauss in the 1820’s Mathematical process for minimizing the SSE

Multivariate Analysis Excel Functions and Tools SLOPE() Returns the slope when passed X, Y data.. INTERCEPT() Returns the intercept when passed X, Y data.. LINEST() Returns the slope and intercepts when passed X, Y data.. TREND() Returns predicted values in a linear trend when passed X, Y data.. Trendline (from the Chart menu) Returns the trendline, equation, and correlation coefficient for a set of X,Y data.