Curvilinear Regression

Slides:



Advertisements
Similar presentations
Guide to Using Minitab 14 For Basic Statistical Applications To Accompany Business Statistics: A Decision Making Approach, 8th Ed. Chapter 15: Multiple.
Advertisements

Wednesday AM  Presentation of yesterday’s results  Associations  Correlation  Linear regression  Applications: reliability.
LECTURE 7: CONTINUOUS INTERACTIONS IN REGRESSION.
Objectives 10.1 Simple linear regression
Polynomial Regression and Transformations STA 671 Summer 2008.
Multiple Linear Regression Polynomial Regression.
/k 2DS00 Statistics 1 for Chemical Engineering lecture 4.
Ch11 Curve Fitting Dr. Deshi Ye
Regression single and multiple. Overview Defined: A model for predicting one variable from other variable(s). Variables:IV(s) is continuous, DV is continuous.
1 Multiple Regression Response, Y (numerical) Explanatory variables, X 1, X 2, …X k (numerical) New explanatory variables can be created from existing.
Regression With Categorical Variables. Overview Regression with Categorical Predictors Logistic Regression.
Interactions: IVs = continuous & continuous IVs = continuous & categorical.
Problems in Applying the Linear Regression Model Appendix 4A
More on ANOVA. Overview ANOVA as Regression Comparison Methods.
Plots, Correlations, and Regression Getting a feel for the data using plots, then analyzing the data with correlations and linear regression.
Multivariate Data Analysis Chapter 4 – Multiple Regression.
Introduction the General Linear Model (GLM) l what “model,” “linear” & “general” mean l bivariate, univariate & multivariate GLModels l kinds of variables.
Multiple Regression and Correlation Analysis
Regression Model Building Setting: Possibly a large set of predictor variables (including interactions). Goal: Fit a parsimonious model that explains variation.
Multiple Regression Dr. Andy Field.
SPSS Statistical Package for Social Sciences Multiple Regression Department of Psychology California State University Northridge
Quantitative Business Analysis for Decision Making Multiple Linear RegressionAnalysis.
Elements of Multiple Regression Analysis: Two Independent Variables Yong Sept
Topic 16: Multicollinearity and Polynomial Regression.
Quiz 9  Correlation (linear)  Regression. 1. Which of the following are the correct hypotheses for testing linear correlations? a) H 0 : μ = 0H 1 :
Understanding Regression Analysis Basics. Copyright © 2014 Pearson Education, Inc Learning Objectives To understand the basic concept of prediction.
Analysis of Covariance, ANCOVA (GLM2)
Regression Analyses II Mediation & Moderation. Review of Regression Multiple IVs but single DV Y’ = a+b1X1 + b2X2 + b3X3...bkXk Where k is the number.
1 G Lect 6M Comparing two coefficients within a regression equation Analysis of sets of variables: partitioning the sums of squares Polynomial curve.
April 6 Logistic Regression –Estimating probability based on logistic model –Testing differences among multiple groups –Assumptions for model.
Xuhua Xia Polynomial Regression A biologist is interested in the relationship between feeding time and body weight in the males of a mammalian species.
1 G Lect 6W Polynomial example Orthogonal polynomials Statistical power for regression G Multiple Regression Week 6 (Wednesday)
Topic 1: Be able to combine functions and determine the resulting function. Topic 2: Be able to find the product of functions and determine the resulting.
Part IV Significantly Different: Using Inferential Statistics
Multiple Linear Regression Partial Regression Coefficients.
Social Science Research Design and Statistics, 2/e Alfred P. Rovai, Jason D. Baker, and Michael K. Ponton Within Subjects Analysis of Variance PowerPoint.
Introduction to Correlation & Regression with SAS Sam Gordji Weir 107.
Regression Models for Quantitative (Numeric) and Qualitative (Categorical) Predictors KNNL – Chapter 8.
1 Quadratic Model In order to account for curvature in the relationship between an explanatory and a response variable, one often adds the square of the.
Chapter 9 Correlational Research Designs. Correlation Acceptable terminology for the pattern of data in a correlation: *Correlation between variables.
Multiple Regression INCM 9102 Quantitative Methods.
 Relationship between education level, income, and length of time out of school  Our new regression equation: is the predicted value of the dependent.
Scatter Diagrams scatter plot scatter diagram A scatter plot is a graph that may be used to represent the relationship between two variables. Also referred.
Multiple regression.
1 MGT 511: Hypothesis Testing and Regression Lecture 8: Framework for Multiple Regression Analysis K. Sudhir Yale SOM-EMBA.
Curvilinear Regression. Monotonic but Non-Linear The relationship between X and Y may be monotonic but not linear. The linear model can be tweaked to.
PSY6010: Statistics, Psychometrics and Research Design Professor Leora Lawton Spring 2007 Wednesdays 7-10 PM Room 204.
1 Chapter 4: Introduction to Predictive Modeling: Regressions 4.1 Introduction 4.2 Selecting Regression Inputs 4.3 Optimizing Regression Complexity 4.4.
Psychology 202a Advanced Psychological Statistics November 10, 2015.
Regression. Outline of Today’s Discussion 1.Coefficient of Determination 2.Regression Analysis: Introduction 3.Regression Analysis: SPSS 4.Regression.
Section 3.5B: Parent Functions
Unit 3 Test Review – Identifying Parent Functions October 30, 2014.
© Copyright 2000, Julia Hartman 1 An Interactive Tutorial for SPSS 10.0 for Windows © Analysis of Covariance (Regression Approach) by Julia Hartman Next.
Anareg Week 10 Multicollinearity Interesting special cases Polynomial regression.
 Seeks to determine group membership from predictor variables ◦ Given group membership, how many people can we correctly classify?
ANCOVA.
Section 3.2 Linear Models: Building Linear Functions from Data.
Venn diagram shows (R 2 ) the amount of variance in Y that is explained by X. Unexplained Variance in Y. (1-R 2 ) =.36, 36% R 2 =.64 (64%)
Week of March 23 Partial correlations Semipartial correlations
Agenda 1.Exam 2 Review 2.Regression a.Prediction b.Polynomial Regression.
Yandell – Econ 216 Chap 15-1 Chapter 15 Multiple Regression Model Building.
Predicting Energy Consumption in Buildings using Multiple Linear Regression Introduction Linear regression is used to model energy consumption in buildings.
Non-linear relationships
Guide to Using Minitab 14 For Basic Statistical Applications
Introduction to the General Linear Model (GLM)
Multiple Regression A curvilinear relationship between one variable and the values of two or more other independent variables. Y = intercept + (slope1.
Curvilinear Regression
Chapter 7 Demand Forecasting in a Supply Chain
Graph Review Skills Needed Identify the relationship in the graph
Cases. Simple Regression Linear Multiple Regression.
Presentation transcript:

Curvilinear Regression

Monotonic but Non-Linear The relationship between X and Y may be monotonic but not linear. The linear model can be tweaked to take this into account by applying a monotonic transformation to Y, X, or both X and Y. Predicting calories consumed from number of persons present at the meal.

R2 = .584

R2 = .814

Calories Log Model Persons

Polynomial Regression

Aggregation of Ladybugs A monotonic transformation will not help here. A polynomial regression will. Copp, N.H. Animal Behavior, 31, 424-430 Subjects = containers, each with 100 ladybugs Y = number of ladybugs free (not aggregated) X = temperature

Polynomial Models Quadratic: Cubic: For each additional power of X added to the model, the regression line will have one more bend.

Using Copp’s Data Compute Temp2, Temp3 and Temp4. Conduct a sequential multiple regression analysis, entering Temp first, then Temp2, then Temp3, and then Temp4. When deciding which model to adopt, consider whether making the model more complex is justified by the resulting increase in R2.

SAS Curvi -- Polynomial Regression, Ladybugs. Download and run the program. Refer to it and the output as Professor Karl goes over the code and the output.

Linear Model, R2 = .615

Quadratic Model, R2=.838

Cubic Model, R2= .861

Which Model to Adopt? Adding Temp2 significantly increased R2, by .838-.615 = .223, keep Temp2. Adding Temp3 significantly increased R2, by .861-.838 = .023 – does this justify keeping Temp3 ? Adding Temp4 did not significantly increase R2. Somewhat reluctantly, I went cubic.

SHIFT Shift to the OUTPUT PDF at this point, come back to the slideshow later.

Multicollinearity May be a problem whenever you have products or powers of predictors in the model. Center the predictor variables, Or simply standardize all variables to mean 0, standard deviation 1.

I am so Cute

SPSS See the document for an example of polynomial regression using SPSS.