Bivariate Data Analysis Bivariate Data analysis 4

If the relationship is linear the residuals plotted against the original x - values would be scattered randomly above and below the line.

A scatter plot of residuals versus the x-values should be boring and have no interesting features, like direction or shape. It should stretch horizontally with about the same amount of scatter throughout. It should show no curves or outliers

r = 0.87 indicates a strong linear relationship between x and y

The scatter plot below however shows the relationship is clearly non-linear

When examining residuals to check whether a linear model is appropriate, it is usually best to plot them. The variation in the residuals is the key to assessing how well the model fits.

The pattern of residuals looks more like a parabola. This should indicate that the data were not really linear, but were more likely to be quadratic.

Discuss this data.

Discuss this situation. Outlier?

Discuss the plot of the residuals

Discuss this scatter plot

Linear?

Residuals

Useful website plots residuals, regression lines etchttp://stat-

Many of our tools for displaying and summarizing data work only when the data meet certain conditions. We cannot use a linear model unless the relationship between two variables is linear. Often re-expression can save the day, straightening bent relationships so that we can fit and use a simple linear model.

Displays of the residuals can often help you find subsets in the data.

When a scatterplot shows a CURVED form that consistently increases or decreases, we can often straighten the form of the plot be re-expressing one or both of the variables.

The correlation is That sounds pretty high, but the scatter plot shows something is not quite right.

Re-expressing f/stop speed by squaring straightens the plot.

This plot looks ‘ straight ’. The correlation is now 0.998, but the increase in correlation is not important. (The original value of is already large.) What is important is the form of the plot is now straight, so the correlation is now an appropriate measure of association.

Goals of re-expression Make the distribution (as seen in its histogram, for example) more symmetric. Make the form of the scatter plot more nearly linear. Make the scatter in a scatter plot spread out evenly rather than following a fan shape.

Some hints Try y 2 for unimodal skewed to the left. Try square root of y for counted data. Try logs for measurements that can ’ t be negative and especially when they grow by percentage increases. Try -1/y or -1/(square root of y). Logs straighten exponential trends and pull in a long right trail. Logs straighten power curves.

Try y versus x 2

Try log or 1/x

Don ’ t stray too far from the powers suggested. Taking a high power may artificially inflate R 2, but it won ’ t give a useful or meaningful model. It is better to stick with powers between 2 and -2. Even in that range you should prefer the simpler powers in the ladder to those in the cracks. A square root is easier to understand than the power.

Comparing histograms and scatter graphs

The data in the scatter plot below shows the progression of the fastest times for the men’s marathon since the Second World War. We may want to use this data to predict the fastest time at 1 January 2010 (i.e. 64 years after 1 January 1946). Page 53

Possible solutions a quadratic (y = ax 2 + bx + c) an exponential function (y = ae bx ) a power function (y = ax b ) 2 separate straight lines – one for say 0 – 23 years and one for say 23 – 60 years a line for only the later years, say 23 – 60 years

Quadratic Curve seems to fit R 2 = is very high Inappropriate to quote r as it is not linear time starts increasing (not sensible) Page 54

Exponential Doesn ’ t fit the data points particularly well

Power Function reasonable fit, R 2 is high R 2 = √

Line for only the later years ( ) Line ( ) – reasonable fit, R 2 is high Note: We only use the later years line for the prediction and ignore the earlier years √

The data in the scatter plot below comes from a random sample of 60 models of new cars taken from all models on the market in New Zealand in May We want to use the engine size to predict the weight of a car. Seems to be linear for engine sizes less than 2500cc. Very weak or no linear relationship for engine sizes over 2500cc. Solution: Fit a line for engine sizes less than 2500cc. Page 55