Chapter 15: Testing for a difference between two dependent (Correlated) Groups. Example: Suppose you wanted to test the drug that may affect IQ, but this time you look for changes within each subject. This is done by measuring the IQ for each subject before and after taking the drug. For 9 subjects, you might get a result like this: The most common application for this test is called a ‘repeated-measures design’ where two measures are obtained from the same group of subjects, and you are looking for a difference in the means of these measures. SubjectIQ before (X) IQ after (Y)

The book discusses two ways of conducting t-tests for a repeated-measures design. We will only cover the second (easy) way. So we’ll be skipping sections 15.1 and 15.2 The easy (‘alternative’) way is to treat each subject as a single measure by calculating the difference (D) for the scores within each subject, and conducting a t- test on these values of D. SubjectIQ before (X) IQ after (Y) D=Y-X

Just perform a simple single sample t-test (like in Chapter 13) on the values of D using n-1 degrees of freedom, where n is the number of pairs. SubjectIQ before (X) IQ after (Y) D=Y-X All we are doing here is conducting a single-sample t- test on the differences.

SubjectIQ before (X) IQ after (Y) D=Y-X Looking in Table D, df = 8, area in one tail: t crit = ±2.306 Decision: reject H 0 and conclude that the drug had a significant effect on IQ using a two-tailed test with  =.05. This is the same equation for a single sample t-test, but with D instead of X:

Using APA Format: “There was a statistically significant change in IQ after taking the drug (M = 6.44, SD = 7.86), t(8)= 2.46, p<.05

The effect size is computed just as a single sample t-test. Again, just use ‘D’ for ‘X’: Remember, the general convention is that g=.2 is small, g=.5 is medium and g=.8 is large, so this is a large effect size What is the power of this test using this effect size? We will use the power curve for one mean: (not two means, because we’re really just conducting a hypothesis test on the mean of the differences)

Here’s the power curve for a two-tailed test for one mean with  =.05 from Chapter 13: For an effect size of 0.819, sample size of 9, what is the power? Answer: about.525 or so.

Power with correlated groups is calculated the same way as for a single sample design. Here’s the power curve for a two-tailed test with  =.05 from Chapter 13: For an effect size of 0.8, how many pairs (n) do we need for a power of 0.8? Answer: about 15 pairs (yellow curve)

Other examples (besides repeated measures) of testing difference of means between dependent (correlated) groups. The methods are the same as for repeated measures – calculate a t-test on the difference between each pair. Matched pairs experiments: Where pairs of subjects are naturally grouped together. For example, in identical twin studies a measure is made from each twin in a pair. D is the difference in scores for each pair of twins. Matched-subjects design: Where the experimenter matches pairs of subjects together based on some other variable such as age or visual acuity.

Example from the tutorial: 25) We measure the visual acuity of 31 republicans under two conditions: 'itchy' and 'tiny'. You then subtract the visual acuity of the 'tiny' from the 'itchy' conditions for each republicans and obtain a mean pair-wise difference of with a standard deviation is Using an alpha value of 0.01, is the visual acuity from the 'itchy' condition significantly different than from the 'tiny' condition? What is the effect size? Answer: D̄ = s D̄ = 1.32 t obs = t crit = ± 2.75 (df = 30) We fail to reject H 0. The visual acuity of itchy republicans is not significantly different than the visual acuity of tiny republicans (M=-2.15, SD = 7.37), t(30) = , p = Effect size: g = 0.29 (small)