The T-Test for Two Related Samples (Dependent Samples) Introduction to Statistics Chapter 11 April 6-8, 2010 Class #21-22

Beyond the one-sample t test Are people happier before or after therapy? In married couples, is the husband or wife happier? Among people with the same IQ, is performance higher on multiple choice or essay exams?

How to do this? For each person or pair of people, create difference score Ignore the original scores Calculate a t, comparing the mean of difference scores to 0 df = number of pairs -1

The t Test for Dependent Samples Repeated-Measures Design When you have two sets of scores from the same person in your sample, you have a repeated-measures, or within-subjects design

The t Test for Dependent Samples Related-Measures Design When each score in one sample is paired, on a one- to-one basis, with a single score in the other sample, you have a related-measures or matched samples design. You use a related-measures design by matching pairs of different subjects in terms of some uncontrolled variable that appears to have a considerable impact on the dependent variable.

The t Test for Dependent Samples You do a t test for dependent samples the same way you do a t test for a single sample, except that: You use difference scores You assume the population mean is 0

Difference Scores The way to handle two scores per person, or a matched pair, is to make difference scores. For each person, or each pair, you subtract one score from the other. Once you have a difference score for each person, or pair, in the study, you treat the study as if there were a single sample of scores (scores that in this situation happen to be difference scores).

A Population of Difference Scores with a Mean of 0 The null hypothesis in a repeated-measures design is that on the average there is no difference between the two groups of scores. This is the same as saying that the mean of the population of the difference scores is 0.

The t Test for Dependent Samples: Example 1

Step 1 State the statistical hypotheses:

Step 2 Set  and determine t critical.

Step 3: Shade in critical region

Step 4: Calculate the t statistic (t calc ) IndividualBeforeAfterD D2D

Step 4: Calculate the t statistic (t calc ) Calculate the sample mean of the difference scores 16 8 = 2.00

Step 4: Calculate the t statistic (t calc ) Calculate the sample variance s 2 = SS/df = SS/(n-1) First you need to calculate the SS (use computational formula from page 96) SS = 42 – 16 2 = = 42-32=10 8 8

Step 4: Calculate the t statistic Calculate the t statistic (t calc ) Then you plug numbers into variance formula: s 2 = SS/df = SS/(n-1) = 10/7 = 1.42

Step 4: Calculate the t statistic (t calc ) Now compute the estimated standard error (see formula on page 315) estimated standard error = sMD sMD = s2s2 n

Step 4: Calculate the t statistic (t calc ) 1.42 =.421 8

Step 4: Calculate the t statistic (t calc ) See new t formula (page 314) t = =

Step 5: Make your decision Make a decision – compare t computed in Step 3 (t OBTAINED ) with t CRITICAL found in the t table. If t OBT > t CRIT (ignoring signs)  Reject H O If t OBT < t CRIT (ignoring signs)  Fail to reject H O t obtained = t critical = Answer: Reject H O Interpret your results. After the pro-socialized medicine lecture, individuals’ attitudes toward socialized were more positive than before the lecture so apparently the lecture worked.

Step 6: Interpretation Interpret your decision

Step 7: Effect Size See page 318 for description: r 2 = t 2 /t 2 +df

The t Test for Dependent Samples: Example 2 At the Olympic level of competition, even the smallest factors can make the difference between winning and losing. For example, Pelton (1983) has shown that Olympic marksmen shoot much better if they fire between heartbeats, rather than squeezing the trigger during a heartbeat. The small vibration caused by a heartbeat seems to be sufficient to affect the marksman’s aim. The following hypothetical data demonstrate this phenomenon. A sample of 6 Olympic marksmen fires a series of rounds while a researcher records heartbeats. For each marksman, an accuracy score (out of 100) is recorded for shots fired during heartbeats and for shots fired between heartbeats. Do the data indicate a significant difference? Test with an alpha of.05. During HeartbeatsBetween Heartbeats

Go through the same five steps as in Example 1 Step 1: State the statistical hypotheses Step 2: Set  and determine t critical. Step 3: Shade in critical region Step 4: Calculate the t statistic (t calc ) Step 5: Make your decision

Step 3: Shade in critical region

Issues with Repeated Measures Designs Order effects. Use counterbalancing in order to eliminate any potential bias in favor of one condition because most subjects happen to experience it first (order effects). Randomly assign half of the subjects to experience the two conditions in a particular order. Practice effects. Do not repeat measurement if effects linger.

Credits