Presentation is loading. Please wait.

Presentation is loading. Please wait.

Homework Chapter 11: 13 Chapter 12: 1, 2, 14, 16.

Similar presentations


Presentation on theme: "Homework Chapter 11: 13 Chapter 12: 1, 2, 14, 16."— Presentation transcript:

1 Homework Chapter 11: 13 Chapter 12: 1, 2, 14, 16

2 Assumptions in Statistics

3 The wrong way to make a comparison of two groups “Group 1 is significantly different from a constant, but Group 2 is not. Therefore Group 1 and Group 2 are different from each other.”

4 A more extreme case...

5 Interpreting Confidence Intervals Different Not differentUnknown

6 Assumptions Random sample(s) Populations are normally distributed Populations have equal variances –2-sample t only

7 Assumptions Random sample(s) Populations are normally distributed Populations have equal variances –2-sample t only What do we do when these are violated?

8 Assumptions in Statistics Are any of the assumptions violated? If so, what are we going to do about it?

9 Detecting deviations from normality Histograms Quantile plots Shapiro-Wilk test

10 Detecting deviations from normality: by histogram Biomass ratio Frequency

11 Detecting deviations from normality: by quantile plot Normal data Normal Quantile

12 Detecting deviations from normality: by quantile plot Biomass ratio Normal Quantile

13 Detecting deviations from normality: by quantile plot Biomass ratio Normal Quantile Normal distribution = straight line Non-normal = non-straight line

14 Detecting differences from normality: Shapiro-Wilk test Shapiro-Wilk Test is used to test statistically whether a set of data comes from a normal distribition Ho: The data come from a normal distribution Ha: The data come from some other distribution

15 What to do when the distribution is not normal If the sample sizes are large, sometimes the standard tests work OK anyway Transformations Non-parametric tests Randomization and resampling

16 The normal approximation Means of large samples are normally distributed So, the parametric tests on large samples work relatively well, even for non-normal data. Rule of thumb- if n > ~50, the normal approximations may work

17 Data transformations A data transformation changes each data point by some simple mathematical formula

18 Log-transformation Y Y' = ln[Y] ln = “natural log”, base e log = “log”, base 10 EITHER WORK

19 Carry out the test on the transformed data!

20

21 Variance and mean increase together --> try the log-transform

22 Other transformations Arcsine Square-root Square Reciprocal Antilog

23 Example: Confidence interval with log-transformed data Data: 5 12 1024 12398 ln data: 1.612.486.939.43 ln[Y]

24 Valid transformations... Require the same transformation be applied to each individual Must be backwards convertible to the original value, without ambiguity Have one-to-one correspondence to original values X = ln[Y] Y = e X

25 Choosing transformations Must transform each individual in the same way You CAN try different transformations until you find one that makes the data fit the assumptions You CANNOT keep trying transformations until P <0.05!!!

26 Assumptions Random sample(s) Populations are normally distributed Populations have equal variances –2-sample t only Do the populations have equal variances? If so, what should We do about it?

27 Comparing the variance of two groups One possible method: the F test

28 The test statistic F Put the larger s 2 on top in the numerator.

29 F... F has two different degrees of freedom, one for the numerator and one for the denominator. (Both are df = n i -1.) The numerator df is listed first, then the denominator df. The F test is very sensitive to its assumption that both distributions are normal.

30 Example: Variation in insect genitalia

31

32 Degrees of freedom For a 2-tailed test, we compare to F  /2,df1,df2 from Table A3.4

33 Why  /2 for the critical value? By putting the larger s 2 in the numerator, we are forcing F to be greater than 1. By the null hypothesis there is a 50:50 chance of either s 2 being greater, so we want the higher tail to include just  /2.

34 Critical value for F

35 Conclusion The F= 107.4 from the data is greater than F (0.025), 6,8 =4.7, so we can reject the null hypothesis that the variances of the two groups are equal. The variance in insect genitalia is much greater for polygamous species than monogamous species.

36 Sample Null hypothesis The two populations have the same variance   1  2 2 F-test Test statistic Null distribution F with n 1 -1, n 2 -1 df compare How unusual is this test statistic? P < 0.05 P > 0.05 Reject H o Fail to reject H o

37 What if we have unequal variances? Welch’s t-test would work If sample sizes are equal and large, then even a ten-fold difference in variance is approximately OK

38 Comparing means when variances are not equal Welch’s t test compared the means of two normally distributed populations that have unequal variances

39 Burrowing owls and dung traps

40 Dung beetles

41 Experimental design 20 randomly chosen burrowing owl nests Randomly divided into two groups of 10 nests One group was given extra dung; the other not Measured the number of dung beetles on the owls’ diets

42 Number of beetles caught Dung added: No dung added:

43 Hypotheses H 0 : Owls catch the same number of dung beetles with or without extra dung (  1 =  2 ) H A : Owls do not catch the same number of dung beetles with or without extra dung (  1   2 )

44 Welch’s t Round down df to nearest integer

45 Owls and dung beetles

46 Degrees of freedom Which we round down to df= 10

47 Reaching a conclusion t 0.05(2), 10 = 2.23 t=4.01 > 2.23 So we can reject the null hypothesis with P<0.05. Extra dung near burrowing owl nests increases the number of dung beetles eaten.

48 Assumptions Random sample(s) Populations are normally distributed Populations have equal variances –2-sample t only What if you don’t want to make so many assumptions?

49 Sample Null hypothesis The two populations have the same mean  1  2 Welch’s t-test Test statistic Null distribution t with df from formula compare How unusual is this test statistic? P < 0.05 P > 0.05 Reject H o Fail to reject H o

50 Non-parametric methods Assume less about the underlying distributions Also called "distribution-free" "Parametric" methods assume a distribution or a parameter

51 Most non-parametric methods use RANKS Rank each data point in all samples from lowest to highest Lowest data point gets rank 1, next lowest gets rank 2,...

52 Sign test Non-parametric test Compares data from one sample to a constant Simple: for each data point, record whether individual is above (+) or below (-) the hypothesized constant. Use a binomial test to compare result to 1/2.

53 Example: Polygamy and the origin of species Is polygamy associated with higher or lower speciation rates?

54 Etc....

55 The differences are not normal

56 Hypotheses H 0 : The median difference in number of species between singly-mating and multiply-mating insect groups is 0. H A : The median difference in number of species between these groups is not 0.

57 7 out of 25 comparisons are negative P = 2 (0.02164) = 0.043

58 The sign test has very low power So it is quite likely to not reject a false null hypothesis.

59 Non-parametric test to compare 2 groups The Mann-Whitney U test compares the central tendencies of two groups using ranks

60 Performing a Mann-Whitney U test First, rank all individuals from both groups together in order (for example, smallest to largest) Sum the ranks for all individuals in each group --> R 1 and R 2

61 Calculating the test statistic, U

62 Example: Garter snake resistance to newt toxin Rough-skinned newt

63 Comparing snake resistance to TTX (tetrodotoxin) This variable is known to be not normally distributed within populations.

64 Hypotheses H 0 : The TTX resistance for snakes from Benton is the same as for snakes from Warrenton. H A : The TTX resistance for snakes from Benton is different from snakes from Warrenton.

65 Calculating the ranks Rank sum for Warrenton: R 1 =1+4+2.5+2.5+7=17

66 Calculating U 1 and U 2 For a two-tailed test, we pick the larger of U 1 or U 2 : U=U 1 =33

67 Compare U to the U table Critical value for U for n 1 =5 and n 2 =7 is 30 33 >30, so we can reject the null hypothesis Snakes from Benton have higher resistance to TTX.

68 How to deal with ties Determine the ranks that the values would have got if they were slightly different. Average these ranks, and assign that average to each tied individual Count all those individuals when deciding the rank of the next largest individual

69 Ties

70 Mann-Whitney: Large sample approximation For n 1 and n 2 both greater than 10, use Compare this Z to the standard normal distribution

71 Example: U 1 =245 U 2 =80 n 1 =13 n 2 =25 Z 0.05(2) =1.96, Z>1.96, so we could reject the null hypothesis

72 Assumption of Mann-Whitney U test Both samples are random samples.


Download ppt "Homework Chapter 11: 13 Chapter 12: 1, 2, 14, 16."

Similar presentations


Ads by Google