Download presentation
Presentation is loading. Please wait.
1
Homework Chapter 11: 13 Chapter 12: 1, 2, 14, 16
2
Assumptions in Statistics
3
The wrong way to make a comparison of two groups “Group 1 is significantly different from a constant, but Group 2 is not. Therefore Group 1 and Group 2 are different from each other.”
4
A more extreme case...
5
Interpreting Confidence Intervals Different Not differentUnknown
6
Assumptions Random sample(s) Populations are normally distributed Populations have equal variances –2-sample t only
7
Assumptions Random sample(s) Populations are normally distributed Populations have equal variances –2-sample t only What do we do when these are violated?
8
Assumptions in Statistics Are any of the assumptions violated? If so, what are we going to do about it?
9
Detecting deviations from normality Histograms Quantile plots Shapiro-Wilk test
10
Detecting deviations from normality: by histogram Biomass ratio Frequency
11
Detecting deviations from normality: by quantile plot Normal data Normal Quantile
12
Detecting deviations from normality: by quantile plot Biomass ratio Normal Quantile
13
Detecting deviations from normality: by quantile plot Biomass ratio Normal Quantile Normal distribution = straight line Non-normal = non-straight line
14
Detecting differences from normality: Shapiro-Wilk test Shapiro-Wilk Test is used to test statistically whether a set of data comes from a normal distribition Ho: The data come from a normal distribution Ha: The data come from some other distribution
15
What to do when the distribution is not normal If the sample sizes are large, sometimes the standard tests work OK anyway Transformations Non-parametric tests Randomization and resampling
16
The normal approximation Means of large samples are normally distributed So, the parametric tests on large samples work relatively well, even for non-normal data. Rule of thumb- if n > ~50, the normal approximations may work
17
Data transformations A data transformation changes each data point by some simple mathematical formula
18
Log-transformation Y Y' = ln[Y] ln = “natural log”, base e log = “log”, base 10 EITHER WORK
19
Carry out the test on the transformed data!
21
Variance and mean increase together --> try the log-transform
22
Other transformations Arcsine Square-root Square Reciprocal Antilog
23
Example: Confidence interval with log-transformed data Data: 5 12 1024 12398 ln data: 1.612.486.939.43 ln[Y]
24
Valid transformations... Require the same transformation be applied to each individual Must be backwards convertible to the original value, without ambiguity Have one-to-one correspondence to original values X = ln[Y] Y = e X
25
Choosing transformations Must transform each individual in the same way You CAN try different transformations until you find one that makes the data fit the assumptions You CANNOT keep trying transformations until P <0.05!!!
26
Assumptions Random sample(s) Populations are normally distributed Populations have equal variances –2-sample t only Do the populations have equal variances? If so, what should We do about it?
27
Comparing the variance of two groups One possible method: the F test
28
The test statistic F Put the larger s 2 on top in the numerator.
29
F... F has two different degrees of freedom, one for the numerator and one for the denominator. (Both are df = n i -1.) The numerator df is listed first, then the denominator df. The F test is very sensitive to its assumption that both distributions are normal.
30
Example: Variation in insect genitalia
32
Degrees of freedom For a 2-tailed test, we compare to F /2,df1,df2 from Table A3.4
33
Why /2 for the critical value? By putting the larger s 2 in the numerator, we are forcing F to be greater than 1. By the null hypothesis there is a 50:50 chance of either s 2 being greater, so we want the higher tail to include just /2.
34
Critical value for F
35
Conclusion The F= 107.4 from the data is greater than F (0.025), 6,8 =4.7, so we can reject the null hypothesis that the variances of the two groups are equal. The variance in insect genitalia is much greater for polygamous species than monogamous species.
36
Sample Null hypothesis The two populations have the same variance 1 2 2 F-test Test statistic Null distribution F with n 1 -1, n 2 -1 df compare How unusual is this test statistic? P < 0.05 P > 0.05 Reject H o Fail to reject H o
37
What if we have unequal variances? Welch’s t-test would work If sample sizes are equal and large, then even a ten-fold difference in variance is approximately OK
38
Comparing means when variances are not equal Welch’s t test compared the means of two normally distributed populations that have unequal variances
39
Burrowing owls and dung traps
40
Dung beetles
41
Experimental design 20 randomly chosen burrowing owl nests Randomly divided into two groups of 10 nests One group was given extra dung; the other not Measured the number of dung beetles on the owls’ diets
42
Number of beetles caught Dung added: No dung added:
43
Hypotheses H 0 : Owls catch the same number of dung beetles with or without extra dung ( 1 = 2 ) H A : Owls do not catch the same number of dung beetles with or without extra dung ( 1 2 )
44
Welch’s t Round down df to nearest integer
45
Owls and dung beetles
46
Degrees of freedom Which we round down to df= 10
47
Reaching a conclusion t 0.05(2), 10 = 2.23 t=4.01 > 2.23 So we can reject the null hypothesis with P<0.05. Extra dung near burrowing owl nests increases the number of dung beetles eaten.
48
Assumptions Random sample(s) Populations are normally distributed Populations have equal variances –2-sample t only What if you don’t want to make so many assumptions?
49
Sample Null hypothesis The two populations have the same mean 1 2 Welch’s t-test Test statistic Null distribution t with df from formula compare How unusual is this test statistic? P < 0.05 P > 0.05 Reject H o Fail to reject H o
50
Non-parametric methods Assume less about the underlying distributions Also called "distribution-free" "Parametric" methods assume a distribution or a parameter
51
Most non-parametric methods use RANKS Rank each data point in all samples from lowest to highest Lowest data point gets rank 1, next lowest gets rank 2,...
52
Sign test Non-parametric test Compares data from one sample to a constant Simple: for each data point, record whether individual is above (+) or below (-) the hypothesized constant. Use a binomial test to compare result to 1/2.
53
Example: Polygamy and the origin of species Is polygamy associated with higher or lower speciation rates?
54
Etc....
55
The differences are not normal
56
Hypotheses H 0 : The median difference in number of species between singly-mating and multiply-mating insect groups is 0. H A : The median difference in number of species between these groups is not 0.
57
7 out of 25 comparisons are negative P = 2 (0.02164) = 0.043
58
The sign test has very low power So it is quite likely to not reject a false null hypothesis.
59
Non-parametric test to compare 2 groups The Mann-Whitney U test compares the central tendencies of two groups using ranks
60
Performing a Mann-Whitney U test First, rank all individuals from both groups together in order (for example, smallest to largest) Sum the ranks for all individuals in each group --> R 1 and R 2
61
Calculating the test statistic, U
62
Example: Garter snake resistance to newt toxin Rough-skinned newt
63
Comparing snake resistance to TTX (tetrodotoxin) This variable is known to be not normally distributed within populations.
64
Hypotheses H 0 : The TTX resistance for snakes from Benton is the same as for snakes from Warrenton. H A : The TTX resistance for snakes from Benton is different from snakes from Warrenton.
65
Calculating the ranks Rank sum for Warrenton: R 1 =1+4+2.5+2.5+7=17
66
Calculating U 1 and U 2 For a two-tailed test, we pick the larger of U 1 or U 2 : U=U 1 =33
67
Compare U to the U table Critical value for U for n 1 =5 and n 2 =7 is 30 33 >30, so we can reject the null hypothesis Snakes from Benton have higher resistance to TTX.
68
How to deal with ties Determine the ranks that the values would have got if they were slightly different. Average these ranks, and assign that average to each tied individual Count all those individuals when deciding the rank of the next largest individual
69
Ties
70
Mann-Whitney: Large sample approximation For n 1 and n 2 both greater than 10, use Compare this Z to the standard normal distribution
71
Example: U 1 =245 U 2 =80 n 1 =13 n 2 =25 Z 0.05(2) =1.96, Z>1.96, so we could reject the null hypothesis
72
Assumption of Mann-Whitney U test Both samples are random samples.
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.