1. American Psychological Association’s Task Force on Statistical Inference TFSI 1999

2. Guidelines and Explanations Applications of significance testing in psychology

3. Two types of guidelines 1) Deal with statistics directly (which test, effect size, looking at your data for abnormalities) 2) Will not be statistically testable but has huge implications for your study (randomization, confounds, missing data)

4. Methods Define population clearly Interpretation of results depends on characteristics of population Define control or comparison group clearly Design

5. Methods Best way to limit bias and confounds Humans are awful randomizers Use a computer Random Assignment

6. Methods Probably not control group - “contrast group” Describe which variables have been controlled Which have not and how they might confound Non-Random Assignment

7. Methods Show process that led to sample size decision Show how effect-size estimates were derived from previous research and theory Power and Sample Size

8. Methods Explicitly define variables in study and show how they are related to goals Be clear & consistent with measurement units Use actual measurement as name Variables/Construct

9. Results Missing data? Attrition? Nonresponse? What techniques to show results are not a result of anomalies - outliers, etc…. Before stats LOOK AT YOUR DATA Complications

10. Analysis Occam’s Razor - simple is better Understand how analysis works and what it’s doing Minimally sufficient analysis

11. Analysis Examine residuals graphically - not necessarily statistically Don’t use kurtosis or skewness Assumptions

12. Analysis Report p value, confidence interval and effect size Never use “accept the null hypothesis” Hypothesis test

13. Analysis Can use unstandardized measure if units of measurement are meaningful (# of cigs/day) Add brief comments that puts effect size in practical and theoretical context Effect Size

14. Analysis Put ‘em in - pretty much same reason as effect size - stability across studies. Interval Estimates

15. Analysis ANOVA with Tukey’s HSD - too conservative Find middle ground - don’t test everything Enough to find interesting results but not so few that the hypotheses and results are boring Multiple Corrections

16. Analysis Use both tables and figures Tell your story but simplicity better Include confidence intervals if possible Tables and Figures

17. Thank you. Any Questions?