Download presentation
Presentation is loading. Please wait.
1
American Psychological Association’s Task Force on Statistical Inference TFSI 1999
2
Guidelines and Explanations Applications of significance testing in psychology
3
Two types of guidelines 1) Deal with statistics directly (which test, effect size, looking at your data for abnormalities) 2) Will not be statistically testable but has huge implications for your study (randomization, confounds, missing data)
4
Methods Define population clearly Interpretation of results depends on characteristics of population Define control or comparison group clearly Design
5
Methods Best way to limit bias and confounds Humans are awful randomizers Use a computer Random Assignment
6
Methods Probably not control group - “contrast group” Describe which variables have been controlled Which have not and how they might confound Non-Random Assignment
7
Methods Show process that led to sample size decision Show how effect-size estimates were derived from previous research and theory Power and Sample Size
8
Methods Explicitly define variables in study and show how they are related to goals Be clear & consistent with measurement units Use actual measurement as name Variables/Construct
9
Results Missing data? Attrition? Nonresponse? What techniques to show results are not a result of anomalies - outliers, etc…. Before stats LOOK AT YOUR DATA Complications
10
Analysis Occam’s Razor - simple is better Understand how analysis works and what it’s doing Minimally sufficient analysis
11
Analysis Examine residuals graphically - not necessarily statistically Don’t use kurtosis or skewness Assumptions
12
Analysis Report p value, confidence interval and effect size Never use “accept the null hypothesis” Hypothesis test
13
Analysis Can use unstandardized measure if units of measurement are meaningful (# of cigs/day) Add brief comments that puts effect size in practical and theoretical context Effect Size
14
Analysis Put ‘em in - pretty much same reason as effect size - stability across studies. Interval Estimates
15
Analysis ANOVA with Tukey’s HSD - too conservative Find middle ground - don’t test everything Enough to find interesting results but not so few that the hypotheses and results are boring Multiple Corrections
16
Analysis Use both tables and figures Tell your story but simplicity better Include confidence intervals if possible Tables and Figures
17
Thank you. Any Questions?
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.