1. 1.10 Validity

2. Diabetes Report
How valid are these results?
Use the checklist!

3. X Although it was truncated
Item
Yes No
N/A
Comment
DATA
Has all relevant data been included?
Is the data interpreted correctly?
Has the original data source been referenced?
Has the data been presented in context?
X Ages excluded
X Improper analysis
X Although it was truncated
X Not all data shown

4. X Item Yes No N/A Comment SURVEY RESULTS
Have the sponsor(s) of the survey been identified?
Have the population and sample size been included?
Has any possible sampling bias been stated?
Is the sample representative of the population?
Do the survey results support the conclusions reached? X
Sampling methods can X be reviewed on CCHS website

5. X 18.5 removed as outlier; no reason given
Item
Yes No
N/A
Comment
REPRESENTATION OF DATA
Have the data ranges been truncated or reduced?
Are the axes scaled proportionally?
Have the start/stop points of the time series been adjusted to support the point of the article?
Have outliers been removed?
X truncated X
X removed as outlier; no reason given

6. X Item Yes No N/A Comment ANALYSIS
Has correlation been confused with causation?
Has accidental association been confused with causation?
Has the margin of error been included? X

7. X Item Yes No N/A Comment MATHEMATICAL ANALYSIS
Are there any obvious mathematical errors?
Has percentage been confused with percentage points?
Has the base value been established for percentage references? X

8. Truncated
Removed “outliers”
Only examined linear portion of graph
Actual data
Their analysis

11. Furthermore… Numbers quoted are correct
Calculations at end of article are nonsense
Why only consider age groups given?
$13 billion is spending over all diabetes patients

12. apparently correct analyses!
Conclusion?
Dig deeper when seeing
apparently correct analyses!
You might find this helpful when considering your Wall of Bad Stats artefact…