1. Topic 10 - Categorical Outcomes
HRP
Topic 10 - Categorical Outcomes

5. Pearson
Less Adverse Events
Modeling
(χ2 /N) ^ .5
Effect Size
+/- 1 for 2x2 tables with
Odds ratio = 22/44 ÷ 28/24
Relative Risk 1 = 22/66 ÷ 28/52

6. Chi-Square Working χ2 = (Observed # - Expected #)2 / Expected #
χ2 determines if an association exits
χ2 does not measure the strength of the association
χ2 depends on and reflects sample size

7. Right click on the flowchart or File > New…

8. Tables Bigger than 2 x 2

11. 2
Type “ Yes” with a leading blank 1 4 3

12. 5 6 7 8

17. (16 * * * 3) / 71 = mean for ACT
(24 * * * 3) / 71 = mean for Placebo

18. OR: 29/23 ÷ 40/60 = 1.891

19. If you model the wrong outcome, tweak this.
You can control parameterization here.

21. Watch for missing data.
Use the response variable sort order if you are predicting the wrong outcome.
Impact of drug relative to an on placebo baseline
The model found an answer. If you have prefect prediction (0 frequencies in the contingency tables), expect problems.

22. Akaike’s Information Criterion, Schwartz Criterion, -2 log likelihood are here.
All are used to compare nested models. AIC and SC penalize you for the number of parameters.
Overall, is the model any good?

26. Concordant = Given a pair of observations with different values in the response variable, the model correctly assigns the higher probability of the outcome to the person with the outcome.
Domer’s D (nc-nd) / t
Gamma (nc –nd) / (nc + nd)
Tau-a (nc – nd) / (.5 * N * N-1)
c = (nc + .5 * (t-nc –nd)) / t
nc = # concordant pairs
Nd = # discordant pairs
t = pairs with different response values
c = area under the ROC curve
Somer’s D = 2(c-.5)

28. Sensitivity: Correctly identify the presence of a condition in those with the disease.
Specificity: Correctly identify the lack of a condition in those without the disease.

31. Odds of a Month in Remission

32. Profile likelihood are more accurate (especially for small samples) but they need extra horsepower to calculate.

33. Confidence Intervals

34. Don’t interpret these as the % of variance accounted for in your model.

35. Image from: Categorical Data Analysis Using Logistic Regression Course Notes (2005) SAS.

36. Like leverage
How good does the model do at predicting each person
Standardized change in parameters if this observation is dropped
Overall change in parameters if this observation is dropped. Like cooks distance.

37. Poorly fit are in the upper corners. Rough rule of thumb is > 4
Poorly fit are in the upper corners. Rough rule of thumb is > 4. See Hosmer and Lemeshow (2000).
Events (healthy)
Not events (sick)

38. Modify the code to get a better plot showing the impact on the CLs.

40. Look for big bubbles and you can hover the mouse over the dots to see the subject-observation number.

41. Are you missing interactions?
Compare you model vs. a saturated model.
It does not make sense if you have continuous variables in the model.

42. Use H and L if you have continuous predictors in the model.

43. Logistic “issues”

44. Conditional Logistic
You want to predict BBD, so change response variable sort order to descending.
They forgot the strata task role! Use “Group analysis by” then tweak the code.

45. Change “by” into strata.