1. Applications of Statistics in Research Bandit Thinkhamrop, Ph.D.(Statistics) Department of Biostatistics and Demography Faculty of Public Health Khon Kaen University

2. Steps of Statistical Applications (Practical guides for beginners) Begin at the conclusion Identify the primary research question Identify the primary study outcome Identify type of the study outcome Identify type of the study design Generate a mock data set Identify type of the main statistical goal List choices of the statistical methods Select the most appropriate statistical method Perform the data analysis using a software Report and interpret the results from the outputs

3. Begin at the conclusion Identify the primary research question Identify the primary study outcome Identify type of the study outcome Identify type of the study design Generate a mock data set Identify type of the main statistical goal List choices of the statistical methods Select the most appropriate statistical method Perform the data analysis using a software Report and interpret the results from the outputs Steps of Statistical Applications (Practical guides for beginners)

4. Begin at the conclusion

5. Identify the primary research question Identify the primary study outcome Identify type of the study outcome Identify type of the study design Generate a mock data set Identify type of the main statistical goal List choices of the statistical methods Select the most appropriate statistical method Perform the data analysis using a software Report and interpret the results from the outputs Steps of Statistical Applications (Practical guides for beginners)

6. Identify the primary research question Where to find the research question? –Title of the study –The objective(s) –The conclusion(s) If more than one, find the primary aim. Try to make the question “quantifiable”

7. Begin at the conclusion Identify the primary research question Identify the primary study outcome Identify type of the study outcome Identify type of the study design Generate a mock data set Identify type of the main statistical goal List choices of the statistical methods Select the most appropriate statistical method Perform the data analysis using a software Report and interpret the results from the outputs Steps of Statistical Applications (Practical guides for beginners)

8. Identify the primary study outcome It is the “primary” dependence variable It is the main finding that was used as the basis for the conclusion of the study It is the target of the statistical inference It is the basis for sample size calculation It resided in the : –Title –Research question –Objective –Sample size calculation –Main finding in the RESULTS section of the report –Conclusion

9. Begin at the conclusion Identify the primary research question Identify the primary study outcome Identify type of the study outcome Identify type of the study design Generate a mock data set Identify type of the main statistical goal List choices of the statistical methods Select the most appropriate statistical method Perform the data analysis using a software Report and interpret the results from the outputs Steps of Statistical Applications (Practical guides for beginners)

10. Type of the study outcome: Key for selecting appropriate statistical methods Study outcome –Dependent variable or response variable –Focus on primary study outcome if there are more Type of the study outcome –Continuous –Categorical (dichotomous, polytomous, ordinal) –Numerical (Poisson) count –Even-free duration

11. Continuous outcome Primary target of estimation: –Mean (SD) –Median (Min:Max) –Correlation coefficient: r and ICC Modeling: –Linear regression The model coefficient = Mean difference –Quantile regression The model coefficient = Median difference Example: –Outcome = Weight, BP, score of ?, level of ?, etc. –RQ: Factors affecting birth weight

12. Categorical outcome Primary target of estimation : –Proportion or Risk Modeling: –Logistic regression The model coefficient = Odds ratio (OR) Example: –Outcome = Disease (y/n), Dead(y/n), cured(y/n), etc. –RQ: Factors affecting low birth weight

13. Numerical (Poisson) count outcome Primary target of estimation : –Incidence rate (e.g., rate per person time) Modeling: –Poisson regression The model coefficient = Incidence rate ratio (IRR) Example: –Outcome = Total number of falls Total time at risk of falling Total time at risk of falling –RQ: Factors affecting elderly fall

14. Event-free duration outcome Primary target of estimation : –Median survival time Modeling: –Cox regression The model coefficient = Hazard ratio (HR) Example: –Outcome = Overall survival, disease-free survival, progression-free survival, etc. –RQ: Factors affecting survival

15. The outcome determine statistics Continuous Mean Median Categorical Proportion (Prevalence Or Risk) Count Rate per “space” Survival Median survival Risk of events at T (t) Linear Reg. Logistic Reg. Poisson Reg. Cox Reg.

16. Statistics quantify errors for judgments Parameter estimation [95%CI] Hypothesis testing [P-value] Parameter estimation [95%CI] Hypothesis testing [P-value]

17. Statistics quantify errors for judgments 7 Parameter estimation [95%CI] Hypothesis testing [P-value] Parameter estimation [95%CI] Hypothesis testing [P-value]

18. Begin at the conclusion Identify the primary research question Identify the primary study outcome Identify type of the study outcome Identify type of the study design Generate a mock data set Identify type of the main statistical goal List choices of the statistical methods Select the most appropriate statistical method Perform the data analysis using a software Report and interpret the results from the outputs Steps of Statistical Applications (Practical guides for beginners)

19. Types of Research Qualitative Quantitative ObservationalExperimental Descriptive Analytical Cross-sectionalCase-controlCohort Quasi-experimental Randomized-controlled Clinical trial Field trial Community intervention trial Parallel or Cross-over or factorial Fixed length or group sequential With or without baseline Systematic review Meta-analysis Cross-sectional descriptive Prevalence survey Poll Phenomenology Grounded Theory Ethnography Description Prevalence case-control Nested case-control Case-cohort case-control Prospective cohort Retrospective cohort Ambi-spective cohort

20. Caution about biases Selection bias Information bias Confounding bias Research Design -Prevent them -Minimize them

21. Caution about biases Selection bias (SB) Information bias (IB) Confounding bias (CB) If data available: SB & IB can be assessed CB can be adjusted using multivariable analysis

22. Begin at the conclusion Identify the primary research question Identify the primary study outcome Identify type of the study outcome Identify type of the study design Generate a mock data set Identify type of the main statistical goal List choices of the statistical methods Select the most appropriate statistical method Perform the data analysis using a software Report and interpret the results from the outputs Steps of Statistical Applications (Practical guides for beginners)

23. Generate a mock data set General format of the data layout idyx1x2X3 1 2 3 4 5 … n

24. Generate a mock data set Continuous outcome example idyx1x2X3 1212122 2201219 301420 4208921 5141018 … n604521 Mean (SD)

25. Generate a mock data set Continuous outcome example idyx1x2X3 1112122 2101219 301420 4008921 501018 … n004521 n, percentage

26. Begin at the conclusion Identify the primary research question Identify the primary study outcome Identify type of the study outcome Identify type of the study design Generate a mock data set Identify type of the main statistical goal List choices of the statistical methods Select the most appropriate statistical method Perform the data analysis using a software Report and interpret the results from the outputs Steps of Statistical Applications (Practical guides for beginners)

27. Common types of the statistical goals Single measurements (no comparison) Difference (compared by subtraction) Ratio (compared by division) Prediction (diagnostic test or predictive model) Correlation (examine a joint distribution) Agreement (examine concordance or similarity between pairs of observations)

28. Begin at the conclusion Identify the primary research question Identify the primary study outcome Identify type of the study outcome Identify type of the study design Generate a mock data set Identify type of the main statistical goal List choices of the statistical methods Select the most appropriate statistical method Perform the data analysis using a software Report and interpret the results from the outputs Steps of Statistical Applications (Practical guides for beginners)

31. Dependency of the study outcome required special statistical methods to handle it Example of dependency or correlated data: –Before-after or Pre-post design –Measuring paired organs i.e., ears, eyes, arms, etc. –Longitudinal data, repeated measurement –Clustered data, many observation unit within a cluster Choices of approaches: –Ignore it => use ordinary analysis as independency - not save –Simplify it => use summary measure then analyze the data as it is independent – not efficient –Handle it => Mixed model, multilevel modeling, GEE - recommended

32. Dependency of the study outcome required special statistical methods to handle it Continuous CategoricalCountSurvival Mean Median Proportion (Prevalence Or Risk) Rate per “space” Median survival Risk of events at T (t) Linear Reg.Logistic Reg.Poisson Reg.Cox Reg. Mixed model, multilevel model, GEE

33. Answer the research question based on lower or upper limit of the CI Back to the conclusion Continuous CategoricalCountSurvival Magnitude of effect 95% CI P-value Magnitude of effect 95% CI P-value Mean Median Proportion (Prevalence or Risk) Rate per “space” Median survival Risk of events at T (t) Appropriate statistical methods

34. Always report the magnitude of effect and its confidence interval Absolute effects: –Mean, Mean difference –Proportion or prevalence, Rate or risk, Rate or Risk difference –Median survival time Relative effects: –Relative risk, Rate ratio, Hazard ratio –Odds ratio Other magnitude of effects: –Correlation coefficient (r), Intra-class correlation (ICC) –Kappa –Diagnostic performance –Etc.

35. Touch the variability (uncertainty) to understand statistical inference idA(x- )(x- ) 2 12-24 22-24 30-416 42-24 51410100 Sum (  ) 200128 Mean( ) 4032.0 SD5.66 Median2 X X X 2+2+0+2+14 = 20 2+2+0+2+14 = 20 = 4 5 5 2+2+0+2+14 = 20 = 4 5 5 0 2 2 2 14 Variance = SD 2 Standard deviation = SD

36. Touch the variability (uncertainty) to understand statistical inference idA(x- )(x- ) 2 12-24 22-24 30-416 42-24 51410100 Sum (  ) 200128 Mean( ) 4032.0 SD5.66 Median2 X X X Measure of variation Measure of central tendency Measure of central tendency

37. Degree of freedom Standard deviation (SD) = The average distant between each data item to their mean

38. Same mean BUT different variation idA 12 22 30 42 514 Sum (  ) 20 Mean4 SD5.66 Median2 idC14 23 35 44 54 Sum (  ) 20 Mean4 SD0.71 Median4 Heterogeneous data Skew distribution Heterogeneous data Symmetry distribution idB10 24 312 44 50 Sum (  ) 20 Mean4 SD4.90 Median4 Homogeneous data Symmetry distribution

39. Facts about Variation Because of variability, repeated samples will NOT obtain the same statistic such as mean or proportion: –Statistics varies from study to study because of the role of chance –Hard to believe that the statistic is the parameter –Thus we need statistical inference to estimate the parameter based on the statistics obtained from a study Data varied widely = heterogeneous data Heterogeneous data requires large sample size to achieve a conclusive finding

40. The Histogram idA 12 22 30 42 514 B14 23 35 44 54 01234567891011121314 01234567891011121314

41. The Frequency Curve idA 12 22 30 42 514 B14 23 35 44 54 01234567891011121314 01234567891011121314

42. Area Under The Frequency Curve idA 12 22 30 42 514 B14 23 35 44 54 01234567891011121314 01234567891011121314

43. Central Limit Theorem Right Skew X1 Symmetry X2 Left Skew X3 Normally distributed X1X Xn 

44. Distribution of the sampling mean Distribution of the raw data Central Limit Theorem X1 X2 X3 X1X Xn 

45. Central Limit Theorem Distribution of the raw data X1X Xn  Distribution of the sampling mean (Theoretical) Normal Distribution Large sample

46. Central Limit Theorem Many X,, SD Standardized for whatever n, Mean = 0, Standard deviation = 1 Large sample X1X Xn  Many,, SE X X X Standard deviation of the sampling mean Standard error (SE) Estimated by SE = SD n 

47. (Theoretical) Normal Distribution

49. Mean ± 3SD 99.73% of AUC

50. Mean ± 2SD 95.45% of AUC

51. Mean ± 1SD 68.26% of AUC

52. n = 25 X = 52 SD = 5 Sample Population Parameter estimation [95%CI] Hypothesis testing [P-value] Parameter estimation [95%CI] Hypothesis testing [P-value]

53. 5 = 1 5 Z = 2.58 Z = 1.96 Z = 1.64

54. n = 25 X = 52 SD = 5 SE = 1 Sample Population Parameter estimation [95%CI] : 52-1.96(1) to 52+1.96(1) 50.04 to 53.96 We are 95% confidence that the population mean would lie between 50.04 and 53.96 [95%CI] : 52-1.96(1) to 52+1.96(1) 50.04 to 53.96 We are 95% confidence that the population mean would lie between 50.04 and 53.96 Z = 2.58 Z = 1.96 Z = 1.64

55. n = 25 X = 52 SD = 5 SE = 1 Sample Hypothesis testing Hypothesis testing Population Z = 55 – 52 1 3 H 0 :  = 55 H A :   55

56. Hypothesis testing H 0 :  = 55 H A :   55 If the true mean in the population is 55, chance to obtain a sample mean of 52 or more extreme is 0.0027. Hypothesis testing H 0 :  = 55 H A :   55 If the true mean in the population is 55, chance to obtain a sample mean of 52 or more extreme is 0.0027. Z = 55 – 52 1 3 P-value = 1-0.9973 = 0.0027 5552 -3SE +3SE

57. Report and interpret p-value appropriately Example of over reliance on p-value: –Real results: n=5900; OR Drug A vs Drug B = 1.02 (P<0.001) –Inappropriate: Quote p-value as < 0.05 or put * or **** (star) to indicate significant results –Wrong: Drug A is highly significantly better than Drug B (P<0.001) –What if 95%CI: 1.001 to 1.300? –This is no clinical meaningful at all….!

58. Report and interpret p-value appropriately Example of over reliance on p-value: –Real results: n=30; OR Drug A vs Drug B = 9.2 (P=0.715) –Inappropriate: Quote p-value as > 0.05 –Wrong: There is no statistical significant difference of the treatment effect (P<0.05). Thus Drug A is as effective as Drug B –What if 95%CI: 0.99 to 28.97? –This is study indicated a low power, NOT suggested an equivalence…! –Correct: There was no sufficient information to concluded that... => inconclusive findings

59. P-value is the magnitude of chance NOT magnitude of effect P-value < 0.05 = Significant findings Small chance of being wrong in rejecting the null hypothesis If in fact there is no [effect], it is unlikely to get the [effect] = [magnitude of effect] or more extreme Significance DOES NOT MEAN importance Any extra-large studies can give a very small P- value even if the [magnitude of effect] is very small

60. P-value is the magnitude of chance NOT magnitude of effect P-value > 0.05 = Non-significant findings High chance of being wrong in rejecting the null hypothesis If in fact there is no [effect], the [effect] = [magnitude of effect] or more extreme can be occurred chance. Non-significance DOES NOT MEAN no difference, equal, or no association Any small studies can give a very large P-value even if the [magnitude of effect] is very large

61. P-value vs. 95%CI (1) A study compared cure rate between Drug A and Drug B Setting: Drug A = Alternative treatment Drug B = Conventional treatment Results: Drug A: n1 = 50, Pa = 80% Drug B: n2 = 50, Pb = 50% Pa-Pb = 30% (95%CI: 26% to 34%; P=0.001) An example of a study with dichotomous outcome

62. P-value vs. 95%CI (2) Pa-Pb = 30% (95%CI: 26% to 34%; P< 0.05) Pa > Pb Pb > Pa

63. P-value vs. 95%CI (3) Adapted from: Armitage, P. and Berry, G. Statistical methods in medical research. 3rd edition. Blackwell Scientific Publications, Oxford. 1994. page 99

64. Tips #6 (b) P-value vs. 95%CI (4) Adapted from: Armitage, P. and Berry, G. Statistical methods in medical research. 3rd edition. Blackwell Scientific Publications, Oxford. 1994. page 99 There were statistically significant different between the two groups.

65. Tips #6 (b) P-value vs. 95%CI (5) Adapted from: Armitage, P. and Berry, G. Statistical methods in medical research. 3rd edition. Blackwell Scientific Publications, Oxford. 1994. page 99 There were no statistically significant different between the two groups.

66. P-value vs. 95%CI (4) Save tips: –Always report 95%CI with p-value, NOT report solely p-value –Always interpret based on the lower or upper limit of the confidence interval, p-value can be an optional –Never interpret p-value > 0.05 as an indication of no difference or no association, only the CI can provide this message.

67. Begin at the conclusion Identify the primary research question Identify the primary study outcome Identify type of the study outcome Identify type of the study design Generate a mock data set Identify type of the main statistical goal List choices of the statistical methods Select the most appropriate statistical method Perform the data analysis using a software Report and interpret the results from the outputs Steps of Statistical Applications (Practical guides for beginners)

68. The outcome determine statistics Continuous CategoricalCountSurvival Mean Median Proportion (Prevalence Or Risk) Rate per “space” Median survival Risk of events at T (t) Linear Reg.Logistic Reg.Poisson Reg.Cox Reg.

69. Dependency of the study outcome required special statistical methods to handle it Continuous CategoricalCountSurvival Mean Median Proportion (Prevalence Or Risk) Rate per “space” Median survival Risk of events at T (t) Linear Reg.Logistic Reg.Poisson Reg.Cox Reg. Mixed model, multilevel model, GEE

70. Back to the conclusion Continuous CategoricalCountSurvival Magnitude of effect 95% CI P-value Magnitude of effect 95% CI P-value Mean Median Proportion (Prevalence or Risk) Rate per “space” Median survival Risk of events at T (t) Answer the research question based on lower or upper limit of the CI Appropriate statistical methods

71. Begin at the conclusion Identify the primary research question Identify the primary study outcome Identify type of the study outcome Identify type of the study design Generate a mock data set Identify type of the main statistical goal List choices of the statistical methods Select the most appropriate statistical method Perform the data analysis using a software Report and interpret the results from the outputs Steps of Statistical Applications (Practical guides for beginners)

72. Perform the data analysis using a software Use the data being generated as if it would be after completion of the research Analyze according to the analysis plan Try to understand the computer output and to find if the research question has been answered: – What is the magnitude of effect and its 95% confidence interval? – Was the results due to the role of chance?

73. Begin at the conclusion Identify the primary research question Identify the primary study outcome Identify type of the study outcome Identify type of the study design Generate a mock data set Identify type of the main statistical goal List choices of the statistical methods Select the most appropriate statistical method Perform the data analysis using a software Report and interpret the results from the outputs Steps of Statistical Applications (Practical guides for beginners)

74. Writing Results Sections Outline Sections:  Study algorithm  Characteristics of the study sample  Results of an exploratory analysis to support ways to answer the RQ  Results to answer the RQ  Results of an exploratory analysis to know more about the answer of the RQ Follow formats required by the research sponsor or the target journal Best done with SAP – Statistical Analysis Plan Narrated tables or figures with key messages and avoid repetitions Do not include explanations in Results section

75. Report results with purpose Refer to the corresponding table or figures early at the beginning of the descriptions Report sufficient data to allow evaluation of the calculation while avoid redundancy Document steps of data analysis from which the results were transcribed Provide statistical inference for the main findings that are the basis for the conclusions Always report the confidence intervals, p-value can be an optional – not the main target Tips for Writing Results Section

76. Q & A Thank you