Brian L. Strom, M.D., M.P.H. Chair and Professor, Department of Biostatistics and Epidemiology Director, Center for Clinical Epidemiology and Biostatistics.

Slides:



Advertisements
Similar presentations
Dr Eva Batistatou. Outline of this presentation… What is epidemiology? The Fundamentals of Epidemiology course What is biostatistics? The Biostatistics.
Advertisements

Department of O UTCOMES R ESEARCH. Daniel I. Sessler, M.D. Professor and Chair Department of O UTCOMES R ESEARCH The Cleveland Clinic Clinical Research.
Study Designs in Epidemiologic
The Bahrain Branch of the UK Cochrane Centre In Collaboration with Reyada Training & Management Consultancy, Dubai-UAE Cochrane Collaboration and Systematic.
1 Case-Control Study Design Two groups are selected, one of people with the disease (cases), and the other of people with the same general characteristics.
Reading the Dental Literature
Estimation and Reporting of Heterogeneity of Treatment Effects in Observational Comparative Effectiveness Research Prepared for: Agency for Healthcare.
Population Health for Health Professionals. Module 2 Epidemiology The Basic Science of Public Health.
Quantitative Research Deals with quantities and relationships between attributes (variables). Involves the collection and analysis of highly structured.
Writing a Research Protocol Michael Aronica MD Program Director Internal Medicine-Pediatrics.
Comunicación y Gerencia 22/12/20101Cohort studies.
Basic Elements of Testing Hypothesis Dr. M. H. Rahbar Professor of Biostatistics Department of Epidemiology Director, Data Coordinating Center College.
Evaluating Hypotheses Chapter 9 Homework: 1-9. Descriptive vs. Inferential Statistics n Descriptive l quantitative descriptions of characteristics ~
Biostatistics Frank H. Osborne, Ph. D. Professor.
Pharmacoepidemiology: Goals and Methods Sean Hennessy, PharmD, PhD Assistant Professor of Epidemiology & Pharmacology Center for Clinical Epidemiology.
Descriptive Research in Physical Activity Epidemiology Descriptive Research in Physical Activity Epidemiology CHAPTER 1 CHAPTER 11.
Critique of May 10, 2000 Report on the Yale Hemorrhagic Stroke Project (HSP) Brian L. Strom, M.D., M.P.H. Chair and Professor, Department of Biostatistics.
Chapter 7. Getting Closer: Grading the Literature and Evaluating the Strength of the Evidence.
By Dr. Ahmed Mostafa Assist. Prof. of anesthesia & I.C.U. Evidence-based medicine.
Sample Size and Statistical Power Epidemiology 655 Winter 1999 Jennifer Beebe.
Cohort Studies Hanna E. Bloomfield, MD, MPH Professor of Medicine Associate Chief of Staff, Research Minneapolis VA Medical Center.
Clinical Pharmacy Basma Y. Kentab MSc..
Screening Sherine Shawky, MD, Dr.PH Assistant Professor Public Health King Abdulaziz University College of Medicine
Biology in Focus, HSC Course Glenda Childrawi, Margaret Robson and Stephanie Hollis A Search For Better Health Topic 11: Epidemiology.
Peginterferon  2a/Ribavirin FDA Antiviral Drugs Advisory Committee Brian Murphy, MD, MPH, MS InterMune Submitted November 12, 2002 for Presentation November.
Multiple Choice Questions for discussion
Copyright © 2012 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 7: Gathering Evidence for Practice.
Epidemiologic Study Designs Nancy D. Barker, MS. Epidemiologic Study Design The plan of an empirical investigation to assess an E – D relationship. Exposure.
OKU 9 Chapter 15: ORTHOPAEDIC RESEARCH Brian E. Walczak.
Agency for Healthcare Research and Quality Advancing Excellence in Health Care Provision of Preventive Services in the Complex Patient AHRQ.
Epidemiology The Basics Only… Adapted with permission from a class presentation developed by Dr. Charles Lynch – University of Iowa, Iowa City.
IMPROVING DIABETES MANAGEMENT IN PRIMARY CARE
Quantitative Evaluation of Drug Name Safety Using Close-to-Reality Simulated Pharmacy Practice Sean Hennessy, PharmD, PhD Assistant Professor of Epidemiology.
Designing your Research Project Designing your Research Project Ivan J Perry Department of Epidemiology & Public Health University College Cor.
Evidence Based Medicine
Types of study designs Arash Najimi
 Is there a comparison? ◦ Are the groups really comparable?  Are the differences being reported real? ◦ Are they worth reporting? ◦ How much confidence.
Applied Epidemiology Sharla Smith. Discussion Assignments How to complete a discussion assignment –Read the chapters –Evaluate the question –Be very specific.
Tips for Researchers on Completing the Data Analysis Section of the IRB Application Don Allensworth-Davies, MSc Statistical Manager, Data Coordinating.
Cohort Study. Objectives To discuss cohort study designs To discuss data from some cohort studies.
Sample Size Considerations for Answering Quantitative Research Questions Lunch & Learn May 15, 2013 M Boyle.
Types of study designs.
Unit 2 – Public Health Epidemiology Chapter 4 – Epidemiology: The Basic Science of Public Health.
Guidelines for Critically Reading the Medical Literature John L. Clayton, MPH.
Research Methods Ass. Professor, Community Medicine, Community Medicine Dept, College of Medicine.
Bayesian Statistics & Innovative Trial Design April 3, 2006 Jane Perlmutter
Organization of statistical research. The role of Biostatisticians Biostatisticians play essential roles in designing studies, analyzing data and.
EVALUATING u After retrieving the literature, you have to evaluate or critically appraise the evidence for its validity and applicability to your patient.
Intro to Psychology Statistics Supplement. Descriptive Statistics: used to describe different aspects of numerical data; used only to describe the sample.
Design of Clinical Research Studies ASAP Session by: Robert McCarter, ScD Dir. Biostatistics and Informatics, CNMC
BIOSTATISTICS Lecture 2. The role of Biostatisticians Biostatisticians play essential roles in designing studies, analyzing data and creating methods.
Strengthening Research Capabilities Professor John B. Kaneene DVM, MPH, PhD, FAES, FAVES Center for Comparative Epidemiology Michigan State University.
Types of Studies. Aim of epidemiological studies To determine distribution of disease To examine determinants of a disease To judge whether a given exposure.
Headlines Introduction General concepts
Chapter 9 Lecture Research Techniques: For the Health Sciences Fifth Edition © 2014 Pearson Education, Inc. Conducting Analytical Epidemiologic Studies.
12/4/031 Drug Safety and Risk Management Advisory Committee Advancing the Science of Proprietary Drug Name Review Paul J. Seligman, MD.
1 Study Design Imre Janszky Faculty of Medicine, ISM NTNU.
Case control & cohort studies
Chapter 17 Physical Activity Epidemiology Research.
Introduction to General Epidemiology (2) By: Dr. Khalid El Tohami.
Copyright © 2008 Delmar. All rights reserved. Chapter 4 Epidemiology and Public Health Nursing.
“Reading and commenting papers” (Scientific English) Alexis Descatha INSERM, UMS UVSQ- Unité de pathologie professionnelle, Garches.
Sample size calculation
Methods of Science Chapter 1 Section 3.
Evidence-based Medicine
Core Competencies: Choosing Study Design
Understanding Results
Tim Auton, Astellas September 2014
Methods of Science Chapter 1 Section 3.
Interpreting Epidemiologic Results.
Presentation transcript:

Brian L. Strom, M.D., M.P.H. Chair and Professor, Department of Biostatistics and Epidemiology Director, Center for Clinical Epidemiology and Biostatistics George S. Pepper Professor of Public Health and Preventive Medicine Professor of Biostatistics and Epidemiology, Medicine, and Pharmacology University of Pennsylvania School of Medicine CCEB

“Sampling” 1.What is an appropriate sample size of respondents to best determine risk of sound and look alike proprietary names in the prescription drug study group? In a focus group? In a survey document? 2.Should sample be randomly selected? Is it important to have a statistical significance for this type of evaluation?

CCEB “Sampling” Introduction Very general principles of sample size calculations and sampling Application of general principles to this situation Recommendations for research, to guide the future

CCEB Options in Research Design Analytic Studies –Experimental Study –Prospective Cohort Study –Retrospective Cohort Study –Case-Control Study Descriptive Studies –Analyses of Secular Trends –Case Series –Case Reports

Case-Control Studies Disease Cohort Studies Factor Present (cases) Absent (not exposed) Present (exposed) Absent(controls)A DC B

CCEB Determinants of Needed Sample Size Alpha Beta Variability (SD) Delta--how small a difference do you want to be able to detect?

CCEB Determinants of Needed Sample Size: Cohort Study Alpha Beta Incidence in the unexposed control group Delta--how small a RR do you want to be able to detect?

CCEB Determinants of Needed Sample Size: Case-Control Study Alpha Beta Prevalence in the undiseased control group Delta--how small a RR do you want to be able to detect?

CCEB Sampling Study Sample Conclusion About a Population ( Association ) Conclusion About Scientific Theory (Causation) Statistical Inference Biological Inference

CCEB Application of General Principles to This Situation THE Central Principle of Research Design: The question is, what is the question??

CCEB Application of General Principles to This Situation In this situation, there are no a priori hypotheses being tested to be able to consider sample size calculations or questions of sampling What is being performed is essentially qualitative research

CCEB Recommendations for Research, to Guide the Future **Evaluate the current process in a quantitative fashion**

CCEB General Strategy for Evaluation Standardize procedure Test for reliability/ reproducibility Test for validity Make changes in the procedure accordingly

CCEB Standardize Procedure Choose among the current possible approaches a “standard” to be evaluated more rigorously

CCEB Test for Reliability/Reproducibility Evaluate the same drug names in the same process with multiple different groups of survey prescribers and experts, to look for whether there is adequate agreement If no reliability, validity is impossible and procedure should be abandoned

CCEB Test for Validity Gold standard needed: –Drug names rejected in initial FDA review –Drug names withdrawn due to problems –Direct measurement of error rate

CCEB Retrospective: Drug Names Rejected in Initial FDA Review Problem: was the initial review decision correct?

CCEB Retrospective: Drug Names Withdrawn Due to Problems Knowledge of reviewers could be problematic –Other countries –Years ago, and using new pharmacists Was the withdrawal decision a correct one?

CCEB Prospective: Direct Measurement of Error Rate Simulate real life situation in a study setting Choose good and bad options for new names Enter possible new names into prescription entry computer program Ask large numbers of docs to write orders Ask large numbers of pharmacists to “fill” each rx, entering into prescription entry computer program Directly measure resulting error rate

CCEB Make Changes in the Procedure Accordingly Determine appropriate cutpoint for expert ratings, ROC curve vs. gold standard Determine appropriate sample sizes through simulation, ie how many are needed to achieve results consistent with the gold standard Modify processes accordingly

CCEB Potential Sources of Support FDA extramural funds AHRQ patient safety funds NIA pharmacology program NIGMS pharmacology program

CCEB Conclusions Applying a quantitative approach to evaluating what has so far been a qualitative one, could lead to major changes in the procedure, and major improvements in the net results

Statitsically incorrect