Presentation is loading. Please wait.

Presentation is loading. Please wait.

Data Mining AERS FDA’s (Spontaneous) Adverse Event Reporting System Division of Drug Risk Evaluation Office of Drug Safety Carolyn McCloskey, M.D., M.P.H.

Published bySuzanna Cunningham Modified over 6 years ago

Similar presentations

Presentation on theme: "Data Mining AERS FDA’s (Spontaneous) Adverse Event Reporting System Division of Drug Risk Evaluation Office of Drug Safety Carolyn McCloskey, M.D., M.P.H."— Presentation transcript:

1 Data Mining AERS FDA’s (Spontaneous) Adverse Event Reporting System Division of Drug Risk Evaluation Office of Drug Safety Carolyn McCloskey, M.D., M.P.H. Drug Safety and Risk Management Advisory Committee May 18, 2005

2 Outline Brief History of data mining (DM) activities at the FDA
Current Use in the Division of Drug Risk Evaluation (DDRE) – CRADA Application Development - WebVDME Pilot - Examples and Selected Conclusions Other CRADA Activities Future Directions in DDRE Pharmacovigilance

3 Historical Overview February 1998:
Office of Women’s Health Grant (Ana Szarfman) March 2003 – July 2005: Cooperative Research & Development Agreement (CRADA) Research in more advanced methodology (Drug-drug interaction & logistic regression modeling)

4 CRADA - Cooperative Research and Development Agreement
Web Visual Data Mining Environment (WebVDME) With Lincoln Technologies, Inc. March 2003 – July 2005

5 CRADA Objectives User-friendly application Web-based environment
Performance Evaluations by User Groups Training Continued development and refinement

6 Empirical Bayes Geometric Mean (EBGM)
An observed/expected score Adjusts for sampling variation (e.g., sample size) No adjustment for reporting bias Allows data stratification in DM software Standard stratification: gender, age group, year

7 EB05 – EB95 Interval Interval in which the EBGM score could be found because of sampling variability EB05 is the lower bound EB95 is the upper bound 90% probability of EBGM occurring between EB05 and EB95

8 Example of Sampling Variability Adjustment (for small numbers)
Adverse Event (AE) Observed Count (N) Expected Count (E) Obs/Exp* N/E (RR) EBGM** EB05 EB95 Myalgia 1,665 334 4.99 4.97 4.78 5.18 Spinal Osteoarthritis 17 3 6.16 4.54 3.03 6.60 * Obs = Observed; Exp = expected ** EBGM = Empirical Bayes Geometric Mean - adjusts for sampling variability

9 CRADA Pre-Pilot Performance Evaluations May 2003 – October 2003
WebVDME record retrieval validation with AERS case retrieval Multiple trade & ingredient nomenclature Drug assignment allocations (suspect & concomitant) Duplicate removal logic OIT system performance evaluations

10 CRADA Pilot Medical Safety Evaluators
Evaluated data mining scores for drugs and biologics Indication vs. new signal Labeled vs. unlabeled Innocent bystanders or concomitant medications Drug names Safety Evaluators’ ease of use

11 CRADA Pilot Epidemiologists
Evaluated Temporal trends Drug name selections Suspect & Concomitant selections Stratification Signal strengths Epidemiologists’ ease of use

12 Pilot Examples New vs. Old Drug EBGM Rankings & Confidence Intervals

13 New Drug (1 Year) EBGM (EB05-EB95)

14 OLDER DRUG (>10 Years) EBGM (EB05-EB95)

15 Selected Pilot Conclusions - 1
WebVDME DM - Statistical tool assists in identifying unusual patterns with AERS data but ! Patterns Need Interpretation!

16 Selected Pilot Conclusions - 2
Knowledge of data in database imperative to interpret Clinical & pharmacologic activities of drug Other - reporting disproportionalities which also reflect limitations of AERS data

17 AERS DATABASE LIMITATIONS

18 Continuing CRADA Activities - DDRE March 2004 - Present
Access by interested Reviewers to WebVDME Training Application Refinements addressing Technical problems identified Customization by user needs

19 Summary – 1 DM Signals in DDRE
Assist in prioritizing evaluations of case series Identify associations, NOT a cause or degree of risk Reflect limitations of data

20 Summary – 2 DM Signals in DDRE
Threshold a compromise between sensitivity and specificity (false positives & negatives) Absence of a DM signal ≠ absence of a drug-event association Magnitude of DM scores ≠ magnitude of risk Always require clinical case report and reporting bias evaluation

21 Future Directions of DM
Prospective signal detection Parallel use with traditional pharmacovigilance methods in DDRE Continued research in more advanced methodology (Drug-drug interaction & logistic regression modeling)

22 Acknowledgments Division of Drug Risk Evaluation
Rita Ouellet-Hellstrom, Ph.D., M.P.H. Mary Willy, Ph.D. Mark Avigan, M.D., C.M.

23 THANK YOU

Download ppt "Data Mining AERS FDA’s (Spontaneous) Adverse Event Reporting System Division of Drug Risk Evaluation Office of Drug Safety Carolyn McCloskey, M.D., M.P.H."

Similar presentations

U.S. Food and Drug Administration Notice: Archived Document The content in this document is provided on the FDA’s website for reference purposes only.

U.S. Food and Drug Administration Notice: Archived Document The content in this document is provided on the FDA’s website for reference purposes only.
Anesthetic and Life Support Drugs and Drug Safety and Risk Management Advisory Committees November 13 & 14, 2008 Reported Manipulation of Oxycodone Extended-Release.

Anesthetic and Life Support Drugs and Drug Safety and Risk Management Advisory Committees November 13 & 14, 2008 Reported Manipulation of Oxycodone Extended-Release.
Data Mining AERS FDA’s (Spontaneous) Adverse Event Reporting System Division of Drug Risk Evaluation Office of Drug Safety Carolyn McCloskey, M.D., M.P.H.

Data Mining AERS FDA’s (Spontaneous) Adverse Event Reporting System Division of Drug Risk Evaluation Office of Drug Safety Carolyn McCloskey, M.D., M.P.H.
Detecting Multi-Item Associations and Temporal Trends Using the WebVDME/MGPS Application DIMACS Tutorial on Statistical and Other Analytic Health Surveillance.

Detecting Multi-Item Associations and Temporal Trends Using the WebVDME/MGPS Application DIMACS Tutorial on Statistical and Other Analytic Health Surveillance.
Data Mining in VAERS to Enhance Vaccine Safety Monitoring at the FDA

Data Mining in VAERS to Enhance Vaccine Safety Monitoring at the FDA
Non-Experimental designs: Developmental designs & Small-N designs

Non-Experimental designs: Developmental designs & Small-N designs
Postmarketing Risk Assessment of Drug Products Division of Drug Risk Evaluation Office of Drug Safety Center for Drug Evaluation and Research.

Postmarketing Risk Assessment of Drug Products Division of Drug Risk Evaluation Office of Drug Safety Center for Drug Evaluation and Research.
Pilot Risk-Ranking Model to Prioritize Manufacturing Sites for GMP Inspections Advisory Committee for Pharmaceutical Science Manufacturing Subcommittee.

Pilot Risk-Ranking Model to Prioritize Manufacturing Sites for GMP Inspections Advisory Committee for Pharmaceutical Science Manufacturing Subcommittee.
1 The Chemoprevention of Sporadic Colorectal Cancer Issues Surrounding a Benefit/Risk Analysis in Clinical Trials Mark Avigan MD CM Medical Officer Division.

1 The Chemoprevention of Sporadic Colorectal Cancer Issues Surrounding a Benefit/Risk Analysis in Clinical Trials Mark Avigan MD CM Medical Officer Division.
Summary of Drug Abuse “Rates” in the United States: Focus on Morphine Catherine Dormitzer, PhD, MPH Division of Epidemiology Office of Surveillance and.

Summary of Drug Abuse “Rates” in the United States: Focus on Morphine Catherine Dormitzer, PhD, MPH Division of Epidemiology Office of Surveillance and.
Accutane FDA (Section Name - Saver’s Initials) 3/9/00 12:50 PM 1 Introduction Russell Ellison, MD Chief Medical Officer Vice President, Medical Affairs.

Accutane FDA (Section Name - Saver’s Initials) 3/9/00 12:50 PM 1 Introduction Russell Ellison, MD Chief Medical Officer Vice President, Medical Affairs.
Research Study Design and Analysis for Cardiologists Nathan D. Wong, PhD, FACC.

Research Study Design and Analysis for Cardiologists Nathan D. Wong, PhD, FACC.
1/26/09 1 Community Health Assessment in Small Populations: Tools for Working With “Small Numbers” Region 2 Quarterly Meeting January 26, 2009.

1/26/09 1 Community Health Assessment in Small Populations: Tools for Working With “Small Numbers” Region 2 Quarterly Meeting January 26, 2009.
Life Sciences Research Office (LSRO) Evaluating Adverse Event Reporting Systems for Dietary Supplements January 30-31, 2003 “Open Portion of Meeting”

Life Sciences Research Office (LSRO) Evaluating Adverse Event Reporting Systems for Dietary Supplements January 30-31, 2003 “Open Portion of Meeting”
Postmarketing Safety Assessment of Osteonecrosis of the Jaw Pamidronate & Zoledronic Acid Division of Drug Risk Evaluation Office of Drug Safety FDA Carol.

Postmarketing Safety Assessment of Osteonecrosis of the Jaw Pamidronate & Zoledronic Acid Division of Drug Risk Evaluation Office of Drug Safety FDA Carol.
Non-Prescription Mevacor ® Merck & Co., Inc. New Drug Application 21-213 Nonprescription Drugs and Endocrinologic and Metabolic Drugs Advisory Committee.

Non-Prescription Mevacor ® Merck & Co., Inc. New Drug Application Nonprescription Drugs and Endocrinologic and Metabolic Drugs Advisory Committee.
March 31, 2006FDA Science Board1 CDER's Office of Drug Safety: Electronic Tools for Risk Assessment and Evaluation Paul J. Seligman, M.D., M.P.H. Director.

March 31, 2006FDA Science Board1 CDER's Office of Drug Safety: Electronic Tools for Risk Assessment and Evaluation Paul J. Seligman, M.D., M.P.H. Director.
Consumer behavior studies1 CONSUMER BEHAVIOR STUDIES STATISTICAL ISSUES Ralph B. D’Agostino, Sr. Boston University Harvard Clinical Research Institute.

Consumer behavior studies1 CONSUMER BEHAVIOR STUDIES STATISTICAL ISSUES Ralph B. D’Agostino, Sr. Boston University Harvard Clinical Research Institute.
Joint Dermatologic and Ophthalmic Drugs & Drug Safety and Risk Management Advisory Committee February 26 & 27, 2004 1 Overview Isotretinoin Pregnancy Exposures:

Joint Dermatologic and Ophthalmic Drugs & Drug Safety and Risk Management Advisory Committee February 26 & 27, Overview Isotretinoin Pregnancy Exposures:
Anti-Infective Drugs Advisory Committee Meeting December 15, 2006 1 Data Mining Analysis of Multiple Antibiotics in AERS Jonathan G. Levine, PhD Mathematical.

Anti-Infective Drugs Advisory Committee Meeting December 15, Data Mining Analysis of Multiple Antibiotics in AERS Jonathan G. Levine, PhD Mathematical.

Similar presentations

Ads by Google