1 Statistical Review DRAFT Barbara Krasnicka, Ph.D. FDA, CDRH Division of Biostatistics.

Slides:



Advertisements
Similar presentations
Non-randomized Medical Device Clinical Studies: A Regulatory Perspective Sep. 16, 2005 Lilly Yue, Ph.D.* CDRH, FDA, Rockville MD * No official support.
Advertisements

The Application of Propensity Score Analysis to Non-randomized Medical Device Clinical Studies: A Regulatory Perspective Lilly Yue, Ph.D.* CDRH, FDA,
How would you explain the smoking paradox. Smokers fair better after an infarction in hospital than non-smokers. This apparently disagrees with the view.
1 Arlene Ash QMC - Third Tuesday September 21, 2010 (as amended, Sept 23) Analyzing Observational Data: Focus on Propensity Scores.
V.: 9/7/2007 AC Submit1 Statistical Review of the Observational Studies of Aprotinin Safety Part I: Methods, Mangano and Karkouti Studies CRDAC and DSaRM.
Does Preoperative Hemoglobin Value Predict Postoperative Cardiovascular Complications after Total Joint Arthroplasty? Kishor Gandhi MD, MPH, Eugene Viscusi.
Amplatzer® Septal Occluder
Widimsky P, Tousek P, Rokyta R, et al. Charles University Prague, CZ PRAGUE-7 Study (Hot Lines presenter)
Comparison of the New Mayo Clinic Risk Scores and Clinical SYNTAX Score in Predicting Adverse Cardiovascular Outcomes following Percutaneous Coronary Intervention.
Inappropriate clopidogrel adherence explains stent related adverse outcomes Leonardo Tamariz, MD, MPH University of Miami.
PROSPECTIVE OBSERVATIONAL MULTICENTER STUDY ON THE MANAGEMENT OF INTERMEDIATE CORONARY STENOSES: The Functional or morphological Lesion Assessment for.
The Long-Term Intervention with Pravastatin in Ischemic Disease (LIPID) The LIPID Study Group N Engl J Med 1998;339:
FDA Clinical Presentation1 Cardica Proximal Anastomosis System 510k Wolf Sapirstein MPH, FACS Clinical Review FDA/CDRH/ODE.
CPORT- E Trial Randomized trial comparing medical, economic and quality of life outcomes of non-primary PCI at hospitals with and without on-site cardiac.
Common Problems in Writing Statistical Plan of Clinical Trial Protocol Liying XU CCTER CUHK.
Long-Term Outcomes Using a Self- Expanding Bioprosthesis in Patients With Severe Aortic Stenosis Deemed Extreme Risk for Surgery: Two-Year Results From.
Long-term predictive value of assessment of coronary atherosclerosis by contrast- enhanced coronary computed tomography angiography: meta- analysis and.
12/10/02Harry Bushar1 Computerized Thermal Imaging Breast Cancer System 2100 (CTI BCS2100) Radiological Devices Advisory Panel December 10, 2002 Statistical.
PCI VS CABG JOURNAL REVIEW
1 Telba Irony, Ph.D. Mathematical Statistician Division of Biostatistics Statistical Analysis of InFUSE  Bone Graft/LT-Cage Lumbar Tapered Fusion Device.
COURAGE: Clinical Outcomes Utilizing Revascularization and Aggressive Drug Evaluation Purpose To compare the efficacy of optimal medical therapy (OMT)
Multiple Choice Questions for discussion
Advanced Statistics for Interventional Cardiologists.
Published in Circulation 2005 Percutaneous Coronary Intervention Versus Conservative Therapy in Nonacute Coronary Artery Disease: A Meta-Analysis Demosthenes.
Preservation Solutions, Vein Graft Patency, and Outcomes after Coronary Bypass Surgery RE Harskamp, JH Alexander, PJ Schulte, CM Brophy, MJ Mack, ED Peterson,
Endarterectomy versus Stenting in Patients with Symptomatic Severe Carotid Stenosis Dr. Quan, Dr. Mirhashemi, Dr. Chiang N Engl J Med 2006; 355:
Multi-vessel disease and intracoronay physiology Combat MI 2009 Kees-joost Botman MD, PhD Catharina hospital Eindhoven Heart Institute The Netherlands.
Study design P.Olliaro Nov04. Study designs: observational vs. experimental studies What happened?  Case-control study What’s happening?  Cross-sectional.
CPORT- E Trial Randomized trial comparing outcomes of non-primary PCI at hospitals with and without on-site cardiac surgery.
1 Statistical Review Dr. Shan Sun-Mitchell. 2 ENT Primary endpoint: Time to treatment failure by day 50 Placebo BDP Patients randomized Number.
1 ENTEREG ® (Alvimopan) Special Safety Section Marjorie Dannis, M.D. Division of Gastroenterology Products Office of Drug Evaluation III CDER, FDA The.
Estimating Causal Effects from Large Data Sets Using Propensity Scores Hal V. Barron, MD TICR 5/06.
Critical Appraisal Did the study address a clearly focused question? Did the study address a clearly focused question? Was the assignment of patients.
Long Term Clinical Outcomes Following Drug-Eluting and Bare Metal Stenting in Massachusetts Laura Mauri, MD, MSc; Treacy Silverstein, B.Sc.; Ann Lovett,
The Synergy between Percutaneous Coronary Intervention with TAXUS and Cardiac Surgery: The SYNTAX Study One Year Results of the PCI and CABG Registries.
A Novel Score to Estimate the Risk of Pneumonia After Cardiac Surgery
Left Main Trifurcation Disease: Early and Long-Term Outcomes Of Percutaneous Coronary Intervention I.Sheiban, A.Gerasimou, F. Sciuto, P.Omedè, G. Biondi.
Clinical Review AbioCor® Implantable Replacement Heart H Julie Swain M.D. Cardiovascular Surgeon Ileana Piña M.D. Heart Failure Cardiologist DRAFT.
Community Outreach to Reduce Disparities in Cardiovascular & Diabetes Morbidity & Mortality in the South Bronx Michael Alderman, MD Michelle Johnson, MD,
Trial Design Issues Associated with Evaluation of Distal Protection Devices in Diseased Saphenous Vein Grafts Bram D. Zuckerman, MD, FACC Medical Officer,
A Claims Database Approach to Evaluating Cardiovascular Safety of ADHD Medications A. J. Allen, M.D., Ph.D. Child Psychiatrist, Pharmacologist Global Medical.
UC c EN. Through Medtronic sponsored research, the Transcatheter Aortic Valves clinical portfolio is studying over 11,000 subjects at over 125.
A Prospective, Randomized Trial Evaluating a Paclitaxel-Eluting Balloon in Patients TReated with Endothelial Progenitor Cell CapTuring Stents for De Novo.
RESOLUTE US One-Year Clinical Outcomes from the Pivotal Multicenter RESOLUTE US Study Objective To evaluate the clinical effectiveness of the Resolute.
1 BLA Sipuleucel-T (APC-8015) FDA Statistical Review and Findings Bo-Guang Zhen, PhD Statistical Reviewer, OBE, CBER March 29, 2007 Cellular, Tissue.
1 Statistical Review of the Observational Studies of Aprotinin Safety Part II: The i3 Drug Safety Study CRDAC and DSaRM Meeting September 12, 2007 P. Chris.
Late Open Artery Hypothesis Jason S. Finkelstein, M.D. Tulane University Medical Center 2/24/03.
1 Pulminiq™ Cyclosporine Inhalation Solution Pulmonary Drug Advisory Committee Meeting June 6, 2005 Statistical Evaluation Statistical Evaluation Jyoti.
Gary L. Kamer Statistician OSB/DBS. 2 Statistical Issues at Time of PMA Review Clinical Study Design Excess All-cause Late Mortality (31 to 365 days)
Effect of Intravascular Ultrasound- Guided vs. Angiography-Guided Everolimus-Eluting Stent Implantation: the IVUS-XPL Randomized Clinical Trial Myeong-Ki.
Is there any role for intravascular ultrasound in bifurcation lesions? Giuseppe Biondi-Zoccai, MD University of Turin, Turin, Italy.
Ten Year Outcome of Coronary Artery Bypass Graft Surgery Versus Medical Therapy in Patients with Ischemic Cardiomyopathy Results of the Surgical Treatment.
Date of download: 6/21/2016 Copyright © The American College of Cardiology. All rights reserved. From: Smoking Is Associated With Adverse Clinical Outcomes.
Measures of disease frequency Simon Thornley. Measures of Effect and Disease Frequency Aims – To define and describe the uses of common epidemiological.
Prof. Dr. Sigmund Silber, FESC, FACC On behalf of the RESOLUTE
Rachel Neubrander, PhD Division of Cardiovascular Devices
Total Occlusion Study of Canada (TOSCA-2) Trial
Saphenous Vein Grafts with Multiple Versus Single Distal Targets in Patients Undergoing Coronary Artery Bypass Surgery: One-Year Graft Failure and Five-Year.
Deputy Director, Division of Biostatistics No Conflict of Interest
PMA Analysis of the CREST Trial Approvability of the RX Acculink Carotid Stent System for Revascularization of Carotid Artery Stenosis in Standard Surgical.
American College of Cardiology Presented by Dr. Stephan Windecker
Common Problems in Writing Statistical Plan of Clinical Trial Protocol
Giuseppe Biondi Zoccai, MD
Jeffrey E. Korte, PhD BMTRY 747: Foundations of Epidemiology II
The Synergy between Percutaneous Coronary Intervention with TAXUS and Cardiac Surgery: The SYNTAX Study One Year Results of the PCI and CABG Registries.
FOR DISTRIBUTION BY MEDTRONIC OFFICE OF MEDICAL AFFAIRS ONLY.
The Synergy between Percutaneous Coronary Intervention with TAXUS and Cardiac Surgery: The SYNTAX Study One Year Results of the PCI and CABG Registries.
Martin B. Leon, David R. Holmes, Dean J. Kereiakes, Jeffrey J
ISAR-LEFT MAIN: A Randomized Clinical Trial on Drug-Eluting Stents for Unprotected Left Main Lesions J. Mehilli, MD Deutsches Herzzentrum Technische.
Atlantic Cardiovascular Patient Outcomes Research Team
Presentation transcript:

1 Statistical Review DRAFT Barbara Krasnicka, Ph.D. FDA, CDRH Division of Biostatistics

2 Objective of the Submission  To present the effectiveness and safety of the Cardica® PAS-Port Proximal Anastomosis System use in patients requiring CABG

3 Studies of Interest  Submission was based on (utilized results of) 4 studies The Pivotal Study Conducted under the Investigational Plan CP ; Study 1 A prospective, nonrandomized, multi-center follow-up study (CP ) carried out to evaluate long-term health status of patients from study CP The C-Port Study Conducted under the Investigational Plan CP ; Study 2 A prospective, nonrandomized, multi-center follow-up study to evaluate long-term (about 1 year) health status of C-Port patients

4 Pivotal Study –General Characteristics  Conducted under the Investigational Plan CP Prospective, non-randomized, one-arm Conducted in 2 German and 1 Swiss clinical sites from June 2002 to March 2003 Objective: Assess ease of PAS-Port device use, identify any procedural failure, and evaluate safety and efficacy of the PAS-Port System Undefined hypotheses Carried out without IDE

5 Pivotal Study – Plan of Evaluations  Four main evaluations: pre-operative (coronary angiography) at discharge from hospital (coronary angiography) three month post-operative assessment six month post-operative (coronary angiography)

6 Primary Effectiveness Endpoint (post-hoc process)  Primary endpoint: Patency of a PAS-Port graft at 6 months assessed by angiography Patency: stenosis < 50% in the proximal anastomosis related to a PAS-Port graft The PAS-Port graft patency rate at 6 months is to be compared to the fixed OPC (OPC: Objective Performance Criterion) number equal 80% The historical control rate was 85% with lower confidence limit (LCL) of 95% CI equal 80%.

7 Other Effectiveness and Safety Endpoints (post-hoc process)  Patency of a proximal anastomosis of a PAS-Port graft at 12 months as assessed by stress ECG  Occurrence and Frequency of MACE (myocardial infarction, mortality and revascularization) at one year estimated in connection with stress ECG  Any adverse event –safety endpoint

8 Patient Disposition – CP Sixty patients signed consent form Five patients were eliminated based on the intra- operative screening process. 55 patients finally enrolled in the study (ITT population) Implantations of the PAS-Port for 47 (85%) patients were successful Devices were not implanted successfully for 8 (15%) patients (10 attempts, 10 technical device failures) 6 month evaluation was performed for only 80% (44/55) of enrolled patients

9 Primary Effectiveness Endpoint Main Results  Observed patency rate (based on the angiography at 6 months) is 0.86 (36/42), 95% CI (0.71,0.95)  With patency imputed based on MRI, the patency rate is 0.87 (41/47), 95% CI (0.74, 0.95)

10 Primary Effectiveness Endpoint Sensitivity Analysis  For the ITT population, when considering all technical failures, all grafts in deceased patients and grafts without additional clinical information indicating patency as occluded, the patency rate is 0.72 (43/60), with 95% CI (0.59, 0.83)

11 Primary Effectiveness Endpoint Summary  Point estimates Lower confidence limits of the 95% CI for the patency rates for different methods of assessment are all below the recommended 80% level

12 MACE Frequencies  Kaplan Meier estimate of MACE frequency rates MACE is defined as: myocardial infarction, mortality, and revascularization related to the PAS-Port device

13 Problems with MACE Evaluations  MACE rate at 6 month +15 days is 13% i.e., much higher than 4.4%  Only 39 (71%) of 55 patients were evaluated at 6 months by angiography  Lack of question on adverse event occurrence history in the so-called ’12 month’ Case Report Form.  7 patients who withdrew at the baseline were re- enrolled for the 2 year evaluation. But only 4 of them received the stress ECG test. Despite that, the sponsor qualified all 7 patients as MACE free during 2 years after procedure

14 Safety Endpoint - Results Summary of Adverse Events

15 Safety Endpoint - Problems Two patients died during the follow-up period between the 6th and 24th month visits 10 technical failures (8 patients) of the device use were not included in the adverse events analysis

16 Limitations of Analyses  The effectiveness endpoint was not met either for ITT, or for the per protocol or for the observed populations.  Point estimates, endpoints of confidence intervals may be biased Post-hoc analyses Small data set, only 55 patients (60 grafts) Missing information (only 42 (70%) grafts were evaluated by angiography) Study was carried out without IDE

17 Limitations of Analyses Procedures performed in only 3 sites outside US Comparison of 12 month MACE rates for the pivotal study with the CABG historical data is inadequate.

18 CP Study – General Characteristics  Prospective, non-randomized, multi-center (4 in Germany and 1 in Switzerland) study  Objective was to assess safety and effectiveness of the C-Port Distal Anastomosis System  Some patients (52/118 = 44%) with multiple vein grafts received the PAS-Port device  The PAS-Port placement was based on surgeons’ discretion and was determined by aorta disease state and preferred grafting sequence.

19 Cohort 2 - Characteristics  A subset of the CP data used as a complementary data set for the pivotal study  Not a separate clinical study  Data set on the PAS-Port system for Cohort 2 was created without stringent clinical rules normally imposed on device clinical studies  Data extracted from a broader data set collected for other purposes  Biases embedded in the data impossible to estimate.

20 Comparisons of Studies  Evaluation of the PAS-Port system in Cohort 2 was retrospective in conjunction with evaluation of another not approved by the FDA anastomosis system  The PAS-Port systems used in pivotal study and Study 2 were not exactly the same; the PAS-Port System was improved during and after pivotal study  Populations of two studies were different with respect to patients’ pre-operative variables (e.g., angina, age, CCS class) and intra-operative covariates (e.g., duration of surgery)

21 Comparisons of Studies-Propensity Score  The sponsor presented justification of pool-ability of the two data sets using the propensity score method  Propensity score may be used to some extent as a diagnostic tool to show comparability between the pivotal study cohort and Cohort 2  If two groups overlap well enough in terms of propensity scores, then it is possible to check the influence of ‘cohort effect’ on the outcome variable adjusted for baseline differences.

22 Propensity Score  The propensity score for a patient can be defined as a conditional probability of patient being assigned to Cohort 2, given the patient’s covariates  Can be used to balance the covariate differences of two groups  Can be seriously degraded if important covariates have not been collected or not taken into account in the analysis  Most of the observed covariates should be considered in the analysis.

23 Sponsor’s Propensity Score Analysis  The propensity score analysis was carried out in two steps: 1.predictors of angiographic patency (diabetes, smoking history, vessel disease) were found 2.the propensity scores were calculated for each patient based on patency predictors  Based on the propensity scores, the sponsor grouped patients into three sub-groups and compared the outcome variable adjusted for baseline differences (p=0.22)  The sponsor claimed that the pool-ability of two data sets was justified.

24 Distribution of Sponsor’s Propensity Score

25 Limitation of the Sponsor’s Analysis  Sponsor’s propensity score analysis could not provide statistical justification that results from two cohorts were poolable because: Propensity scores were based only on three covariates which were predictors of patency Some important covariates (e.g., duration of operation..) were not included in the analysis Data set was very small

26 Propensity Score Analysis Model Building  A logistic regression model with a stepwise selection was utilized to build the propensity score model  The final propensity score model included the following covariates: Age, Angina, CCS, Gender, Hyperlipidemia, Vessel disease, NYHA, # of proximal anastomosis, Use of aspirin within 5 days of operation

27 Model Building  The entire population (109 pts) was divided into propensity score third-tiles, with 36 patients in each third-tile  One patient was excluded because she/he did not have CCS  Most patients from Cohort 2 was in the in 3 rd and 2 nd third-tiles (36 and 16 patients, respectively)

28 Propensity Score Distribution

29 Conclusion of Propensity Score Analysis  Propensity score distributions for the pivotal study and Cohort 2 do not overlap at all and do not support the sponsor’s pool-ability conclusion

30 Final Conclusions  No statistical support for combining two data sets (Pivotal Study and Cohort 2) does exist. Therefore, no statistical analysis for the combined data will be presented  A subset of the CP data ( Cohort 2) is not a separate clinical study

31 Final Conclusions  Pivotal Study alone did not supply evidence of effectivness and safety of the PAS-Port System  Point estimates for the effectiveness and safety endpoints may be biased due to: Post-hoc analyses A lot of missing information (in some cases, the imputed patency is questionable). Small data set