Presentation is loading. Please wait.

Presentation is loading. Please wait.

Analysis and Visualization Approaches to Assess UDU Capability Presented at MBSW 2015 19 May 2015 Jeff Hofer, Adam Rauk 1.

Published byPrudence Shepherd Modified over 9 years ago

Similar presentations

Presentation on theme: "Analysis and Visualization Approaches to Assess UDU Capability Presented at MBSW 2015 19 May 2015 Jeff Hofer, Adam Rauk 1."— Presentation transcript:

1 Analysis and Visualization Approaches to Assess UDU Capability Presented at MBSW 2015 19 May 2015 Jeff Hofer, Adam Rauk 1

2 Outline ♦Background and Motivation ♦ASTM E2810 ♦Linking development results to Process Validation and Routine testing Bayesian analysis ♦Visualization tool ♦Conclusions 2015 MBSW, Tuesday, May 19, 2015 Jeff Hofer and Adam Rauk, Eli Lilly 2

3 Motivation ♦USP 905 is a standard that must be met whenever a product is tested … it is not a release test ♦Increasing expectations to use ASTM E2810 (or other approach) to demonstrate ability to meet USP 905 ♦ASTM E2810 provides requirements that, if met, for the specific sample size tested provide a specified level of confidence that the USP 905 test would be met at least a specified percentage of the time if tested in the future 2015 MBSW, Tuesday, May 19, 2015 Jeff Hofer and Adam Rauk, Eli Lilly 3

4 True Example OC Curves for ASTM plans and USP test from recent ISPE team publication 2015 MBSW, Tuesday, May 19, 2015 Jeff Hofer and Adam Rauk, Eli Lilly 4 Demonstration of Conservativeness These OC curves change based on the true batch mean

5 Example ASTM E2810 Acceptance Table 2015 MBSW, Tuesday, May 19, 2015 Jeff Hofer and Adam Rauk, Eli Lilly 5 Acceptance Ranges This table changes based on the sample plan and confidence/coverage

6 Question How can one concisely and clearly summarize a product’s capability to meet complex criteria, such as that of ASTM E2810, from multiple Stage 1 (i.e., development) studies? 2015 MBSW, Tuesday, May 19, 2015 Jeff Hofer and Adam Rauk, Eli Lilly 6

7 Challenge ♦Create a way to summarize development UDU study data that Includes individual studies and provides an overall summary for a given product Enables more informed risk assessments as a product moves from development into process validation and routine manufacture Allows for comparison between products, platforms, and scales Is readily understandable/interpretable 2015 MBSW, Tuesday, May 19, 2015 Jeff Hofer and Adam Rauk, Eli Lilly 7

8 Desired Attributes ♦KISS ♦Seamlessly adjust for studies of varying size ♦Visualize the amount of uncertainty in the results ♦Leverage prior knowledge where appropriate Apply Bayesian methods to estimate credible intervals for variability estimates –Some estimates using traditional random effects resulted in poor estimates. Bayesian methods provide significantly improved estimation in these cases. Determine reasonable priors to use for variability estimates 2015 MBSW, Tuesday, May 19, 2015 Jeff Hofer and Adam Rauk, Eli Lilly 8

9 Factors Impacting the Ability of a Batch to Pass the Different UDU Criteria ♦Batch Mean ♦Location to Location Variability ♦Within Location Variability ♦Note Weight variability, concentration variability, and assay variability are not explicitly called out but they contribute to the above elements 2015 MBSW, Tuesday, May 19, 2015 Jeff Hofer and Adam Rauk, Eli Lilly 9

10 Monte Carlo Simulation to Obtain 95% Limit Contours ♦Properties Varied True batch mean True location to location standard deviation True within location standard deviation ♦Estimates Probability of passing the various criteria –USP 905 –ASTM 50/95 30 locations x 2 samples per location when there was either 0% or 90% of the total variance due to location to location (example Process Validation, Stage 2) –ASTM 50/80 10/30 (example Routine Release, Stage 3) ♦Summarize Show contours of constant 95% probability of passing a given criteria on a plot of within location versus between location variability 2015 MBSW, Tuesday, May 19, 2015 Jeff Hofer and Adam Rauk, Eli Lilly 10

11 Example OC Curves when  =100 2015 MBSW, Tuesday, May 19, 2015 Jeff Hofer and Adam Rauk, Eli Lilly 11

12 95% Pass Contours for Mean=100 2015 MBSW, Tuesday, May 19, 2015 Jeff Hofer and Adam Rauk, Eli Lilly 12

13 95% Limit Contours for Passing USP, Example Process Validation (50/95)*, and Example Routine Release (50/80)* ♦Plots were created displaying the contours with 95% probability of meeting the specific criteria for different combinations of True Batch Mean (96, 97, 98, 99, 100) True Between Location Standard Deviation True Within Location Standard Deviation ♦Contours become more restrictive as the true mean deviates from 100% ♦When showing multiple batches on same plot, show the contours corresponding to the worst case mean 2015 MBSW, Tuesday, May 19, 2015 Jeff Hofer and Adam Rauk, Eli Lilly 13 *ASTM E2810

14 Working with Product Data 2015 MBSW, Tuesday, May 19, 2015 Jeff Hofer and Adam Rauk, Eli Lilly 14

15 Product Data ♦Data are obtained for batches Dosage units are obtained from multiple locations across the batch At least two dosage units are tested from some locations ♦Bayesian analysis is performed to estimate the between and within location variability and associated credible limits 2015 MBSW, Tuesday, May 19, 2015 Jeff Hofer and Adam Rauk, Eli Lilly 15

16 Bayesian Analysis ♦Bayesian statistical methods used to estimate the within and between standard deviations and 90% credible intervals (provides upper 95% credible limit) ♦Can incorporate prior belief and realistic constraints ♦Relatively non-informative priors utilized Within location SD is Uniform(0.001,10) Between location SD is Uniform(0.001,10) Batch mean comes from a Normal(100,SD=10) ♦The actual data is utilized along with the prior to obtain a posterior distribution for the parameters 2015 MBSW, Tuesday, May 19, 2015 Jeff Hofer and Adam Rauk, Eli Lilly 16

17 Summarizing Analysis Results ♦Plot the point estimates (medians) and the upper 95% credible limits for the posterior distributions of the between and within location standard deviations for individual studies/batches 2015 MBSW, Tuesday, May 19, 2015 Jeff Hofer and Adam Rauk, Eli Lilly 17

18 95% Pass Contours for Mean=100 & Credible Intervals for Line Segment Creation 2015 MBSW, Tuesday, May 19, 2015 Jeff Hofer and Adam Rauk, Eli Lilly 18 Upper 95% Credible Limit Median Estimate

19 Summarizing Analysis Results ♦If line lies inclusively within the contours, we have high (95%) confidence that true within and between location standard deviations are small enough for the batch mean that the corresponding criteria can be met 95% of the time ♦If point estimates fall directly on contour, we have 50% confidence that we could meet the corresponding criteria 95% of the time 2015 MBSW, Tuesday, May 19, 2015 Jeff Hofer and Adam Rauk, Eli Lilly 19

20 Quality Statements ♦When the line endpoint lies inclusively within the contours, there is  95% probability that the true standard deviation is small enough for the batch mean that the corresponding criteria can be met 95% of the time ♦When a point estimate falls directly on the line, there is a 50% probability that the corresponding criteria will be met 95% of the time 2015 MBSW, Tuesday, May 19, 2015 Jeff Hofer and Adam Rauk, Eli Lilly 20

21 Example – Plot of Contours for 95% Pass Percentage for Different Criteria using Worst Case Batch Mean versus 95% Credible Limits for Between and Within Location Variability 2015 MBSW, Tuesday, May 19, 2015 Jeff Hofer and Adam Rauk, Eli Lilly 21

22 Example 2 – Plot of Contours for 95% Pass Percentage for Different Criteria using Worst Case Batch Mean versus 95% Credible Limits for Between and Within Location Variability 2015 MBSW, Tuesday, May 19, 2015 Jeff Hofer and Adam Rauk, Eli Lilly 22

23 Conclusion ♦There is a desire to have a criteria that ensures that one would meet the USP 905 requirements a high percentage of the time ASTM E2810 provides such criteria ♦Bayesian methods provide an excellent way to summarize development content uniformity data ♦Bayesian analysis results can be visualized to demonstrate a product’s capability to meet the USP and ASTM requirements ♦Such a product capability evaluation is useful for assessing risk as a product transitions from development to the manufacturing stages of process validation (Stage 2) and eventually routine release (Stage 3) 2015 MBSW, Tuesday, May 19, 2015 Jeff Hofer and Adam Rauk, Eli Lilly 23

24 Backup Slides 2015 MBSW, Tuesday, May 19, 2015 Jeff Hofer and Adam Rauk, Eli Lilly 24

25 Example OC Curves when  =100 2015 MBSW, Tuesday, May 19, 2015 Jeff Hofer and Adam Rauk, Eli Lilly 25

Download ppt "Analysis and Visualization Approaches to Assess UDU Capability Presented at MBSW 2015 19 May 2015 Jeff Hofer, Adam Rauk 1."

Similar presentations

May F. Mo FDA/Industry Statistics Workshop

May F. Mo FDA/Industry Statistics Workshop
Statistical Evaluation of Dissolution for Specification Setting and Stability Studies Fasheng Li Associate Director, Pharmaceutical Statistics Worldwide.

Statistical Evaluation of Dissolution for Specification Setting and Stability Studies Fasheng Li Associate Director, Pharmaceutical Statistics Worldwide.
Statistical Approaches to Addressing the Requirements of the New FDA Process Validation Guidance for Small Molecules 1 Jason Marlin, MS/T Statistics, Eli.

Statistical Approaches to Addressing the Requirements of the New FDA Process Validation Guidance for Small Molecules 1 Jason Marlin, MS/T Statistics, Eli.
Sampling: Final and Initial Sample Size Determination

Sampling: Final and Initial Sample Size Determination
Mitigating Risk of Out-of-Specification Results During Stability Testing of Biopharmaceutical Products Jeff Gardner Principal Consultant 36 th Annual Midwest.

Mitigating Risk of Out-of-Specification Results During Stability Testing of Biopharmaceutical Products Jeff Gardner Principal Consultant 36 th Annual Midwest.
Sample size optimization in BA and BE trials using a Bayesian decision theoretic framework Paul Meyvisch – An Vandebosch BAYES 2014 - London 13 June 2014.

Sample size optimization in BA and BE trials using a Bayesian decision theoretic framework Paul Meyvisch – An Vandebosch BAYES London 13 June 2014.
Propagation of Error Ch En 475 Unit Operations. Quantifying variables (i.e. answering a question with a number) 1. Directly measure the variable. - referred.

Propagation of Error Ch En 475 Unit Operations. Quantifying variables (i.e. answering a question with a number) 1. Directly measure the variable. - referred.
Introduction to Inference Estimating with Confidence Chapter 6.1.

Introduction to Inference Estimating with Confidence Chapter 6.1.
Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 7-1 Chapter 7 Confidence Interval Estimation Statistics for Managers.

Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 7-1 Chapter 7 Confidence Interval Estimation Statistics for Managers.
Basic Business Statistics, 10e © 2006 Prentice-Hall, Inc. Chap 8-1 Chapter 8 Confidence Interval Estimation Basic Business Statistics 10 th Edition.

Basic Business Statistics, 10e © 2006 Prentice-Hall, Inc. Chap 8-1 Chapter 8 Confidence Interval Estimation Basic Business Statistics 10 th Edition.
Business Statistics: A Decision-Making Approach, 6e © 2005 Prentice-Hall, Inc. Chap 7-1 Introduction to Statistics: Chapter 8 Estimation.

Business Statistics: A Decision-Making Approach, 6e © 2005 Prentice-Hall, Inc. Chap 7-1 Introduction to Statistics: Chapter 8 Estimation.
Lecture 10 Comparison and Evaluation of Alternative System Designs.

Lecture 10 Comparison and Evaluation of Alternative System Designs.
Using ranking and DCE data to value health states on the QALY scale using conventional and Bayesian methods Theresa Cain.

Using ranking and DCE data to value health states on the QALY scale using conventional and Bayesian methods Theresa Cain.
8-1 Copyright ©2011 Pearson Education, Inc. publishing as Prentice Hall Chapter 8 Confidence Interval Estimation Statistics for Managers using Microsoft.

8-1 Copyright ©2011 Pearson Education, Inc. publishing as Prentice Hall Chapter 8 Confidence Interval Estimation Statistics for Managers using Microsoft.
Copyright ©2011 Pearson Education 8-1 Chapter 8 Confidence Interval Estimation Statistics for Managers using Microsoft Excel 6 th Global Edition.

Copyright ©2011 Pearson Education 8-1 Chapter 8 Confidence Interval Estimation Statistics for Managers using Microsoft Excel 6 th Global Edition.
Inferences About Process Quality

Inferences About Process Quality
Statistics for Managers Using Microsoft Excel, 5e © 2008 Pearson Prentice-Hall, Inc.Chap 8-1 Statistics for Managers Using Microsoft® Excel 5th Edition.

Statistics for Managers Using Microsoft Excel, 5e © 2008 Pearson Prentice-Hall, Inc.Chap 8-1 Statistics for Managers Using Microsoft® Excel 5th Edition.
Statistics for Managers Using Microsoft® Excel 7th Edition

Statistics for Managers Using Microsoft® Excel 7th Edition
Lecture II-2: Probability Review

Lecture II-2: Probability Review
69 th Annual International Conference on Mass Properties Engineering Michael Diggs, Melissa Cooley & David Hansch Naval Architects The Use of Inferential.

69 th Annual International Conference on Mass Properties Engineering Michael Diggs, Melissa Cooley & David Hansch Naval Architects The Use of Inferential.

Similar presentations

Ads by Google