Basics of the semiparametric frailty model

Slides:



Advertisements
Similar presentations
Modeling of Data. Basic Bayes theorem Bayes theorem relates the conditional probabilities of two events A, and B: A might be a hypothesis and B might.
Advertisements

Image Modeling & Segmentation
Point Estimation Notes of STAT 6205 by Dr. Fan.
Probabilistic analog of clustering: mixture models
1 Parametric Empirical Bayes Methods for Microarrays 3/7/2011 Copyright © 2011 Dan Nettleton.
Bayesian inference “Very much lies in the posterior distribution” Bayesian definition of sufficiency: A statistic T (x 1, …, x n ) is sufficient for 
1 12. Principles of Parameter Estimation The purpose of this lecture is to illustrate the usefulness of the various concepts introduced and studied in.
Chapter 7 Title and Outline 1 7 Sampling Distributions and Point Estimation of Parameters 7-1 Point Estimation 7-2 Sampling Distributions and the Central.
Statistical Estimation and Sampling Distributions
Chap 8: Estimation of parameters & Fitting of Probability Distributions Section 6.1: INTRODUCTION Unknown parameter(s) values must be estimated before.
Segmentation and Fitting Using Probabilistic Methods
Cox Model With Intermitten and Error-Prone Covariate Observation Yury Gubman PhD thesis in Statistics Supervisors: Prof. David Zucker, Prof. Orly Manor.
Ai in game programming it university of copenhagen Statistical Learning Methods Marco Loog.
Visual Recognition Tutorial
Goodness of Fit of a Joint Model for Event Time and Nonignorable Missing Longitudinal Quality of Life Data – A Study by Sneh Gulati* *with Jean-Francois.
EE-148 Expectation Maximization Markus Weber 5/11/99.
Maximum likelihood (ML)
Today Today: Chapter 9 Assignment: 9.2, 9.4, 9.42 (Geo(p)=“geometric distribution”), 9-R9(a,b) Recommended Questions: 9.1, 9.8, 9.20, 9.23, 9.25.
Prediction and model selection
Visual Recognition Tutorial
Computer vision: models, learning and inference
Expectation-Maximization (EM) Chapter 3 (Duda et al.) – Section 3.9
Copyright © Cengage Learning. All rights reserved. 6 Point Estimation.
Modeling clustered survival data The different approaches.
Maximum likelihood (ML)
17. Duration Modeling. Modeling Duration Time until retirement Time until business failure Time until exercise of a warranty Length of an unemployment.
Bayesian Model Selection in Factorial Designs Seminal work is by Box and Meyer Seminal work is by Box and Meyer Intuitive formulation and analytical approach,
Lecture 15 Tobit model for corner solution
Multivariate survival analysis Luc Duchateau, Ghent University Paul Janssen, Hasselt University 1.
Estimation Basic Concepts & Estimation of Proportions
1 As we have seen in section 4 conditional probability density functions are useful to update the information about an event based on the knowledge about.
Prof. Dr. S. K. Bhattacharjee Department of Statistics University of Rajshahi.
Random Sampling, Point Estimation and Maximum Likelihood.
A Beginner’s Guide to Bayesian Modelling Peter England, PhD EMB GIRO 2002.
Bayesian Analysis and Applications of A Cure Rate Model.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Deterministic vs. Random Maximum A Posteriori Maximum Likelihood Minimum.
Mixture Models, Monte Carlo, Bayesian Updating and Dynamic Models Mike West Computing Science and Statistics, Vol. 24, pp , 1993.
Ch 2. Probability Distributions (1/2) Pattern Recognition and Machine Learning, C. M. Bishop, Summarized by Yung-Kyun Noh and Joo-kyung Kim Biointelligence.
Pro gradu –thesis Tuija Hevonkorpi.  Basic of survival analysis  Weibull model  Frailty models  Accelerated failure time model  Case study.
Lévy copulas: Basic ideas and a new estimation method J L van Velsen, EC Modelling, ABN Amro TopQuants, November 2013.
PROBABILITY AND STATISTICS FOR ENGINEERING Hossein Sameti Department of Computer Engineering Sharif University of Technology Principles of Parameter Estimation.
Example: Bioassay experiment Problem statement –Observations: At each level of dose, 5 animals are tested, and number of death are observed.
CS Statistical Machine learning Lecture 24
Lecture 2: Statistical learning primer for biologists
Point Estimation of Parameters and Sampling Distributions Outlines:  Sampling Distributions and the central limit theorem  Point estimation  Methods.
Multilevel and multifrailty models. Overview  Multifrailty versus multilevel Only one cluster, two frailties in cluster e.g., prognostic index (PI) analysis,
Semantics and History of the term frailty Luc Duchateau Ghent University, Belgium.
Statistics Sampling Distributions and Point Estimation of Parameters Contents, figures, and exercises come from the textbook: Applied Statistics and Probability.
1 Chapter 8: Model Inference and Averaging Presented by Hui Fang.
1 Borgan and Henderson: Event History Methodology Lancaster, September 2006 Session 6.1: Recurrent event data Intensity processes and rate functions Robust.
Joint Modelling of Accelerated Failure Time and Longitudinal Data By By Yi-Kuan Tseng Yi-Kuan Tseng Joint Work With Joint Work With Professor Jane-Ling.
1 Borgan and Henderson: Event History Methodology Lancaster, September 2006 Session 8.1: Cohort sampling for the Cox model.
DURATION ANALYSIS Eva Hromádková, Applied Econometrics JEM007, IES Lecture 9.
[Topic 11-Duration Models] 1/ Duration Modeling.
Prediction and Missing Data. Summarising Distributions ● Models are often large and complex ● Often only interested in some parameters – e.g. not so interested.
Lecture 15 Tobit model for corner solution
Comparing Cox Model with a Surviving Fraction with regular Cox model
12. Principles of Parameter Estimation
Linear Mixed Models in JMP Pro
Maximum Likelihood Find the parameters of a model that best fit the data… Forms the foundation of Bayesian inference Slide 1.
Bayesian Models in Machine Learning
SMEM Algorithm for Mixture Models
'Linear Hierarchical Models'
Where did we stop? The Bayes decision rule guarantees an optimal classification… … But it requires the knowledge of P(ci|x) (or p(x|ci) and P(ci)) We.
Continuous distributions
Parametric Empirical Bayes Methods for Microarrays
11. Conditional Density Functions and Conditional Expected Values
11. Conditional Density Functions and Conditional Expected Values
12. Principles of Parameter Estimation
Applied Statistics and Probability for Engineers
Presentation transcript:

Basics of the semiparametric frailty model Luc Duchateau Ghent University, Belgium

Fitting the semiparametric frailty model The EM approach The penalised partial likelihood approach The bayesian approach The laplacian integration approach

The EM approach For frailty models we have observed information Unobserved information

Solution based on marginal likelihood? Assuming a Weibull baseline hazard and a one-parameter gamma frailty model we obtained an explicit expression for the marginal log likelihood The marginal log likelihood contains the baseline hazard. So we run into trouble if we want to take a semiparametric approach, i.e., unspecified baseline hazard Heterogeneity Weibull Risk coeff

Splitting log likelihood in two parts Assume we have complete information observed o Denote by the joint ‘density’

Introducing partial likelihood Since -at the moment- we assume observed we can estimate using the partial likelihood idea, i.e., replace by maximize with respect to maximize with respect to Since is unobserved, approach needs to be adapted

Use Expectation-Maximisation Step 1: Initialisation Start with and (obtained by fitting the classical Cox model) as initial values Step 2: Expectation Given obtain

Use Expectation-Maximisation Step 1: Initialisation Step 2: Expectation Step 3: Maximisation Take with  Maximise to obtain

Use Expectation-Maximisation Step 1: Initialisation Step 2: Expectation Step 3: Maximisation Step 4: Maximisation Take with  Maximise to obtain

Expectation step in detail Can we get explicit expressions for the conditional expectations in Step 2? Yes for the gamma frailty density

Explicit expression Expectation with ordered event times number of events at

Illustration For k=1 We obtain and

Illustration For k=2 We obtain and

Schematic presentation of EM

The PPL approach We use random effects rather than the frailties The full data log likelihood:

The penalty term can be seen as penalty term For the reference value (mean) is zero or have small (close to zero) and therefore takes a large negative value: a decrease of the likelihood (act as a penalty) We therefore write with

PPL: partial likelihood - penalty term To apply semiparametric ideas, consider the ‘s in as ‘parameters’ (we put the ‘s and the components of at the same level Using partial likelihood ideas we replace by with

Conclusion For inference on and we will use the penalized partial likelihood We now consider two concrete examples: (McGilchrist and Aisbett (1991)) is loggamma, i.e., is a one-parameter gamma density

Zero-mean normal density Maximization of consists of an inner loop (k index) an outer loop (l index)

The loggamma density Maximization as before with inner and outer loop but more involved since REML estimator for is not available

Marginal partial likelihood We obtain a new value of by a golden section search on As stopping criterion we now use What is ?