Download presentation
Presentation is loading. Please wait.
Published byGarey William Anthony Modified over 9 years ago
1
This presentation is made available through a Creative Commons Attribution- Noncommercial license. Details of the license and permitted uses are available at http://creativecommons.org/licenses/by-nc/3.0/ © 2013, 2014 Juliet Pulliam, Steve Bellan, Clinic on the Meaningful Modeling of Epidemiological Data, ICI3D Programhttp://creativecommons.org/licenses/by-nc/3.0/ Likelihood Fitting and dynamic models, Part I: Dynamic Model Fitting And Inference Robustness (Updated: 8 June 2014) Attribution: JRC Pulliam and SE Bellan, Clinic on the Meaningful Modeling of Epidemiological Data Source URL: http://lalashan.mcmaster.ca/theobio/mmed/http://lalashan.mcmaster.ca/theobio/mmed/ For further information please contact mmed.faculty@gmail.edu.
2
Non-exponential Waiting Times Public Health, Epidemiology, and Models Introduction to Dynamics of Infectious Diseases Foundations of Dynamic Modeling (Hidden) Assumptions of Simple ODE’s Breaking Assumptions! Discrete Individuals and Finite Populations Consequences of Heterogeneity Difference Equations and Discrete Time Intervals Heterogeneity tutorial Gillespie, Stochastic R-F, Chain Binomials Introduction to Thinking about Data Introduction to Infectious Disease Data Thinking about Data II: Confounding, bias, and noise Data Cleaning and Database Management Formulating Research Questions Creating a Model World Variability, Sampling, and Simulation Introduction to Statistical Philosophy Introduction to Likelihood HIV Spreadsheets Study Design and Analysis: Epi methods and RCT’s Integration!
3
Non-exponential Waiting Times Public Health, Epidemiology, and Models Introduction to Dynamics of Infectious Diseases Foundations of Dynamic Modeling (Hidden) Assumptions of Simple ODE’s Breaking Assumptions! Discrete Individuals and Finite Populations Consequences of Heterogeneity Difference Equations and Discrete Time Intervals Heterogeneity tutorial Gillespie, Stochastic R-F, Chain Binomials Introduction to Thinking about Data Introduction to Infectious Disease Data Thinking about Data II: Confounding, bias, and noise Data Cleaning and Database Management Formulating Research Questions Creating a Model World Variability, Sampling, and Simulation Introduction to Statistical Philosophy Introduction to Likelihood HIV Spreadsheets Fitting Dynamic Models I: A conceptual framework Study Design and Analysis: Epi methods and RCT’s Integration!
4
Likelihood fitting and dynamic models, Part 1 Juliet Pulliam, PhD Department of Biology and Emerging Pathogens Institute University of Florida and RAPIDD Program, DIEPS Fogarty International Center US National Institutes of Health Clinic on the Meaningful Modeling of Epidemiological Data ICI3D Program and AIMS - South Arica June 6, 2014
5
Process Model S I
6
S I Parameters
7
Process Model S I Parameters Where do parameters come from?
8
A priori parameterization Use external data to determine values for the parameters in your model CASCADE study
9
A priori parameterization Use external data to determine values for the parameters in your model eg, time from seroconversion to death Plug estimates into models to determine expected dynamics
10
A priori parameterization Long-term time series are not available Designing a new study Data are limited and your goal is to estimate a particular quantity that has not been directly measured Comparing model structures, especially when multiple long-term time series are not available for validation
11
Fitting models to data A priori parameterization Use external data to determine values for the parameters in your model Rarely possible for all model parameters
12
Fitting models to data A priori parameterization Use external data to determine values for the parameters in your model Rarely possible for all model parameters Trajectory matching Feature matching
13
Process Model S I Parameters some (possibly) fixed and others to be fitted
14
Time series Process Model S I Parameters some (possibly) fixed and others to be fitted
15
Process Model S I Parameters some (possibly) fixed and others to be fitted Time series expectation or distribution of latent variables
16
Process Model S I Parameters some (possibly) fixed and others to be fitted Time series expectation or distribution of latent variables Deterministic models
17
Process Model S I Parameters some (possibly) fixed and others to be fitted Time series expectation or distribution of latent variables Deterministic models Stochastic models
18
Data
19
n = 3092
20
Data Observation model n = 3092 PDF:
21
Likelihood of prevalence (given data) Data Observation model n = 3092 LIKELIHOOD: PDF:
22
Data
23
Observation model PDF:
24
Likelihood of prevalence trajectory (given data) Data Observation model LIKELIHOOD: PDF:
25
Likelihood of parameters (given data) Data Observation model Time series expectation or distribution of latent variables Process Model S I Parameters some (possibly) fixed and others to be fitted
26
Likelihood of the model (given data) Data Observation model Time series expectation or distribution of latent variables Process Model S I Parameters some (possibly) fixed and others to be fitted
27
Process Model S I Why do we fit models to data in infectious disease epidemiology?
28
Koopman’s Inference Robustness Assessment Framework Koopman et al. 2014. Transmission modeling to enhance surveillance system function.
29
Koopman’s Inference Robustness Assessment Framework 1. Select the policy inference to be pursued Koopman et al. 2014. Transmission modeling to enhance surveillance system function.
30
Koopman’s Inference Robustness Assessment Framework 2. Construct & Analyze Simple Models 1. Select the policy inference to be pursued Koopman et al. 2014. Transmission modeling to enhance surveillance system function.
31
Koopman’s Inference Robustness Assessment Framework 2. Construct & Analyze Simple Models 3. Constrain Parameter Space with Data 1. Select the policy inference to be pursued Koopman et al. 2014. Transmission modeling to enhance surveillance system function.
32
Koopman’s Inference Robustness Assessment Framework 2. Construct & Analyze Simple Models 3. Constrain Parameter Space with Data 4. Make inference across parameter space 1. Select the policy inference to be pursued Koopman et al. 2014. Transmission modeling to enhance surveillance system function.
33
Koopman’s Inference Robustness Assessment Framework 2. Construct & Analyze Simple Models 3. Constrain Parameter Space with Data 4. Make inference across parameter space Inference Same Across Parameter Space Inference Differs Across Parameter Space 1. Select the policy inference to be pursued Koopman et al. 2014. Transmission modeling to enhance surveillance system function.
34
Koopman’s Inference Robustness Assessment Framework 2. Construct & Analyze Simple Models 3. Constrain Parameter Space with Data 4. Make inference across parameter space Inference Same Across Parameter Space 5. Relax Assumptions with More Realistic Model Inference Differs Across Parameter Space 1. Select the policy inference to be pursued Koopman et al. 2014. Transmission modeling to enhance surveillance system function.
35
Koopman’s Inference Robustness Assessment Framework 2. Construct & Analyze Simple Models 3. Constrain Parameter Space with Data 4. Make inference across parameter space Inference Same Across Parameter Space 5. Relax Assumptions with More Realistic Model Inference Differs Across Parameter Space 6. Find other types and sources of available data OR study cost benefit of new data collection to justify getting new data. 1. Select the policy inference to be pursued Koopman et al. 2014. Transmission modeling to enhance surveillance system function.
36
Koopman’s Inference Robustness Assessment Framework 4. Make inference across parameter space Inference Same Across Parameter Space 5. Relax Assumptions with More Realistic Model Koopman et al. 2014. Transmission modeling to enhance surveillance system function. Inference Robustness Assessment Loop
37
Koopman’s Inference Robustness Assessment Framework 3. Constrain Parameter Space with Data 4. Make inference across parameter space Inference Differs Across Parameter Space 6. Find other types and sources of available data OR study cost benefit of new data collection to justify getting new data. Koopman et al. 2014. Transmission modeling to enhance surveillance system function. Inference Identifiability Assessment Loop
38
Assess inference robustness to realistic relaxation of simplifying model assumptions Koopman’s Inference Robustness Assessment Framework Koopman et al. 2014. Slide courtesy of JS Koopman (with modification).
39
Assess inference robustness to realistic relaxation of simplifying model assumptions Pursue complexity that matters by keeping models as simple as possible but not so simple that they lead to an incorrect inference Koopman’s Inference Robustness Assessment Framework Koopman et al. 2014. Slide courtesy of JS Koopman (with modification).
40
Assess inference robustness to realistic relaxation of simplifying model assumptions Pursue complexity that matters by keeping models as simple as possible but not so simple that they lead to an incorrect inference Koopman’s Inference Robustness Assessment Framework Koopman et al. 2014. Slide courtesy of JS Koopman (with modification). Validate the inference!
41
Assess inference robustness to realistic relaxation of simplifying model assumptions Pursue complexity that matters by keeping models as simple as possible but not so simple that they lead to an incorrect inference Koopman’s Inference Robustness Assessment Framework Koopman et al. 2014. Slide courtesy of JS Koopman (with modification). Validate the inference! not the model or method you’re working with
42
Non-exponential Waiting Times Public Health, Epidemiology, and Models Introduction to Dynamics of Infectious Diseases Foundations of Dynamic Modeling (Hidden) Assumptions of Simple ODE’s Breaking Assumptions! Discrete Individuals and Finite Populations Consequences of Heterogeneity Difference Equations and Discrete Time Intervals Heterogeneity tutorial Gillespie, Stochastic R-F, Chain Binomials Introduction to Thinking about Data Introduction to Infectious Disease Data Thinking about Data II: Confounding, bias, and noise Data Cleaning and Database Management Formulating Research Questions Creating a Model World Variability, Sampling, and Simulation Introduction to Statistical Philosophy Introduction to Likelihood HIV Spreadsheets Fitting Dynamic Models I: A conceptual framework Study Design and Analysis: Epi methods and RCT’s Integration!
43
Non-exponential Waiting Times Public Health, Epidemiology, and Models Introduction to Dynamics of Infectious Diseases Foundations of Dynamic Modeling (Hidden) Assumptions of Simple ODE’s Breaking Assumptions! Discrete Individuals and Finite Populations Consequences of Heterogeneity Difference Equations and Discrete Time Intervals Heterogeneity tutorial Gillespie, Stochastic R-F, Chain Binomials Introduction to Thinking about Data Introduction to Infectious Disease Data Thinking about Data II: Confounding, bias, and noise Data Cleaning and Database Management Formulating Research Questions Creating a Model World Variability, Sampling, and Simulation Introduction to Statistical Philosophy Introduction to Likelihood HIV Spreadsheets Fitting Dynamic Models I: A conceptual framework Monte Carlo Markov Chains Demographic Stochasticity and Ensemble Models Study Design and Analysis: Epi methods and RCT’s Integration! Fitting Dynamic Models II: Practical considerations
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.