PHARMACOECONOMIC EVALUATIONS & METHODS MARKOV MODELING IN DECISION ANALYSIS FROM THE PHARMACOECONOMICS ON THE INTERNET ®SERIES ©Paul C Langley 2004 Maimon.

Slides:



Advertisements
Similar presentations
Matrix Algebra Matrix algebra is a means of expressing large numbers of calculations made upon ordered sets of numbers. Often referred to as Linear Algebra.
Advertisements

Matrix Algebra Matrix algebra is a means of expressing large numbers of calculations made upon ordered sets of numbers. Often referred to as Linear Algebra.
Refresher: Vector and Matrix Algebra Mike Kirkpatrick Department of Chemical Engineering FAMU-FSU College of Engineering.
Mathematics. Matrices and Determinants-1 Session.
3_3 An Useful Overview of Matrix Algebra
MF-852 Financial Econometrics
Review of Matrix Algebra
Finite Mathematics & Its Applications, 10/e by Goldstein/Schneider/SiegelCopyright © 2010 Pearson Education, Inc. 1 of 60 Chapter 8 Markov Processes.
MOHAMMAD IMRAN DEPARTMENT OF APPLIED SCIENCES JAHANGIRABAD EDUCATIONAL GROUP OF INSTITUTES.
“No one can be told what the matrix is…
Wednesday, July 15, 2015 EQ: What are the similarities and differences between matrices and real numbers ? Warm Up Evaluate each expression for a = -5,
Intro to Matrices Don’t be scared….
Arithmetic Operations on Matrices. 1. Definition of Matrix 2. Column, Row and Square Matrix 3. Addition and Subtraction of Matrices 4. Multiplying Row.
CE 311 K - Introduction to Computer Methods Daene C. McKinney
College Algebra Fifth Edition James Stewart Lothar Redlin Saleem Watson.
1 Chapter 2 Matrices Matrices provide an orderly way of arranging values or functions to enhance the analysis of systems in a systematic manner. Their.
Chapter 7 Matrix Mathematics Matrix Operations Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display.
Chapter 10 Review: Matrix Algebra
ECON 1150 Matrix Operations Special Matrices
Equation --- An equation is a mathematical statement that asserts the equality of twomathematicalstatement expressions. An equation involves an unknown,
Barnett/Ziegler/Byleen Finite Mathematics 11e1 Review for Chapter 4 Important Terms, Symbols, Concepts 4.1. Systems of Linear Equations in Two Variables.
Rev.S08 MAC 1140 Module 10 System of Equations and Inequalities II.
Matrices. Given below is a record of all the types of books kept in a class library. TypeFictionGeneral Malay2547 Chinese4072 English8085.
Multivariate Statistics Matrix Algebra II W. M. van der Veld University of Amsterdam.
Matrix Algebra and Applications
Matrices & Determinants Chapter: 1 Matrices & Determinants.
4.1 Matrix Operations What you should learn: Goal1 Goal2 Add and subtract matrices, multiply a matrix by a scalar, and solve the matrix equations. Use.
To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna 5-1 1© 2006 by Prentice Hall, Inc. Upper Saddle River, NJ Module 5 Mathematical.
Statistics and Linear Algebra (the real thing). Vector A vector is a rectangular arrangement of number in several rows and one column. A vector is denoted.
Overview Definitions Basic matrix operations (+, -, x) Determinants and inverses.
1 C ollege A lgebra Systems and Matrices (Chapter5) 1.
Matrices CHAPTER 8.1 ~ 8.8. Ch _2 Contents  8.1 Matrix Algebra 8.1 Matrix Algebra  8.2 Systems of Linear Algebra Equations 8.2 Systems of Linear.
Unit 3: Matrices.
Linear algebra: matrix Eigen-value Problems Eng. Hassan S. Migdadi Part 1.
4.4 Identify and Inverse Matrices Algebra 2. Learning Target I can find and use inverse matrix.
College Algebra Sixth Edition James Stewart Lothar Redlin Saleem Watson.
Fundamentals of Engineering Analysis
Meeting 18 Matrix Operations. Matrix If A is an m x n matrix - that is, a matrix with m rows and n columns – then the scalar entry in the i th row and.
CALCULUS – III Matrix Operation by Dr. Eman Saad & Dr. Shorouk Ossama.
Chiang & Wainwright Mathematical Economics
3.4 Solution by Matrices. What is a Matrix? matrix A matrix is a rectangular array of numbers.
Unit 3 Matrix Arithmetic IT Disicipline ITD 1111 Discrete Mathematics & Statistics STDTLP 1 Unit 3 Matrix Arithmetic.
Matrices and Determinants
MATRIX A set of numbers arranged in rows and columns enclosed in round or square brackets is called a matrix. The order of a matrix gives the number of.
STROUD Worked examples and exercises are in the text Programme 5: Matrices MATRICES PROGRAMME 5.
CS 450: COMPUTER GRAPHICS TRANSFORMATIONS SPRING 2015 DR. MICHAEL J. REALE.
Goldstein/Schnieder/Lay: Finite Math & Its Applications, 9e 1 of 60 Chapter 8 Markov Processes.
Unit 3: Matrices. Matrix: A rectangular arrangement of data into rows and columns, identified by capital letters. Matrix Dimensions: Number of rows, m,
STROUD Worked examples and exercises are in the text PROGRAMME 5 MATRICES.
Matrices. Matrix - a rectangular array of variables or constants in horizontal rows and vertical columns enclosed in brackets. Element - each value in.
Matrix Algebra Definitions Operations Matrix algebra is a means of making calculations upon arrays of numbers (or data). Most data sets are matrix-type.
Matrices, Vectors, Determinants.
Matrices. Variety of engineering problems lead to the need to solve systems of linear equations matrixcolumn vectors.
10.4 Matrix Algebra. 1. Matrix Notation A matrix is an array of numbers. Definition Definition: The Dimension of a matrix is m x n “m by n” where m =
A very brief introduction to Matrix (Section 2.7) Definitions Some properties Basic matrix operations Zero-One (Boolean) matrices.
MATRICES A rectangular arrangement of elements is called matrix. Types of matrices: Null matrix: A matrix whose all elements are zero is called a null.
Linear Algebra by Dr. Shorouk Ossama.
Matrices Introduction.
MTH108 Business Math I Lecture 20.
10.4 The Algebra of Matrices
Chapter 7 Matrix Mathematics
MATHEMATICS Matrix Algebra
5 Systems of Linear Equations and Matrices
Warm-up a. Solve for k: 13 −5
Precalculus Mathematics for Calculus Fifth Edition
Unit 3: Matrices
Presented By Farheen Sultana Ist Year I SEM
Matrices.
Chapter 4 Systems of Linear Equations; Matrices
Matrices and Determinants
Presentation transcript:

PHARMACOECONOMIC EVALUATIONS & METHODS MARKOV MODELING IN DECISION ANALYSIS FROM THE PHARMACOECONOMICS ON THE INTERNET ®SERIES ©Paul C Langley 2004 Maimon Research LLC

OBJECTIVES To describe the place of Markov models in pharmacoeconomic analysis To provide an introduction to Matrix methods To illustrate the steps required to set up a Markov model To consider the limitations of Markov models

THE PLACE OF MARKOV MODELS Markov models represent a variant of decision analysis for pharmacoeconomic evaluations where the treatment pathways and options may be both complex and repetitive Markov models can also be used in situations where prevalence as well as incidence based impact assessments are required.

TYPES OF MARKOV MODEL In representing complex decision processes in simple and convenient mathematical form, we can use two types of Markov model: –regular Markov chain models –absorbing Markov chain models

ABSORBING MARKOV CHAINS These are the most widely used form of Markov model in pharmacoeconomics They are used to estimate time spent by a patient group in a particular disease state when all patients eventually leave that disease state by recovery or death They can be used to estimate both time spent in a disease state or time spent in a budget period

MATRIX ALGEBRA The principal obstacles to utilizing Markov models are the lack of familiarity with the rules of matrix manipulation and their application to Markov processes These rules are summarized in the downloadable text which includes a brief introduction to Markov processes and the mathematics of absorbing Markov chains

WHAT DO I NEED TO KNOW? What are matrices and vectors? What are the rules of matrix manipulation? What is an identity matrix? What is matrix inversion? What is a transition matrix? What is a fundamental matrix?

MATRICES AND VECTORS Matrices and vectors are arrays or ordered collections of real numbers Vectors, which can be row vectors or column vectors, are designated by lower bold case (i.e., u = [ 5 6 7] is a row vector with three real numbers as components) Matrices are rectangular or square arrays of real numbers designated by upper case bold letters (i.e., N or I or Q)

MATRIX NOTATION When we describe a matrix it is in terms of the number of rows (the i th row) and the number of columns (the j th column) We can describe matrices in terms of their size by using i and j (i.e., size i x j), where a square matrix is a special case of i = j Row vectors would be written (1 x j) and column vectors (i x 1)

IDENTITY MATRIX In order to manipulate matrices and apply Markov models we require a special type of square matrix which we call an identity matrix By construction an identity matrix has ones in its leading diagonal and zeros everywhere else

MATRIX ADDITION AND SUBTRACTION In standard arithmetic we can add and subtract one number from another In matrix manipulation, where we are dealing with arrays of numbers, we can similarly add or subtract one matrix from another by operating on the corresponding components However, to do addition and subtraction matrices must be of the same size

MATRIX MULTIPLICATION The process of matrix multiplication is somewhat more complex Note also that we don’t require matrices to be of the same size or order but they must follow the rule where we have two matrices (m x n) and (n x k) we can only multiply if n is common, i.e., (m x n)(n x k) = (m x k) which is a product matrix of size (m x k) The mechanics of multiplication involves combining row and column components

OPERATIONS NOTATION Addition: A + B = C Subtraction: A - B = D Multiplication: AB = E but note that multiplication is not commutative but depends upon the order of multiplication (as a result of the rules of matrix multiplication Hence we use the terms pre-multiplication and post-multiplication so that BA  E

MATRIX DIVISION There is no division as such in matrix algebra, we cannot divide the components in one matrix by the components in another Rather, we talk about multiplying by a matrix which is the inverse of that matrix We talk about an operation analogous to division: if we have two matrices A and B and we are told B is the product of A and come unknown matrix X, where AX = B, then we solve for X

SOLUTION To perform our operation and solve for X we pre-multiply by the inverse of A to give A -1 AX = A -1 B since A -1 A = I (by construction) and IX = X then we have X = A -1 B (providing A has an inverse)

TRANSITION MATRIX The only other element of matrix algebra we require is to define a transition matrix This is a square matrix where the components are non-negative real numbers expressed as probabilities and the sum of each row is equal to unity Usually denoted by P

MARKOV CHAINS There are two types of Markov chain which are of interest in pharmacoeconomic modeling and which will now consider: regular Markov chains absorbing Markov chains

REGULAR MARKOV CHAIN Regular Markov chains illustrate an interesting property of the behavior of transition matrices If we multiply the transition matrix P by itself we get the probability of being in a particular state after 2 periods (P x P = P 2 ) Eventually P n converges to a fixed point matrix solution (a W matrix) where each of the rows w is an identical probability vector

ABSORBING MARKOV CHAINS Our principal interest is in absorbing Markov chains There are three steps in applying absorbing Markov chains to a health care decision problem –identifying mutually exclusive treatment states –specifying a transition matrix for these states –solving for the fundamental matrix of the absorbing Markov chain

TREATMENT STATES Defining mutually exclusive and exhaustive disease states through which a patient might move relies upon the clinical knowledge of the analyst These are most easily thought of as treatment stages which eventually result in the patient leaving the system via death or recovery, although the patient does not have to move through each of them and some transitions may be barred

TRANSITION PROBABILITIES Each row of the transition matrix summarizes the probability of persons moving between treatment states Transition probabilities are defined for a fixed time interval (e.g., month, quarter) The rows sum to one including the probability of moving to the absorbing state Matrix manipulation focuses on the square transition matrix hence everyone eventually leaves the system

FUNDAMENTAL MATRIX The part of the transition matrix that is manipulated to derive the fundamental matrix (denoted N) is called the Q matrix N is solved as the solution to an infinite series I + Q + Q 2 + Q 3 + or as N = (I - Q) -1 Each element of the N matrix is the mean number of times that the chain is in state a j given it started in state a i

APPLICATION (I) This final property of the fundamental matrix means that if we add up all of the elements in any row of the matrix, multiplying this by the fixed time interval, we get the survival time of patients who entered the system in this row state Hence the fundamental matrix generates survival times and time spent in each treatment state

APPLICATION (II) Rather than solve for the fundamental matrix we can take any number of the elements of the geometric sequence and generate time spent in treatment states over a given time period This means that the absorbing Markov process can generate both incidence and prevalence based estimates

APPLICATION (III) In order to apply the absorbing Markov chain to the impact of new therapies all we need to do is to vary the transition probabilities (while maintaining consistency in the probabilities) Hence we can compare new drug impacts on time spent in treatment states

APPLICATION (IV) Estimates of time spent in treatment states are the basis for costs and outcomes impact assessments If we estimate resources and costs used to support fixed interval treatment times in the various treatment states we can estimate treatment costs for the time spent in each If we have outcome measures (e.g., QALYs) for each state we can estimate outcomes in QALY terms

OVERVIEW Markov models are potentially a major contribution to decision analysis Even so, they still embody assumptions of constant cost and complete therapy switching They are very demanding of data and are difficult to populate