Introducing Bayesian Networks in Neuropsychological Measures Presented at 2006 APS Annual Conference Toshi Yumoto University of Maryland, Abt Associate.

Slides:



Advertisements
Similar presentations
Bayes rule, priors and maximum a posteriori
Advertisements

Introducing Psychometric Approaches to Analyze Neuropsychological Measures: Mixture Modeling Association for Psychological Science Annual Meeting, New.
Chapter 18: The Chi-Square Statistic
Correlational and Differential Research
Naïve Bayes. Bayesian Reasoning Bayesian reasoning provides a probabilistic approach to inference. It is based on the assumption that the quantities of.
Survey Design Teri Peterson Acknowledgements The Survey Kit By Arlene Fink Survey Design and Sampling Procedures By Tony Babinec Statistics.com.
ADVANCED STATISTICS FOR MEDICAL STUDIES Mwarumba Mwavita, Ph.D. School of Educational Studies Research Evaluation Measurement and Statistics (REMS) Oklahoma.
VALIDITY AND RELIABILITY
Chapter 5 Measurement, Reliability and Validity.
COURSE: JUST 3900 INTRODUCTORY STATISTICS FOR CRIMINAL JUSTICE Instructor: Dr. John J. Kerbs, Associate Professor Joint Ph.D. in Social Work and Sociology.
CmpE 104 SOFTWARE STATISTICAL TOOLS & METHODS MEASURING & ESTIMATING SOFTWARE SIZE AND RESOURCE & SCHEDULE ESTIMATING.
Evaluating Diagnostic Accuracy of Prostate Cancer Using Bayesian Analysis Part of an Undergraduate Research course Chantal D. Larose.
Business Statistics for Managerial Decision
Introduction of Probabilistic Reasoning and Bayesian Networks
Simple Linear Regression
Inferences About Means of Two Independent Samples Chapter 11 Homework: 1, 2, 3, 4, 6, 7.
Clustered or Multilevel Data
Item Response Theory. Shortcomings of Classical True Score Model Sample dependence Limitation to the specific test situation. Dependence on the parallel.
PSY 307 – Statistics for the Behavioral Sciences
OMS 201 Review. Range The range of a data set is the difference between the largest and smallest data values. It is the simplest measure of dispersion.
11 Populations and Samples.
Report on the City Carrier Street Time Study January 14, 2015.
7-1 Copyright ©2011 Pearson Education, Inc. publishing as Prentice Hall Chapter 7 Sampling and Sampling Distributions Statistics for Managers using Microsoft.
The Calibration Process
Chapter 14 Inferential Data Analysis
1 The New York State Education Department New York State’s Student Reporting and Accountability System.
Chapter One of Your Thesis
Structural Equation Modeling Intro to SEM Psy 524 Ainsworth.
Chapter 12 Inferential Statistics Gay, Mills, and Airasian
Chapter 8 Introduction to Hypothesis Testing. Hypothesis Testing Hypothesis testing is a statistical procedure Allows researchers to use sample data to.
1 STATISTICAL HYPOTHESES AND THEIR VERIFICATION Kazimieras Pukėnas.
1 Bayesian methods for parameter estimation and data assimilation with crop models Part 2: Likelihood function and prior distribution David Makowski and.
Introduction Neuropsychological Symptoms Scale The Neuropsychological Symptoms Scale (NSS; Dean, 2010) was designed for use in the clinical interview to.
Review of Chapters 1- 5 We review some important themes from the first 5 chapters 1.Introduction Statistics- Set of methods for collecting/analyzing data.
Slide 1 Estimating Performance Below the National Level Applying Simulation Methods to TIMSS Fourth Annual IES Research Conference Dan Sherman, Ph.D. American.
Bayesian networks Classification, segmentation, time series prediction and more. Website: Twitter:
Copyright ©2011 Pearson Education 7-1 Chapter 7 Sampling and Sampling Distributions Statistics for Managers using Microsoft Excel 6 th Global Edition.
1 Things That May Affect Estimates from the American Community Survey.
Variables, sampling, and sample size. Overview  Variables  Types of variables  Sampling  Types of samples  Why specific sampling methods are used.
Counseling Research: Quantitative, Qualitative, and Mixed Methods, 1e © 2010 Pearson Education, Inc. All rights reserved. Basic Statistical Concepts Sang.
12.1 Heteroskedasticity: Remedies Normality Assumption.
Testing Hypotheses about Differences among Several Means.
Bayesian Learning Chapter Some material adapted from lecture notes by Lise Getoor and Ron Parr.
6. Evaluation of measuring tools: validity Psychometrics. 2012/13. Group A (English)
4 Hypothesis & Testing. CHAPTER OUTLINE 4-1 STATISTICAL INFERENCE 4-2 POINT ESTIMATION 4-3 HYPOTHESIS TESTING Statistical Hypotheses Testing.
Biostatistics Unit 5 – Samples. Sampling distributions Sampling distributions are important in the understanding of statistical inference. Probability.
CHI SQUARE TESTS.
CHAPTER OVERVIEW The Measurement Process Levels of Measurement Reliability and Validity: Why They Are Very, Very Important A Conceptual Definition of Reliability.
Chapter 11 Statistical Techniques. Data Warehouse and Data Mining Chapter 11 2 Chapter Objectives  Understand when linear regression is an appropriate.
MEASUREMENT. MeasurementThe assignment of numbers to observed phenomena according to certain rules. Rules of CorrespondenceDefines measurement in a given.
Validity and Item Analysis Chapter 4. Validity Concerns what the instrument measures and how well it does that task Not something an instrument has or.
Validity and Item Analysis Chapter 4.  Concerns what instrument measures and how well it does so  Not something instrument “has” or “does not have”
Example-1: An insurance company sells a 10,000 TRL 1-year term insurance policy at an annual premium of 290 TRL. Based on many year’s information, the.
NATIONAL CONFERENCE ON STUDENT ASSESSMENT JUNE 22, 2011 ORLANDO, FL.
Reliability performance on language tests is also affected by factors other than communicative language ability. (1) test method facets They are systematic.
Latent regression models. Where does the probability come from? Why isn’t the model deterministic. Each item tests something unique – We are interested.
Introduction To Statistics
9-1 ESTIMATION Session Factors Affecting Confidence Interval Estimates The factors that determine the width of a confidence interval are: 1.The.
Research in Psychology Chapter Two 8-10% of Exam AP Psychology.
REGRESSION MODEL FITTING & IDENTIFICATION OF PROGNOSTIC FACTORS BISMA FAROOQI.
Educational Research Inferential Statistics Chapter th Chapter 12- 8th Gay and Airasian.
NURS 306, Nursing Research Lisa Broughton, MSN, RN, CCRN RESEARCH STATISTICS.
© 2009 Pearson Prentice Hall, Salkind. Chapter 5 Measurement, Reliability and Validity.
The Calibration Process
CONCEPTS OF HYPOTHESIS TESTING
Simple Linear Regression
Inferential Statistics
Chapter 18: The Chi-Square Statistic
Quality Assessment The goal of laboratory analysis is to provide the accurate, reliable and timeliness result Quality assurance The overall program that.
Mathematical Foundations of BME Reza Shadmehr
Presentation transcript:

Introducing Bayesian Networks in Neuropsychological Measures Presented at 2006 APS Annual Conference Toshi Yumoto University of Maryland, Abt Associate Gregory Anderson Xtria, Adler School of Professional Psychology Daisy Wise University of Maryland

Bayesian Networks It is very difficult for practitioners to combine this information objectively Paul Meehl, Clinical versus Statistical Prediction (1954) Bayesian Networks provide an effective way to combine different sources of information such as: Information from distinct domains Demographic (e.g. gender, race/ethnicity) and Clinical Information (e.g. previous diagnosis, different type of tests) It is easy to add new information or modify existing information

Bayesian Network (2) A Bayes Net is suitable for discrete data Continuous data needs to be converted into categorical data Complex models can be divided into several conditionally independent parts Model estimation is easier Straightforward to add conditional independent data Bayesian Network is visual and intuitive Class assignments are expressed as a proportion (e.g. percent) Provides a prediction for all parameters based on limited (or no) information Allows both subjective and objective evaluation of a network Microsoft Belief Networks (MSBNx, Kadie, Hovel, Horvitz, 2001) was used to build a Bayesian Network

Part I Conversion of continuous scores to discrete categories by Finite Mixture Approach Part II Create Bayesian Network based on hypothesized model Estimate conditional probabilities This research used a Latent Class Model Part III Examine and Modify model Steps in Network Development

Measures and Sample The ATLAS is a comprehensive assessment for ADHD containing 7 different sections (Anderson & Post, 2006). One of the sections is a series of neuropsychological measures and observations of performance during testing. This paper examines three of the major traits of the neuropsychological measures for ADHD. Diagnoses of ADHD & LD were gathered from a parent report. The sample is around 220 subjects, 8-18 years of age, from across the nation, gathered in the test field trials.

Creation of Discrete scores The assumption was made that test scores are from more than one distribution A Finite Mixture Model was therefore utilized Cut scores were established using the intersection of the distributions # of mixture distribution = # of cut scores + 1 A discrete score was assigned based on a persons mixture distribution characteristic For more information contact authors.

Finite Mixture Analysis for Trail A Cut Score

Hypothesized Model

Model Specification Three Distinct Domains Visual Trace/Sequence Three Latent Classes Memory Three Latent Classes Impulsive/Error Two Latent Classes Second Order Latent Class Four Latent Classes Diagnosis (LD/ADHD) Four manifest categories Typical, LD, ADHD, and LD/ADHD

Specification of the Bayesian Network For each domain conditional probability of indicator variables are specified given latent class membership (for that domain). These probabilities are first specified based on the assumption that we have no information. These are then updated, given information such as test scores or clinical observations.

Partial Model: Visual Trace Network No information known

Partial Model: Visual Trace Network All item scores known

Probability of LD/ADHD state given Middle Visual Trace level Middle Memory level High Impulsive level SOClass and LD/ADHD states are unobserved Proportions are expected class states

Probability of LD/ADHD state with Six test results Trail A time (middle) and error (middle) Trail B time (middle-low) and error (middle) Word Memory 1 (low) and Word Memory 3 (low) Other nodes have expected category distribution Highest probability indicates most likely category

It is easy to combine additional information such as clinical observations and gender to improve model prediction. Clinical observation is conditionally independent from other nodes given LD/ADHD states (i.e. only affect the probability of LD/ADHD node) Gender has direct effect on LD/ADHD states and Impulsive/Error level, which indirectly affect second order class states. This type of information is harder to add later and should be included from the beginning, if appropriate.

Summary Bayesian Networks provide an effective way to express and examine hypothesized models. The model performance can be compared with precision of prediction (e.g. LD/ADHD diagnoses in this research). Any statistical procedures estimating expected scores (i.e. probability of responses) may be used to build a network. Bayes Net uses discrete data, therefore latent class model and latent trait model (with discrete proficiency levels) nicely fit model development. Combining additional information is straight forward and relatively easy Understanding of conditional independence is the key Bayes Net estimates expected probability from available information Makes best possible diagnosis without complete data

Contacts Toshi Yumoto Gregory Anderson Daisy Wise