Research Techniques Made Simple: Validation of Outcome Measures in Dermatology Kate V. Viola, MD, MHS 1 Tamar Nijsten, MD, PhD 2 Karthik Krishnamurthy,

Slides:



Advertisements
Similar presentations
Measurement Concepts Operational Definition: is the definition of a variable in terms of the actual procedures used by the researcher to measure and/or.
Advertisements

1 COMM 301: Empirical Research in Communication Kwan M Lee Lect4_1.
Part II Sigma Freud & Descriptive Statistics
Reliability and Validity of Research Instruments
Concept of Reliability and Validity. Learning Objectives  Discuss the fundamentals of measurement  Understand the relationship between Reliability and.
Selection, part 1 OS352 HRM Fisher Feb 21, Agenda Finish material on recruiting Impact of legal environment on selection process Basic characteristics.
Selection, part 1 OS352 HRM Fisher Oct. 7, Agenda SAP Case Study Impact of legal environment on selection process How do strategy and culture.
In the name of Allah. Development and psychometric Testing of a new Instrument to Measure Affecting Factors on Women’s Behaviors to Breast Cancer Prevention:
Sampling and Data Collection
Ilana F. Gareen, Ph.D. Brown University Center for Statistical Sciences
The PHQ9 Screening Tool for Depression. The PHQ9 Nine item depression module derived from the full Patient Health Questionnaire (PHQ) Depression screening.
Guidelines for the reporting of evidence identification in decision models: observations and suggested way forward Louise Longworth National Institute.
…patient reported outcome (PRO) measure for your clinical study Dr Keith Meadows, DHP Research & Consultancy Ltd.
Acute Ischemic Stroke Management: 2004 Emergency Medicine Perspectives.
Technical Issues Two concerns Validity Reliability
Measurement and Data Quality
Critical Appraisal of Clinical Practice Guidelines
MEASUREMENT CHARACTERISTICS Error & Confidence Reliability, Validity, & Usability.
Copyright © 2012 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 14 Measurement and Data Quality.
Unanswered Questions in Typical Literature Review 1. Thoroughness – How thorough was the literature search? – Did it include a computer search and a hand.
FDA Approach to Review of Outcome Measures for Drug Approval and Labeling: Content Validity Initiative on Methods, Measurement, and Pain Assessment in.
Gerald G Krueger MD Professor, Benning Presidential Endowed Chair
Self-reported cognitive and emotional effects and lifestyle changes shortly after preventive cardiovascular consultations in general practice Dea Kehler.
Introduction Patients with tumors affecting the spine have significant impairments in Quality of Life domains that include physical function, neural function,
Research Techniques Made Simple: Evaluating the Strength of Clinical Recommendations in the Medical Literature: GRADE, SORT, and AGREE Mayra Buainain de.
Assessing clinical judgment using the script concordance test: The importance of using specialty-specific experts to develop the scoring key Petrucci AM.
Lecture 6: Reliability and validity of scales (cont) 1. In relation to scales, define the following terms: - Content validity - Criterion validity (concurrent.
1 Chapter 24 Scale Development and Statistical Analysis Methods for Scale Data.
Validity and Reliability THESIS. Validity u Construct Validity u Content Validity u Criterion-related Validity u Face Validity.
Composite Scores of Asthma Control Michael Schatz, MD Michelle M. Cloutier, MD Co-Chairs.
BMH CLINICAL GUIDELINES IN EUROPE. OUTLINE Background to the project Objectives The AGREE Instrument: validation process and results Outcomes.
Chapter 8 Validity and Reliability. Validity How well can you defend the measure? –Face V –Content V –Criterion-related V –Construct V.
Designs and Reliability Assessing Student Learning Section 4.2.
Copyright © 2008 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 17 Assessing Measurement Quality in Quantitative Studies.
Measurement Issues General steps –Determine concept –Decide best way to measure –What indicators are available –Select intermediate, alternate or indirect.
Impact of Scribes Upon Emergency Physician Self Assessed Authenticity Lisa M.Brown 1 Matthew J. Benage 1 Andrew V. Tran 1 Dane M. Chapman, MD, PhD 2 1.
PFF Teal = MAIN COLORS PFF Green = Light Green = Red = HIGHLIGHT COLORS Light Grey = Dark Grey =
Research Design Evidence Based Medicine Concepts and Glossary.
Report on the NCSEAM Part C Family Survey Batya Elbaum, Ph.D. National Center for Special Education Accountability Monitoring February 2005.
Classroom Assessment Chapters 4 and 5 ELED 4050 Summer 2007.
Applied Quantitative Analysis and Practices LECTURE#17 By Dr. Osman Sadiq Paracha.
GRAPPA Committee Reports and Outcome measures Dafna D. Gladman, MD, FRCPC Professor of Medicine, University of Toronto Director, PsA Program, University.
Psychosocial difficulties in head and neck cancer; the development of an evidence based measurement instrument Lucy Ziegler Rob Newell.
Copyright © 2014 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 11 Measurement and Data Quality.
CoRPS London 26 & 27 October 2010 Center of Research on Psychology in Somatic diseases Understanding PRO in hematological disorders: Do we have a consensus?
Measurement and Scaling Concepts
Quantification of dyspnea using descriptors: Development and initial testing of the Dyspnea-12 J Yorke, S H Moosavi, C Shuldham, P W Jones (Thorax
Test-Retest Reliability of the Work Disability Functional Assessment Battery (WD-FAB) Dr. Leighton Chan, MD, MPH Chief, Rehabilitation Medicine Department.
ESTABLISHING RELIABILITY AND VALIDITY OF RESEARCH TOOLS Prof. HCL Rawat Principal UCON,BFUHS Faridkot.
Copyright © 2014 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 25 Critiquing Assessments Sherrilene Classen, Craig A. Velozo.
MGMT 588 Research Methods for Business Studies
Lecture 5 Validity and Reliability
Questions What are the sources of error in measurement?
Assessment Theory and Models Part II
Test Validity.
Tests and Measurements: Reliability
assessing scale reliability
Sun Jae Moon, Yeon Pyo Hong and Weon Young Lee
مركز مطالعات و توسعه آموزش دانشگاه علوم پزشكي كرمان
ابزار گرد آوری داده ها 1- پرسشنامه 2- مشاهده 3- مصاحبه
The first test of validity
“Validation” of Outcome Measures in Dermatology
Res.Asst. Nurten TERKES, Prof. Hicran BEKTAS
Validation and Reliability of a Disease-Specific Quality of Life Measure in Patients with Cutaneous Lupus Erythematosus: CLEQoL M.E. Ogunsanya,1 S.K. Cho,2.
Introduction to Psychometric Analysis of Survey Data
Patient reported outcome measures for facial skin cancer: a systematic review and evaluation of the quality of their measurement properties Tom Dobbs,
UCLA Department of Medicine
Qualities of a good data gathering procedures
Presentation transcript:

Research Techniques Made Simple: Validation of Outcome Measures in Dermatology Kate V. Viola, MD, MHS 1 Tamar Nijsten, MD, PhD 2 Karthik Krishnamurthy, DO 1 1.Albert Einstein College of Medicine, New York, USA 2. Erasmus Medical Center, Rotterdam, The Netherlands.

Outcome Measures Quantify: Clinical disease severity: -Generalized health: BSA, PGA -Disease specific: PASI, SCORAD Patient-reported outcomes: -Generic: SF36 -Dermatology: DLQI, Skindex

Development of Outcome Measures Item Generation – Exploratory interviews – Systematic literature reviews – Consultation with disease experts Item Reduction – Target audience administration – Impact factor for question inclusion and exclusion

Property Testing: Validity Content validity - instrument adequacy in addressing all relevant items Convergent validity - studied tools correlate with tools measuring same underlying construct Construct validity - different groups of patients show score difference

Item Structure for Skin Disease Outcome Measure

Property Testing: Reliability Test – retest reliability- score consistency when administered at different times (interclass correlation coefficients) Internal consistency- degree to which set of items measures the same construct (Cronbach’s alpha test)

Property Testing : Responsiveness and Response Distribution Responsiveness- instrument’s ability to change when patient experiences change in disease state (minimal clinical important difference) Response distribution- assesses whether entire range of item scores is utilized (measurement indicators)

Outcome Measures: Role in Dermatology Supplements clinical judgment to optimize management approach and treatment Provides insight into educational gaps and psychosocial issues Influences clinical guideline recommendations Plays a role in future cost-effective treatment strategies