תוקף ומהימנות של ה- Dementia Quality of Life בארה"בMeasure

Slides:



Advertisements
Similar presentations
1 Regression as Moment Structure. 2 Regression Equation Y =  X + v Observable Variables Y z = X Moment matrix  YY  YX  =  YX  XX Moment structure.
Advertisements

Structural Equation Modeling. What is SEM Swiss Army Knife of Statistics Can replicate virtually any model from “canned” stats packages (some limitations.
Abstract Two studies examined the internal and external validity of three school climate scales on the School Climate Bullying Survey (SCBS), a self–report.
Reliability & Validity.  Limits all inferences that can be drawn from later tests  If reliable and valid scale, can have confidence in findings  If.
Part II Sigma Freud & Descriptive Statistics
The Technology-Rich Outcomes-Focused Learning Environment Inventory (TROFLEI): A Cross-Cultural Validation Anita Welch, Claudette Peterson, Chris Ray,
Chapter 17 Making Sense of Advanced Statistical Procedures in Research Articles.
Part II Knowing How to Assess Chapter 5 Minimizing Error p115 Review of Appl 644 – Measurement Theory – Reliability – Validity Assessment is broader term.
Developing the Research Question
Overview of field trial analysis procedures National Research Coordinators Meeting Windsor, June 2008.
Chapter 4 Validity.
Developing and validating a stress appraisal measure for minority adolescents Journal of Adolescence 28 (2005) 547–557 Impact Factor: A.A. Rowley.
Reliability Analysis. Overview of Reliability What is Reliability? Ways to Measure Reliability Interpreting Test-Retest and Parallel Forms Measuring and.
Statistical presentation in international scientific publications 6. Reporting more complicated findings Malcolm Campbell Lecturer in Statistics, School.
When Measurement Models and Factor Models Conflict: Maximizing Internal Consistency James M. Graham, Ph.D. Western Washington University ABSTRACT: The.
Correlation 1. Correlation - degree to which variables are associated or covary. (Changes in the value of one tends to be associated with changes in the.
Social Science Research Design and Statistics, 2/e Alfred P. Rovai, Jason D. Baker, and Michael K. Ponton Internal Consistency Reliability Analysis PowerPoint.
Instructor: Prof. Dr. SALIH KATIRCIOGLU Submitted by: Esmaeil Khaksar Shahmirzadi.
Chapter 12 Inferential Statistics Gay, Mills, and Airasian
PAIN MANAGEMENT AND THE IMPACT OF PAIN ON QUALITY OF LIFE IN NURSING HOME RESIDENTS Efrat Adler, RN, MS, FNP, Doctoral Student 1,2 Ann L. Gruber-Baldini,
Rivka Herman 1 *,RN. M.Sc Michal Libergal 1 *, PhD; David Rott 2, MD Michal Libergal 1 *, PhD; David Rott 2, MD 1 Henrietta Szold Hadassah-Hebrew University.
Unanswered Questions in Typical Literature Review 1. Thoroughness – How thorough was the literature search? – Did it include a computer search and a hand.
Chapter 18 Some Other (Important) Statistical Procedures You Should Know About Part IV Significantly Different: Using Inferential Statistics.
Purpose The present study examined the psychometric properties of the SCARED in order to begin establishing an evidence base for using the SCARED in pediatric.
Lecture 6: Reliability and validity of scales (cont) 1. In relation to scales, define the following terms: - Content validity - Criterion validity (concurrent.
 3 instruments that together assess medical and psychiatric comorbidities within a geriatric population living in a Long-Term Care (LTC) facility  Geriatric.
1 Chapter 24 Scale Development and Statistical Analysis Methods for Scale Data.
Validity. Face Validity  The extent to which items on a test appear to be meaningful and relevant to the construct being measured.
Tests and Measurements Intersession 2006.
Measurement Models: Exploratory and Confirmatory Factor Analysis James G. Anderson, Ph.D. Purdue University.
Reliability Analysis Based on the results of the PAF, a reliability analysis was run on the 16 items retained in the Task Value subscale. The Cronbach’s.
Chapter 8 Validity and Reliability. Validity How well can you defend the measure? –Face V –Content V –Criterion-related V –Construct V.
Aron, Aron, & Coups, Statistics for the Behavioral and Social Sciences: A Brief Course (3e), © 2005 Prentice Hall Chapter 12 Making Sense of Advanced Statistical.
Measurement Models: Identification and Estimation James G. Anderson, Ph.D. Purdue University.
INDE 6335 ENGINEERING ADMINISTRATION SURVEY DESIGN Dr. Christopher A. Chung Dept. of Industrial Engineering.
Validity and Item Analysis Chapter 4.  Concerns what instrument measures and how well it does so  Not something instrument “has” or “does not have”
The Self-Compassion Scale (SCS) is the primary measure of self- compassion in both social/personality psychology and clinical research (Neff, 2003). It.
CJT 765: Structural Equation Modeling Class 8: Confirmatory Factory Analysis.
ALISON BOWLING CONFIRMATORY FACTOR ANALYSIS. REVIEW OF EFA Exploratory Factor Analysis (EFA) Explores the data All measured variables are related to every.
School of Nursing Health Literacy Among Informal Caregivers of Persons With Memory Loss Judith A. Erlen, PhD, RN, FAAN; Jennifer H. Lingler, PhD, RN; Lisa.
Chapter 17 STRUCTURAL EQUATION MODELING. Structural Equation Modeling (SEM)  Relatively new statistical technique used to test theoretical or causal.
® The Use of Confirmatory Factor Analysis to Support the Use of Subscores for a Large-Scale Student Outcomes Assessment Rochelle S. Michel, Ph.D. Evaluation.
Research in Social Work Practice Salem State University
1University of Oklahoma 2Shaker Consulting
Lecture 5 Validity and Reliability
Structural Equation Modeling using MPlus
REGRESSION (R2).
Chapter 15 Confirmatory Factor Analysis
Basic Estimation Techniques
Understanding Results
Designing and evaluating a health belief model (HBM) based intervention to increase intent of human papilloma virus (HPV) vaccination among male youth.
Study Limitations and Future Directions See Handout for References
Planful coping and depression: a cross cultural latent structural analysis Poster presentation at the American Psychological Association (APA) annual meeting.
CJT 765: Structural Equation Modeling
Cohen, J.(1988).Statistical Power Analysis for the Behavioral Sciences, 2nd edition. Lawrence ErlbaumAssociates. Cohen, J.(1988).Statistical Power Analysis.
Making Sense of Advanced Statistical Procedures in Research Articles
BPK 304W Correlation.
Shared Vulnerabilities for Social Anxiety, Binge Eating, and Obesity
Basic Estimation Techniques
Dr. Chin and Dr. Nettelhorst Winter 2018
Validation of the Portuguese DSM-IV-MR-J
Evaluation of measuring tools: reliability
Confirmatory Factor Analysis
Understanding Statistical Inferences
SOC 681 – Causal Models with Directly Observed Variables
Evaluating Multi-item Scales
Factor Analysis.
Evaluating Multi-item Scales
UCLA Department of Medicine
Project Description & Design Problem Statement & Significance
Presentation transcript:

תוקף ומהימנות של ה- Dementia Quality of Life בארה"בMeasure Henrietta Szold Hadassah Hebrew University School of Nursing, Jerusalem תוקף ומהימנות של ה- Dementia Quality of Life בארה"בMeasure אפרת אדלר PhD, RN, FNP Barbara Resnick, PhD, CRNP, FAAN

איכות חיים של דיירי בתי אבות- הגדרה מושג רב מימדי המתאר את רווחת הפרט ומורכב מ: תפיסה סוביקטיבית משתנים פיזיים בריאות נפשית תפקוד חברתי משתנים סביבתיים, תרבותיים ורוחניים (Birren, et al., 1991; ferrans, 1997; Kane, 2003)

איכות חיים- המשך איכות חיים הוא משתנה תוצאה אוניברסלי רצוי ונחשב למטרה מספר אחת של Healthy People 2010 Advancing Excellence in America’s Nursing Homes Campaign הערכה של איכות חיים לדיירי בתי אבות הסובלים מדמנציה הופכת לאחת הדרכים החשובות להערכת תוכניות התערבות ואיכות הטיפול בבתי אבות תוכנית לאומית שמטרתה לשפר את התוצאים הטיפוליים בבתי אבות בארהב (“Advancing Excellence”, 2006; Edelman, et al., 2005: Sacher, 2001; Zimmerman et al., 2005).

The Dementia Quality of Life שאלון למילוי עצמי (או ראיון) שפותח לקשישים החיים בקהילה ואשר אובחנו כסובלים מדמנציה קלה עד בינונית (MMSE ≥ 12) מורכב מ-29 פריטים הנחלקים לחמישה תחומים: הערכה עצמית אפקט חיובי אפקט שלילי תחושת בדידות חוש אסתטי סולם ליקרט, 1=אף פעם, 5= לעיתים קרובות (Brod et al., 1999)

בנוסף שאלה שאינה נכללת בציון הסופי אשר שואלת את הפרט כיצד הוא מגדיר את איכות חייו: מצוין, טוב מאוד, בסדר, גרוע בפיתוח הכלי נמצאו עדויות מספקות לעקביות פנימית של כל תת סולם ( α= 0.67-0.89) ו- test-retest reliability (range: 0.64 - 0.90) תוקף התבסס על קורולציה מובהקת בין הכלי לבין מדדים של רווחה ודכאון

מטרת המחקר בדיקת תוקף ומהימנות של ה - Dementia Quality of Life (DQOL) instrument במדגם שכלל 12 בתי אבות במחוז בולטימור, מרילנד

השיטה מחקר זה השתמש בניתוח נתוני הבסיס של מחקר התערבותי גדול - Res-Care Intervention Study מדגם: 486 דיירים מ - 12 בתי אבות גדולים (>100 מיטות) באזור בולטימור שני בתי אבות היו פרטיים, השאר השתייכו לגופים שונים 8 היו למטרות רווח בתי האבות זווגו על פי הבעלות Resnick et al., 2009

קריטריוני הכללה דייר אשר מתגורר באחד משניים עשר בתי האבות הנ"ל בני 65 שנה או יותר MMSE 12 ומעלה תוחלת חיים צפויה מעל שישה חודשים המשתתפים לא נמצאו בבית האבות לצורך שיקום מסוגלים לחתום על הסכמה מדעת

Restorative Care (ResCare) Study 2,058 screened 893 eligible (43.4%) 594 consented (67%) Of consented, 492 eligible per MMSE (83%) Of consented, 486 eligible per MMSE≥ 12 and no missing data on the outcome variables (80%)

השערות המחקר הכלי יהיה בעל עקביות פנימית, , test- retest reliability ותוקף מבנה מקובלים כל אחד מתת סולמות הכלי יסביר כמות משמעותית של השונות באיכות חיים בדיירי בתי אבות

Descriptive statistics of the DQOL

ניתוח הנתונים Construct validity: confirmatory factor analysis (CFA) and Rasch Analysis Criterion-related validity: multiple regression and testing the relationship between the subscales of the DQOL and each item and overall QOL of each subscale within the DQOL measure For CFA model testing was done using the AMOS statistical program and the sample covariance matrix served as input and a maximum likelihood solution sought. The Chi-square statis­tic, the normed fit index (NFI), and Steigers Root Mean Square Error of Approximation (RMSEA) were used to estimate model fit (Arbuckle, 1997). Path significance for each of the paths in the model was based on the Critical Ratio (CR) (Arbuckle). For the Rasch analysis, two values were used to determine the fit of the items to the model: logit measures and fit statistics. To establish the fit of each of the items the INFIT and OUTFIT statistics, reported as mean square (MnSq) fit statistics, were considered (acceptable range is from 0.6 to 1.4) (Smith & Smith, 2004). A stepwise progression with all five subscales regressed on overall QOL was done. A p<.05 level of significant was used in all analyses. In addition, all items were regressed independently onto overall QOL to determine which of the items within the subscales were significantly associated with overall QOL. (Arbuckle, 1997; Bollen, 1989; Brod et al., 1999; Smith & Smith, 2004; Waltz, Strickland, & Lenz, 2005)

המשך)) ניתוח הנתונים Estimates of internal consistency: Cronbach’s alpha with an alpha coefficient of ≥ 0.70 considered as evidence of internal consistency; A squared multiple correlation coefficient, R²0< .50 Lastly, test-retest reliability of the DQOL was evaluated by repeating the measure at four and 12 months post baseline testing in residents living in control sites of each subscale within the DQOL measure For CFA model testing was done using the AMOS statistical program and the sample covariance matrix served as input and a maximum likelihood solution sought. The Chi-square statis­tic, the normed fit index (NFI), and Steigers Root Mean Square Error of Approximation (RMSEA) were used to estimate model fit (Arbuckle, 1997). Path significance for each of the paths in the model was based on the Critical Ratio (CR) (Arbuckle). For the Rasch analysis, two values were used to determine the fit of the items to the model: logit measures and fit statistics. To establish the fit of each of the items the INFIT and OUTFIT statistics, reported as mean square (MnSq) fit statistics, were considered (acceptable range is from 0.6 to 1.4) (Smith & Smith, 2004). A stepwise progression with all five subscales regressed on overall QOL was done. A p<.05 level of significant was used in all analyses. In addition, all items were regressed independently onto overall QOL to determine which of the items within the subscales were significantly associated with overall QOL.

תוקף - תוצאות עיקריות תוקף הכלי הוכח על פי CFA ו- RASCH ANALYSIS בהתייחס לתוקף קריטריון, שלושה תת סולמות: הערכה עצמית, אפקט חיובי ואפקט שלילי הסבירו 30% מהשונות באיכות חיים .סך כל הפריטים הסבירו 33% מהשונות באיכות חיים. הרגשת בדידות ואסתטיקה לא הוסיפו לשונות Based on Rasch model testing, all the items fit the model for which they were intended (i.e. the subscale) with INFIT and OUTFIT statistics all within the 0.6 to 1.4 range. In addition, the item mapping for each of the measures showed a good spread of the items and there were few individuals scoring extremely high on the trait or extremely low. The subscales, therefore, seemed to appropriately measure the trait of interest.

מהימנות עקביות פנימית נעה בין α= 0.52-0.84, מהימנות בינונית test-retest לאחר ארבעה חודשים r= 0.60, p< 0.001 ולאחר 12 חודש r= 0.635, p< 0.001 , מהימנות גבוהה יציבות נבדקה בקבוצת הביקורת בלבד והראתה יציבות גבוהה (הסקור של כל תת סולם נשאר זהה) There was some evidence for the internal consistency of the subscales of the DQOL. The alpha coefficients were 0.65 for Sense of Aesthetics, 0.53 for Feelings of Belonging, 0.84 for Negative Affect, 0.62 for Self-esteem, and 0.72 for Positive Affect (“Standards for education and psychological testing”, 2004)

מסקנות סה"כ הכלי הוכח כתקף על סמך CFA ו- RASCH עקביות פנימית בינונית אך test-retest גבוה וכן בעל יציבות פנימית גבוהה מומלץ לבצע ריויזיה של הכלי ע"י הוצאת הפריטים ושני תתי הסולמות (אסתטיקה ובדידות) שלא נמצאו בקורולציה עם איכות חיים בדיירי בתי אבות (Adler & Resnick, 2010)

מגבלות יתכן כי משתנים אשר מסבירים איכות חיים בקהילה אינם אותם משתנים אשר מסבירים איכות חיים בבתי אבות כגון כאב, חוללות עצמית, תוצאים מצופים, יחסי צוות- דייר, סביבה ועוד ה- MMSE במדגם היה יחסית גבוה (21) לדיירי בתי אבות Degenholtz et al.,2008; Kane et al., 2004; Resnick et al., 2003; Zanocchi et al., 2007