Translation and Cross-Cultural Equivalence of Health Measures

Slides:



Advertisements
Similar presentations
Measurement Concepts Operational Definition: is the definition of a variable in terms of the actual procedures used by the researcher to measure and/or.
Advertisements

Cross Cultural Research
Conceptualization and Measurement
VALIDITY AND RELIABILITY
MGT-491 QUANTITATIVE ANALYSIS AND RESEARCH FOR MANAGEMENT
Item Response Theory in Health Measurement
Barbara M. Altman Emmanuelle Cambois Jean-Marie Robine Extended Questions Sets: Purpose, Characteristics and Topic Areas Fifth Washington group meeting.
Validity In our last class, we began to discuss some of the ways in which we can assess the quality of our measurements. We discussed the concept of reliability.
CH. 9 MEASUREMENT: SCALING, RELIABILITY, VALIDITY
Culture and psychological knowledge: A Recap
Overview of field trial analysis procedures National Research Coordinators Meeting Windsor, June 2008.
Chapter 4 Validity.
VALIDITY.
Concept of Measurement
Doing Social Psychology Research
Topic 3: Regression.
Developing a Questionnaire. Goals Discuss asking the right questions in the right way as part of an epidemiologic study. Review the steps for creating.
Scaling and Attitude Measurement in Travel and Hospitality Research Research Methodologies CHAPTER 11.
Chapter 9 Flashcards. measurement method that uses uniform procedures to collect, score, interpret, and report numerical results; usually has norms and.
Sampling Methods.
Validity and Validation: An introduction Note: I have included explanatory notes for each slide. To access these, you will probably have to save the file.
Measuring Social Life Ch. 5, pp
Item Analysis: Classical and Beyond SCROLLA Symposium Measurement Theory and Item Analysis Modified for EPE/EDP 711 by Kelly Bradley on January 8, 2013.
Validity and Reliability
© 2013 Cengage Learning. Outline  Types of Cross-Cultural Research  Method validation studies  Indigenous cultural studies  Cross-cultural comparisons.
Translation and Cross-Cultural Equivalence of Health Measures.
PERSONALITY ASSESSMENT ACROSS CULTURES Imported and Indigenous Instruments.
Understanding Statistics
Cross-Cultural Research Methods. Methodological concerns with Cross-cultural comparisons  Equivalence  Response Bias  Interpreting and Analyzing Data.
Evaluating a Research Report
Copyright © Cengage Learning. All rights reserved. Section 1.3 Introduction to Experimental Design.
ScWk 240 Week 6 Measurement Error Introduction to Survey Development “England and America are two countries divided by a common language.” George Bernard.
Psychology 307: Cultural Psychology Lecture 3
6. Evaluation of measuring tools: validity Psychometrics. 2012/13. Group A (English)
Chapter 4 – Research Methods in Clinical Psych Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Measurement Models: Exploratory and Confirmatory Factor Analysis James G. Anderson, Ph.D. Purdue University.
Chapter 8 Marketing Research and Information System.
Measurement Validity.
VALIDITY AND VALIDATION: AN INTRODUCTION Note: I have included explanatory notes for each slide. To access these, you will probably have to save the file.
PSYC313-04B Cross-Cultural Studies The Emic-Etic Dilemma: Measurement problems in cross- cultural research Michael Hills, PhD.
Basic concepts in measurement Basic concepts in measurement Believe nothing, no matter where you read it, or who said it, unless it agrees with your own.
Research Methodology and Methods of Social Inquiry Nov 8, 2011 Assessing Measurement Reliability & Validity.
Chapter Seven: The Basics of Experimentation II: Final Considerations, Unanticipated Influences, and Cross-Cultural Issues.
Experimental Research Methods in Language Learning Chapter 5 Validity in Experimental Research.
Introduction Studies are important for gathering information. In this lesson, you will learn how to effectively design a study so that it yields reliable.
Objective 4.3 Using one or more examples, explain “emic” and “etic” concepts.
Psychology 307: Cultural Psychology Lecture 3
How To Analyze a Reading Presented By: Dr. Akassi Content From The Norton’s Field Guide To Writing.
©2011 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole or in part.
Chapter 7 Measuring of data Reliability of measuring instruments The reliability* of instrument is the consistency with which it measures the target attribute.
Reliability performance on language tests is also affected by factors other than communicative language ability. (1) test method facets They are systematic.
Item Response Theory in Health Measurement
Chapter 14: Affective Assessment
Sampling Design & Measurement Scaling
CULTURAL CONSIDERATIONS IN DIAGNOSIS ABNORM – NORMS & DIAGNOSIS #3 PART 1.
Writing A Review Sources Preliminary Primary Secondary.
Applied Opinion Research Training Workshop Day 3.
Review: Stages in Research Process Formulate Problem Determine Research Design Determine Data Collection Method Design Data Collection Forms Design Sample.
Educational Research Chapter 8. Tools of Research Scales and instruments – measure complex characteristics such as intelligence and achievement Scales.
Questionnaire-Part 2. Translating a questionnaire Quality of the obtained data increases if the questionnaire is presented in the respondents’ own mother.
Ethical dimension of nursing and health care
Chapter 2 Theoretical statement:
Attitudes.
Evaluation of measuring tools: validity
Reliability & Validity
Marketing Research and Information System
Lecture 6 Structured Interviews and Instrument Design Part II:
Measuring Social Life: How Many? How Much? What Type?
Test construction 1. Testing in a cross-cultural context
Spanish and English Neuropsychological Assessment Scales - Guiding Principles and Evolution Friday Harbor Psychometrics Workshop 2005.
Presentation transcript:

Translation and Cross-Cultural Equivalence of Health Measures

Context: why are we interested? Multinational drug trials: Need to ensure products are tested in standard way in different countries. Cross-cultural research within countries International health studies (WHOQoL, etc.) Evidence-based medicine: how confident can I be that results of a clinical trial overseas would apply here?

Translation Simply translate an instrument and administer it Differences in response interpreted as differences in prevalence: assumes equivalence of the measurement scale in the 2 countries Almost certainly inadequate Translation + back translation

Issues to consider in translating an instrument Do you wish to adapt the measure for a new country, or make comparisons across countries? Should it be a strict translation or an adaptation? Back-translation gives linguistic identity rather than equivalence Example of long-term memory item in a dementia screen “In what year did the first world war begin?” In most countries the ‘official’ language differs from the vernacular. Which do we use? We often ignore linguistic variations within countries

Translation or cultural domination? Beware hidden biases in whole idea of translation. Consider a statement by Alexander Leighton (circa 1955) : “…with refinements and changes introduced here and there in order to convey the meaning of the English questions as accurately as possible…”

Issues to consider - continued Why was this instrument chosen? Is the content truly relevant in another culture? At least some of the content of most scales is culture-specific (e.g., items in NHP seen as blasphemous in Arabic countries) Was the scale developed on a particular cultural group? NHP = Nottingham Health Profile

Words & cultural concepts An etic approach to language (phonetic) describes the physical properties of the word, without referring to its functional meaning: language The emic approach takes account of the context, meaning and purpose of a word: concepts

Translation example: Friends “Does poor health prevent you from seeing your friends?” Be careful: emic meaning of “friend” differs in UK, US, and Australian forms of English Even more differences between Ami(e), Amigo and Freund

Relevance of Culture Culture shapes the way we think about health and illness: it influences the attention we pay to symptoms, our reactions to pain, etc. Expectations & definitions of feeling good, etc. It influences customary behaviours, relationships with others, including people with clip boards & questionnaires: the ‘questionnaire sophistication’ of the group. It affects the way we interpret the language used in our questionnaires.

Level of abstraction Concepts can be: Abstract but general E.g., Happiness, Ability These terms probably apply in different cultures, but are imprecise and subjective: their meaning may differ. However, being subjective may be sufficient in itself: perhaps a person’s subjective answer is inherently valid. (Discussion point: does it matter if happiness means slightly different things in different cultures?) Concrete and specific Number of hospital beds per capita You can compare these across cultures, but They are very context-dependent so less cross-culturally comparable.

Establishing Cross-Cultural Equivalence Are you using the same general measurement procedures? Or, at least culturally equivalent approaches? (This could mean using different words) Item equivalence: items should mean the same thing to people in one culture as in another And be similarly difficult. E.g. on FAS test, items with identical meaning in French are not FAS, but T, N and P. Response scale equivalence (e.g., is the distance between “moderately severe” and “severe” the same in both cultures? Will respondents feel equally comfortable with responses like “Disagree strongly”?) FAS refers to a cognition test in which respondents are asked to mention as many words as they can in a set time, beginning with the letters F, A, and S. The point here is simply that you cannot use these same letters in other languages because the frequency of words beginning with those letters differs. And there are more words (total) in English. This test would probably not work at all in Chinese!

Conceptual or Functional Equivalence Is the theme being measured really a universal experience? Does this construct mean the same thing in both cultures? (How do we know this?) Does it matter that a theme such as quality of life has a different range in 2 cultures? Should it be measured relative to local expectations, or in an absolute way? Do the same cause-effect relations exist in each culture? Does a similar situation lead to similar behaviours across cultures? (E.g., sick enough to go to a doctor)

Developing cross-cultural measures Sequential approach Translate an instrument into another language Simultaneous approach Conceptualize & develop measure in each culture Choose a set of equivalent items that reflect the same construct in different cultures Core instrument plus culture-specific additional components

Common strategies for ensuring cross-cultural equivalence Direct translation and comparison Better translation techniques Multi-trait, multimethod matrix Item response theory methods Differential item functioning

Strategies, continued Response pattern method Factor analysis Multidimensional scaling Combined etic-emic approach Multi-strategy approach

Factor analysis Empirical analysis of how items relate to one another Shows how many concepts scale measures and which items measure that scale Confirmatory: must have theory about how items go together Simultaneous factor analysis in different populations Factor structure should be the same Test whether data are similar to be called equal Same factor pattern-loadings Same goodness of fit

Differential Item Functioning (DIF) Related to IRT theory DIF = a difference in an item score between two groups who are equal in ability (e.g. as indicated by equal overall scores) Needed because tests can have matching factor structures and still be biased.

DIF analyses Involves comparison of 2 or more groups (e.g. different languages) Step1: match people on ability (total score) 2nd step: for each score group, compare performance of reference and focal group on each item. (Reference is usually the original language)

Two types of DIF Uniform Non-uniform Difference in item difficulty between reference and focal group Item may be more difficult for one group (perhaps translation problem?) Non-uniform Difference in item discrimination parameter between reference and focal group

Translation & cultural equivalence suggestions Plan cross-cultural applications from the outset Consider relevance of quality of life carefully: omit? Avoid questionnaires! Use ‘DIF’ analyses Run within-country analyses Develop measures within each country Search for a core set of universal items (e.g. WHOQoL) Make sure the values are explicit