Cross-Cultural Survey Research. Survey Research Laboratory 2 of 15 Cognitive Survey Response Model Question interpretation Memory retrieval Judgment formation.

Slides:



Advertisements
Similar presentations
Studying at postgraduate level Student Services Get Ahead 2012 Angela Dierks.
Advertisements

Cross Cultural Research
Culture and psychological knowledge: A Recap
Moving from Notions to Numbers: Psychological Measurement Chapter 4 James A. Van Slyke.
Organizational Design, Diagnosis, and Development Session 12 Organizational Diagnosis, II Techniques of Data Collection.
Culture and Personality What is cultural psychology? Why should we study it? Different research approaches Structural framework Self-Ways (Markus)
Chapter 4 Validity.
UNOBTRUSIVE RESEARCH Research Methods University of Massachusetts at Boston ©2011 William Holmes.
Collecting Quantitative Data
Copyright  2000, Richard B. Warnecke QUALITATIVE APPROACHES TO QUESTIONNAIRE DESIGN: METHODS AND APPLICATIONS RICHARD B. WARNECKE, Ph.D. UNIVERSITY OF.
© 2004 The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin.
Chapter 41 Training for Organizations Research Skills.
Advantages and Disadvantages of Telephone Interviews.
BASIC TERMINOLOGY n Test n Measurement n Evaluation.
SOWK 6003 Social Work Research Week 4 Research process, variables, hypothesis, and research designs By Dr. Paul Wong.
Methodology A preview. What is Methodology  Choosing a method of data collection  Structure of the research  Builds on and draws from problem statement.
Chapter 10 Collecting Quantitative Data. SURVEY QUESTIONNAIRES Establishing Procedures to Collect Survey Data Recording Survey Data Establishing the Reliability.
Introduction to Qualitative Research
SOWK 6003 Social Work Research Week 5 Measurement By Dr. Paul Wong.
Southampton Education School Southampton Education School Dissertation Studies Rigour, Ethics, & Risk.
Survey Research. Structured interview of: Structured interview of: Sample of individuals in order to generalize to a larger population Sample of individuals.
Copyright c 2001 The McGraw-Hill Companies, Inc.1 Chapter 9 Surveys, Questionnaires, and Polls Most commonly used quantitative method Used for obtaining.
© 2001 Dr. Laura Snodgrass, Ph.D.1 Non-experimental Methods Observation and Survey Research.
CHAPTER FIVE (Part II) Sampling and Survey Research.
© 2013 Cengage Learning. Outline  Types of Cross-Cultural Research  Method validation studies  Indigenous cultural studies  Cross-cultural comparisons.
Questionnaires and Interviews
CENTER FOR NONPROFIT EXCELLENCE EVALUATION WORKSHOP SERIES Session IV: Analyzing and Reporting Your Data Presenters: Patty Emord.
Cognitive Interviewing for Question Evaluation Kristen Miller, Ph.D. National Center for Health Statistics
PERSONALITY ASSESSMENT ACROSS CULTURES Imported and Indigenous Instruments.
Research Methods in Psychology (Pp 1-31). Research Studies Pay particular attention to research studies cited throughout your textbook(s) as you prepare.
SPECA Regional Wrokshop on Disability Statistics, Dec 13-15, 2006 Issues Related to Disability Measurement: Cognitive testing and mode Jennifer Madans.
Measurement Neuman and Robson Ch. 6. What is it? The process of creating measurable concrete variables from abstract concepts Extends the senses (empirical)
Cross-Cultural Research Methods. Methodological concerns with Cross-cultural comparisons  Equivalence  Response Bias  Interpreting and Analyzing Data.
Evaluating a Research Report
Human Learning Asma Marghalani.
Phase 2 Project Logistics: Overview 1. Project Start-up Activities 2. Training 3. Focus Groups and In-depth Interviews 4. Household Survey a.Sample selection.
Context Effects: Interpreting the Question Should we ask specific questions before general ones? (e.g., rate course, then curriculum) What about with attitude.
 Descriptive Methods ◦ Observation ◦ Survey Research  Experimental Methods ◦ Independent Groups Designs ◦ Repeated Measures Designs ◦ Complex Designs.
555 Review. Chapter 2: Introduction The sequence of 8 types of research Differences between qualitative and quantitative research – Components of qualitative.
SURVEY RESEARCH.  Purposes and general principles Survey research as a general approach for collecting descriptive data Surveys as data collection methods.
Chapter 8 Marketing Research and Information System.
Journalism 614: Concept Explication. Research Concepts  What do we mean when we want to study… –Prejudice?, Participation?, or Patriotism?  Research.
Academic Research Academic Research Dr Kishor Bhanushali M
Educational Research CECS 5610 Dr. Gerald Knezek University of North Texas Clicking on the Speaker or Quicktime icon will play the audio associated with.
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
Introduction to Scientific Research. Science Vs. Belief Belief is knowing something without needing evidence. Eg. The Jewish, Islamic and Christian belief.
Research Design and Instrument Development
© 2006 by The McGraw-Hill Companies, Inc. All rights reserved. 1 Chapter 9 Surveys, Questionnaires, and Polls Most commonly used quantitative method –Used.
Data Analysis. What it is Knowing the data Organizing & Chunking Interpreting themes Making meaning.
The effects of Peer Pressure, Living Standards and Gender on Underage Drinking Psychologist- Kanari zukoshi.
Cultural Anthropology. Cultural Anthropology -- an academic discipline.
Translation and Cross-Cultural Equivalence of Health Measures
Methods of Data Collection Survey Methods Self-Administered Questionnaires Interviews Methods of Observation Non-Participant Observation Participant Observation.
Chapter Nine: Qualitative Procedures
CULTURAL CONSIDERATIONS IN DIAGNOSIS ABNORM – NORMS & DIAGNOSIS #3 PART 1.
SOCIOLOGICAL RESEARCH Importance of social research Help solve social problems by understanding how they come about, and why they persist. Makes clear.
Journalism 614: Survey Research. Survey Research  Structured interview of: –Sample of individuals in order to generalize to a larger population  Survey.
Margaret Blake RESEARCH METHODS FESTIVAL: Evaluating questionnaires with cognitive testing.
PERSONALITY ASSESSMENT ACROSS CULTURES Imported and Indigenous Instruments.
Consumer Research Ch 2. Types Qualitative Research Glean insight Quantitative Research Draw conclusions.
1. 2 Issues in the Design and Testing of Business Survey Questionnaires: Diane K. Willimack U.S. Census Bureau Economic Census The International.
Research Methods & Design Outline
Instrument Development and Psychometric Evaluation: Scientific Standards May 2012 Dynamic Tools to Measure Health Outcomes from the Patient Perspective.
Survey Research.
Marketing Research and Information System
مناهج وطرق جمع المعلومات
The cognitive model in answering questions Marco Ballin
Introduction to Qualitative Research
Quantitative vs Qualitative Research
MEASUREMENT AND QUESTIONNAIRE CONSTRUCTION:
Presentation transcript:

Cross-Cultural Survey Research

Survey Research Laboratory 2 of 15 Cognitive Survey Response Model Question interpretation Memory retrieval Judgment formation Response editing

Survey Research Laboratory 3 of 15 Question Interpretation Emic (culture specific) Etic (pancultural)

Survey Research Laboratory 4 of 15 Category Fallacy Assuming a question or concept is universally understood when in fact understanding is culturally conditioned

Survey Research Laboratory 5 of 15 Memory Retrieval Episodic vs. semantic recall Search strategies Memory cues

Survey Research Laboratory 6 of 15 Accessibility Anchoring Response formatting Response styles Judgment Formation

Survey Research Laboratory 7 of 15 Self presentation/social desirability Acquiescence Interviewer effects Response Editing

Survey Research Laboratory 8 of 15 1.Reliability 2.Validity 3.Equivalence Elements of Social Measurement in Cross-Cultural Research

Survey Research Laboratory 9 of 15 Types of Equivalence Referenced in Research Literature 1.Calibration17.Factorial34.Operational50.Theoretical 2.Complete18.Formal35.Pseudo51.Translation 3.Conceptual19.Functional36.Psychological52.Verbal 4.Construct20.Grammatical-Syntactical53.Vocabulary 5.Construct 21.Indicator37.Psychometric operationalization22.Idiomatic38.Relational 6.Content23.Instrument39.Relative 7. Contextual24.Item40.Response 8. Credible25.Lexical41.Scalar 9.Criterion26.Linguistic42.Semantic 10.Cross-cultural27.Literal43.Situational 11.Cultural28.Meaning44.Stimulus 12.Definitional29.Measurement45.Structural 13.Direct30.Measurement unit46.Substantive 14.Exact31.Metaphorical47.Syntactic 15.Experiential32.Metric48.Technical 16.Factor33.Motivational49.Text

Survey Research Laboratory 10 of 15 Procedural Equivalence Emphasis on equivalent methods Interpretive Equivalence Emphasis on equivalent meaning

Survey Research Laboratory 11 of 15 A.Question Development Phase B.Questionnaire Pretesting Phase C.Data Collection Phase D.Data Analysis Phase Available Methods for Addressing Equivalence in Cross-Cultural Survey Research

Survey Research Laboratory 12 of 15 A. Question Development Stage 1.Expert consultation/collaboration 2.Ethnographic and other qualitative approaches 3.“Good” question-wording practices 4.“Good” translation practices 5.Facet analysis

Survey Research Laboratory 13 of 15 B. Questionnaire Pretesting Phase 1.Cognitive interviews/structured probes 2.Comparative response scale calibration 3.Comparative behavior coding 4.Compare alternative data collection modes

Survey Research Laboratory 14 of 15 C. Data Collection Phase 1.Use multiple indicators 2.Use both emic and etic questions 3.Respondent/interviewer matching

Survey Research Laboratory 15 of 15 D. Data Analysis Phase 1.Item analysis 2.Item response theory 3.Generalizability theory 4.Confirmatory factor analysis 5.Multidimensional scaling 6.Applying statistical controls 7.Identity-equivalence method