Self- other agreement in personal values Henrik Dobewall 1 ; Toivo Aavik 1 ; Kenn Konstabel 2 ; Shalom H. Schwartz 3,4, & Anu Realo 1 1 University of Tartu,

Slides:



Advertisements
Similar presentations
Basic Values in Europe Shalom Schwartz The Hebrew University of Jerusalem ESS Launch Conference Brussels November 25, 2003.
Advertisements

Agenda Levels of measurement Measurement reliability Measurement validity Some examples Need for Cognition Horn-honking.
Chapter 8 Flashcards.
ESS Launch Conference Brussels November 25, 2003
Survey Methodology Reliability and Validity EPID 626 Lecture 12.
1 COMM 301: Empirical Research in Communication Kwan M Lee Lect4_1.
VALIDITY AND RELIABILITY
Research Methodology Lecture No : 11 (Goodness Of Measures)
Part II Sigma Freud & Descriptive Statistics
Emotion and Personality. Emotions  Components of Emotions (e.g., fear):  Distinct subjective feelings (e.g., anxiety)  Accompanied by bodily changes.
Personality and Life Satisfaction: A Facet-Level Analysis Ulrich Schimmack Shigehiro Oishi R. Michael Furr David C. Funder.
1]Knoll, N., Burkert, S., & Schwartzer, R. (2006). Reciprocal support provision: Personality as a moderator? European Journal of Personality, 20,
Part II Knowing How to Assess Chapter 5 Minimizing Error p115 Review of Appl 644 – Measurement Theory – Reliability – Validity Assessment is broader term.
PEARL Personal Employability Achievement and Reflection for Learning PEARL Personal Employability Achievement and Reflection for Learning.
Reliability and Validity in Experimental Research ♣
Copyright © 2009 Pearson Education Canada2-1 Chapter 2: Child Development 2.1 Doing Child-Development Research 2.2 Child-Development Research and Family.
What are competencies – some definitions ……… Competencies are the characteristics of an employee that lead to the demonstration of skills & abilities,
FOUNDATIONS OF NURSING RESEARCH Sixth Edition CHAPTER Copyright ©2012 by Pearson Education, Inc. All rights reserved. Foundations of Nursing Research,
Chapter 3 Nelson & Quick Personality, Perception, and Attribution Copyright ©2005 by South-Western, a division of Thomson Learning. All rights reserved.
Research Methods in MIS
Chapter 7 Correlational Research Gay, Mills, and Airasian
Classroom Assessment A Practical Guide for Educators by Craig A
Chapter 9 Descriptive Research. Overview of Descriptive Research Focused towards the present –Gathering information and describing the current situation.
Quantitative Research
Evaluation After presenting the results, I asked students to rate the classroom activity according to whether it (1) was enjoyable to them, (2) was helpful.
Chapter 2 Finding Ideas to Research. Generating Topics Translate ideas into valid and reliable ways of measuring them Collect evidence Unique Topics Innovative.
Descriptive and Causal Research Designs
© 2013 Cengage Learning. Outline  Types of Cross-Cultural Research  Method validation studies  Indigenous cultural studies  Cross-cultural comparisons.
Reliability and factorial structure of a Portuguese version of the Children’s Hope Scale José Tomás da Silva Maria Paula Paixão Catarina Carvalho dos Santos.
Qualitative Research Methodologies Keys to Exploratory Research.
From personality to politics. Liberals and Conservatives Rely on Different Sets of Moral Foundations Jesse Graham, Jonathan Haidt, Brian A. Nosek (2009)
Justice across cultures Ron Fischer Psyc338 Reward Allocation and Justice Perceptions of justice Distributive Justice & Reward Allocation –Contextual.
Instrumentation.
MEASUREMENT CHARACTERISTICS Error & Confidence Reliability, Validity, & Usability.
Control in Experimentation & Achieving Constancy Chapters 7 & 8.
Social Cognitive & Trait Theories
Rank-order consistency and profile stability of self- and informant-reports of personal values Henrik Dobewall, Universitat Pompeu Fabra Barcelona, SPAIN;
MGTO 324 Recruitment and Selections Validity I (Construct Validity) Kin Fai Ellick Wong Ph.D. Department of Management of Organizations Hong Kong University.
2010 SPA Annual Meeting San Jose, California Cross-Informant Assessment: Concepts, Behavioral Science, and Applications Marvin W. Acklin, Ph.D. Honolulu,
Classroom Assessment A Practical Guide for Educators by Craig A. Mertler Chapter 13 Assessing Affective Characteristics.
 Descriptive Methods ◦ Observation ◦ Survey Research  Experimental Methods ◦ Independent Groups Designs ◦ Repeated Measures Designs ◦ Complex Designs.
Measurement Validity.
Class 9 Dependent Variables, Instructions/Literature Review
Gender differences in symptom reporting: the influence of psychological traits. Laura Goodwin Dr Stephen Fairclough Liverpool John Moores University BACKGROUND.
MOI UNIVERSITY SCHOOL OF BUSINESS AND ECONOMICS CONCEPT MEASUREMENT, SCALING, VALIDITY AND RELIABILITY BY MUGAMBI G.K. M’NCHEBERE EMBA NAIROBI RESEARCH.
Measurement Issues General steps –Determine concept –Decide best way to measure –What indicators are available –Select intermediate, alternate or indirect.
Experimental Research Methods in Language Learning Chapter 5 Validity in Experimental Research.
Observed Autonomy And Connection With Parents And Peers As Predictors Of Early Adolescent Sexual Adaptation Joseph P. Allen Felicia Hall University of.
The effects of Peer Pressure, Living Standards and Gender on Underage Drinking Psychologist- Kanari zukoshi.
Social capital and perceived happiness: some evidence and issues Takashi Oshio Hitotsubashi University 1.
Chapter 14: Affective Assessment
Openness to experience, plasticity, and creativity: exploring lower-order to higher- order, and interactive effects (Silvia et al., 2009) November 24,
Measurement Experiment - effect of IV on DV. Independent Variable (2 or more levels) MANIPULATED a) situational - features in the environment b) task.
Chapter 6 - Standardized Measurement and Assessment
Copyright © 2014 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 11 Measurement and Data Quality.
5. Evaluation of measuring tools: reliability Psychometrics. 2011/12. Group A (English)
© 2009 Pearson Prentice Hall, Salkind. Chapter 5 Measurement, Reliability and Validity.
Measurement and Scaling Concepts
Idaho Test of Accurate Person Perception: Initial Creation of a Standardized Test Tera D. Letzring, Douglas E. Colman, Jared Vineyard Idaho State University.
Class 9 Dependent Variables, Instructions/Literature Review Class 9 Dependent Variables, Instructions/Literature Review Chapters 13 Spring 2016.
Survey Methodology Reliability and Validity
Organizational Behavior (MGT-502)
Personality, Perception, and Attribution
Questions What are the sources of error in measurement?
Concept of Test Validity
Measuring Athlete Coachability
Reliability and Validity of Measurement
Personality, Perception, and Attribution
Evaluation of measuring tools: reliability
Chapter 8 VALIDITY AND RELIABILITY
Presentation transcript:

Self- other agreement in personal values Henrik Dobewall 1 ; Toivo Aavik 1 ; Kenn Konstabel 2 ; Shalom H. Schwartz 3,4, & Anu Realo 1 1 University of Tartu, Estonia; 2 National Institute for Health Development and University of Tartu, Estonia; 3 The Hebrew University of Jerusalem, Israel; 4 National Research University— Higher School of Economics, Russia Küsitlusuuringute metodoloogia seminar, 18. oktoober Self-other agreement in values

Research question Can we judge other people’s values accurately, or are values too subjective to assess? Are self-reports valid? To address this question, we examined self-other agreement (i.e., the correlation between self- and other-reports) for personal values for four higher- order values. Based on the European Social Survey (ESS) Portrait Values Questionnaire (PVQ21). Self-other agreement in values 2

Schwartz‘s Value Circle Values are beliefs about “desirable, transsituational goals, varying in importance, that serve as guiding principles in people’s lives” (Schwartz & Bardi, 2001, p. 269).

Higher-order values Self-Transcendence - striving for sharing and fairness Conservation - holding communal-tied preferences for self- restriction and order Self-Enhancement -valuing competition and personal gain, even at the expense of others Openness to Change - valuing novelty and expression of intellectual, behavioral, and emotional autonomy Self-other agreement in values 4

5

Topics Self-other agreement in values 6

Human values by Shalom Schwartz Chapter 1: The Values Theory Chapter 2: Values as dependent variables Chapter 3: Values as independent variables Chapter 4: Measuring values Chapter 5: Higher-order values Self-other agreement in values 7

Self-other agreement People’s self-reports of their behaviour, attitudes, and personality may be affected by various response biases, for instance, socially desirable responding (Paulhus, 1991). How do we know, then, if a person truly endorses Benevolence values highly or rejects Power values? One possibility is to collect data through an independent measurement method, using opinions of other people (e.g., peers, spouses, siblings, parents etc.) who know the person well. Self-other agreement in values 8

Self-other agreement in related constructs An examination of the convergent (Campbell & Fiske, 1959) or consensual (McCrae, 1982) validity has a remarkable history in the fields of - well-being (e.g., Dobewall et al., 2012; r =.55 / Schneider & Schimmack, 2009; r =.42 ), - Big Five personality traits (e.g., Connolly et al., 2007; r =.36 / Konstabel et al., 2012; McCrae et al., 2004; r =.40 to r =.70) - or affectivity traits (Watson et al., 2000). Self-other agreement in values 9

Subjectivity of values Personal values might be too privately held personal concerns (McAdams, 1995) or “too individually subjective” (Hitlin & Piliavin, 2004, p. 359) to be judged by others. Rokeach (1973) and Schwartz (1992) both suggest that it is difficult for others to infer a person’s values because a value may be expressed in a variety of behaviours and any single behaviour may express multiple values. Moreover, values refer to motivation, not to action, so observers must infer them indirectly. Self-other agreement in values 10

Values as very contextualized Five Factor Theory of personality: Values, are so- called characteristic adaptations - being formed through the interaction of traits with the environment (McCrae & Costa, 1999)  better assessed by direct observation than traits (Allik & McCrae, 2002). Self-other agreement in values 11

Previous research The use of other-ratings in value research is relatively scarce (Lee et al. 2009, Rentfrow & Gosling, 2006) ; None of these studies, however, took the examination of self-other agreement as their focus. Several did not report many of the agreement correlations (e.g., Murray et al., 2002) or did not interpret them meaningfully (e.g., Lee et al., 2009). Self-other agreement in values 12

Correction for measurement error / attenuation (Spearman, 1904) Schwartz (2005) explains that the specific values measured with the ESS Human Values Scale / PVQ21 have low reliabilities because each scale has only two items (three for Universalism), and these items were constructed and selected to cover the broad conceptual components of each value rather than to express the same narrowly defined content. Cronbach Alpha (Cronbach, 1951) can be used. Self-other agreement in values 13

Method Measures PVQ21 (Schwartz et al., 2001) ; 4 higher-order values used. ‘Short Five’ personality inventory (S5 ; Konstabel et al., 2012). Data N = 101 for self-ratings and N = 96 for other-ratings (x2). Mean age of 25.7 years (SD = 7.9) / 26.9 years (SD = 9.5). Acquaintance 9.7 years (SD = 8.2). Self-other agreement in values 14

Internal consistency coefficients and self-other agreement correlations for higher-order values (PVQ21) Self-other agreement in values 15 Cronbach Alphas Self-Other Agreement Self- ratings Other- ratings ObservedCorrectedNo. of Items Openness to Change Conservatism Self-Enhancement Self-Transcendence Median

Robustness test Consensus similar to that for the Big Five personality traits (S5) in the same sample (median r =.52 /.68). Sample 2. Estonian Value Inventory (culture-specific; Aavik & Allik, 2002 ) - Self-other agreement was also substantial for the six more narrowly defined value factors (median r =.50 /.68). Profile (distinctive) correlation (Furr, 2008) supported intra-individual accuracy. Self-other agreement in values 16

Exemplar applications Sending value messages to others and inferring others’ values is a common activity... Happiness in marriage ( Murray et al., 2002) Respect for and identification with their leaders in organizations (Graf et al., 2011) Social bonds of friends via conveyed value similarity (music taste ; Boer et al., 2011 ) Cross-cultural value stereotypes (Dobewall & Strack, 2011) Transmission of values from one generation to another (Knafo & Schwartz, 2003) Assessing children’s values (future research) Self-other agreement in values 17

Conclusions Informants can judge targets’ values just as accurately as they judge their well-being, personality traits, emotions, and other individual attributes. The results suggest that other-ratings of personal values can be used to validate (see e.g., Sandvik et al., 1993) and complement (see e.g., Fogarty et al., 2013) self-report value measures. Self-other agreement in values 18

Any questions? Self-other agreement in values 19 „Die Gedanken sind frei“ (1800)