1 Teck-Hua Ho University of California, Berkeley In collaboration with Catherine Yeung, NUS Stanford University, May 2013.

Slides:



Advertisements
Similar presentations
BEHAVIORAL RESEARCH IN MANAGERIAL ACCOUNTING RANJANI KRISHNAN HARVARD BUSINESS SCHOOL & MICHIGAN STATE UNIVERSITY 2008.
Advertisements

Eliciting Honest Feedback 1.Eliciting Honest Feedback: The Peer-Prediction Model (Miller, Resnick, Zeckhauser) 2.Minimum Payments that Reward Honest Feedback.
Robin L. Donaldson May 5, 2010 Prospectus Defense Florida State University College of Communication and Information.
3. Basic Topics in Game Theory. Strategic Behavior in Business and Econ Outline 3.1 What is a Game ? The elements of a Game The Rules of the.
Choices Involving Risk
Statistics Versus Parameters
Research Methods in Psychology Complex Designs.  Experiments that involve two or more independent variables studies simultaneously at least one dependent.
Lecture Outline Being the Target of Prejudice Stereotype Threat Positive Prejudice.
1 Duke PhD Summer Camp August 2007 Outline  Motivation  Mutual Consistency: CH Model  Noisy Best-Response: QRE Model  Instant Convergence: EWA Learning.
1 Information Markets & Decision Makers Yiling Chen Anthony Kwasnica Tracy Mullen Penn State University This research was supported by the Defense Advanced.
Math Candel Maastricht University. 1.Internal validity Do your conclusions reflect the “true state of nature” ? 2.External validity or generalizability.
Behavior in organization. Sociology and social psychology Field of organizational behavior psychology communication Political science Management science.
Macroeconomics - Barro Chapter 15 1 C h a p t e r 1 5 Money and Business Cycles I: The Price-Misperceptions Model.
 The misinformation effect refers to incorrect recall or source attribution of an item presented after a to-be-remembered event as having been presented.
Chapter 4 Principles of Quantitative Research. Answering Questions  Quantitative Research attempts to answer questions by ascribing importance (significance)
A Positive Approach to Coaching Effectiveness and Performance Enhancement Ronald E. Smith “Profound responsibilities come with teaching and coaching. You.
1 Chapter 16 Conduct of Monetary Policy: Goals and Targets.
Part III Exchange Rate Risk Management Information on existing and anticipated economic conditions of various countries and on historical exchange rate.
Choice-based assessments Dan Schwartz
The Mutability of Altruism: A Perspective from Economics David Clingingsmith Case Western Reserve University Workshop in Multidisciplinary Philanthropy.
Marketing Research: Overview
Mechanisms for Making Crowds Truthful Andrew Mao, Sergiy Nesterko.
Chapter 10 THE NATURE OF WORK GROUPS AND TEAMS. CHAPTER 10 The Nature of Work Groups and Teams Copyright © 2002 Prentice-Hall What is a Group? A set of.
NÁRODNÁ BANKA SLOVENSKA BNB, April 23, 2008 Miroslav Gavura Forecasting and Policy Analysis System in the NBS.
Copyright © 2009 Pearson Addison-Wesley. All rights reserved. Chapter 21 Monetary Policy Strategy.
Does Formative Feedback Help or Hinder Students? An Empirical Investigation 2015 DEE Conference Carlos Cortinhas, University of Exeter.
Experimental Research Methods in Language Learning Chapter 2 Experimental Research Basics.
9-1 McGraw-Hill/Irwin ©2006 The McGraw-Hill Companies, Inc., All Rights Reserved CHAPTER NINE Ethics In Negotiation.
Product Characteristics, Competition and Dividends by Hoberg, Phillips, and Prabhala University of Maryland Discussion by Gustavo Grullon Rice University.
Public Charity as a Proximate Factor of Evolved Reputation- Building Strategy Brittany and Bo.
Can Money Buy Happiness? Evidence from the Discounting of Uncertain Happiness Tracy A. Tufenk & Daniel D. Holt Psychology Department, University of Wisconsin-Eau.
INTRO TO EXPERIMENTAL RESEARCH, continued Lawrence R. Gordon Psychology Research Methods I.
© 2007 Towers Perrin June 17, 2008 Loss Reserving: Performance Testing and the Control Cycle Casualty Actuarial Society Pierre Laurin.
Andrew Gibson, Kieran Francis, Harriet Brown, Emily Williams, Claire Massett and Felicity Lindsay.
1 The Determinants of Managerial Decisions Under Risk Martin G. Kocher University of Innsbruck Ganna Pogrebna Columbia University Matthias Sutter University.
1 Self-Regulation and Ability Predictors of Academic Success during College Anastasia Kitsantas, Faye Huie, and Adam Winsler George Mason University.
Presenter: Chen, Yu-Chu Advisor: Chen, Ming-Puu Date: 2008 Nov.3 Corrective Feedback in the Chatroom: An experimental study Loewen, S. & Erlam, R. (2006).
1 Self-governance of a Spatial Explicit Real-time Dynamic Common Resource: A Content Analysis of Communication Patterns Marco Janssen School of Human Evolution.
McGraw-Hill/Irwin Copyright © 2010 by The McGraw-Hill Companies, Inc. All rights reserved.
Learning Outcomes Identify the types of hypotheses Identify Characteristics of a good hypothesis Identify the types of hypotheses Formulate a valid hypothesis.
Some factors leading to initial attraction Proximity (more likely to form relationships with those who live near us, or that we interact with on a regular.
How do rules and changing incentives influence people’s economic behavior?
Click the mouse button or press the space bar to display information. 1.Discuss ways parents and guardians teach family values. What You’ll Learn 2.Identify.
Chapter 3: Statistical Significance Testing Warner (2007). Applied statistics: From bivariate through multivariate. Sage Publications, Inc.
Sociological Research Methods. The Research Process Sociologists answer questions about society through empirical research (observation and experiments)
Enrica Carbone (UniBA) Giovanni Ponti (UA- UniFE) ESA-Luiss–30/6/2007 Positional Learning with Noise.
Testing theories of fairness— Intentions matter Armin Falk, Ernst Fehr, Urs Fischbacher February 26, 2015.
Ethics Defined… Ethics Morals Prudent Practical Legal
CULTURAL STEREOTYPES AND NORM OF RECIPROCITY 11/03/
The Impact of Student Self-e ffi cacy on Scientific Inquiry Skills: An Exploratory Investigation in River City, a Multi-user Virtual Environment Presenter:
Promises, Reliance and Psychological Lock-In Rebecca Stone & Alexander Stremitzer IMPRS Jena, July 28.
Brian Lukoff Stanford University October 13, 2006.
Coordination and Learning in Dynamic Global Games: Experimental Evidence Olga Shurchkov MIT The Economic Science Association World Meeting 2007.
Is Altruism Really Selfless? “As a general rule, a modern biologist seeing an animal doing something to benefit another assumes either that it is being.
Gender and economic preferences
THE GUIDE TO ECONOMIC THINKING
UNSW | BUSINESS SCHOOL | SCHOOL OF ECONOMICS Calling the shots Experimental evidence on significant aversion to non-existing strategic risk Ben Greiner.
Forecasting Exchange Rates 9 9 Lecture Chapter Objectives To explain how firms can benefit from forecasting exchange rates; To describe the common.
Performance Reviews MANA 4328 Dennis C. Veit
Katherine J. Klein The Wharton School, University of Pennsylvania Edward J. Carberry Rotterdam School of Management, Erasmus University Beyster Fellow.
Yu-Hsuan Lin Catholic University of Korea, Korea University of York, U.K. 5 th Congress of EAAERE, Taipei, 06 th – 07 th August 2015.
Slepian & Ames - Materials 1. Images of cards used to play mixed-motive game –Each player received 6 cards (2 High, 2 Low, 1 Don’t Trust, 1 Trust) –Back.
Correlated equilibria, good and bad: an experimental study
Antecedents and Consequences of Unsolicited vs
Selfish or Selfless? On the signal value of emotion in altruistic behavior Deborah Small Wharton, University of Pennsylvania In collaboration with Alix.
Principles of Quantitative Research
Social Psychology Do you feel pressure to dress like everyone else?
Giving feedback to clients
Mahsa Ashabi, Hannah Cummons, Madison Levine, Ashwini Shridhar
Understanding your audience is fundamental to the success of any message. You need to adapt your message to fit the audience’s goals, interests, and needs.
Presentation transcript:

1 Teck-Hua Ho University of California, Berkeley In collaboration with Catherine Yeung, NUS Stanford University, May 2013

Giving and Receiving Feedback in Real Life 2 Examples of one-shot feedback giving and receiving interaction:

Feedback Giving Game 3 Performance report: “4 correct answers.” Answer 10 Math questions, each correct answer earns $1. “You have answered [X] questions correctly.” Feedback Paid based on the client’s happiness. Each point on the happiness scale earns 50 cents. Am I happy about it? [0 = not at all; 10 = very happy] (The client knows it.) Affective response

Giving and Receiving Feedback 4 AGENT CLIENT Agent has information about Client’s performance and has to provide feedback to Client Performance (private info.) Feedback Affective response Agent makes more money when Client is happier Client knows that Agent will make more money when she is happier. What feedback would the agent choose to give? How would the client respond to the feedback?

Economics versus Psychology Economics – Signaling game The agent receives private information The agent sends a message to the client The client responds by sending an action that determines the agent’s payoff – Equilibrium analysis without common beliefs Psychology – Monetize emotions to give them economic significance – Document empirical regularities for formal economic theorizing

Literature Review in Psychology Mixed findings, focus mainly on the client’s side Flattery enhances judgment of the flatterer (Gordon 1996) Flattery triggers negative attributions – “the salesclerk was nice because she was working on commission” (e.g., Main et al. 2007) Flattery hurts explicit attitude but enhances implicit attitude (Chan and Sengupta 2010) – Hurts immediate judgment but improves delayed judgment – Helps when the target is under time pressure 6

Our research Simultaneously examine the agent’s decision and the client’s response Does the agent inflate feedback, if yes, does it work, and why? Happiness Performance Feedback Contribution of our Research 7 Past research's approach: No real agent Pre-set levels of ingratiation (Variables of theoretical interest are manipulated) “…you are a fashionable and stylish person. Your dress sense is classy and chic….” “I’m sure that she will take her responsibility very seriously and that she’ll do an excellent job…”

Study 1: Procedure 8 AGENT CLIENT Happiness Performance Feedback How is the Agent paid? Based on Client’s happiness; each scale point = 50¢ -- “Proportional” Condition $3 for truthful reporting, $0 for untruthful reporting -- “Truth-telling” Condition Stage 2. Feedback Communication A receives C’s performance (actual no. of correct answers) Stage 1. Math Quiz C answers 10 SAT questions in 15 minutes Each correct answer earns C $1. A sends feedback to C (“You have correctly answered [ ] questions.”) Stage 3. Emotional Reaction C indicates happiness (0 - 10) Experiment Ends C finds out her performance. Both get paid.

Study 1 - Findings 9 Actual Quiz Score Feedback Inflation Feedback Value Client’s Happiness Proportional condition ($0.5 per happiness point) Truth-telling condition ($3 if feedback is truthful) Differencen.s.2.09 (p<.01) 2.07 (p<.01) Does the agent inflate feedback? If yes, does it work? Truth-telling condition (n=40): 100% truthfully reported Proportional condition (n=64): 60% inflated feedback, 40% truthfully reported – The agent inflates feedback. – The client is happier and the agent earns 33% more money.

Study 2: Validating Happiness Measure Does tying the Agent’s payoff to the Client’s happiness rating change the way the client reports her happiness? 10 Proportional Condition Client indicates happiness [1-10], each point earns the agent 50¢ Truth-telling Condition Agent is paid $3 for truthful reporting Decoupled Condition Client indicates happiness [1-10] Client determines agent’s payoff [1-10], each point earns the agent 50¢ Provides an unbiased measure of happiness

Study 2: Validating Happiness Measure 11 ConditionsActual Quiz Score Agent’s Feedback Client’s Happiness Client’s decision of Agent’s payoff Truth-telling ($3 if truthful) Proportional (50¢ / happy point) Decoupled

Explanations for the Basic Findings 12 Opportunism-Overconfidence Hypothesis Agent inflates feedback because he wants to make more money The agent inflates feedback (and earns more). The client reports being happier. Client is truly happier because she truly believes in the feedback Client is not truly happier, but reports being happier to make the agent more mon ey Alternative Explanation: Altruism Hypothesis Agent sugarcoats to make the client happier (but not to make more money) as a “White lie” (Erat and Gneezy 2012) evidence of costly altruistic behavior from dictator games Agent is paid $3 for any feedback Agent is paid based on client’s happiness, but only if the feedback is truthful Two New Conditions for the Next Study:

Study 3: Testing the Altruism Hypothesis Proportional Condition Agent paid based on Client’s Happiness $0.5 / happiness scale point Flat-rate Condition Agent paid $3 for ANY feedback { accurate, inflated, deflated } Testing Agent’s Altruistic Motive Truth-proportional Condition Agent is paid based on Client’s happiness, but only if the feedback is truthful Testing Client’s Altruistic Motive 13

Study 3: Findings 14 Actual Quiz Score Feedback Inflation Feedback Value Client’s reported Happiness Proportional ($0.5 / point) Flat-rate ($3, any feedback) Truth-proportional ($0.5 / point only if feedback is truthful) Proportional (n=64): 48% inflated, 52% truthfully reported Flat-rate (n=24): 83.3 truthfully reported; 8.3% inflated; 8.3% deflated, Truth-proportional (n=56): 100% truthfully reported

Study 4: Conditional Altruism Client wants to benefit the agent only when she is ahead of the agent in cash earnings – Client’s altruism is conditional on the premise that she makes more money than the agent Study 4: – Manipulate relative positions in earnings 15 Client earns $1 per correct answer Agent earns 50¢ per happiness point Proportional condition Agent earns $1 per happiness point Client earns 50¢ per correct answer Swap Payoff condition Actual Quiz Score Agent’s Feedback Client’s Happiness

The Opportunism-Overconfidence Hypothesis 16 Opportunism-Overconfidence Hypothesis Agent inflates feedback because he wants to make more money The agent inflates feedback (and earns more). The client reports being happier. Client is truly happier Why does she believe in the feedback? Client is over-confident. Feedback inflation matches with client’s own forecast – Study 5 Opportunistic agent inflates feedback only if he can benefit by doing so – Study 6

Study 5: Findings 17 Actual Quiz Score Client’s Own Prediction Agent’s Feedback Client’s reported Happiness Agent’s Payoff Proportional *6.08*6.28$3.14 Truth-telling $3.00 Proportional condition (n=64): 40% inflated Truth-telling condition (n=32): 0% inflated Regression: Feedback = * Performance Prediction, R 2 =.89 *Not statistically different, both at the individual level and group level

Study 6: Validation Study Opportunistic agent inflates feedback only if he can benefit by doing so Design: – Proportional condition: agent paid based on ex-post happiness – Truth-telling condition 18 AGENT CLIENT Ex-post Happiness Performance Feedback Finds out actual performance

Study 6: Findings More on feedback deflation:  Deflation does not change ex-post happiness Deflation: beta =0.31, p =.30 Actual Math quiz performance: beta =.56, p < Quiz Score Agent’s Feedback Client’s Happiness (intermediate) Client’s Happiness (Ex-post) Proportional Truth-telling Proportional condition (n=64): 67.2% truthfully reported 9.4% inflated 23.4% deflated Truth-telling condition (n=32): 100% honestly reported

Findings: Study 1 – Study 6 20 AGENT CLIENT Happiness Performance Feedback Inflates feedback because he believes that he can benefit from doing so. Would the agent inflate feedback when: 1.the feedback is consequential? 2.the truth is not “stretchable”? (“Honest” people lie by stretching the truth; Mazar et al. 2008; Schweitzer and Hsee 2002) Can make more money from happier client Feedback inflation matches with her expectation. Truly happier as a result of receiving the inflated feedback.

Study 7: Feedback Giving when the Truth is not “Stretchable” Agent learns about Client’s performance as “bad” (0-5 correct) or “good” (6-10 correct) Agent gives feedback as “Good” or “Bad” 21 Feedback: BadFeedback: Good Actual: Bad230 Actual: Good033 Feedback: BadFeedback: Good Actual: Bad1718 Actual: Good223 Truth-Telling Condition Proportional Condition

Study 8: Giving Consequential Feedback 22 Stage 2. Feedback Communication A gives C feedback about her Quiz 1 performance Stage 1. Math Quiz 1 (UNPAID) C answers 10 SAT questions in 15 minutes No monetary consequence Stage 3. Emotional Reaction C indicates happiness (0 - 10) Stage 4. Math Quiz 2 (PAID) C answers 10 SAT questions in 15 minutes C chooses two payment schemes: -Performance-based $1 for each correct answer -$5 fixed fee AGENT CLIENT Happiness Performance Feedback Q 1 Q 2

Study 8: Findings 23 Stage 2. Feedback Communication Average feedback value = 6.69* Stage 1. Math Quiz 1 (UNPAID) Average no. of correct ans. = 5.51* Stage 3. Emotional Reaction Happiness = 6.64 Stage 4. Math Quiz 2 (PAID) AGENT CLIENT Happiness Performance Feedback Q 1 Q 2 *p <.01 n = 80 Choice of performance-based scheme increases with feedback favourability beta =.31, p <.01

Extensions When there are more than one agent – Degree of overlap of information – Sequential versus simultaneous Feedback strategy space – Continuous versus categorical Degree of information – Complete versus incomplete – Granularity of information Equilibrium analysis of feedback giving game without common belief Effect of physical appearance – Client’s physical appearance – Agent’s physical appearance 24