Can a Dominatrix Make My Pump Work? Michael H. Birnbaum CSUF Decision Research Center

Acknowledgments Daniel Navarro-Martinez, Neil Stewart, and Christoph Ungemach contributed to this project, including research done at U. Warwick. Jeffrey P. Bahra assisted with data collection here at CSUF.

Outline Transitivity Stochastic Dominance Search for intransitivity predicted by an imperfect dominance detecting editor True and Error Model: Can estimate the proportion of different response patterns, separate error from true violations of a property. Results: Very little evidence for editor.

Transitivity If A is preferred to B, and B is preferred to C, then A is preferred to C. Problem: how to separate violations due to “error” or variability of true preferences from violations due to “true” intention? Controversy: random utility, additive error component on utility, iid issues, and true and error models. I favor true and error model.

Stochastic Dominance If the probability to get prize x or more in gamble A always is greater than or equal to the corresponding probability in gamble B and sometimes strictly higher, we say gamble A dominates B by first order stochastic dominance. Original Prospect Theory violated stochastic dominance in cases where people satisfied dominance.

Wrong Prediction of OPT A = ($99,.1; $98,.1; $97,.8) B = ($101,.2; $100,.8) “Stripped” Original prospect theory predicts A is preferred to B, violating dominance. Fishburn (1978) pointed out this type of implication with respect to Handa’s model, which like Edwards’ SWU (“SEU”) model, used decision weights.

Editing Rules of PT (1979) Kahneman (2003): The editing rules were a pre- emptive defense of “prospect” theory from implications thought at the time to be dubious or false. These were postulated without any evidence in 1979 paper as excuses. Editing rule of dominance detector: People look for dominance and satisfy it when “transparent.” Neither CPT nor TAX implies this type of violation of dominance. CPT (1992) implies stochastic dominance, automatically satisfies the editing rule of “combination”, and was not limited to two non-zero branches.

Violations of Stochastic Dominance Birnbaum (1997) proposed the following recipe, implied by RAM and TAX (configural weighted) models. A = ($96,.90; $14,.05; $12,.05) B = ($96,.85; $90,.05; $12,.10) Birnbaum & Navarrete (1998) found about 70% violations. Replicated in 42 studies with different formats, incentives, participants, etc.

Can we use Dominance to create violations of Transitivity? Birnbaum, Patton, & Lott (1999) : Maybe people can detect dominance in simpler choices. Compare G+ and G- with G0, as follows: G+ = ($96,.9; $14,.05; $12,.05) G- = ($96,.85; $90,.05; $12,.10) G0 = ($96,.9; $12,.10) Prediction: G+ > G0, G0 > G- but G- > G+. Starmer (1999): Similar attempt.

Previous Results BPL (1999) results: many people violating dominance on simpler choices. Intermediate results. Concluded: maybe there is a partially accurate dominance detector used part of the time by some people. “Translucent” choices added to “transparent” and “opaque.” Neither BPL (1999) nor Starmer (1999) were unambiguous. At the time, the appropriate error model was lacking.

3 New Studies: Individual Data Each person received 40 choice problems in each “block”, randomly ordered, with problems from transitivity design separated by at least 3 trials. Embedded were 8 choice problems testing stochastic dominance and transitivity. 3 studies with 100 people are combined here. Many responses per choice problem for each person. Allows analysis via both gTET and iTET.

True and Error Models iTET: Individual person analysis. gTET: Group analysis summarized over people. Both models assume: Two responses to the same choice problem by the same person in the same block of trials are based on the same “true” preferences, but may differ due to random “errors.” Both models violate iid: in gTET, violations mean that different people have different true preferences; iTET, violations of iid when the same person has a mixture of true preferences and changes from block to block.

Some Advantages of TE Models The models are testable. They provide a framework, like ANOVA, for statistical tests of transitivity or other properties. They allow estimation of the distribution of true preference patterns in a mixture. Some “rival” approaches are simply special cases; e.g., Thurstone, Case V.

Results-Violations of SD Choice Type FemalesGS+ GS-G+ G0G0 G-G+ G- First Last Males First Last

Response Patterns First Last Pattern G F G &F G F * * Total

Response Patterns—All Blocks Pattern G test F test G and F * Total

Modal Response Patterns by S PatternNumber *

Tests of iid Birnbaum (2012, 2013) tests of iid in small samples, based on random permutations of the data. A number of participants showed significant violations of iid. Compute preference reversals between blocks; compute correlation between gap and number of preference reversals. Median correlations were.50,.77, and.70 in 3 studies. Variance test also sig. for many participants. Further, there were significant decreases in violations of SD.

PPN Violations of SD in G+ vs G-

Estimation of Errors in TE model

Fit of gTET case with p(112) = 0

Possible Problem for Prior TAX Model The “prior” TAX model is a special case model that assumed particular parameters and specifications for purpose of making predictions to new studies. Weight transfer =  /(n + 1). Prior TAX prediction is 222 (All violations), whereas most common patterns are 122 and 111. This could be fixed Post Hoc, but it might represent something deeper. [BPL (1999) attributed discrepancy to partially effective editor, but these results raise doubts.]

Two People out of 100 Two people had data compatible with an editor that works for G+ vs. G0 and G- vs. G0 but not G+ vs. G-. One of these also showed evidence of changing from pattern predicted by this hypothesis to increasing conformity to SD. Most people had data compatible with transitive orders. Some also were consistent from start to finish (one with 78 blocks of data, perfect 122 pattern except for two “errors” out of 468 responses).

Conclusions Results provide much clearer answer than in BPL 99. Whereas BPL thought there might be evidence for a partially effective dominance detector working part of the time, these data show very little evidence, based on the TE analysis. Other tests of editing rules have also failed to find support; in fact, evidence shows systematic violation of coalescing, cancellation. Other “heuristic” or “simplifying” principles are refuted when formulated and tested as descriptive theory (JMP). Whereas a few people might use these on occasion, they have not yet proven successful when tested as models of the majority of participants.

Appendix For those who want details of the TE Models, I recommend paper in JDM: Birnbaum, M. H. (2013). True-and-error models violate independence and yet they are testable. Judgment and Decision Making, 8, Associated Excel spreadsheets with equations for analysis of Transitivity via TE models.