Reexamining Education Fairness: An Experimental Study of College Admission Policies in China Yang Zhang May 7, 2013.

Slides:



Advertisements
Similar presentations
Building Agents for the Lemonade Game Using a Cognitive Hierarchy Population Model Michael Wunder Michael Kaisers Michael Littman John Yaros.
Advertisements

Stackelberg -leader/follower game 2 firms choose quantities sequentially (1) chooses its output; then (2) chooses it output; then the market clears This.
Game Theory and Computer Networks: a useful combination? Christos Samaras, COMNET Group, DUTH.
Peter Lam Discrete Math CS. Outline  Use game theory to solve strictly determining games  Non strictly games  Create models for games  Find optimal.
Cognitive Biases 2 Incomplete and Unrepresentative Data.
Game Theory The study of rational behavior among interdependent agents Agents have a common interest to make the pie as large as possible, but Agents have.
Satisfaction Equilibrium Stéphane Ross. Canadian AI / 21 Problem In real life multiagent systems :  Agents generally do not know the preferences.
International Students in Iowa Linda Serra Hagedorn, Ph.D. Associate Dean – College of Human Sciences Professor – School of Education.
Harsanyi transformation Players have private information Each possibility is called a type. Nature chooses a type for each player. Probability distribution.
B OUNDED R ATIONALITY in L ABORATORY B ARGAINING with A SSYMETRIC I NFORMATION Timothy N. Cason and Stanley S. Reynolds Economic Theory, 25, (2005)
Job Market Signaling (Spence model)
East Meets West Facts And Innovation Perspective of education in China.
Outline  In-Class Experiment on Centipede Game  Test of Iterative Dominance Principle I: McKelvey and Palfrey (1992)  Test of Iterative Dominance Principle.
© 2005 The McGraw-Hill Companies, Inc., All Rights Reserved. Chapter 5 Making Systematic Observations.
Experiments and Observational Studies.  A study at a high school in California compared academic performance of music students with that of non-music.
A Study of Computational and Human Strategies in Revelation Games 1 Noam Peled, 2 Kobi Gal, 1 Sarit Kraus 1 Bar-Ilan university, Israel. 2 Ben-Gurion university,
Inference by College Admission Departments: Bayesian or Cursed? Michael Conlin Michigan State University Stacy Dickert-Conlin Michigan State University.
Chinese Urban Youth’s Perception toward EU Speaker: Changjian JiangAug. 21 rd, 2008.
Higher Education in China past and present. GaoKao National College Entrance Examination abolished during the Cultural Revolution Deng Xiaoping’s.
Confirmation Bias. Critical Thinking Among our critical thinking questions were: Does the evidence really support the claim? Is there other evidence that.
Experiments & Statistics. Experiment Design Playtesting Experiments don’t have to be “big”--many game design experiments take only 30 minutes to design.
Introduction To Biological Research. Step-by-step analysis of biological data The statistical analysis of a biological experiment may be broken down into.
LECTURE 19 THURSDAY, 14 April STA 291 Spring
Course Behavioral Economics Alessandro InnocentiAlessandro Innocenti Academic year Lecture 14 Fairness LECTURE 14 FAIRNESS Aim: To analyze the.
Classifying Attributes with Game- theoretic Rough Sets Nouman Azam and JingTao Yao Department of Computer Science University of Regina CANADA S4S 0A2
90288 – Select a Sample and Make Inferences from Data The Mayor’s Claim.
Section 2.4: Simple Comparative Experiments. Experiment – A planned intervention undertaken to observe the effects of one or more explanatory variables,
August th Computer Olympiad1 Learning Opponent-type Probabilities for PrOM search Jeroen Donkers IKAT Universiteit Maastricht.
90288 – Select a Sample and Make Inferences from Data The Mayor’s Claim.
Chapter Seven Measurement and Decision-Making Issues in Selection.
Experiments on Risk Taking and Evaluation Periods Misread as Evidence of Myopic Loss Aversion Ganna Pogrebna June 30, 2007 Experiments on Risk Taking and.
1 Adversarial Search CS 171/271 (Chapter 6) Some text and images in these slides were drawn from Russel & Norvig’s published material.
1 Multiple Regression A single numerical response variable, Y. Multiple numerical explanatory variables, X 1, X 2,…, X k.
Study Session Experimental Design. 1. Which of the following is true regarding the difference between an observational study and and an experiment? a)
Chapter 3.1.  Observational Study: involves passive data collection (observe, record or measure but don’t interfere)  Experiment: ~Involves active data.
The Science of Networks 6.1 Today’s topics Game Theory Normal-form games Dominating strategies Nash equilibria Acknowledgements Vincent Conitzer, Michael.
Essential Statistics Chapter 141 Thinking about Inference.
One-way ANOVA: - Comparing the means IPS chapter 12.2 © 2006 W.H. Freeman and Company.
The Economic Framework For our purposes two basic sets of agents: –Consumers –Firms Interact through markets Faced with some economic environment or market.
Testing theories of fairness— Intentions matter Armin Falk, Ernst Fehr, Urs Fischbacher February 26, 2015.
Proprietary & Confidential 1 Drug Efficacy in the Wild Tim Vaughan 17 June 2011.
Chapter 6 Introduction to Multiple Regression. 2 Outline 1. Omitted variable bias 2. Causality and regression analysis 3. Multiple regression and OLS.
Psychology As Science Psychologists use the “scientific method” Steps to the scientific method: - make observations - ask question - develop hypothesis.
Binomial Distribution and Applications. Binomial Probability Distribution A binomial random variable X is defined to the number of “successes” in n independent.
Chapter 6 Extensive Form Games With Perfect Information (Illustrations)
Producing Data: Experiments BPS - 5th Ed. Chapter 9 1.
Predicting Consensus Ranking in Crowdsourced Setting Xi Chen Mentors: Paul Bennett and Eric Horvitz Collaborator: Kevyn Collins-Thompson Machine Learning.
Double Coordination in Small Groups Luigi Mittone, Matteo Ploner, Ivan Soraperra Computable and Experimental Economics Laboratory – University of Trento,
Reexamining Education Fairness: An Experimental Study of Chinese College Admission Policies EITM Houston Yang Zhang University of Iowa June 26, 2013.
Lecture 22 Dustin Lueker.  Similar to testing one proportion  Hypotheses are set up like two sample mean test ◦ H 0 :p 1 -p 2 =0  Same as H 0 : p 1.
Chapter 7: Random Variables 7.2 – Means and Variance of Random Variables.
Yu-Hsuan Lin Catholic University of Korea, Korea University of York, U.K. 5 th Congress of EAAERE, Taipei, 06 th – 07 th August 2015.
Chapter 11: Test for Comparing Group Means: Part I.
Social Networks and Trust: not the Experimental Evidence you may Expect Daniela Di Cagno Emanuela Sciubba Luiss Guido Carli, Rome Birkbeck College, London.
Correlated equilibria, good and bad: an experimental study
Management support systems II
Inference: Bayesian, Cursed, …
Carnegie Mellon University
Nash Equilibrium A strategy combination (a,b) is a Nash equilibrium for two players if neither player would unilaterally deviate if he expected the other.
POSC 202A: Lecture Lecture: Substantive Significance, Relationship between Variables 1.
SAMPLING.
Alternative-offer bargainging
More About Factorial Design
Psych 231: Research Methods in Psychology
Suppose that the random variable X has a distribution with a density curve that looks like the following: The sampling distribution of the mean of.
Amir Ghaisi Grigorios Fountas Panos Anastasopoulos Fred Mannering
Inferential Statistics
Psych 231: Research Methods in Psychology
CHAPTER 10 Comparing Two Populations or Groups
Principles of Experimental Design
Presentation transcript:

Reexamining Education Fairness: An Experimental Study of College Admission Policies in China Yang Zhang May 7, 2013

College Admission Policies in China College Entrance Exam (Gaokao) A nation-wide comprehensive exam in every June Universities only consider Gaokao scores in recruiting new students. College Admissions Competition for college education is limited within each province because of the quota system. Local variations in college admission policies Immediate acceptance (most provinces) vs. deterred acceptance (e.g. Shanghai). Exam content Timing of application

Timing of Application Low information Not knowing your own and others’ Gaokao scores. Private/asymmetric information Estimating your own score based on the official answers, but not knowing others’ scores. Complete information Knowing your rank among all students. Gaokao Exam Result Distribution

Research Questions How does timing of application affect students’ strategies in college application? How does timing of application affect the distribution of admission outcomes?

Three Games 1. Mimic Exams 2. College Entrance Exam Randomly pick one mimic exam score. Mimic 1Mimic 2 A B C

Three Games Cont’d 3. College Application Choose one university from Harvard and the UI. Get 2 dollars from Harvard and 1 dollar from the UI. Three games only differ in the timing of application. 4. College Admission Each university only admits one student.

Defining Admission Fairness Expected Rank Distribution Ideal Outcome Distribution RankABC ABC Harvard UI None Expected Utility

Available Information in College Choice (e.g Student A) Complete Information Expected rank distribution (unnecessary) A, B, and C’s Gaokao scores Private/asymmetric information Expected rank distribution A’s Gaokao score Low information Expected rank distribution

Experiment Subjects 10 groups and 30 subjects 21 Chinese (15 experienced), 6 Americans, 1 Taiwanese, and 2 Koreans 8 groups for each treatment (complete, private, and low information) Post-game discussion Which games are fair and which are not fair? What was your expectation of other players’ choices (belief)? Does the experiment well reflect the reality? Other thoughts?

Complete Information Game: Evaluating the Expected Strategies Nash Equilibrium(a) Observed Strategy Distribution RankStrategy 1Harvard 2UI 3Harvard or UI Rank Strategy HarvardUI 1 1 (8) 0 (0) 2 0 (0) 1 (8) (1) (7)

Complete Information Game: Evaluating the Expected Admission Outcomes Expected outcome distribution Luck in getting a higher score Observed outcome distribution Adjusted outcome distribution ABC Harvard UI None Expected Utility ABC Harvard UI None Expected Utility ABC Harvard UI None Expected Utility High scoreLow score A B 0.7 C0.5

Private Information Game: Evaluating the Expected Strategies High scoreLow score HarvardUIHarvardUI A (3)(1)(3)(1) B (1) (2)(4) C (0)(4)(1)(3) High scoreLow score AHarvard BUI C Harvard High scoreLow score AHarvard BUI C High scoreLow score AHarvard B UI C High scoreLow score AHarvardUI BHarvard C UI High scoreLow score AHarvardUI BHarvard CUI

Private Information Game: Evaluating the Expected Admission Outcomes Expected outcome distribution Adjusted outcome distribution ABC Harvard UI None Expected Utility ABC Harvard UI None Expected Utility

Low Information Game: Evaluating the Expected Strategies Bayesian Equilibrium Observed Strategy Distribution Strategy AHarvard BUI C Strategy HarvardUI A 1 (8) 0 (0) B (7) (1) C 0 (0) 1 (8)

Low Information Game: Evaluating the Expected Admission Outcomes Expected outcome distribution Adjusted outcome distribution ABC Harvard100 UI None Expected Utility ABC Harvard UI None Expected Utility

Conclusions Observed Strategies Complete information: the experimental results perfectly fit the Nash equilibrium that A chooses Harvard, B chooses the UI, and C is indifferent between the two. Private information: A is more likely to choose Harvard, and B is more likely to choose the UI no matter which score they pick. C chooses the UI most of the time. A bigger sample is needed to further evaluate the PBEs. Low information: As the Bayesian equilibrium suggests, A always chooses Harvard and C always chooses the UI. B is risk-seeking that she applies for Harvard most of the time. Adjusted Outcome Distributions Complete information yields ideal outcome distribution. Private information greatly favors C and slightly favors A at the cost of B. Low information is biased against both A and B, but in favor of C, which contradicts the Bayesian equilibrium.

Future Research Directions Under deterred acceptance algorithms, how will different levels of information affect college choices? Two-sided matching game Statistically evaluate the theoretical predictions with agent quantal response equilibrium. A problem of chi2 test. Policy innovation and diffusion in an authoritarian country. “The adoption of a design is at least partly a political process. (Roth 2002: 1345)”