Paper Bringing Real Market Participants’ Real Preferences into the Lab: An Experiment That Changed the Course Allocation Mechanism at Wharton

In mechanism design theory it is common to assume that agents can perfectly report their preferences, even in complex settings where this assumption strains reality. We experimentally test whether real market participants can report their real preferences for course schedules “accurately enough” for a novel course allocation mechanism, approximate competitive equilibrium from equal incomes (A-CEEI), to realize its theoretical benefits. To use market participants’ real preferences (i.e., rather than artificial “induced preferences” as is typical in market design experiments), we developed a new experimental method. Our method, the “elicited preferences” approach, generates preference data from subjects through a series of binary choices. These binary choices revealed that subjects preferred their schedules constructed under A-CEEI to their schedules constructed under the incumbent mechanism, a bidding points auction, and that A-CEEI reduced envy, suggesting subjects were able to report their preferences accurately enough to realize the efficiency and fairness benefits of A-CEEI. However, preference reporting mistakes did meaningfully harm mechanism performance. One identifiable pattern of mistakes was that subjects had relatively more difficulty reporting cardinal as opposed to ordinal preference information. The experiment helped to persuade the Wharton School to adopt the new mechanism and helped guide aspects of its practical implementation, especially around preference reporting. 

Get the Working Paper

• Authored by Eric Budish Judd B. Kessler
• 2016
• Nonprofit