IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v68y2022i2p1107-1130.html
   My bibliography  Save this article

Can Market Participants Report Their Preferences Accurately (Enough)?

Author

Listed:
  • Eric Budish

    (Booth School of Business, University of Chicago, Chicago, Illinois 60637)

  • Judd B. Kessler

    (The Wharton School, University of Pennsylvania, Philadelphia, Pennsylvania 19104)

Abstract

In mechanism design theory it is common to assume that agents can perfectly report their preferences, even in complex settings in which this assumption strains reality. We experimentally test whether real market participants can report their real preferences for course schedules “accurately enough” for a novel course allocation mechanism, approximate competitive equilibrium from equal incomes (A-CEEI), to realize its theoretical benefits. To use market participants’ real preferences (i.e., rather than artificial “induced preferences” as is typical in market design experiments), we develop a new experimental method. Our method, the “elicited preferences” approach, generates preference data from subjects through a series of binary choices. These binary choices reveal that subjects prefer their schedules constructed under A-CEEI to their schedules constructed under the incumbent mechanism, a bidding points auction, and that A-CEEI reduces envy, suggesting subjects are able to report their preferences accurately enough to realize the efficiency and fairness benefits of A-CEEI. However, preference-reporting mistakes do meaningfully harm mechanism performance. One identifiable pattern of mistakes was that subjects had relatively more difficulty reporting cardinal as opposed to ordinal preference information. The experiment helped to persuade the Wharton School to adopt the new mechanism and helped guide aspects of its practical implementation, especially around preference reporting.

Suggested Citation

  • Eric Budish & Judd B. Kessler, 2022. "Can Market Participants Report Their Preferences Accurately (Enough)?," Management Science, INFORMS, vol. 68(2), pages 1107-1130, February.
  • Handle: RePEc:inm:ormnsc:v:68:y:2022:i:2:p:1107-1130
    DOI: 10.1287/mnsc.2020.3937
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.2020.3937
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.2020.3937?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Federico Echenique & Leeat Yariv, 2013. "An Experimental Study of Decentralized Matching," Working Papers 2013-3, Princeton University. Economics Department..
    2. Lars Ehlers & Bettina Klaus, 2003. "Coalitional strategy-proof and resource-monotonic solutions for multiple assignment problems," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 21(2), pages 265-280, October.
    3. Alvin E. Roth, 2009. "What Have We Learned from Market Design?," Innovation Policy and the Economy, University of Chicago Press, vol. 9(1), pages 79-112.
    4. Chen, Yan & Jiang, Ming & Kesten, Onur & Robin, Stéphane & Zhu, Min, 2018. "Matching in the large: An experimental study," Games and Economic Behavior, Elsevier, vol. 110(C), pages 295-317.
    5. Eric Budish & Estelle Cantillon, 2012. "The Multi-unit Assignment Problem: Theory and Evidence from Course Allocation at Harvard," American Economic Review, American Economic Association, vol. 102(5), pages 2237-2271, August.
    6. Rustamdjan Hakimov & Onur Kesten, 2018. "The Equitable Top Trading Cycles Mechanism For School Choice," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 59(4), pages 2219-2258, November.
    7. Eduardo M Azevedo & Eric Budish, 2019. "Strategy-proofness in the Large," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 86(1), pages 81-116.
    8. Fragiadakis, Daniel E. & Troyan, Peter, 2019. "Designing mechanisms to focalize welfare-improving strategies," Games and Economic Behavior, Elsevier, vol. 114(C), pages 232-252.
    9. Paul Milgrom, 2009. "Assignment Messages and Exchanges," American Economic Journal: Microeconomics, American Economic Association, vol. 1(2), pages 95-113, August.
    10. Caterina Calsamiglia & Chao Fu & Maia Güell, 2020. "Structural Estimation of a Model of School Choices: The Boston Mechanism versus Its Alternatives," Journal of Political Economy, University of Chicago Press, vol. 128(2), pages 642-680.
    11. Caterina Calsamiglia & Guillaume Haeringer & Flip Klijn, 2010. "Constrained School Choice: An Experimental Study," American Economic Review, American Economic Association, vol. 100(4), pages 1860-1874, September.
    12. Kojima, Fuhito, 2009. "Random assignment of multiple indivisible objects," Mathematical Social Sciences, Elsevier, vol. 57(1), pages 134-142, January.
    13. Dirk Bergemann & Stephen Morris, 2012. "Robust Mechanism Design," World Scientific Book Chapters, in: Robust Mechanism Design The Role of Private Information and Higher Order Beliefs, chapter 2, pages 49-96, World Scientific Publishing Co. Pte. Ltd..
    14. Vernon L. Smith, 1962. "An Experimental Study of Competitive Market Behavior," Journal of Political Economy, University of Chicago Press, vol. 70, pages 322-322.
    15. Bogomolnaia, Anna & Moulin, Herve, 2001. "A New Solution to the Random Assignment Problem," Journal of Economic Theory, Elsevier, vol. 100(2), pages 295-328, October.
    16. Nguyen, Thành & Peivandi, Ahmad & Vohra, Rakesh, 2016. "Assignment problems with complementarities," Journal of Economic Theory, Elsevier, vol. 165(C), pages 209-241.
    17. Shengwu Li, 2017. "Obviously Strategy-Proof Mechanisms," American Economic Review, American Economic Association, vol. 107(11), pages 3257-3287, November.
    18. Muriel Niederle & Lise Vesterlund, 2007. "Do Women Shy Away From Competition? Do Men Compete Too Much?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(3), pages 1067-1101.
    19. Mohammad Akbarpour & Afshin Nikzad, 2020. "Approximate Random Allocation Mechanisms," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 87(6), pages 2473-2510.
    20. Eric Budish, 2011. "The Combinatorial Assignment Problem: Approximate Competitive Equilibrium from Equal Incomes," Journal of Political Economy, University of Chicago Press, vol. 119(6), pages 1061-1103.
    21. He, Yinghua, 2012. "Gaming the Boston School Choice Mechanism in Beijing," TSE Working Papers 12-345, Toulouse School of Economics (TSE).
    22. Muriel Niederle & Alvin E. Roth, 2009. "Market Culture: How Rules Governing Exploding Offers Affect Market Performance," American Economic Journal: Microeconomics, American Economic Association, vol. 1(2), pages 199-219, August.
    23. Paul Klemperer, 2004. "Auctions: Theory and Practice," Online economics textbooks, SUNY-Oswego, Department of Economics, number auction1.
    24. Alex Rees-Jones & Samuel Skowronek, 2018. "An experimental investigation of preference misrepresentation in the residency match," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 115(45), pages 11471-11476, November.
    25. John Hatfield, 2009. "Strategy-proof, efficient, and nonbossy quota allocations," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 33(3), pages 505-515, September.
    26. C. Nicholas McKinney & Muriel Niederle & Alvin E. Roth, 2005. "The Collapse of a Medical Labor Clearinghouse (and Why Such Failures Are Rare)," American Economic Review, American Economic Association, vol. 95(3), pages 878-889, June.
    27. Lehmann, Benny & Lehmann, Daniel & Nisan, Noam, 2006. "Combinatorial auctions with decreasing marginal utilities," Games and Economic Behavior, Elsevier, vol. 55(2), pages 270-296, May.
    28. John H. Kagel & Yuanchuan Lien & Paul Milgrom, 2010. "Ascending Prices and Package Bidding: A Theoretical and Experimental Analysis," American Economic Journal: Microeconomics, American Economic Association, vol. 2(3), pages 160-185, August.
    29. Pesendorfer, Martin & Cantillon, Estelle, 2007. "Combination Bidding in Multi-Unit Auctions," CEPR Discussion Papers 6083, C.E.P.R. Discussion Papers.
    30. Alvin E. Roth, 2018. "Marketplaces, Markets, and Market Design," American Economic Review, American Economic Association, vol. 108(7), pages 1609-1658, July.
    31. Milgrom,Paul, 2004. "Putting Auction Theory to Work," Cambridge Books, Cambridge University Press, number 9780521536721.
    32. Yan Chen & Ming Jiang & Onur Kesten & Stéphane Robin & Min Zhu, 2018. "Matching in the large: An experimental study," Post-Print halshs-01973298, HAL.
    33. Roth, Alvin E. & Vesna Prasnikar & Masahiro Okuno-Fujiwara & Shmuel Zamir, 1991. "Bargaining and Market Behavior in Jerusalem, Ljubljana, Pittsburgh, and Tokyo: An Experimental Study," American Economic Review, American Economic Association, vol. 81(5), pages 1068-1095, December.
    34. Hatfield, John William & Kominers, Scott Duke, 2017. "Contract design and stability in many-to-many matching," Games and Economic Behavior, Elsevier, vol. 101(C), pages 78-97.
    35. Scott Duke Kominers & Alexander Teytelboym & Vincent P Crawford, 2017. "An invitation to market design," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 33(4), pages 541-571.
    36. Mar Reguant, 2014. "Complementary Bidding Mechanisms and Startup Costs in Electricity Markets," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(4), pages 1708-1742.
    37. Rustamdjan Hakimov & C.-Philipp Heller & Dorothea Kübler & Morimitsu Kurino, 2021. "How to Avoid Black Markets for Appointments with Online Booking Systems," American Economic Review, American Economic Association, vol. 111(7), pages 2127-2151, July.
    38. Tayfun Sönmez & Tobias B. Switzer, 2013. "Matching With (Branch‐of‐Choice) Contracts at the United States Military Academy," Econometrica, Econometric Society, vol. 81(2), pages 451-488, March.
    39. Kahneman, Daniel & Knetsch, Jack L & Thaler, Richard H, 1990. "Experimental Tests of the Endowment Effect and the Coase Theorem," Journal of Political Economy, University of Chicago Press, vol. 98(6), pages 1325-1348, December.
    40. Paul Klemperer, 2004. "Auctions: Theory and Practice," Online economics textbooks, SUNY-Oswego, Department of Economics, number auction1.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Di Feng, 2023. "Efficiency in Multiple-Type Housing Markets," Papers 2308.14989, arXiv.org, revised Dec 2023.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Scott Duke Kominers & Alexander Teytelboym & Vincent P Crawford, 2017. "An invitation to market design," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 33(4), pages 541-571.
    2. Eric Budish & Judd B. Kessler, 2016. "Can Market Participants Report their Preferences Accurately (Enough)?," NBER Working Papers 22448, National Bureau of Economic Research, Inc.
    3. Yan Chen & Peter Cramton & John A. List & Axel Ockenfels, 2021. "Market Design, Human Behavior, and Management," Management Science, INFORMS, vol. 67(9), pages 5317-5348, September.
    4. Rustamdjan Hakimov & Dorothea Kübler, 2021. "Experiments on centralized school choice and college admissions: a survey," Experimental Economics, Springer;Economic Science Association, vol. 24(2), pages 434-488, June.
    5. Nikhil Agarwal & Eric Budish, 2021. "Market Design," NBER Working Papers 29367, National Bureau of Economic Research, Inc.
    6. Eric Budish & Estelle Cantillon, 2012. "The Multi-unit Assignment Problem: Theory and Evidence from Course Allocation at Harvard," American Economic Review, American Economic Association, vol. 102(5), pages 2237-2271, August.
    7. Hakimov, Rustamdjan & Kübler, Dorothea, 2019. "Experiments On Matching Markets: A Survey," Rationality and Competition Discussion Paper Series 153, CRC TRR 190 Rationality and Competition.
    8. Bolton, Gary E. & Ockenfels, Axel, 2012. "Behavioral economic engineering," Journal of Economic Psychology, Elsevier, vol. 33(3), pages 665-676.
    9. Li, Mengling, 2020. "Ties matter: Improving efficiency in course allocation by allowing ties," Journal of Economic Behavior & Organization, Elsevier, vol. 178(C), pages 354-384.
    10. Eduardo M Azevedo & Eric Budish, 2019. "Strategy-proofness in the Large," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 86(1), pages 81-116.
    11. Alvin E. Roth & Robert B. Wilson, 2019. "How Market Design Emerged from Game Theory: A Mutual Interview," Journal of Economic Perspectives, American Economic Association, vol. 33(3), pages 118-143, Summer.
    12. Miralles, Antonio & Pycia, Marek, 2021. "Foundations of pseudomarkets: Walrasian equilibria for discrete resources," Journal of Economic Theory, Elsevier, vol. 196(C).
    13. Tong Wang & Congyi Zhou, 2020. "High school admission reform in China: a welfare analysis," Review of Economic Design, Springer;Society for Economic Design, vol. 24(3), pages 215-269, December.
    14. Ha, Wei & Kang, Le & Song, Yang, 2020. "College matching mechanisms and matching stability: Evidence from a natural experiment in China," Journal of Economic Behavior & Organization, Elsevier, vol. 175(C), pages 206-226.
    15. Axel Ockenfels, 2009. "Marktdesign und Experimentelle Wirtschaftsforschung," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 10(s1), pages 31-53, May.
    16. Kojima, Fuhito, 2013. "Efficient resource allocation under multi-unit demand," Games and Economic Behavior, Elsevier, vol. 82(C), pages 1-14.
    17. Alvin E. Roth, 2009. "What Have We Learned from Market Design?," Innovation Policy and the Economy, University of Chicago Press, vol. 9(1), pages 79-112.
    18. Charness, Gary & Kuhn, Peter, 2011. "Lab Labor: What Can Labor Economists Learn from the Lab?," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 3, pages 229-330, Elsevier.
    19. Committee, Nobel Prize, 2020. "Improvements to auction theory and inventions of new auction formats," Nobel Prize in Economics documents 2020-2, Nobel Prize Committee.
    20. Justus Haucap, 2020. "Nobelpreis für Robert Wilson und Paul Milgrom: Zwei Ökonomen, die echte Märkte schufen [Nobel Prize for Robert Wilson and Paul Milgrom: Two Economists who Created Real Markets]," Wirtschaftsdienst, Springer;ZBW - Leibniz Information Centre for Economics, vol. 100(12), pages 969-975, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:68:y:2022:i:2:p:1107-1130. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.