IDEAS home Printed from https://ideas.repec.org/p/cwl/cwldpp/2418r2.html

Data-Driven Mechanism Design: Jointly Eliciting Preferences and Information

Author

Listed:
  • Dirk Bergemann

    (Yale University)

  • Marek Bojko

    (Yale University)

  • Paul DŸtting

    (Google Research)

  • Renato Paes Leme

    (Google Research)

  • Haifeng Xu

    (University of Chicago and Google Research)

  • Song Zuo

    (Google Research)

Abstract

We study mechanism design in environments where agents have private preferences and private information about a common payoff-relevant state. In such settings with multi-dimensional types, standard mechanisms fail to implement efficient allocations. We address this limitation by proposing data-driven mechanisms that condition transfers on additional post-allocation information, modeled as an estimator of the payoff-relevant state. Our mechanisms extend the classic Vickrey-Clarke-Groves framework. We show they achieve exact implementation in posterior equilibrium when the state is fully revealed or utilities are affine in an unbiased estimator. With a consistent estimator, they achieve approximate implementation that converges to exact implementation as the estimator converges, and we provide bounds on the convergence rate. We demonstrate applications to digital advertising auctions and AI shopping assistants, where user engagement naturally reveals relevant information, and to procurement auctions with consumer spot markets, where additional information arises from a pricing game played by the same agents.

Suggested Citation

  • Dirk Bergemann & Marek Bojko & Paul DŸtting & Renato Paes Leme & Haifeng Xu & Song Zuo, 2025. "Data-Driven Mechanism Design: Jointly Eliciting Preferences and Information," Cowles Foundation Discussion Papers 2418R2, Cowles Foundation for Research in Economics, Yale University.
  • Handle: RePEc:cwl:cwldpp:2418r2
    as

    Download full text from publisher

    File URL: https://cowles.yale.edu/sites/default/files/2026-01/d2418r2_0.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Liang, Annie & Madsen, Erik, 2024. "Data and incentives," Theoretical Economics, Econometric Society, vol. 19(1), January.
    2. Gentzkow, Matthew & Kamenica, Emir, 2017. "Bayesian persuasion with multiple senders and rich signal spaces," Games and Economic Behavior, Elsevier, vol. 104(C), pages 411-429.
    3. Richard McLean & Andrew Postlewaite, 2004. "Informational Size and Efficient Auctions," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 71(3), pages 809-827.
    4. Jay Lu, 2019. "Bayesian Identification: A Theory for State-Dependent Utilities," American Economic Review, American Economic Association, vol. 109(9), pages 3192-3228, September.
    5. Philippe Jehiel & Benny Moldovanu, 2005. "Allocative and Informational Externalities in Auctions and Related Mechanisms," Levine's Bibliography 784828000000000490, UCLA Department of Economics.
    6. Benjamin Edelman & Michael Ostrovsky & Michael Schwarz, 2007. "Internet Advertising and the Generalized Second-Price Auction: Selling Billions of Dollars Worth of Keywords," American Economic Review, American Economic Association, vol. 97(1), pages 242-259, March.
    7. Dirk Bergemann & Stephen Morris, 2012. "Robust Mechanism Design," World Scientific Book Chapters, in: Robust Mechanism Design The Role of Private Information and Higher Order Beliefs, chapter 2, pages 49-96, World Scientific Publishing Co. Pte. Ltd..
    8. Green, Jerry R & Laffont, Jean-Jacques, 1987. "Posterior Implementability in a Two-Person Decision Problem," Econometrica, Econometric Society, vol. 55(1), pages 69-94, January.
    9. Milgrom, Paul R & Weber, Robert J, 1982. "A Theory of Auctions and Competitive Bidding," Econometrica, Econometric Society, vol. 50(5), pages 1089-1122, September.
    10. Green, Jerry & Laffont, Jean-Jacques, 1977. "On the revelation of preferences for public goods," Journal of Public Economics, Elsevier, vol. 8(1), pages 79-93, August.
    11. Jehiel, Philippe & Meyer-ter-Vehn, Moritz & Moldovanu, Benny & Zame, William R., 2007. "Posterior implementation vs ex-post implementation," Economics Letters, Elsevier, vol. 97(1), pages 70-73, October.
    12. Philippe Jehiel & Moritz Meyer-ter-Vehn & Benny Moldovanu & William R. Zame, 2006. "The Limits of ex post Implementation," Econometrica, Econometric Society, vol. 74(3), pages 585-610, May.
    13. Green, Jerry & Laffont, Jean-Jacques, 1977. "Characterization of Satisfactory Mechanisms for the Revelation of Preferences for Public Goods," Econometrica, Econometric Society, vol. 45(2), pages 427-438, March.
    14. Hansen, Robert G, 1985. "Auctions with Contingent Payments," American Economic Review, American Economic Association, vol. 75(4), pages 862-865, September.
    15. Paul Dütting & Felix Fischer & David C. Parkes, 2019. "Expressiveness and Robustness of First-Price Position Auctions," Mathematics of Operations Research, INFORMS, vol. 44(1), pages 196-211, February.
    16. William Vickrey, 1961. "Counterspeculation, Auctions, And Competitive Sealed Tenders," Journal of Finance, American Finance Association, vol. 16(1), pages 8-37, March.
    17. Hal R. Varian & Christopher Harris, 2014. "The VCG Auction in Theory and Practice," American Economic Review, American Economic Association, vol. 104(5), pages 442-445, May.
    18. Matsushima, Hitoshi & Miyazaki, Koichi & Yagi, Nobuyuki, 2010. "Role of linking mechanisms in multitask agency with hidden information," Journal of Economic Theory, Elsevier, vol. 145(6), pages 2241-2259, November.
    19. Zhaowei She & Turgay Ayer & Daniel Montanera, 2022. "Can Big Data Cure Risk Selection in Healthcare Capitation Program? A Game Theoretical Analysis," Manufacturing & Service Operations Management, INFORMS, vol. 24(6), pages 3117-3134, November.
    20. Neeman, Zvika, 2004. "The relevance of private information in mechanism design," Journal of Economic Theory, Elsevier, vol. 117(1), pages 55-77, July.
    21. Riordan, Michael H. & Sappington, David E. M., 1988. "Optimal contracts with public ex post information," Journal of Economic Theory, Elsevier, vol. 45(1), pages 189-199, June.
    22. Berry, Steven & Levinsohn, James & Pakes, Ariel, 1995. "Automobile Prices in Market Equilibrium," Econometrica, Econometric Society, vol. 63(4), pages 841-890, July.
    23. Paul Dütting & Felix Fischer & David C. Parkes, 2024. "Nontruthful Position Auctions Are More Robust to Misspecification," Mathematics of Operations Research, INFORMS, vol. 49(2), pages 901-927, May.
    24. , & ,, 2015. "Implementation with interdependent valuations," Theoretical Economics, Econometric Society, vol. 10(3), September.
    25. Laffont, Jean-Jacques & Tirole, Jean, 1986. "Using Cost Observation to Regulate Firms," Journal of Political Economy, University of Chicago Press, vol. 94(3), pages 614-641, June.
    26. Caragiannis, Ioannis & Kaklamanis, Christos & Kanellopoulos, Panagiotis & Kyropoulou, Maria & Lucier, Brendan & Paes Leme, Renato & Tardos, Éva, 2015. "Bounding the inefficiency of outcomes in generalized second price auctions," Journal of Economic Theory, Elsevier, vol. 156(C), pages 343-388.
    27. Dirk Bergemann & Juuso V‰lim‰ki, 2010. "The Dynamic Pivot Mechanism," Econometrica, Econometric Society, vol. 78(2), pages 771-789, March.
    28. McLean, Richard P. & Postlewaite, Andrew, 2017. "A dynamic non-direct implementation mechanism for interdependent value problems," Games and Economic Behavior, Elsevier, vol. 101(C), pages 34-48.
    29. Matthew O Jackson & Hugo F Sonnenschein, 2007. "Overcoming Incentive Constraints by Linking Decisions -super-1," Econometrica, Econometric Society, vol. 75(1), pages 241-257, January.
    30. Braverman, Mark & Chassang, Sylvain, 2022. "Data-driven incentive alignment in capitation schemes," Journal of Public Economics, Elsevier, vol. 207(C).
    31. Jerry R. Green & Nancy L. Stokey, 2022. "Two representations of information structures and their comparisons," Decisions in Economics and Finance, Springer;Associazione per la Matematica, vol. 45(2), pages 541-547, December.
    32. Laffont, Jean-Jacques & Tirole, Jean, 1987. "Auctioning Incentive Contracts," Journal of Political Economy, University of Chicago Press, vol. 95(5), pages 921-937, October.
    33. Dütting, Paul & Fischer, Felix & Parkes, David C., 2019. "Expressiveness and robustness of first-price position auctions," LSE Research Online Documents on Economics 85877, London School of Economics and Political Science, LSE Library.
    34. Edward Clarke, 1971. "Multipart pricing of public goods," Public Choice, Springer, vol. 11(1), pages 17-33, September.
    35. Moulin, H., 1986. "Characterizations of the pivotal mechanism," Journal of Public Economics, Elsevier, vol. 31(1), pages 53-78, October.
    36. Cremer, Jacques & McLean, Richard P, 1988. "Full Extraction of the Surplus in Bayesian and Dominant Strategy Auctions," Econometrica, Econometric Society, vol. 56(6), pages 1247-1257, November.
    37. Steven T. Berry, 1994. "Estimating Discrete-Choice Models of Product Differentiation," RAND Journal of Economics, The RAND Corporation, vol. 25(2), pages 242-262, Summer.
    38. Dirk Bergemann & Juuso Valimaki, 2002. "Information Acquisition and Efficient Mechanism Design," Econometrica, Econometric Society, vol. 70(3), pages 1007-1033, May.
    39. Groves, Theodore, 1973. "Incentives in Teams," Econometrica, Econometric Society, vol. 41(4), pages 617-631, July.
    40. McAfee, R Preston & Reny, Philip J, 1992. "Correlated Information and Mechanism Design," Econometrica, Econometric Society, vol. 60(2), pages 395-421, March.
    41. Richard McLean & Andrew Postlewaite, 2002. "Informational Size and Incentive Compatibility," Econometrica, Econometric Society, vol. 70(6), pages 2421-2453, November.
    42. Claudio Mezzetti, 2004. "Mechanism Design with Interdependent Valuations: Efficiency," Econometrica, Econometric Society, vol. 72(5), pages 1617-1626, September.
    43. Susan Athey & Ilya Segal, 2013. "An Efficient Dynamic Mechanism," Econometrica, Econometric Society, vol. 81(6), pages 2463-2485, November.
    44. Klemperer, Paul, 1998. "Auctions with almost common values: The 'Wallet Game' and its applications," European Economic Review, Elsevier, vol. 42(3-5), pages 757-769, May.
    45. Choi, Jaewon & Kim, Taesung, 1999. "A Nonparametric, Efficient Public Good Decision Mechanism: Undominated Bayesian Implementation," Games and Economic Behavior, Elsevier, vol. 27(1), pages 64-85, April.
    46. Jehiel, Philippe & Moldovanu, Benny, 2001. "Efficient Design with Interdependent Valuations," Econometrica, Econometric Society, vol. 69(5), pages 1237-1259, September.
    47. Milgrom, Paul, 2010. "Simplified mechanisms with an application to sponsored-search auctions," Games and Economic Behavior, Elsevier, vol. 70(1), pages 62-70, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. is not listed on IDEAS
    2. Bergemann, Dirk & Bonatti, Alessandro & Wu, Nicholas, 2025. "Bidding with budgets: Data-driven bid algorithms in digital advertising," International Journal of Industrial Organization, Elsevier, vol. 102(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liu, Heng, 2018. "Efficient dynamic mechanisms in environments with interdependent valuations: the role of contingent transfers," Theoretical Economics, Econometric Society, vol. 13(2), May.
    2. Philippe Jehiel & Benny Moldovanu, 2005. "Allocative and Informational Externalities in Auctions and Related Mechanisms," Levine's Bibliography 784828000000000490, UCLA Department of Economics.
    3. Miller, Nolan H. & Pratt, John W. & Zeckhauser, Richard J. & Johnson, Scott, 2007. "Mechanism design with multidimensional, continuous types and interdependent valuations," Journal of Economic Theory, Elsevier, vol. 136(1), pages 476-496, September.
    4. Matsushima, Hitoshi & Noda, Shunya, 2023. "Mechanism design with general ex-ante investments," Journal of Mathematical Economics, Elsevier, vol. 106(C).
    5. Hitoshi Matsushima & Shunya Noda, 2019. "Mechanism Design with General Ex-Ante Investments (Revised version of F415 )," CARF F-Series CARF-F-464, Center for Advanced Research in Finance, Faculty of Economics, The University of Tokyo.
    6. , & ,, 2015. "Implementation with interdependent valuations," Theoretical Economics, Econometric Society, vol. 10(3), September.
    7. Guo, Huiyi, 2019. "Mechanism design with ambiguous transfers: An analysis in finite dimensional naive type spaces," Journal of Economic Theory, Elsevier, vol. 183(C), pages 76-105.
    8. Johnson, Scott & Miller, Nolan & Pratt, John W. & Zeckhauser, Richard, 2003. "Efficient Design with Multidimensional, Continuous Types, and Interdependent Valuations," Working Paper Series rwp03-020, Harvard University, John F. Kennedy School of Government.
    9. Song, Yangwei, 2018. "Efficient implementation with interdependent valuations and maxmin agents," Journal of Economic Theory, Elsevier, vol. 176(C), pages 693-726.
    10. Song, Yangwei, 2018. "Efficient Implementation with Interdependent Valuations and Maxmin Agents," Rationality and Competition Discussion Paper Series 92, CRC TRR 190 Rationality and Competition.
    11. Aristotelis Boukouras & Kostas Koufopoulos, 2017. "Efficient allocations in economies with asymmetric information when the realized frequency of types is common knowledge," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 64(1), pages 75-98, June.
    12. Aristotelis Boukouras & Kostas Koufopoulos, 2015. "Efficient Allocations in Economies with Asymmetric Information when the Realized Frequency of Types is Common Knowledge," Discussion Papers in Economics 15/04, Division of Economics, School of Business, University of Leicester.
    13. Obara Ichiro, 2008. "The Full Surplus Extraction Theorem with Hidden Actions," The B.E. Journal of Theoretical Economics, De Gruyter, vol. 8(1), pages 1-28, March.
    14. He, Wei & Li, Jiangtao, 2016. "Efficient dynamic mechanisms with interdependent valuations," Games and Economic Behavior, Elsevier, vol. 97(C), pages 166-173.
    15. Paul Milgrom, 2011. "Critical Issues In The Practice Of Market Design," Economic Inquiry, Western Economic Association International, vol. 49(2), pages 311-320, April.
    16. Sushil Bikhchandani & Ichiro Obara, 2017. "Mechanism design with information acquisition," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 63(3), pages 783-812, March.
    17. Swaprava Nath & Onno Zoeter & Y. Narahari & Christopher Dance, 2015. "Dynamic mechanism design with interdependent valuations," Review of Economic Design, Springer;Society for Economic Design, vol. 19(3), pages 211-228, September.
    18. Jehiel, Philippe & Meyer-ter-Vehn, Moritz & Moldovanu, Benny, 2012. "Locally robust implementation and its limits," Journal of Economic Theory, Elsevier, vol. 147(6), pages 2439-2452.
    19. Bergemann, Dirk & Pavan, Alessandro, 2015. "Introduction to Symposium on Dynamic Contracts and Mechanism Design," Journal of Economic Theory, Elsevier, vol. 159(PB), pages 679-701.
    20. Kosenok, Grigory & Severinov, Sergei, 2008. "Individually rational, budget-balanced mechanisms and allocation of surplus," Journal of Economic Theory, Elsevier, vol. 140(1), pages 126-161, May.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cwl:cwldpp:2418r2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Brittany Ladd (email available below). General contact details of provider: https://edirc.repec.org/data/cowleus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.