IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2403.04057.html
   My bibliography  Save this paper

To Spend or to Gain: Online Learning in Repeated Karma Auctions

Author

Listed:
  • Damien Berriaud
  • Ezzat Elokda
  • Devansh Jalota
  • Emilio Frazzoli
  • Marco Pavone
  • Florian Dorfler

Abstract

Recent years have seen a surge of artificial currency-based mechanisms in contexts where monetary instruments are deemed unfair or inappropriate, e.g., in allocating food donations to food banks, course seats to students, and, more recently, even for traffic congestion management. Yet the applicability of these mechanisms remains limited in repeated auction settings, as it is challenging for users to learn how to bid an artificial currency that has no value outside the auctions. Indeed, users must jointly learn the value of the currency in addition to how to spend it optimally. In this work, we study the problem of learning to bid in two prominent classes of artificial currency auctions: those in which currency, which users spend to obtain public resources, is only issued at the beginning of a finite period; and those where, in addition to the initial currency endowment, currency payments are redistributed to users at each time step. In the latter class, the currency has been referred to as karma, since users do not only spend karma to obtain public resources but also gain karma for yielding them. In both classes, we propose a simple learning strategy, called adaptive karma pacing, and show that this strategy a) is asymptotically optimal for a single user bidding against competing bids drawn from a stationary distribution; b) leads to convergent learning dynamics when all users adopt it; and c) constitutes an approximate Nash equilibrium as the number of users grows. Our results require a novel analysis in comparison to adaptive pacing strategies in monetary auctions, since we depart from the classical assumption that the currency has known value outside the auctions, and moreover consider that the currency is both spent and gained in the class of auctions with redistribution.

Suggested Citation

  • Damien Berriaud & Ezzat Elokda & Devansh Jalota & Emilio Frazzoli & Marco Pavone & Florian Dorfler, 2024. "To Spend or to Gain: Online Learning in Repeated Karma Auctions," Papers 2403.04057, arXiv.org.
  • Handle: RePEc:arx:papers:2403.04057
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2403.04057
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Kevin W. S. Roberts, 1980. "Interpersonal Comparability and Social Choice Theory," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 47(2), pages 421-439.
    2. Tayfun Sönmez & M. Utku Ünver & M. Bumin Yenmez, 2020. "Incentivized Kidney Exchange," American Economic Review, American Economic Association, vol. 110(7), pages 2198-2224, July.
    3. Canice Prendergast, 2022. "The Allocation of Food to Food Banks," Journal of Political Economy, University of Chicago Press, vol. 130(8), pages 1993-2017.
    4. Eric Budish & Estelle Cantillon, 2012. "The Multi-unit Assignment Problem: Theory and Evidence from Course Allocation at Harvard," American Economic Review, American Economic Association, vol. 102(5), pages 2237-2271, August.
    5. Arnott, Richard & de Palma, Andre & Lindsey, Robin, 1990. "Economics of a bottleneck," Journal of Urban Economics, Elsevier, vol. 27(1), pages 111-130, January.
    6. Santiago R. Balseiro & Huseyin Gurkan & Peng Sun, 2019. "Multiagent Mechanism Design Without Money," Operations Research, INFORMS, vol. 67(5), pages 1417-1436, September.
    7. Kris Johnson & David Simchi-Levi & Peng Sun, 2014. "Analyzing Scrip Systems," Operations Research, INFORMS, vol. 62(3), pages 524-534, June.
    8. Santiago R. Balseiro & Omar Besbes & Gabriel Y. Weintraub, 2015. "Repeated Auctions with Budgets in Ad Exchanges: Approximations and Design," Management Science, INFORMS, vol. 61(4), pages 864-884, April.
    9. Gibbard, Allan, 1973. "Manipulation of Voting Schemes: A General Result," Econometrica, Econometric Society, vol. 41(4), pages 587-601, July.
    10. Santiago R. Balseiro & Yonatan Gur, 2019. "Learning in Repeated Auctions with Budgets: Regret Minimization and Equilibrium," Management Science, INFORMS, vol. 65(9), pages 3952-3968, September.
    11. Kim, Jaehong & Li, Mengling & Xu, Menghan, 2021. "Organ donation with vouchers," Journal of Economic Theory, Elsevier, vol. 191(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ezzat Elokda & Saverio Bolognani & Andrea Censi & Florian Dorfler & Emilio Frazzoli, 2022. "A self-contained karma economy for the dynamic allocation of common resources," Papers 2207.00495, arXiv.org, revised May 2023.
    2. Shivam Gupta & Wei Chen & Milind Dawande & Ganesh Janakiraman, 2023. "Three Years, Two Papers, One Course Off: Optimal Nonmonetary Reward Policies," Management Science, INFORMS, vol. 69(5), pages 2852-2869, May.
    3. Ezzat Elokda & Heinrich Nax & Saverio Bolognani & Florian Dorfler, 2024. "Karma: An Experimental Study," Papers 2404.02687, arXiv.org.
    4. Li, Mengling & Riyanto, Yohanes E. & Xu, Menghan, 2023. "Prioritized organ allocation rules under compatibility constraints," Games and Economic Behavior, Elsevier, vol. 141(C), pages 403-427.
    5. Diebold, Franz & Bichler, Martin, 2017. "Matching with indifferences: A comparison of algorithms in the context of course allocation," European Journal of Operational Research, Elsevier, vol. 260(1), pages 268-282.
    6. Marek Pycia & Peter Troyan, 2021. "A theory of simplicity in games and mechanism design," ECON - Working Papers 393, Department of Economics - University of Zurich.
    7. Monte, Daniel & Tumennasan, Norovsambuu, 2015. "Centralized allocation in multiple markets," Journal of Mathematical Economics, Elsevier, vol. 61(C), pages 74-85.
    8. Sönmez, Tayfun & Ünver, M. Utku & Yılmaz, Özgür, 2018. "How (not) to integrate blood subtyping technology to kidney exchange," Journal of Economic Theory, Elsevier, vol. 176(C), pages 193-231.
    9. Erdmann, Anett & Arilla, Ramón & Ponzoa, José M., 2022. "Search engine optimization: The long-term strategy of keyword choice," Journal of Business Research, Elsevier, vol. 144(C), pages 650-662.
    10. Vincent Conitzer & Christian Kroer & Debmalya Panigrahi & Okke Schrijvers & Nicolas E. Stier-Moses & Eric Sodomka & Christopher A. Wilkens, 2022. "Pacing Equilibrium in First Price Auction Markets," Management Science, INFORMS, vol. 68(12), pages 8515-8535, December.
    11. Shengwu Li, 2024. "Designing Simple Mechanisms," Papers 2403.18694, arXiv.org, revised Apr 2024.
    12. Mengzhou Zhuang & Eric (Er) Fang & Jongkuk Lee & Xiaoling Li, 2021. "The Effects of Price Rank on Clicks and Conversions in Product List Advertising on Online Retail Platforms," Information Systems Research, INFORMS, vol. 32(4), pages 1412-1430, December.
    13. Jacquillat, Alexandre & Vaze, Vikrant & Wang, Weilong, 2022. "Primary versus secondary infrastructure capacity allocation mechanisms," European Journal of Operational Research, Elsevier, vol. 303(2), pages 668-687.
    14. Hana Choi & Carl F. Mela & Santiago R. Balseiro & Adam Leary, 2020. "Online Display Advertising Markets: A Literature Review and Future Directions," Information Systems Research, INFORMS, vol. 31(2), pages 556-575, June.
    15. Zikun Ye & Dennis J. Zhang & Heng Zhang & Renyu Zhang & Xin Chen & Zhiwei Xu, 2023. "Cold Start to Improve Market Thickness on Online Advertising Platforms: Data-Driven Algorithms and Field Experiments," Management Science, INFORMS, vol. 69(7), pages 3838-3860, July.
    16. Zhaohua Chen & Mingwei Yang & Chang Wang & Jicheng Li & Zheng Cai & Yukun Ren & Zhihua Zhu & Xiaotie Deng, 2022. "Budget-Constrained Auctions with Unassured Priors: Strategic Equivalence and Structural Properties," Papers 2203.16816, arXiv.org, revised Feb 2024.
    17. Luofeng Liao & Christian Kroer, 2023. "Statistical Inference and A/B Testing for First-Price Pacing Equilibria," Papers 2301.02276, arXiv.org, revised Jun 2023.
    18. Itai Ashlagi & Alvin E. Roth, 2021. "Kidney Exchange: An Operations Perspective," Management Science, INFORMS, vol. 67(9), pages 5455-5478, September.
    19. Santiago Balseiro & Christian Kroer & Rachitesh Kumar, 2021. "Contextual Standard Auctions with Budgets: Revenue Equivalence and Efficiency Guarantees," Papers 2102.10476, arXiv.org, revised Oct 2022.
    20. Sandro Ambuehl & B. Douglas Bernheim, 2021. "Interpreting the Will of the People - A Positive Analysis of Ordinal Preference Aggregation," CESifo Working Paper Series 9317, CESifo.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2403.04057. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.