IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2211.14977.html
   My bibliography  Save this paper

QLAMMP: A Q-Learning Agent for Optimizing Fees on Automated Market Making Protocols

Author

Listed:
  • Dev Churiwala
  • Bhaskar Krishnamachari

Abstract

Automated Market Makers (AMMs) have cemented themselves as an integral part of the decentralized finance (DeFi) space. AMMs are a type of exchange that allows users to trade assets without the need for a centralized exchange. They form the foundation for numerous decentralized exchanges (DEXs), which help facilitate the quick and efficient exchange of on-chain tokens. All present-day popular DEXs are static protocols, with fixed parameters controlling the fee and the curvature - they suffer from invariance and cannot adapt to quickly changing market conditions. This characteristic may cause traders to stay away during high slippage conditions brought about by intractable market movements. We propose an RL framework to optimize the fees collected on an AMM protocol. In particular, we develop a Q-Learning Agent for Market Making Protocols (QLAMMP) that learns the optimal fee rates and leverage coefficients for a given AMM protocol and maximizes the expected fee collected under a range of different market conditions. We show that QLAMMP is consistently able to outperform its static counterparts under all the simulated test conditions.

Suggested Citation

  • Dev Churiwala & Bhaskar Krishnamachari, 2022. "QLAMMP: A Q-Learning Agent for Optimizing Fees on Automated Market Making Protocols," Papers 2211.14977, arXiv.org.
    • Handle: RePEc:arx:papers:2211.14977
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2211.14977
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Yongge Wang, 2020. "Automated Market Makers for Decentralized Finance (DeFi)," Papers 2009.01676, arXiv.org, revised Sep 2020.
    2. Guillermo Angeris & Tarun Chitra, 2020. "Improved Price Oracles: Constant Function Market Makers," Papers 2003.10001, arXiv.org, revised Jun 2020.
    3. Alex Evans & Guillermo Angeris & Tarun Chitra, 2021. "Optimal Fees for Geometric Mean Market Makers," Papers 2104.00446, arXiv.org.
    4. Vijay Mohan, 2022. "Automated market makers and decentralized exchanges: a DeFi primer," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 8(1), pages 1-48, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Daniel Kirste & Niclas Kannengie{ss}er & Ricky Lamberty & Ali Sunyaev, 2023. "How Automated Market Makers Approach the Thin Market Problem in Cryptoeconomic Systems," Papers 2309.12818, arXiv.org, revised Sep 2023.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Philippe Bergault & Louis Bertucci & David Bouba & Olivier Gu'eant, 2022. "Automated Market Makers: Mean-Variance Analysis of LPs Payoffs and Design of Pricing Functions," Papers 2212.00336, arXiv.org, revised Nov 2023.
    2. Daniel Kirste & Niclas Kannengie{ss}er & Ricky Lamberty & Ali Sunyaev, 2023. "How Automated Market Makers Approach the Thin Market Problem in Cryptoeconomic Systems," Papers 2309.12818, arXiv.org, revised Sep 2023.
    3. Arman Abgaryan & Utkarsh Sharma, 2023. "Dynamic Function Market Maker," Papers 2307.13624, arXiv.org.
    4. Matthias Nadler & Felix Bekemeier & Fabian Schar, 2022. "DeFi Risk Transfer: Towards A Fully Decentralized Insurance Protocol," Papers 2212.10308, arXiv.org.
    5. Raphael Auer & Bernhard Haslhofer & Stefan Kitzler & Pietro Saggese & Friedhelm Victor, 2023. "The Technology of Decentralized Finance (DeFi)," BIS Working Papers 1066, Bank for International Settlements.
    6. Guillermo Angeris & Alex Evans & Tarun Chitra, 2021. "Replicating Monotonic Payoffs Without Oracles," Papers 2111.13740, arXiv.org.
    7. Nassib Boueri, 2021. "G3M Impermanent Loss Dynamics," Papers 2108.06593, arXiv.org, revised Jun 2022.
    8. Nicola Cantarutti & Alex Harker & Carter Woetzel, 2023. "Silkswap: An asymmetric automated market maker model for stablecoins," Papers 2302.07822, arXiv.org.
    9. Guillermo Angeris & Alex Evans & Tarun Chitra, 2023. "Replicating market makers," Digital Finance, Springer, vol. 5(2), pages 367-387, June.
    10. Guillermo Angeris & Akshay Agrawal & Alex Evans & Tarun Chitra & Stephen Boyd, 2021. "Constant Function Market Makers: Multi-Asset Trades via Convex Optimization," Papers 2107.12484, arXiv.org.
    11. Lioba Heimbach & Eric Schertenleib & Roger Wattenhofer, 2022. "Risks and Returns of Uniswap V3 Liquidity Providers," Papers 2205.08904, arXiv.org, revised Sep 2022.
    12. Bhaskar Krishnamachari & Qi Feng & Eugenio Grippo, 2021. "Dynamic Curves for Decentralized Autonomous Cryptocurrency Exchanges," Papers 2101.02778, arXiv.org.
    13. Massimo Bartoletti & James Hsin-yu Chiang & Alberto Lluch-Lafuente, 2020. "SoK: Lending Pools in Decentralized Finance," Papers 2012.13230, arXiv.org.
    14. Zhimeng Yang & Ariah Klages-Mundt & Lewis Gudgeon, 2023. "Oracle Counterpoint: Relationships between On-chain and Off-chain Market Data," Papers 2303.16331, arXiv.org, revised Jul 2023.
    15. Eduard Hartwich & Alexander Rieger & Johannes Sedlmeir & Dominik Jurek & Gilbert Fridgen, 2023. "Machine economies," Electronic Markets, Springer;IIM University of St. Gallen, vol. 33(1), pages 1-13, December.
    16. Erdong Chen & Mengzhong Ma & Zixin Nie, 2024. "Exploring the Impact: How Decentralized Exchange Designs Shape Traders' Behavior on Perpetual Future Contracts," Papers 2402.03953, arXiv.org, revised Apr 2024.
    17. Maxim Bichuch & Zachary Feinstein, 2022. "Axioms for Automated Market Makers: A Mathematical Framework in FinTech and Decentralized Finance," Papers 2210.01227, arXiv.org, revised Aug 2023.
    18. Sam M. Werner & Daniel Perez & Lewis Gudgeon & Ariah Klages-Mundt & Dominik Harz & William J. Knottenbelt, 2021. "SoK: Decentralized Finance (DeFi)," Papers 2101.08778, arXiv.org, revised Sep 2022.
    19. Tarun Chitra & Alex Evans, 2020. "Why Stake When You Can Borrow?," Papers 2006.11156, arXiv.org.
    20. Tristan Lim, 2022. "Predictive Crypto-Asset Automated Market Making Architecture for Decentralized Finance using Deep Reinforcement Learning," Papers 2211.01346, arXiv.org, revised Jan 2023.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2211.14977. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.