IDEAS home Printed from https://ideas.repec.org/p/ris/ewikln/2018_003.html
   My bibliography  Save this paper

Multi-unit multiple bid auctions in balancing markets: an agent-based Q-learning approach

Author

Listed:
  • Viehmann, Johannes

    (Energiewirtschaftliches Institut an der Universitaet zu Koeln (EWI))

  • Lorenczik, Stefan

    (IEA)

  • Malischek, Raimund

    (IEA)

Abstract

There is an ongoing debate on the appropriate auction design for competitive electricity balancing markets. Uniform (UPA)and discriminatory price auctions (DPA), the prevalent designs in use today, are assumed to have different properties with regard to prices and effciencies. These properties cannot be thoroughly described using analytical methods due to the complex strategy space in repeated multi-unit multiple bid auctions. Therefore, using an agent-based Q-learning model, we simulate the strategic bidding behaviour in these auctions under a variety of market conditions. We find that UPAs lead to higher prices in all analysed market settings. This is mainly due to the fact that players engage in bid shading more aggressively. Moreover, small players in UPAs learn to free ride on the price setting of large players and learn higher profits per unit of capacity owned, while they are disadvantaged in DPAs. UPAs also generally feature higher effciencies, but there are exceptions to this observation. If demand is varying and players are provided with additional information about scarcity in the market, market prices increase only in case asymmetric players are present.

Suggested Citation

  • Viehmann, Johannes & Lorenczik, Stefan & Malischek, Raimund, 2018. "Multi-unit multiple bid auctions in balancing markets: an agent-based Q-learning approach," EWI Working Papers 2018-3, Energiewirtschaftliches Institut an der Universitaet zu Koeln (EWI).
  • Handle: RePEc:ris:ewikln:2018_003
    as

    Download full text from publisher

    File URL: https://www.ewi.uni-koeln.de/cms/wp-content/uploads/2018/12/EWI_WP_18-03_Multi-unit_multiple_bid_auctions_in_balancing_markets.pdf
    File Function: Full text
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Rassenti, Stephen J & Smith, Vernon L & Wilson, Bart J, 2003. "Discriminatory Price Auctions in Electricity Markets: Low Volatility at the Expense of High Price Levels," Journal of Regulatory Economics, Springer, vol. 23(2), pages 109-123, March.
    2. Natalia Fabra & Nils‐Henrik Fehr & David Harbord, 2006. "Designing electricity auctions," RAND Journal of Economics, RAND Corporation, vol. 37(1), pages 23-46, March.
    3. Kahn, Alfred E. & Cramton, Peter C. & Porter, Robert H. & Tabors, Richard D., 2001. "Uniform Pricing or Pay-as-Bid Pricing: A Dilemma for California and Beyond," The Electricity Journal, Elsevier, vol. 14(6), pages 70-79, July.
    4. John Geanakoplos & Robert Axtell & J. Doyne Farmer & Peter Howitt & Benjamin Conlee & Jonathan Goldstein & Matthew Hendrey & Nathan M. Palmer & Chun-Yi Yang, 2012. "Getting at Systemic Risk via an Agent-Based Model of the Housing Market," American Economic Review, American Economic Association, vol. 102(3), pages 53-58, May.
    5. Federico, Giulio & Rahman, David, 2003. "Bidding in an Electricity Pay-as-Bid Auction," Journal of Regulatory Economics, Springer, vol. 24(2), pages 175-211, September.
    6. Kutschinski, Erich & Uthmann, Thomas & Polani, Daniel, 2003. "Learning competitive pricing strategies by multi-agent reinforcement learning," Journal of Economic Dynamics and Control, Elsevier, vol. 27(11), pages 2207-2218.
    7. Heim, Sven & Götz, Georg, 2021. "Do Pay-As-Bid Auctions Favor Collusion? Evidence from Germany's market for reserve power," Energy Policy, Elsevier, vol. 155(C).
    8. William Vickrey, 1961. "Counterspeculation, Auctions, And Competitive Sealed Tenders," Journal of Finance, American Finance Association, vol. 16(1), pages 8-37, March.
    9. Bunn, Derek W. & Oliveira, Fernando S., 2007. "Agent-based analysis of technological diversification and specialization in electricity markets," European Journal of Operational Research, Elsevier, vol. 181(3), pages 1265-1278, September.
    10. Weidlich, Anke & Veit, Daniel, 2008. "A critical survey of agent-based wholesale electricity market models," Energy Economics, Elsevier, vol. 30(4), pages 1728-1759, July.
    11. Bower, John & Bunn, Derek, 2001. "Experimental analysis of the efficiency of uniform-price versus discriminatory auctions in the England and Wales electricity market," Journal of Economic Dynamics and Control, Elsevier, vol. 25(3-4), pages 561-592, March.
    12. Atakelty Hailu & Sophie Thoyer, 2007. "Designing Multi‐unit Multiple Bid Auctions: An Agent‐based Computational Model of Uniform, Discriminatory and Generalised Vickrey Auctions," The Economic Record, The Economic Society of Australia, vol. 83(s1), pages 57-72, September.
    13. Kutschinski, Erich & Uthmann, Thomas & Polani, Daniel, 2003. "Learning competitive pricing strategies by multi-agent reinforcement learning," Journal of Economic Dynamics and Control, Elsevier, vol. 27(11-12), pages 2207-2218, September.
    14. Kimbrough, Steven O. & Murphy, Frederic H., 2013. "Strategic bidding of offer curves: An agent-based approach to exploring supply curve equilibria," European Journal of Operational Research, Elsevier, vol. 229(1), pages 165-178.
    15. Waltman, Ludo & Kaymak, Uzay, 2008. "Q-learning agents in a Cournot oligopoly model," Journal of Economic Dynamics and Control, Elsevier, vol. 32(10), pages 3275-3293, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Viehmann, Johannes & Lorenczik, Stefan & Malischek, Raimund, 2021. "Multi-unit multiple bid auctions in balancing markets: An agent-based Q-learning approach," Energy Economics, Elsevier, vol. 93(C).
    2. Pär Holmberg, 2009. "Supply function equilibria of pay-as-bid auctions," Journal of Regulatory Economics, Springer, vol. 36(2), pages 154-177, October.
    3. Albert Banal-Estañol & Augusto Rupérez-Micola, 2010. "Are agent-based simulations robust? The wholesale electricity trading case," Economics Working Papers 1214, Department of Economics and Business, Universitat Pompeu Fabra.
    4. Zou, Xiaoyan, 2009. "Double-sided auction mechanism design in electricity based on maximizing social welfare," Energy Policy, Elsevier, vol. 37(11), pages 4231-4239, November.
    5. Azadeh, A. & Skandari, M.R. & Maleki-Shoja, B., 2010. "An integrated ant colony optimization approach to compare strategies of clearing market in electricity markets: Agent-based simulation," Energy Policy, Elsevier, vol. 38(10), pages 6307-6319, October.
    6. Balint, T. & Lamperti, F. & Mandel, A. & Napoletano, M. & Roventini, A. & Sapio, A., 2017. "Complexity and the Economics of Climate Change: A Survey and a Look Forward," Ecological Economics, Elsevier, vol. 138(C), pages 252-265.
    7. T. S. Genc, 2009. "Discriminatory Versus Uniform-Price Electricity Auctions with Supply Function Equilibrium," Journal of Optimization Theory and Applications, Springer, vol. 140(1), pages 9-31, January.
    8. Natalia Fabra & Nils‐Henrik Fehr & David Harbord, 2006. "Designing electricity auctions," RAND Journal of Economics, RAND Corporation, vol. 37(1), pages 23-46, March.
    9. Tong Zhang & B. Brorsen, 2011. "Oligopoly firms with quantity-price strategic decisions," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 6(2), pages 157-170, November.
    10. Holmberg, Pär, 2005. "Comparing Supply Function Equilibria of Pay-as-Bid and Uniform-Price Auctions," Working Paper Series 2005:17, Uppsala University, Department of Economics.
    11. Hästö, Peter & Holmberg, Pär, 2005. "Some Inequalities related to the analysis of electricity auctions," Working Paper Series 2005:23, Uppsala University, Department of Economics.
    12. Holmberg, Pär & Newbery, David, 2010. "The supply function equilibrium and its policy implications for wholesale electricity auctions," Utilities Policy, Elsevier, vol. 18(4), pages 209-226, December.
    13. Banal-Estañol, Albert & Rupérez Micola, Augusto, 2011. "Behavioural simulations in spot electricity markets," European Journal of Operational Research, Elsevier, vol. 214(1), pages 147-159, October.
    14. Tharakunnel, Kurian & Bhattacharyya, Siddhartha, 2009. "Single-leader-multiple-follower games with boundedly rational agents," Journal of Economic Dynamics and Control, Elsevier, vol. 33(8), pages 1593-1603, August.
    15. Heim, Sven & Götz, Georg, 2021. "Do Pay-As-Bid Auctions Favor Collusion? Evidence from Germany's market for reserve power," Energy Policy, Elsevier, vol. 155(C).
    16. Sebastian Just, 2011. "Appropriate contract durations in the German markets for on-line reserve capacity," Journal of Regulatory Economics, Springer, vol. 39(2), pages 194-220, April.
    17. Balint, T. & Lamperti, F. & Mandel, A. & Napoletano, M. & Roventini, A. & Sapio, A., 2017. "Complexity and the Economics of Climate Change: A Survey and a Look Forward," Ecological Economics, Elsevier, vol. 138(C), pages 252-265.
    18. Weidlich Anke & Veit Daniel, 2008. "Agent-Based Simulations for Electricity Market Regulation Advice: Procedures and an Example," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 228(2-3), pages 149-172, April.
    19. Khezr, Peyman & Nepal, Rabindra, 2021. "On the viability of energy-capacity markets under decreasing marginal costs," Energy Economics, Elsevier, vol. 96(C).
    20. Müller, Gernot & Rammerstorfer, Margarethe, 2008. "A theoretical analysis of procurement auctions for tertiary control in Germany," Energy Policy, Elsevier, vol. 36(7), pages 2620-2627, July.

    More about this item

    Keywords

    Agent-based computational economics; Auction design; Electricity markets;
    All these keywords.

    JEL classification:

    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques
    • D43 - Microeconomics - - Market Structure, Pricing, and Design - - - Oligopoly and Other Forms of Market Imperfection
    • D44 - Microeconomics - - Market Structure, Pricing, and Design - - - Auctions
    • L94 - Industrial Organization - - Industry Studies: Transportation and Utilities - - - Electric Utilities

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ris:ewikln:2018_003. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/ewikode.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sabine Williams (email available below). General contact details of provider: https://edirc.repec.org/data/ewikode.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.