IDEAS home Printed from https://ideas.repec.org/p/upf/upfgen/1214.html
   My bibliography  Save this paper

Are agent-based simulations robust? The wholesale electricity trading case

Author

Abstract

Agent-based computational economics is becoming widely used in practice. This paper explores the consistency of some of its standard techniques. We focus in particular on prevailing wholesale electricity trading simulation methods. We include different supply and demand representations and propose the Experience-Weighted Attractions method to include several behavioural algorithms. We compare the results across assumptions and to economic theory predictions. The match is good under best-response and reinforcement learning but not under fictitious play. The simulations perform well under flat and upward-slopping supply bidding, and also for plausible demand elasticity assumptions. Learning is influenced by the number of bids per plant and the initial conditions. The overall conclusion is that agent-based simulation assumptions are far from innocuous. We link their performance to underlying features, and identify those that are better suited to model wholesale electricity markets.

Suggested Citation

  • Albert Banal-Estañol & Augusto Rupérez-Micola, 2010. "Are agent-based simulations robust? The wholesale electricity trading case," Economics Working Papers 1214, Department of Economics and Business, Universitat Pompeu Fabra.
  • Handle: RePEc:upf:upfgen:1214
    as

    Download full text from publisher

    File URL: https://econ-papers.upf.edu/papers/1214.pdf
    File Function: Whole Paper
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Natalia Fabra & Nils‐Henrik Fehr & David Harbord, 2006. "Designing electricity auctions," RAND Journal of Economics, RAND Corporation, vol. 37(1), pages 23-46, March.
    2. Junjie Sun & Leigh Tesfatsion, 2007. "Dynamic Testing of Wholesale Power Market Designs: An Open-Source Agent-Based Framework," Computational Economics, Springer;Society for Computational Economics, vol. 30(3), pages 291-327, October.
    3. repec:rje:randje:v:37:y:2006:1:p:23-46 is not listed on IDEAS
    4. Li, Hongyan & Sun, Junjie & Tesfatsion, Leigh S., 2009. "Separation and Volatility of Locational Marginal Prices in Restructured Wholesale Power Markets," Staff General Research Papers Archive 13075, Iowa State University, Department of Economics.
    5. Jan W. Rivkin & Nicolaj Siggelkow, 2003. "Balancing Search and Stability: Interdependencies Among Elements of Organizational Design," Management Science, INFORMS, vol. 49(3), pages 290-311, March.
    6. Sebastien Pouget, 2007. "Adaptive Traders and the Design of Financial Markets," Journal of Finance, American Finance Association, vol. 62(6), pages 2835-2863, December.
    7. G. Fagiolo & C. Birchenhall & P. Windrum, 2007. "Empirical Validation in Agent-based Models: Introduction to the Special Issue," Computational Economics, Springer;Society for Computational Economics, vol. 30(3), pages 189-194, October.
    8. Erev, Ido & Roth, Alvin E, 1998. "Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria," American Economic Review, American Economic Association, vol. 88(4), pages 848-881, September.
    9. Alvin E. Roth & Tayfun Sönmez & M. Utku Ünver, 2004. "Kidney Exchange," The Quarterly Journal of Economics, Oxford University Press, vol. 119(2), pages 457-488.
    10. Bunn, Derek W. & Oliveira, Fernando S., 2007. "Agent-based analysis of technological diversification and specialization in electricity markets," European Journal of Operational Research, Elsevier, vol. 181(3), pages 1265-1278, September.
    11. Van Huyck, John B & Battalio, Raymond C & Beil, Richard O, 1990. "Tacit Coordination Games, Strategic Uncertainty, and Coordination Failure," American Economic Review, American Economic Association, vol. 80(1), pages 234-248, March.
    12. Matteo Richiardi & Roberto Leombruni & Nicole J. Saam & Michele Sonnessa, 2006. "A Common Protocol for Agent-Based Social Simulation," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 9(1), pages 1-15.
    13. Bunn, Derek W. & Martoccia, Maria, 2005. "Unilateral and collusive market power in the electricity pool of England and Wales," Energy Economics, Elsevier, vol. 27(2), pages 305-315, March.
    14. Day, Christopher J & Bunn, Derek W, 2001. "Divestiture of Generation Assets in the Electricity Pool of England and Wales: A Computational Approach to Analyzing Market Power," Journal of Regulatory Economics, Springer, vol. 19(2), pages 123-141, March.
    15. Paul J. J. Welfens & Christian Richter & Holger C. Wolf, 2019. "Transitions," International Economics and Economic Policy, Springer, vol. 16(4), pages 563-564, October.
    16. Derek Bunn & Fernando Oliveira, 2003. "Evaluating Individual Market Power in Electricity Markets via Agent-Based Simulation," Annals of Operations Research, Springer, vol. 121(1), pages 57-77, July.
    17. James Nicolaisen & Valentin Petrov & Leigh Tesfatsion, 2000. "Market Power and Efficiency in a Computational Electricity Market with Discriminatory Double-Auction Pricing," Computational Economics 0004005, University Library of Munich, Germany.
    18. Roth, Alvin E. & Erev, Ido, 1995. "Learning in extensive-form games: Experimental data and simple dynamic models in the intermediate term," Games and Economic Behavior, Elsevier, vol. 8(1), pages 164-212.
    19. Par Holmberg, 2007. "Supply Function Equilibrium with Asymmetric Capacities and Constant Marginal Costs," The Energy Journal, International Association for Energy Economics, vol. 0(Number 2), pages 55-82.
    20. Marks, Robert, 2006. "Market Design Using Agent-Based Models," Handbook of Computational Economics, in: Leigh Tesfatsion & Kenneth L. Judd (ed.), Handbook of Computational Economics, edition 1, volume 2, chapter 27, pages 1339-1380, Elsevier.
    21. Crawford, Gregory S. & Crespo, Joseph & Tauchen, Helen, 2007. "Bidding asymmetries in multi-unit auctions: Implications of bid function equilibria in the British spot market for electricity," International Journal of Industrial Organization, Elsevier, vol. 25(6), pages 1233-1268, December.
    22. Weidlich, Anke & Veit, Daniel, 2008. "A critical survey of agent-based wholesale electricity market models," Energy Economics, Elsevier, vol. 30(4), pages 1728-1759, July.
    23. Bower, John & Bunn, Derek, 2001. "Experimental analysis of the efficiency of uniform-price versus discriminatory auctions in the England and Wales electricity market," Journal of Economic Dynamics and Control, Elsevier, vol. 25(3-4), pages 561-592, March.
    24. Tesfatsion, Leigh & Judd, Kenneth L., 2006. "Handbook of Computational Economics, Vol. 2: Agent-Based Computational Economics," Staff General Research Papers Archive 10368, Iowa State University, Department of Economics.
    25. Colin Camerer & Teck-Hua Ho, 1999. "Experience-weighted Attraction Learning in Normal Form Games," Econometrica, Econometric Society, vol. 67(4), pages 827-874, July.
    26. Michael H. Rothkopf & Aleksandar Pekev{c} & Ronald M. Harstad, 1998. "Computationally Manageable Combinational Auctions," Management Science, INFORMS, vol. 44(8), pages 1131-1147, August.
    27. Bolle, Friedel, 1992. "Supply function equilibria and the danger of tacit collusion : The case of spot markets for electricity," Energy Economics, Elsevier, vol. 14(2), pages 94-102, April.
    28. Rothkopf, Michael H., 2002. "Control of Market Power in Electricity Auctions," The Electricity Journal, Elsevier, vol. 15(8), pages 15-24, October.
    29. Midgley, David & Marks, Robert & Kunchamwar, Dinesh, 2007. "Building and assurance of agent-based models: An example and challenge to the field," Journal of Business Research, Elsevier, vol. 60(8), pages 884-893, August.
    30. von der Fehr, Nils-Henrik Morch & Harbord, David, 1993. "Spot Market Competition in the UK Electricity Industry," Economic Journal, Royal Economic Society, vol. 103(418), pages 531-546, May.
    31. Thomas H. Noe & Michael J. Rebello & Jun Wang, 2003. "Corporate Financing: An Artificial Agent‐based Analysis," Journal of Finance, American Finance Association, vol. 58(3), pages 943-973, June.
    32. Holmberg, Par, 2008. "Unique supply function equilibrium with capacity constraints," Energy Economics, Elsevier, vol. 30(1), pages 148-172, January.
    33. Ido Erev & Alvin Roth & Robert Slonim & Greg Barron, 2007. "Learning and equilibrium as useful approximations: Accuracy of prediction on randomly selected constant sum games," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 33(1), pages 29-51, October.
    34. Jerker Denrell, 2004. "Random Walks and Sustained Competitive Advantage," Management Science, INFORMS, vol. 50(7), pages 922-934, July.
    35. Alvin E. Roth, 2002. "The Economist as Engineer: Game Theory, Experimentation, and Computation as Tools for Design Economics," Econometrica, Econometric Society, vol. 70(4), pages 1341-1378, July.
    36. Micola, Augusto Rupérez & Banal-Estañol, Albert & Bunn, Derek W., 2008. "Incentives and coordination in vertically related energy markets," Journal of Economic Behavior & Organization, Elsevier, vol. 67(2), pages 381-393, August.
    37. Green, Richard J & Newbery, David M, 1992. "Competition in the British Electricity Spot Market," Journal of Political Economy, University of Chicago Press, vol. 100(5), pages 929-953, October.
    38. Brenner, Thomas, 2006. "Agent Learning Representation: Advice on Modelling Economic Learning," Handbook of Computational Economics, in: Leigh Tesfatsion & Kenneth L. Judd (ed.), Handbook of Computational Economics, edition 1, volume 2, chapter 18, pages 895-947, Elsevier.
    39. John Bower & Derek W. Bunn, 2000. "Model-Based Comparisons of Pool and Bilateral Markets for Electricity," The Energy Journal, International Association for Energy Economics, vol. 0(Number 3), pages 1-29.
    40. Duffy, John, 2006. "Agent-Based Models and Human Subject Experiments," Handbook of Computational Economics, in: Leigh Tesfatsion & Kenneth L. Judd (ed.), Handbook of Computational Economics, edition 1, volume 2, chapter 19, pages 949-1011, Elsevier.
    41. Robert Marks, 2007. "Validating Simulation Models: A General Framework and Four Applied Examples," Computational Economics, Springer;Society for Computational Economics, vol. 30(3), pages 265-290, October.
    42. Bushnell, James & Wolfram, Catherine, 2008. "Electricity Markets," Staff General Research Papers Archive 31547, Iowa State University, Department of Economics.
    43. Bunn, Derek W. & Day, Christopher J., 2009. "Computational modelling of price formation in the electricity pool of England and Wales," Journal of Economic Dynamics and Control, Elsevier, vol. 33(2), pages 363-376, February.
    44. Ron Adner & Daniel Levinthal, 2001. "Demand Heterogeneity and Technology Evolution: Implications for Product and Process Innovation," Management Science, INFORMS, vol. 47(5), pages 611-628, May.
    45. Fama, Eugene F & MacBeth, James D, 1973. "Risk, Return, and Equilibrium: Empirical Tests," Journal of Political Economy, University of Chicago Press, vol. 81(3), pages 607-636, May-June.
    46. Klemperer, Paul D & Meyer, Margaret A, 1989. "Supply Function Equilibria in Oligopoly under Uncertainty," Econometrica, Econometric Society, vol. 57(6), pages 1243-1277, November.
    47. Blumsack, Seth & Perekhodtsev, Dmitri & Lave, Lester B., 2002. "Market Power in Deregulated Wholesale Electricity Markets: Issues in Measurement and the Cost of Mitigation," The Electricity Journal, Elsevier, vol. 15(9), pages 11-24, November.
    48. Bower, John & Bunn, Derek W. & Wattendrup, Claus, 2001. "A model-based analysis of strategic consolidation in the German electricity industry," Energy Policy, Elsevier, vol. 29(12), pages 987-1005, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Richstein, Jörn C. & Chappin, Emile J.L. & de Vries, Laurens J., 2014. "Cross-border electricity market effects due to price caps in an emission trading system: An agent-based approach," Energy Policy, Elsevier, vol. 71(C), pages 139-158.
    2. Khan, Agha Salman M. & Verzijlbergh, Remco A. & Sakinci, Ozgur Can & De Vries, Laurens J., 2018. "How do demand response and electrical energy storage affect (the need for) a capacity market?," Applied Energy, Elsevier, vol. 214(C), pages 39-62.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Banal-Estañol, Albert & Rupérez Micola, Augusto, 2011. "Behavioural simulations in spot electricity markets," European Journal of Operational Research, Elsevier, vol. 214(1), pages 147-159, October.
    2. Albert Banal-Estañol & Augusto Rupérez Micola, 2009. "Composition of Electricity Generation Portfolios, Pivotal Dynamics, and Market Prices," Management Science, INFORMS, vol. 55(11), pages 1813-1831, November.
    3. Weidlich, Anke & Veit, Daniel, 2008. "A critical survey of agent-based wholesale electricity market models," Energy Economics, Elsevier, vol. 30(4), pages 1728-1759, July.
    4. Gaivoronskaia, E. & Tsyplakov, A., 2018. "Using a Modified Erev-Roth Algorithm in an Agent-Based Electricity Market Model," Journal of the New Economic Association, New Economic Association, vol. 39(3), pages 55-83.
    5. Sensfuß, Frank & Ragwitz, Mario & Genoese, Massimo & Möst, Dominik, 2007. "Agent-based simulation of electricity markets: a literature review," Working Papers "Sustainability and Innovation" S5/2007, Fraunhofer Institute for Systems and Innovation Research (ISI).
    6. Weidlich Anke & Veit Daniel, 2008. "Agent-Based Simulations for Electricity Market Regulation Advice: Procedures and an Example," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 228(2-3), pages 149-172, April.
    7. Bolle, Friedel & Grimm, Veronika & Ockenfels, Axel & del Pozo, Xavier, 2013. "An experiment on supply function competition," European Economic Review, Elsevier, vol. 63(C), pages 170-185.
    8. Balint, T. & Lamperti, F. & Mandel, A. & Napoletano, M. & Roventini, A. & Sapio, A., 2017. "Complexity and the Economics of Climate Change: A Survey and a Look Forward," Ecological Economics, Elsevier, vol. 138(C), pages 252-265.
    9. Chen, Shu-Heng, 2012. "Varieties of agents in agent-based computational economics: A historical and an interdisciplinary perspective," Journal of Economic Dynamics and Control, Elsevier, vol. 36(1), pages 1-25.
    10. Holmberg, Pär, 2009. "Numerical calculation of an asymmetric supply function equilibrium with capacity constraints," European Journal of Operational Research, Elsevier, vol. 199(1), pages 285-295, November.
    11. Sarıca, Kemal & Kumbaroğlu, Gürkan & Or, Ilhan, 2012. "Modeling and analysis of a decentralized electricity market: An integrated simulation/optimization approach," Energy, Elsevier, vol. 44(1), pages 830-852.
    12. Balint, T. & Lamperti, F. & Mandel, A. & Napoletano, M. & Roventini, A. & Sapio, A., 2017. "Complexity and the Economics of Climate Change: A Survey and a Look Forward," Ecological Economics, Elsevier, vol. 138(C), pages 252-265.
    13. de Frutos, Maria-Angeles & Fabra, Natalia, 2008. "On the Impact of Forward Contract Obligations in Multi-Unit Auctions," CEPR Discussion Papers 6756, C.E.P.R. Discussion Papers.
    14. Joseph Mullins & Liam Wagner & John Foster, 2010. "Price Spikes in Electricity Markets: A Strategic Perspective," Energy Economics and Management Group Working Papers 05, School of Economics, University of Queensland, Australia.
    15. Anderson, Edward & Holmberg, Pär, 2018. "Price instability in multi-unit auctions," Journal of Economic Theory, Elsevier, vol. 175(C), pages 318-341.
    16. Pär Holmberg, 2009. "Supply function equilibria of pay-as-bid auctions," Journal of Regulatory Economics, Springer, vol. 36(2), pages 154-177, October.
    17. E. J. Anderson & T. D. H. Cau, 2009. "Modeling Implicit Collusion Using Coevolution," Operations Research, INFORMS, vol. 57(2), pages 439-455, April.
    18. Li, Gong & Shi, Jing & Qu, Xiuli, 2011. "Modeling methods for GenCo bidding strategy optimization in the liberalized electricity spot market–A state-of-the-art review," Energy, Elsevier, vol. 36(8), pages 4686-4700.
    19. Young, David & Poletti, Stephen & Browne, Oliver, 2014. "Can agent-based models forecast spot prices in electricity markets? Evidence from the New Zealand electricity market," Energy Economics, Elsevier, vol. 45(C), pages 419-434.
    20. Genc, Talat S. & Reynolds, Stanley S., 2011. "Supply function equilibria with capacity constraints and pivotal suppliers," International Journal of Industrial Organization, Elsevier, vol. 29(4), pages 432-442, July.

    More about this item

    Keywords

    Agent-based computational economics; electricity; market design; experience-weighted attraction (EWA); learning; supply functions; demand aggregation; initial beliefs.;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:upf:upfgen:1214. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: http://www.econ.upf.edu/ .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: The email address of this maintainer does not seem to be valid anymore. Please ask the person in charge to update the entry or send us the correct address (email available below). General contact details of provider: http://www.econ.upf.edu/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.