IDEAS home Printed from https://ideas.repec.org/p/upf/upfgen/1214.html
   My bibliography  Save this paper

Are agent-based simulations robust? The wholesale electricity trading case

Author

Abstract

Agent-based computational economics is becoming widely used in practice. This paper explores the consistency of some of its standard techniques. We focus in particular on prevailing wholesale electricity trading simulation methods. We include different supply and demand representations and propose the Experience-Weighted Attractions method to include several behavioural algorithms. We compare the results across assumptions and to economic theory predictions. The match is good under best-response and reinforcement learning but not under fictitious play. The simulations perform well under flat and upward-slopping supply bidding, and also for plausible demand elasticity assumptions. Learning is influenced by the number of bids per plant and the initial conditions. The overall conclusion is that agent-based simulation assumptions are far from innocuous. We link their performance to underlying features, and identify those that are better suited to model wholesale electricity markets.

Suggested Citation

  • Albert Banal-Estañol & Augusto Rupérez-Micola, 2010. "Are agent-based simulations robust? The wholesale electricity trading case," Economics Working Papers 1214, Department of Economics and Business, Universitat Pompeu Fabra.
    • Handle: RePEc:upf:upfgen:1214
    as

    Download full text from publisher

    File URL: https://econ-papers.upf.edu/papers/1214.pdf
    File Function: Whole Paper
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Junjie Sun & Leigh Tesfatsion, 2007. "Dynamic Testing of Wholesale Power Market Designs: An Open-Source Agent-Based Framework," Computational Economics, Springer;Society for Computational Economics, vol. 30(3), pages 291-327, October.
    2. Li, Hongyan & Sun, Junjie & Tesfatsion, Leigh S., 2009. "Separation and Volatility of Locational Marginal Prices in Restructured Wholesale Power Markets," Staff General Research Papers Archive 13075, Iowa State University, Department of Economics.
    3. Fudenberg, Drew & Levine, David, 1998. "Learning in games," European Economic Review, Elsevier, vol. 42(3-5), pages 631-639, May.
    4. Jan W. Rivkin & Nicolaj Siggelkow, 2003. "Balancing Search and Stability: Interdependencies Among Elements of Organizational Design," Management Science, INFORMS, vol. 49(3), pages 290-311, March.
    5. G. Fagiolo & C. Birchenhall & P. Windrum, 2007. "Empirical Validation in Agent-based Models: Introduction to the Special Issue," Computational Economics, Springer;Society for Computational Economics, vol. 30(3), pages 189-194, October.
    6. Van Huyck, John B & Battalio, Raymond C & Beil, Richard O, 1990. "Tacit Coordination Games, Strategic Uncertainty, and Coordination Failure," American Economic Review, American Economic Association, vol. 80(1), pages 234-248, March.
    7. Natalia Fabra & Nils‐Henrik Fehr & David Harbord, 2006. "Designing electricity auctions," RAND Journal of Economics, RAND Corporation, vol. 37(1), pages 23-46, March.
    8. Matteo Richiardi & Roberto Leombruni & Nicole J. Saam & Michele Sonnessa, 2006. "A Common Protocol for Agent-Based Social Simulation," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 9(1), pages 1-15.
    9. Day, Christopher J & Bunn, Derek W, 2001. "Divestiture of Generation Assets in the Electricity Pool of England and Wales: A Computational Approach to Analyzing Market Power," Journal of Regulatory Economics, Springer, vol. 19(2), pages 123-141, March.
    10. Paul J. J. Welfens & Christian Richter & Holger C. Wolf, 2019. "Transitions," International Economics and Economic Policy, Springer, vol. 16(4), pages 563-564, October.
    11. Derek Bunn & Fernando Oliveira, 2003. "Evaluating Individual Market Power in Electricity Markets via Agent-Based Simulation," Annals of Operations Research, Springer, vol. 121(1), pages 57-77, July.
    12. James Nicolaisen & Valentin Petrov & Leigh Tesfatsion, 2000. "Market Power and Efficiency in a Computational Electricity Market with Discriminatory Double-Auction Pricing," Computational Economics 0004005, University Library of Munich, Germany.
    13. Roth, Alvin E. & Erev, Ido, 1995. "Learning in extensive-form games: Experimental data and simple dynamic models in the intermediate term," Games and Economic Behavior, Elsevier, vol. 8(1), pages 164-212.
    14. Alvin E. Roth & Tayfun Sönmez & M. Utku Ünver, 2004. "Kidney Exchange," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(2), pages 457-488.
    15. Par Holmberg, 2007. "Supply Function Equilibrium with Asymmetric Capacities and Constant Marginal Costs," The Energy Journal, International Association for Energy Economics, vol. 0(Number 2), pages 55-82.
    16. Crawford, Gregory S. & Crespo, Joseph & Tauchen, Helen, 2007. "Bidding asymmetries in multi-unit auctions: Implications of bid function equilibria in the British spot market for electricity," International Journal of Industrial Organization, Elsevier, vol. 25(6), pages 1233-1268, December.
    17. Tesfatsion, Leigh & Judd, Kenneth L., 2006. "Handbook of Computational Economics, Vol. 2: Agent-Based Computational Economics," Staff General Research Papers Archive 10368, Iowa State University, Department of Economics.
    18. Colin Camerer & Teck-Hua Ho, 1999. "Experience-weighted Attraction Learning in Normal Form Games," Econometrica, Econometric Society, vol. 67(4), pages 827-874, July.
    19. Rothkopf, Michael H., 2002. "Control of Market Power in Electricity Auctions," The Electricity Journal, Elsevier, vol. 15(8), pages 15-24, October.
    20. Midgley, David & Marks, Robert & Kunchamwar, Dinesh, 2007. "Building and assurance of agent-based models: An example and challenge to the field," Journal of Business Research, Elsevier, vol. 60(8), pages 884-893, August.
    21. von der Fehr, Nils-Henrik Morch & Harbord, David, 1993. "Spot Market Competition in the UK Electricity Industry," Economic Journal, Royal Economic Society, vol. 103(418), pages 531-546, May.
    22. Liu, Haifeng & Tesfatsion, Leigh S. & Chowdhury, A.A., 2009. "Derivation of Locational Marginal Prices for Restructured Wholesale Power Markets," Staff General Research Papers Archive 13068, Iowa State University, Department of Economics.
    23. Benjamin F. Hobbs & J. S. Pang, 2007. "Nash-Cournot Equilibria in Electric Power Markets with Piecewise Linear Demand Functions and Joint Constraints," Operations Research, INFORMS, vol. 55(1), pages 113-127, February.
    24. Holmberg, Par, 2008. "Unique supply function equilibrium with capacity constraints," Energy Economics, Elsevier, vol. 30(1), pages 148-172, January.
    25. Ido Erev & Alvin Roth & Robert Slonim & Greg Barron, 2007. "Learning and equilibrium as useful approximations: Accuracy of prediction on randomly selected constant sum games," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 33(1), pages 29-51, October.
    26. Micola, Augusto Rupérez & Banal-Estañol, Albert & Bunn, Derek W., 2008. "Incentives and coordination in vertically related energy markets," Journal of Economic Behavior & Organization, Elsevier, vol. 67(2), pages 381-393, August.
    27. Green, Richard J & Newbery, David M, 1992. "Competition in the British Electricity Spot Market," Journal of Political Economy, University of Chicago Press, vol. 100(5), pages 929-953, October.
    28. Leigh Tesfatsion & Kenneth L. Judd (ed.), 2006. "Handbook of Computational Economics," Handbook of Computational Economics, Elsevier, edition 1, volume 2, number 2.
    29. Duffy, John, 2006. "Agent-Based Models and Human Subject Experiments," Handbook of Computational Economics, in: Leigh Tesfatsion & Kenneth L. Judd (ed.), Handbook of Computational Economics, edition 1, volume 2, chapter 19, pages 949-1011, Elsevier.
    30. Robert Marks, 2007. "Validating Simulation Models: A General Framework and Four Applied Examples," Computational Economics, Springer;Society for Computational Economics, vol. 30(3), pages 265-290, October.
    31. Bushnell, James & Wolfram, Catherine, 2008. "Electricity Markets," Staff General Research Papers Archive 31547, Iowa State University, Department of Economics.
    32. Ron Adner & Daniel Levinthal, 2001. "Demand Heterogeneity and Technology Evolution: Implications for Product and Process Innovation," Management Science, INFORMS, vol. 47(5), pages 611-628, May.
    33. Fama, Eugene F & MacBeth, James D, 1973. "Risk, Return, and Equilibrium: Empirical Tests," Journal of Political Economy, University of Chicago Press, vol. 81(3), pages 607-636, May-June.
    34. Newbery, D.M., 1991. "Capacity-Constrained Supply Function Equilibria: Competition and Entry in the Electricity Spot Market and Competition and Regulation in English Electricity Industry," Cambridge Working Papers in Economics 9208, Faculty of Economics, University of Cambridge.
    35. Alvin E. Roth, 2002. "The Economist as Engineer: Game Theory, Experimentation, and Computation as Tools for Design Economics," Econometrica, Econometric Society, vol. 70(4), pages 1341-1378, July.
    36. Blumsack, Seth & Perekhodtsev, Dmitri & Lave, Lester B., 2002. "Market Power in Deregulated Wholesale Electricity Markets: Issues in Measurement and the Cost of Mitigation," The Electricity Journal, Elsevier, vol. 15(9), pages 11-24, November.
    37. Natalia Fabra & Nils-Henrik M. von der Fehr & David Harbord, 2006. "Designing Electricity Auctions," RAND Journal of Economics, The RAND Corporation, vol. 37(1), pages 23-46, Spring.
    38. Sebastien Pouget, 2007. "Adaptive Traders and the Design of Financial Markets," Journal of Finance, American Finance Association, vol. 62(6), pages 2835-2863, December.
    39. Erev, Ido & Roth, Alvin E, 1998. "Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria," American Economic Review, American Economic Association, vol. 88(4), pages 848-881, September.
    40. Bunn, Derek W. & Oliveira, Fernando S., 2007. "Agent-based analysis of technological diversification and specialization in electricity markets," European Journal of Operational Research, Elsevier, vol. 181(3), pages 1265-1278, September.
    41. Bunn, Derek W. & Martoccia, Maria, 2005. "Unilateral and collusive market power in the electricity pool of England and Wales," Energy Economics, Elsevier, vol. 27(2), pages 305-315, March.
    42. Marks, Robert, 2006. "Market Design Using Agent-Based Models," Handbook of Computational Economics, in: Leigh Tesfatsion & Kenneth L. Judd (ed.), Handbook of Computational Economics, edition 1, volume 2, chapter 27, pages 1339-1380, Elsevier.
    43. Weidlich, Anke & Veit, Daniel, 2008. "A critical survey of agent-based wholesale electricity market models," Energy Economics, Elsevier, vol. 30(4), pages 1728-1759, July.
    44. Bower, John & Bunn, Derek, 2001. "Experimental analysis of the efficiency of uniform-price versus discriminatory auctions in the England and Wales electricity market," Journal of Economic Dynamics and Control, Elsevier, vol. 25(3-4), pages 561-592, March.
    45. Michael H. Rothkopf & Aleksandar Pekev{c} & Ronald M. Harstad, 1998. "Computationally Manageable Combinational Auctions," Management Science, INFORMS, vol. 44(8), pages 1131-1147, August.
    46. Bolle, Friedel, 1992. "Supply function equilibria and the danger of tacit collusion : The case of spot markets for electricity," Energy Economics, Elsevier, vol. 14(2), pages 94-102, April.
    47. Drew Fudenberg & David K. Levine, 1998. "The Theory of Learning in Games," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262061945, December.
    48. Thomas H. Noe & Michael J. Rebello & Jun Wang, 2003. "Corporate Financing: An Artificial Agent‐based Analysis," Journal of Finance, American Finance Association, vol. 58(3), pages 943-973, June.
    49. Derek W. Bunn and Fernando Oliveira, 2001. "An Application of Agent-based Simulation to the New Electricity Trading Arrangements of England and Wales," Computing in Economics and Finance 2001 93, Society for Computational Economics.
    50. Jerker Denrell, 2004. "Random Walks and Sustained Competitive Advantage," Management Science, INFORMS, vol. 50(7), pages 922-934, July.
    51. Brenner, Thomas, 2006. "Agent Learning Representation: Advice on Modelling Economic Learning," Handbook of Computational Economics, in: Leigh Tesfatsion & Kenneth L. Judd (ed.), Handbook of Computational Economics, edition 1, volume 2, chapter 18, pages 895-947, Elsevier.
    52. John Bower & Derek W. Bunn, 2000. "Model-Based Comparisons of Pool and Bilateral Markets for Electricity," The Energy Journal, International Association for Energy Economics, vol. 0(Number 3), pages 1-29.
    53. Bunn, Derek W. & Day, Christopher J., 2009. "Computational modelling of price formation in the electricity pool of England and Wales," Journal of Economic Dynamics and Control, Elsevier, vol. 33(2), pages 363-376, February.
    54. Klemperer, Paul D & Meyer, Margaret A, 1989. "Supply Function Equilibria in Oligopoly under Uncertainty," Econometrica, Econometric Society, vol. 57(6), pages 1243-1277, November.
    55. Bower, John & Bunn, Derek W. & Wattendrup, Claus, 2001. "A model-based analysis of strategic consolidation in the German electricity industry," Energy Policy, Elsevier, vol. 29(12), pages 987-1005, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Richstein, Jörn C. & Chappin, Emile J.L. & de Vries, Laurens J., 2014. "Cross-border electricity market effects due to price caps in an emission trading system: An agent-based approach," Energy Policy, Elsevier, vol. 71(C), pages 139-158.
    2. Khan, Agha Salman M. & Verzijlbergh, Remco A. & Sakinci, Ozgur Can & De Vries, Laurens J., 2018. "How do demand response and electrical energy storage affect (the need for) a capacity market?," Applied Energy, Elsevier, vol. 214(C), pages 39-62.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Banal-Estañol, Albert & Rupérez Micola, Augusto, 2011. "Behavioural simulations in spot electricity markets," European Journal of Operational Research, Elsevier, vol. 214(1), pages 147-159, October.
    2. Albert Banal-Estañol & Augusto Rupérez Micola, 2009. "Composition of Electricity Generation Portfolios, Pivotal Dynamics, and Market Prices," Management Science, INFORMS, vol. 55(11), pages 1813-1831, November.
    3. Weidlich, Anke & Veit, Daniel, 2008. "A critical survey of agent-based wholesale electricity market models," Energy Economics, Elsevier, vol. 30(4), pages 1728-1759, July.
    4. Sensfuß, Frank & Ragwitz, Mario & Genoese, Massimo & Möst, Dominik, 2007. "Agent-based simulation of electricity markets: a literature review," Working Papers "Sustainability and Innovation" S5/2007, Fraunhofer Institute for Systems and Innovation Research (ISI).
    5. Lin-Ju Chen & Lei Zhu & Ying Fan & Sheng-Hua Cai, 2013. "Long-Term Impacts of Carbon Tax and Feed-in Tariff Policies on China's Generating Portfolio and Carbon Emissions: A Multi-Agent-Based Analysis," Energy & Environment, , vol. 24(7-8), pages 1271-1293, December.
    6. Eric Guerci & Stefano Ivaldi & Silvano Cincotti, 2008. "Learning Agents in an Artificial Power Exchange: Tacit Collusion, Market Power and Efficiency of Two Double-auction Mechanisms," Computational Economics, Springer;Society for Computational Economics, vol. 32(1), pages 73-98, September.
    7. Weidlich Anke & Veit Daniel, 2008. "Agent-Based Simulations for Electricity Market Regulation Advice: Procedures and an Example," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 228(2-3), pages 149-172, April.
    8. Gaivoronskaia, E. & Tsyplakov, A., 2018. "Using a Modified Erev-Roth Algorithm in an Agent-Based Electricity Market Model," Journal of the New Economic Association, New Economic Association, vol. 39(3), pages 55-83.
    9. Chen, Shu-Heng, 2012. "Varieties of agents in agent-based computational economics: A historical and an interdisciplinary perspective," Journal of Economic Dynamics and Control, Elsevier, vol. 36(1), pages 1-25.
    10. Balint, T. & Lamperti, F. & Mandel, A. & Napoletano, M. & Roventini, A. & Sapio, A., 2017. "Complexity and the Economics of Climate Change: A Survey and a Look Forward," Ecological Economics, Elsevier, vol. 138(C), pages 252-265.
    11. E. J. Anderson & T. D. H. Cau, 2009. "Modeling Implicit Collusion Using Coevolution," Operations Research, INFORMS, vol. 57(2), pages 439-455, April.
    12. Sarıca, Kemal & Kumbaroğlu, Gürkan & Or, Ilhan, 2012. "Modeling and analysis of a decentralized electricity market: An integrated simulation/optimization approach," Energy, Elsevier, vol. 44(1), pages 830-852.
    13. Holmberg, Pär, 2009. "Numerical calculation of an asymmetric supply function equilibrium with capacity constraints," European Journal of Operational Research, Elsevier, vol. 199(1), pages 285-295, November.
    14. repec:hal:spmain:info:hdl:2441/1nlv566svi86iqtetenms15tc4 is not listed on IDEAS
    15. repec:hal:spmain:info:hdl:2441/5qr7f0k4sk8rbq4do5u6v70rm0 is not listed on IDEAS
    16. Holmberg, Pär & Newbery, David & Ralph, Daniel, 2013. "Supply function equilibria: Step functions and continuous representations," Journal of Economic Theory, Elsevier, vol. 148(4), pages 1509-1551.
    17. Bolle, Friedel & Grimm, Veronika & Ockenfels, Axel & del Pozo, Xavier, 2013. "An experiment on supply function competition," European Economic Review, Elsevier, vol. 63(C), pages 170-185.
    18. Hunt Allcott, 2012. "The Smart Grid, Entry, and Imperfect Competition in Electricity Markets," NBER Working Papers 18071, National Bureau of Economic Research, Inc.
    19. Rahimiyan, Morteza & Rajabi Mashhadi, Habib, 2010. "Evaluating the efficiency of divestiture policy in promoting competitiveness using an analytical method and agent-based computational economics," Energy Policy, Elsevier, vol. 38(3), pages 1588-1595, March.
    20. Joseph Mullins & Liam Wagner & John Foster, 2010. "Price Spikes in Electricity Markets: A Strategic Perspective," Energy Economics and Management Group Working Papers 05, School of Economics, University of Queensland, Australia.
    21. Holmberg, Pär & Newbery, David, 2010. "The supply function equilibrium and its policy implications for wholesale electricity auctions," Utilities Policy, Elsevier, vol. 18(4), pages 209-226, December.
    22. Waltman, Ludo & Kaymak, Uzay, 2008. "Q-learning agents in a Cournot oligopoly model," Journal of Economic Dynamics and Control, Elsevier, vol. 32(10), pages 3275-3293, October.

    More about this item

    Keywords

    Agent-based computational economics; electricity; market design; experience-weighted attraction (EWA); learning; supply functions; demand aggregation; initial beliefs.;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:upf:upfgen:1214. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: http://www.econ.upf.edu/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.