IDEAS home Printed from https://ideas.repec.org/a/kap/compec/v44y2014i4p507-536.html
   My bibliography  Save this article

Efficient Sampling and Meta-Modeling for Computational Economic Models

Author

Listed:
  • Isabelle Salle
  • Murat Yıldızoğlu

Abstract

Extensive exploration of simulation models comes at a high computational cost, all the more when the model involves a lot of parameters. Economists usually rely on random explorations, such as Monte Carlo simulations, and basic econometric modeling to approximate the properties of computational models. This paper aims to provide guidelines for the use of a much more efficient method that combines a parsimonious sampling of the parameter space using a specific design of experiments (DoE), with a well-suited metamodeling method first developed in geostatistics: kriging. We illustrate these guidelines by following them in the analysis of two simple and well known economic models: Nelson and Winter’s industrial dynamics model, and Cournot oligopoly with learning firms. In each case, we show that our DoE experiments can catch the main effects of the parameters on the models’ dynamics with a much lower number of simulations than the Monte-Carlo sampling (e.g. 85 simulations instead of 2,000 in the first case). In the analysis of the second model, we also introduce supplementary numerical tools that may be combined with this method, for characterizing configurations complying with a specific criterion (social optimal, replication of stylized facts, etc.). Our appendix gives an example of the R-project code that can be used to apply this method on other models, in order to encourage other researchers to quickly test this approach on their models. Copyright Springer Science+Business Media New York 2014

Suggested Citation

  • Isabelle Salle & Murat Yıldızoğlu, 2014. "Efficient Sampling and Meta-Modeling for Computational Economic Models," Computational Economics, Springer;Society for Computational Economics, vol. 44(4), pages 507-536, December.
  • Handle: RePEc:kap:compec:v:44:y:2014:i:4:p:507-536
    DOI: 10.1007/s10614-013-9406-7
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s10614-013-9406-7
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1007/s10614-013-9406-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Yıldızoğlu, Murat & Sénégas, Marc-Alexandre & Salle, Isabelle & Zumpe, Martin, 2014. "Learning The Optimal Buffer-Stock Consumption Rule Of Carroll," Macroeconomic Dynamics, Cambridge University Press, vol. 18(4), pages 727-752, June.
    2. Tesfatsion, Leigh & Judd, Kenneth L., 2006. "Handbook of Computational Economics, Vol. 2: Agent-Based Computational Economics," Staff General Research Papers Archive 10368, Iowa State University, Department of Economics.
    3. Leigh Tesfatsion & Kenneth L. Judd (ed.), 2006. "Handbook of Computational Economics," Handbook of Computational Economics, Elsevier, edition 1, volume 2, number 2.
    4. Edward Herbst & Frank Schorfheide, 2014. "Sequential Monte Carlo Sampling For Dsge Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(7), pages 1073-1098, November.
    5. Richard R. Nelson & Sidney G. Winter, 1978. "Forces Generating and Limiting Concentration under Schumpeterian Competition," Bell Journal of Economics, The RAND Corporation, vol. 9(2), pages 524-548, Autumn.
    6. Mebane Jr., Walter R. & Sekhon, Jasjeet S., 2011. "Genetic Optimization Using Derivatives: The rgenoud Package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 42(i11).
    7. Nelson, Richard R & Winter, Sidney G, 1982. "The Schumpeterian Tradeoff Revisited," American Economic Review, American Economic Association, vol. 72(1), pages 114-132, March.
    8. Oeffner, Marc, 2008. "Agent–Based Keynesian Macroeconomics - An Evolutionary Model Embedded in an Agent–Based Computer Simulation," MPRA Paper 18199, University Library of Munich, Germany, revised Oct 2009.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Salle, Isabelle & Yıldızoğlu, Murat & Sénégas, Marc-Alexandre, 2013. "Inflation targeting in a learning economy: An ABM perspective," Economic Modelling, Elsevier, vol. 34(C), pages 114-128.
    2. Mellár, Tamás & Hau, Orsolya & Sebestyén, Tamás, 2013. "Láthatóvá tehető-e a láthatatlan kéz? Egy ágensalapú piaci modell tapasztalatai [Can the invisible hand be rendered visible? Experiences of an agent-based market model]," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(9), pages 992-1024.
    3. Sinitskaya, Ekaterina & Tesfatsion, Leigh, 2015. "Macroeconomies as constructively rational games," Journal of Economic Dynamics and Control, Elsevier, vol. 61(C), pages 152-182.
    4. Isabelle Salle & Marc-Alexandre Sénégas & Murat Yıldızoğlu, 2019. "How transparent about its inflation target should a central bank be?," Journal of Evolutionary Economics, Springer, vol. 29(1), pages 391-427, March.
    5. Isabelle SALLE & Marc-Alexandre SENEGAS & Murat YILDIZOGLU, 2013. "How Transparent About Its Inflation Target Should a Central Bank be? An Agent-Based Model Assessment," Cahiers du GREThA (2007-2019) 2013-24, Groupe de Recherche en Economie Théorique et Appliquée (GREThA).
    6. Váry, Miklós, 2015. "Piaci alkalmazkodás ragadós árak mellett - Calvo-típusú ármerevség egy ágensalapú modellben [Market adjustment under sticky prices: the price rigidity of a Calvo type in an agent-based model]," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(1), pages 48-77.
    7. Müller, Matthias & Kudic, Muhamed & Vermeulen, Ben, 2021. "The influence of the structure of technological knowledge on inter-firm R&D collaboration and knowledge discovery: An agent-based simulation approach," Journal of Business Research, Elsevier, vol. 129(C), pages 570-579.
    8. Sinitskaya, Ekaterina, 2014. "Computational modeling of an economy using elements of artificial intelligence," ISU General Staff Papers 201401010800005291, Iowa State University, Department of Economics.
    9. Popoyan, Lilit & Napoletano, Mauro & Roventini, Andrea, 2017. "Taming macroeconomic instability: Monetary and macro-prudential policy interactions in an agent-based model," Journal of Economic Behavior & Organization, Elsevier, vol. 134(C), pages 117-140.
    10. Kubin, Ingrid & Zörner, Thomas O. & Gardini, Laura & Commendatore, Pasquale, 2019. "A credit cycle model with market sentiments," Structural Change and Economic Dynamics, Elsevier, vol. 50(C), pages 159-174.
    11. Klaus Jaffe, 2015. "Agent based simulations visualize Adam Smith's invisible hand by solving Friedrich Hayek's Economic Calculus," Papers 1509.04264, arXiv.org, revised Nov 2015.
    12. repec:hal:spmain:info:hdl:2441/5bnglqth5987gaq6dhju3psjn3 is not listed on IDEAS
    13. Zhang, Hui & Cao, Libin & Zhang, Bing, 2017. "Emissions trading and technology adoption: An adaptive agent-based analysis of thermal power plants in China," Resources, Conservation & Recycling, Elsevier, vol. 121(C), pages 23-32.
    14. Cincotti, Silvano & Raberto, Marco & Teglio, Andrea, 2010. "Credit money and macroeconomic instability in the agent-based model and simulator Eurace," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 4, pages 1-32.
    15. Paul L. Borrill & Leigh Tesfatsion, 2011. "Agent-based Modeling: The Right Mathematics for the Social Sciences?," Chapters, in: John B. Davis & D. Wade Hands (ed.), The Elgar Companion to Recent Economic Methodology, chapter 11, Edward Elgar Publishing.
    16. Balint, T. & Lamperti, F. & Mandel, A. & Napoletano, M. & Roventini, A. & Sapio, A., 2017. "Complexity and the Economics of Climate Change: A Survey and a Look Forward," Ecological Economics, Elsevier, vol. 138(C), pages 252-265.
    17. Yoo, Seung Han, 2014. "Learning a population distribution," Journal of Economic Dynamics and Control, Elsevier, vol. 48(C), pages 188-201.
    18. Cees Diks & Cars Hommes & Valentyn Panchenko & Roy Weide, 2008. "E&F Chaos: A User Friendly Software Package for Nonlinear Economic Dynamics," Computational Economics, Springer;Society for Computational Economics, vol. 32(1), pages 221-244, September.
    19. Serena Brianzoni & Roy Cerqueti & Elisabetta Michetti, 2010. "A Dynamic Stochastic Model of Asset Pricing with Heterogeneous Beliefs," Computational Economics, Springer;Society for Computational Economics, vol. 35(2), pages 165-188, February.
    20. Yamamoto, Ryuichi, 2019. "Dynamic Predictor Selection And Order Splitting In A Limit Order Market," Macroeconomic Dynamics, Cambridge University Press, vol. 23(5), pages 1757-1792, July.
    21. Ashraf, Quamrul & Gershman, Boris & Howitt, Peter, 2017. "Banks, market organization, and macroeconomic performance: An agent-based computational analysis," Journal of Economic Behavior & Organization, Elsevier, vol. 135(C), pages 143-180.

    More about this item

    Keywords

    Computational economics; Exploration of agent-based models; Design of experiments; Meta-modeling;
    All these keywords.

    JEL classification:

    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis
    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques
    • C80 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - General
    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:compec:v:44:y:2014:i:4:p:507-536. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.