IDEAS home Printed from https://ideas.repec.org/p/hal/cesptp/hal-05559166.html

Building a global sensitivity analysis to quantify the robustness of macro-economic models

Author

Listed:
  • Edouard Dossetto

    (CES - Centre d'économie de la Sorbonne - UP1 - Université Paris 1 Panthéon-Sorbonne - CNRS - Centre National de la Recherche Scientifique)

  • Christophe Chorro

    (CES - Centre d'économie de la Sorbonne - UP1 - Université Paris 1 Panthéon-Sorbonne - CNRS - Centre National de la Recherche Scientifique)

Abstract

Currently used macro-economic models are facing various defaults (see [Stiglitz, 2018]), especially in a complex economic environment involving a large number of calibrated / estimated parameters which leads to highly parameter-sensitive results (see [Grandjean and Giraud, 2017]). Moreover, in social sciences, where most data are approximations, the impact of inputs' uncertainties cannot be considered negligible, and questioning the robustness of our macro-economic models becomes more and more essential to conduct public policies in these fields [European Commision, 2009]. In this paper, the robustness of the [Grasselli and Costa Lima, 2012] model was tested in terms of sensitivity to parameters. After a review of the various sensitivity analysis methods (see also in appendix), a Global Sensitivity Analysis (GSA) with Sobol' indices estimated by the [Saltelli, 2002] method was selected according to the features of the models: nonlinearities, a small number of inputs, and modest computational costs. The process is based on two initial sampling matrices generated by Latin Hypercube Sampling (LHS). A review of literature shows that GSA has been also conducted on the DSGE, RBC, and DICE models [Nordhaus, 2008]. With this method, the sensitivity of an output in the [Grasselli and Costa Lima, 2012] model to its inputs is two to four times less important than the one in a DSGE [Ratto, 2008], RBC [Harenberg et al., 2017] or IAM (DICE) model [Nordhaus, 2008], [Miftakhova, 2019], [Butler et al., 2014] and [Anderson et al., 2014]. One can slightly improve the model's robustness by endogeneizing the main influential parameter. For instance, the [Grasselli and Costa Lima, 2012] model with a CES production function is slightly more robust than one with a Leontief production function.

Suggested Citation

  • Edouard Dossetto & Christophe Chorro, 2022. "Building a global sensitivity analysis to quantify the robustness of macro-economic models," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) hal-05559166, HAL.
  • Handle: RePEc:hal:cesptp:hal-05559166
    Note: View the original document on HAL open archive server: https://hal.science/hal-05559166v2
    as

    Download full text from publisher

    File URL: https://hal.science/hal-05559166v2/document
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Sungbae An & Frank Schorfheide, 2007. "Bayesian Analysis of DSGE Models—Rejoinder," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 211-219.
    2. Blatman, Géraud & Sudret, Bruno, 2010. "Efficient computation of global sensitivity indices using sparse polynomial chaos expansions," Reliability Engineering and System Safety, Elsevier, vol. 95(11), pages 1216-1229.
    3. Iskrev, Nikolay, 2010. "Local identification in DSGE models," Journal of Monetary Economics, Elsevier, vol. 57(2), pages 189-202, March.
    4. Robert M. Solow, 1956. "A Contribution to the Theory of Economic Growth," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 70(1), pages 65-94.
    5. Del Negro, Marco & Schorfheide, Frank, 2008. "Forming priors for DSGE models (and how it affects the assessment of nominal rigidities)," Journal of Monetary Economics, Elsevier, vol. 55(7), pages 1191-1208, October.
    6. Lubik, Thomas A. & Schorfheide, Frank, 2007. "Do central banks respond to exchange rate movements? A structural investigation," Journal of Monetary Economics, Elsevier, vol. 54(4), pages 1069-1087, May.
    7. Emanuele Borgonovo & William Castaings & Stefano Tarantola, 2011. "Moment Independent Importance Measures: New Results and Analytical Test Cases," Risk Analysis, John Wiley & Sons, vol. 31(3), pages 404-428, March.
    8. Frank Schorfheide, 2000. "Loss function-based evaluation of DSGE models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(6), pages 645-670.
    9. Bovari, Emmanuel & Giraud, Gaël & Mc Isaac, Florent, 2018. "Coping With Collapse: A Stock-Flow Consistent Monetary Macrodynamics of Global Warming," Ecological Economics, Elsevier, vol. 147(C), pages 383-398.
    10. Gourieroux, C. & Laurent, J. P. & Scaillet, O., 2000. "Sensitivity analysis of Values at Risk," Journal of Empirical Finance, Elsevier, vol. 7(3-4), pages 225-245, November.
    11. Mankiw, N Gregory, 2001. "The Inexorable and Mysterious Tradeoff between Inflation and Unemployment," Economic Journal, Royal Economic Society, vol. 111(471), pages 45-61, May.
    12. Miftakhova, Alena, 2021. "Global sensitivity analysis for optimal climate policies: Finding what truly matters," Economic Modelling, Elsevier, vol. 105(C).
    13. Simone Manganelli, 2004. "Asset Allocation by Variance Sensitivity Analysis," Journal of Financial Econometrics, Oxford University Press, vol. 2(3), pages 370-389.
    14. Marco Ratto, 2008. "Analysing DSGE Models with Global Sensitivity Analysis," Computational Economics, Springer;Society for Computational Economics, vol. 31(2), pages 115-139, March.
    15. Tian, Wei, 2013. "A review of sensitivity analysis methods in building energy analysis," Renewable and Sustainable Energy Reviews, Elsevier, vol. 20(C), pages 411-419.
    16. Sungbae An & Frank Schorfheide, 2007. "Bayesian Analysis of DSGE Models," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 113-172.
    17. Den Haan, Wouter J. & Judd, Kenneth L. & Juillard, Michel, 2011. "Computational suite of models with heterogeneous agents II: Multi-country real business cycle models," Journal of Economic Dynamics and Control, Elsevier, vol. 35(2), pages 175-177, February.
    18. Robert J. Gordon, 2013. "The Phillips Curve is Alive and Well: Inflation and the NAIRU During the Slow Recovery," NBER Working Papers 19390, National Bureau of Economic Research, Inc.
    19. Desai, Meghnad & Henry, Brian & Mosley, Alexander & Pemberton, Malcolm, 2006. "A clarification of the Goodwin model of the growth cycle," Journal of Economic Dynamics and Control, Elsevier, vol. 30(12), pages 2661-2670, December.
    20. Borgonovo, Emanuele & Plischke, Elmar, 2016. "Sensitivity analysis: A review of recent advances," European Journal of Operational Research, Elsevier, vol. 248(3), pages 869-887.
    21. Frank Smets & Rafael Wouters, 2007. "Shocks and Frictions in US Business Cycles: A Bayesian DSGE Approach," American Economic Review, American Economic Association, vol. 97(3), pages 586-606, June.
    22. Barry Anderson & Emanuele Borgonovo & Marzio Galeotti & Roberto Roson, 2014. "Uncertainty in Climate Change Modeling: Can Global Sensitivity Analysis Be of Help?," Risk Analysis, John Wiley & Sons, vol. 34(2), pages 271-293, February.
    23. Jeremy E. Oakley & Anthony O'Hagan, 2004. "Probabilistic sensitivity analysis of complex models: a Bayesian approach," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(3), pages 751-769, August.
    24. Helton, J.C. & Johnson, J.D. & Sallaberry, C.J. & Storlie, C.B., 2006. "Survey of sampling-based methods for uncertainty and sensitivity analysis," Reliability Engineering and System Safety, Elsevier, vol. 91(10), pages 1175-1209.
    25. Liu, Ruixue & Owen, Art B., 2006. "Estimating Mean Dimensionality of Analysis of Variance Decompositions," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 712-721, June.
    26. Sobol, I.M., 1998. "On quasi-Monte Carlo integrations," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 47(2), pages 103-112.
    27. Aruoba, S. Boragan & Fernandez-Villaverde, Jesus & Rubio-Ramirez, Juan F., 2006. "Comparing solution methods for dynamic equilibrium economies," Journal of Economic Dynamics and Control, Elsevier, vol. 30(12), pages 2477-2508, December.
    28. Saltelli, Andrea & Bolado, Ricardo, 1998. "An alternative way to compute Fourier amplitude sensitivity test (FAST)," Computational Statistics & Data Analysis, Elsevier, vol. 26(4), pages 445-460, February.
    29. Adolf Hurwitz, 1963. "Mathematische Werke," Springer Books, Springer, number 978-3-0348-4160-3, March.
    30. Steve Keen, 1995. "Finance and Economic Breakdown: Modeling Minsky’s “Financial Instability Hypothesis”," Journal of Post Keynesian Economics, Taylor & Francis Journals, vol. 17(4), pages 607-635, July.
    31. Robert J. Gordon, 2011. "The History of the Phillips Curve: Consensus and Bifurcation," Economica, London School of Economics and Political Science, vol. 78(309), pages 10-50, January.
    32. Canova, Fabio, 1995. "Sensitivity Analysis and Model Evaluation in Simulated Dynamic General Equilibrium Economies," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 36(2), pages 477-501, May.
    33. Marco Ratto & Andrea Pagano, 2010. "Using recursive algorithms for the efficient identification of smoothing spline ANOVA models," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 94(4), pages 367-388, December.
    34. Thomas Lubik & Frank Schorfheide, 2006. "A Bayesian Look at New Open Economy Macroeconomics," NBER Chapters, in: NBER Macroeconomics Annual 2005, Volume 20, pages 313-382, National Bureau of Economic Research, Inc.
    35. Stiglitz, Joseph E, 1974. "The Cambridge-Cambridge Controversy in the Theory of Capital: A View from New Haven: A Review Article," Journal of Political Economy, University of Chicago Press, vol. 82(4), pages 893-903, July/Aug..
    36. Sobol’, I.M. & Tarantola, S. & Gatelli, D. & Kucherenko, S.S. & Mauntz, W., 2007. "Estimating the approximation error when fixing unessential factors in global sensitivity analysis," Reliability Engineering and System Safety, Elsevier, vol. 92(7), pages 957-960.
    37. Jordi Galí & Tommaso Monacelli, 2005. "Monetary Policy and Exchange Rate Volatility in a Small Open Economy," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(3), pages 707-734.
    38. Antonin Pottier & Adrien Nguyen-Huu, 2017. "Debt and investment in the Keen model: a reappraisal of modelling Minsky," Review of Keynesian Economics, Edward Elgar Publishing, vol. 5(4), pages 631–647-6, October.
    39. Frank Smets & Raf Wouters, 2003. "An Estimated Dynamic Stochastic General Equilibrium Model of the Euro Area," Journal of the European Economic Association, MIT Press, vol. 1(5), pages 1123-1175, September.
    40. Sobol’, I.M. & Kucherenko, S., 2009. "Derivative based global sensitivity measures and their link with global sensitivity indices," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 79(10), pages 3009-3017.
    41. Daniel Harenberg & Stefano Marelli & Bruno Sudret & Viktor Winschel, 2019. "Uncertainty quantification and global sensitivity analysis for economic models," Quantitative Economics, Econometric Society, vol. 10(1), pages 1-41, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fernández-Villaverde, J. & Rubio-Ramírez, J.F. & Schorfheide, F., 2016. "Solution and Estimation Methods for DSGE Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 527-724, Elsevier.
    2. Ma, Yong, 2016. "Nonlinear monetary policy and macroeconomic stabilization in emerging market economies: Evidence from China," Economic Systems, Elsevier, vol. 40(3), pages 461-480.
    3. Özer Karagedikli & Troy Matheson & Christie Smith & Shaun P. Vahey, 2010. "RBCs AND DSGEs: THE COMPUTATIONAL APPROACH TO BUSINESS CYCLE THEORY AND EVIDENCE," Journal of Economic Surveys, Wiley Blackwell, vol. 24(1), pages 113-136, February.
    4. Zamarripa, Rene, 2024. "Parameter instabilities and monetary policy in a small open economy: Evidence from an estimated model for the UK," International Review of Economics & Finance, Elsevier, vol. 96(PB).
    5. Rabanal, Pau & Tuesta, Vicente, 2010. "Euro-dollar real exchange rate dynamics in an estimated two-country model: An assessment," Journal of Economic Dynamics and Control, Elsevier, vol. 34(4), pages 780-797, April.
    6. Kamber, Gunes & McDonald, Chris & Sander, Nick & Theodoridis, Konstantinos, 2016. "Modelling the business cycle of a small open economy: The Reserve Bank of New Zealand's DSGE model," Economic Modelling, Elsevier, vol. 59(C), pages 546-569.
    7. Marco Di Pietro & Enrico Saltari, 2018. "Economic Fluctuations in the U.S. and Euro Area: Quantifying the Contribution of Technical Change," Southern Economic Journal, John Wiley & Sons, vol. 85(1), pages 203-216, July.
    8. Stefano Grassi & Marco Lorusso & Francesco Ravazzolo, 2021. "Adaptive Importance Sampling for DSGE Models," BEMPS - Bozen Economics & Management Paper Series BEMPS84, Faculty of Economics and Management at the Free University of Bozen.
    9. Kawther Alimi & Mohamed Chakroun, 2022. "Wage Rigidity Impacts on Unemployment and Inflation Persistence in Tunisia: Evidence from an Estimated DSGE Model," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 13(1), pages 474-500, March.
    10. Çebi, Cem, 2012. "The interaction between monetary and fiscal policies in Turkey: An estimated New Keynesian DSGE model," Economic Modelling, Elsevier, vol. 29(4), pages 1258-1267.
    11. Shahid, Muhammad & Qayyum, Abdul & Shahid Malik, Waseem, 2016. "Fiscal and Monetary Policy Interactions in Pakistan Using a Dynamic Stochastic General Equilibrium Framework," MPRA Paper 85549, University Library of Munich, Germany, revised 2017.
    12. Ma, Yong, 2014. "Monetary policy based on nonlinear quantity rule: Evidence from China," International Review of Economics & Finance, Elsevier, vol. 34(C), pages 89-104.
    13. Adnan Haider Bukhari & Safdar Ullah Khan, 2008. "A Small Open Economy DSGE Model for Pakistan," The Pakistan Development Review, Pakistan Institute of Development Economics, vol. 47(4), pages 963-1008.
    14. Daniele Siena, 2014. "The European Monetary Union and Imbalances: Is it an Anticipation Story ?," Working papers 501, Banque de France.
    15. Raffaella Giacomini, 2013. "The relationship between DSGE and VAR models," CeMMAP working papers CWP21/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    16. Chatelain, Jean-Bernard & Ralf, Kirsten, 2018. "Publish and Perish: Creative Destruction and Macroeconomic Theory," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 46(2), pages 65-101.
    17. Drissi, Ramzi & Ghassan, Hassan B., 2018. "Sticky Price versus Sticky Information Price: Empirical Evidence in the New Keynesian Setting," MPRA Paper 93075, University Library of Munich, Germany, revised Apr 2019.
    18. Stan du Plessis & Ben Smit & Rudi Steinbach, 2014. "A mediumsized open economy DSGE model of South Africa," Working Papers 6319, South African Reserve Bank.
    19. S. Boragan Aruoba & Frank Schorfheide, 2011. "Sticky Prices versus Monetary Frictions: An Estimation of Policy Trade-Offs," American Economic Journal: Macroeconomics, American Economic Association, vol. 3(1), pages 60-90, January.
    20. Alban Moura & Olivier Pierrard, 2024. "Bayesian Evaluation of DSGE Models with Housing and Collateral Effects," Annals of Economics and Statistics, GENES, issue 155, pages 91-124.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:cesptp:hal-05559166. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CCSD (email available below). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.