IDEAS home Printed from https://ideas.repec.org/p/fsc/fstech/9.html
   My bibliography  Save this paper

Catching up with history: A methodology to validate global CGE models

Author

Listed:
  • Michiel van Dijk
  • George Philippidis
  • Geert Woltjer

Abstract

As a key adjunct to the process of policy formulation, market models are often called upon to quantify possible opportunities and threats. Significant improvements in computational power, database and modelling capacity contributed to a widespread usage of computable general equilibrium (CGE) frameworks in an array of policy fields. Curiously, however, in contrast to modelling efforts in, for example, the biophysical sciences, CGE model findings are seldom subjected to any systematic validation procedure. A cursory review of the literature reveals isolated single country CGE model validation exercises, although with a dearth of available data, there is a paucity of equivalent studies which implement such a procedure in a global CGE context. This paper takes a first step in this direction by proposing a systematic methodological procedure for evaluating global CGE model performance, using a consistent macro and sectoral historical time series dataset and validation statistics taken from the biophysical literature. Focusing on sectoral output trends, the results show that model simulation performs better than extrapolation from past trends. Notwithstanding, simulation error remains high in some sectors, particularly in small economies which have undergone rapid growth. Further econometric tests reveal that simulation error is mainly caused by sector specific factors rather than country specific characteristics. The latter observation is consistent with previous research on productivity specifications in CGE models, which in concert with the validation techniques proposed in this paper, serves as a promising avenue of future research.

Suggested Citation

  • Michiel van Dijk & George Philippidis & Geert Woltjer, 2016. "Catching up with history: A methodology to validate global CGE models," FOODSECURE Technical papers 9, LEI Wageningen UR.
  • Handle: RePEc:fsc:fstech:9
    as

    Download full text from publisher

    File URL: http://www3.lei.wur.nl/FoodSecurePublications/TP9_vDijk_CGE_Validation_complete.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Patrick Guillaumont, 2010. "Assessing the Economic Vulnerability of Small Island Developing States and Least Developed Countries," Post-Print hal-00594797, HAL.
    2. Kehoe, Timothy J & Polo, Clemente & Sancho, Ferran, 1995. "An Evaluation of the Performance of an Applied General Equilibrium Model of the Spanish Economy," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 6(1), pages 115-141, June.
    3. Easterly, William & Kraay, Aart, 2000. "Small States, Small Problems? Income, Growth, and Volatility in Small States," World Development, Elsevier, vol. 28(11), pages 2013-2027, November.
    4. Craig Gallet, 1997. "Cyclical fluctuations and coordination in the US steel industry," Applied Economics, Taylor & Francis Journals, vol. 29(3), pages 279-285.
    5. Patrick Guillaumont, 2010. "Assessing the Economic Vulnerability of Small Island Developing States and the Least Developed Countries," Journal of Development Studies, Taylor & Francis Journals, vol. 46(5), pages 828-854.
    6. C. F. Bach & S. E. Frandsen & H. G. Jensen, 2000. "Agricultural and Economy‐Wide Effects of European Enlargement: Modelling the Common Agricultural Policy," Journal of Agricultural Economics, Wiley Blackwell, vol. 51(2), pages 162-180, May.
    7. Rand, John & Tarp, Finn, 2002. "Business Cycles in Developing Countries: Are They Different?," World Development, Elsevier, vol. 30(12), pages 2071-2088, December.
    8. Antimiani, Alessandro & Costantini, Valeria & Paglialunga, Elena, 2015. "The sensitivity of climate-economy CGE models to energy-related elasticity parameters: Implications for climate policy design," Economic Modelling, Elsevier, vol. 51(C), pages 38-52.
    9. McCarl, Bruce A. & Apland, Jeffrey, 1986. "Validation of Linear Programming Models," Journal of Agricultural and Applied Economics, Cambridge University Press, vol. 18(2), pages 155-164, December.
    10. Pritchett, Lant, 2000. "Understanding Patterns of Economic Growth: Searching for Hills among Plateaus, Mountains, and Plains," The World Bank Economic Review, World Bank, vol. 14(2), pages 221-250, May.
    11. Jeffrey J. Reimer, 2007. "Assessing Global Computable General Equilibrium Model Validity Using Agricultural Price Volatility," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 89(2), pages 383-397.
    12. Patrick Guillaumont, 2010. "Assessing the Economic Vulnerability of Small Island Developing States and the Least Developed Countries," Post-Print halshs-00512159, HAL.
    13. Mary O'Mahony & Marcel P. Timmer, 2009. "Output, Input and Productivity Measures at the Industry Level: The EU KLEMS Database," Economic Journal, Royal Economic Society, vol. 119(538), pages 374-403, June.
    14. Joseph Francois & Hans Van Meijl & Frank Van Tongeren, 2005. "Trade liberalization in the Doha Development Round [Trade in Manufactures, the Outcome of the Uruguay Round and Developing Country Interests]," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 20(42), pages 350-391.
    15. Waschik, Robert, 2015. "Differentiated products, increasing returns to scale and heterogeneous firms in a CGE model of the Australian coal sector," Energy Economics, Elsevier, vol. 51(C), pages 521-529.
    16. Kehoe, Timothy J., 2002. "An Evaluation of the Performance of Applied General Equilibrium Models of the Impact of NAFTA," Conference papers 331066, Purdue University, Center for Global Trade Analysis, Global Trade Analysis Project.
    17. Farzad Taheripour & Thomas W. Hertel & Wallace E. Tyner, 2011. "Implications of biofuels mandates for the global livestock industry: a computable general equilibrium analysis," Agricultural Economics, International Association of Agricultural Economists, vol. 42(3), pages 325-342, May.
    18. Lakatos, Csilla & Walmsley, Terrie, 2012. "Investment creation and diversion effects of the ASEAN–China free trade agreement," Economic Modelling, Elsevier, vol. 29(3), pages 766-779.
    19. Yang, J.M. & Yang, J.Y. & Liu, S. & Hoogenboom, G., 2014. "An evaluation of the statistical methods for testing the performance of crop models with observed data," Agricultural Systems, Elsevier, vol. 127(C), pages 81-89.
    20. Christoph Böhringer & Thomas F. Rutherford, 2010. "The Costs of Compliance: A CGE Assessment of Canada’s Policy Options under the Kyoto Protocol," The World Economy, Wiley Blackwell, vol. 33(2), pages 177-211, February.
    21. McCarl, Bruce A., 1984. "Model Validation: An Overview with some Emphasis on Risk Models," Review of Marketing and Agricultural Economics, Australian Agricultural and Resource Economics Society, vol. 52(03), pages 1-21, December.
    22. Boulanger, Pierre & Philippidis, George, 2015. "The EU budget battle: Assessing the trade and welfare impacts of CAP budgetary reform," Food Policy, Elsevier, vol. 51(C), pages 119-130.
    23. Dixon, Peter B. & Rimmer, Maureen T., 2013. "Validation in Computable General Equilibrium Modeling," Handbook of Computable General Equilibrium Modeling, in: Peter B. Dixon & Dale Jorgenson (ed.), Handbook of Computable General Equilibrium Modeling, edition 1, volume 1, chapter 0, pages 1271-1330, Elsevier.
    24. Nuno Crespo & Maria Paula Fontoura, 2007. "Integration of CEECs into EU Market: Structural Change and Convergence," Journal of Common Market Studies, Wiley Blackwell, vol. 45(3), pages 611-632, September.
    25. Maria Paula Fontoura & Nuno Crespo, 2004. "Integration of CEECs into EU Markets: Structural Change and Convergence," Working Papers Department of Economics 2004/15, ISEG - Lisbon School of Economics and Management, Department of Economics, Universidade de Lisboa.
    26. Patrick Guillaumont, 2010. "Assessing the Economic Vulnerability of Small Island Developing States and the Least Developed Countries," Post-Print hal-00488679, HAL.
    27. Beckman, Jayson & Hertel, Thomas & Tyner, Wallace, 2011. "Validating energy-oriented CGE models," Energy Economics, Elsevier, vol. 33(5), pages 799-806, September.
    28. Malik, Adeel & Temple, Jonathan R.W., 2009. "The geography of output volatility," Journal of Development Economics, Elsevier, vol. 90(2), pages 163-178, November.
    29. Hong, Chanyoung & Yang, Heewon & Hwang, Wonsik & Lee, Jeong-Dong, 2014. "Validation of an R&D-based computable general equilibrium model," Economic Modelling, Elsevier, vol. 42(C), pages 454-463.
    30. Nuno Crespo & Maria Paula Fontoura, 2007. "Integration of CEECs into EU Market: Structural Change and Convergence," Journal of Common Market Studies, Wiley Blackwell, vol. 45, pages 611-632, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhao, Xin & Calvin, Katherine V. & Wise, Marshall A. & Iyer, Gokul, 2021. "The role of global agricultural market integration in multiregional economic modeling: Using hindcast experiments to validate an Armington model," Economic Analysis and Policy, Elsevier, vol. 72(C), pages 1-17.
    2. Zhao, Xin & Calvin, Katherine & Wise, Marshall & Iyer, Gokul, 2021. "The role of global agricultural market integration in multiregional economic modeling: using hindcast experiments to validate an Armington model," Conference papers 333309, Purdue University, Center for Global Trade Analysis, Global Trade Analysis Project.
    3. Hepburn, Cameron & Mealy, Penny, 2017. "Transformational Change: Parallels for addressing climate and development goals," INET Oxford Working Papers 2019-02, Institute for New Economic Thinking at the Oxford Martin School, University of Oxford, revised May 2019.
    4. Cotterman, Turner, 2019. "Why Rapid and Deep Decarbonization isn’t Simple: Linking Bottom-up Socio-technical Decision-making Insights with Top-down Macroeconomic Analyses," Conference papers 333088, Purdue University, Center for Global Trade Analysis, Global Trade Analysis Project.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Montalbano, Pierluigi, 2011. "Trade Openness and Developing Countries' Vulnerability: Concepts, Misconceptions, and Directions for Research," World Development, Elsevier, vol. 39(9), pages 1489-1502, September.
    2. Jean-François Hoarau & Nicolas Lucic, 2022. "Are real merchandise imports per capita a good predictor for the standard of living for the small island world: Testing for the imports-led growth and the growth-led imports hypotheses in panels over ," TEPP Working Paper 2022-16, TEPP.
    3. Angeon, Valérie & Bates, Samuel, 2015. "Reviewing Composite Vulnerability and Resilience Indexes: A Sustainable Approach and Application," World Development, Elsevier, vol. 72(C), pages 140-162.
    4. Lino P. Briguglio & Melchior Vella, 2015. "Labour demand in the EU and returns to scale: A production function approach," The Journal of International Trade & Economic Development, Taylor & Francis Journals, vol. 24(8), pages 1103-1116, December.
    5. Claire GOAVEC & Jean-François HOARAU, 2015. "Vulnérabilité Économique Structurelle Et Dépendance Touristique : Quels Enseignements Pour Les Petites Économies Insulaires En Développement," Region et Developpement, Region et Developpement, LEAD, Universite du Sud - Toulon Var, vol. 42, pages 157-188.
    6. Gnangnon, Sèna Kimm, 2023. "Effect of the duration of membership in the GATT/WTO on economic growth volatility," Structural Change and Economic Dynamics, Elsevier, vol. 65(C), pages 448-467.
    7. Thalis P. V. Zis & Harilaos N. Psaraftis, 2022. "Impacts of short-term measures to decarbonize maritime transport on perishable cargoes," Maritime Economics & Logistics, Palgrave Macmillan;International Association of Maritime Economists (IAME), vol. 24(3), pages 602-629, September.
    8. Zouhair Aït Benhamou & Lesly Cassin, 2018. "The effects of migration and remittances on development and capital in Caribbean Small Island Developing States," EconomiX Working Papers 2018-41, University of Paris Nanterre, EconomiX.
    9. Angelucci, Federica & Conforti, Piero, 2010. "Risk management and finance along value chains of Small Island Developing States. Evidence from the Caribbean and the Pacific," Food Policy, Elsevier, vol. 35(6), pages 565-575, December.
    10. Claire Goavec & Jean-François Hoarau, 2015. "Structural economic vulnerability and tourism dependence: new assessment for small island developing economies [Vulnérabilité économique structurelle et dépendance touristique : quels enseignements," Post-Print hal-01454720, HAL.
    11. Patrick GUILLAUMONT, 2014. "Measuring Structural Economic Vulnerability in Africa," Working Papers P97, FERDI.
    12. Christos A. Kontovas & Krishna Sooprayen, 2020. "Maritime Cargo Prioritisation during a Prolonged Pandemic Lockdown Using an Integrated TOPSIS-Knapsack Technique: A Case Study on Small Island Developing States—The Rodrigues Island," Sustainability, MDPI, vol. 12(19), pages 1-20, September.
    13. Jared C. Carbone & Linda T.M. Bui & Don Fullerton & Sergey Paltsev & Ian Sue Wing, 2022. "When and How to Use Economy-Wide Models for Environmental Policy Analysis," Annual Review of Resource Economics, Annual Reviews, vol. 14(1), pages 447-465, October.
    14. Liu, Yang & Dong, Kangyin & Jiang, Qingzhe, 2023. "Assessing energy vulnerability and its impact on carbon emissions: A global case," Energy Economics, Elsevier, vol. 119(C).
    15. Hosein, Roger & Satnarine-Singh, Nirvana & Saridakis, George, 2022. "The Spillover Effect of Exports: An Analysis of Caribbean SIDs," Economia Internazionale / International Economics, Camera di Commercio Industria Artigianato Agricoltura di Genova, vol. 75(1), pages 1-28.
    16. Gnangnon, Sèna Kimm, 2022. "Effect of structural economic vulnerability on the participation in international trade," EconStor Preprints 262004, ZBW - Leibniz Information Centre for Economics.
    17. Blancard, Stéphane & Hoarau, Jean-François, 2013. "A new sustainable human development indicator for small island developing states: A reappraisal from data envelopment analysis," Economic Modelling, Elsevier, vol. 30(C), pages 623-635.
    18. Luis Hernando Portillo-Riascos & Edinson Ortiz-Benavides, 2021. "The External Vulnerability of the Colombian Economy 1990-2015: A Comparative Analysis," Lecturas de Economía, Universidad de Antioquia, Departamento de Economía, issue 94, pages 11-46, Enero-Jun.
    19. Sèna Kimm Gnangnon, 2012. "Does Structural Economic Vulnerability Matter for Public Indebtedness in Developing Countries?," CERDI Working papers halshs-00749469, HAL.
    20. Hertel, Thomas, 2013. "Global Applied General Equilibrium Analysis Using the Global Trade Analysis Project Framework," Handbook of Computable General Equilibrium Modeling, in: Peter B. Dixon & Dale Jorgenson (ed.), Handbook of Computable General Equilibrium Modeling, edition 1, volume 1, chapter 0, pages 815-876, Elsevier.

    More about this item

    JEL classification:

    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • D58 - Microeconomics - - General Equilibrium and Disequilibrium - - - Computable and Other Applied General Equilibrium Models
    • C68 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computable General Equilibrium Models

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fsc:fstech:9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Barbara van der Hout (email available below). General contact details of provider: https://edirc.repec.org/data/ledlonl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.