IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v34y2018i2p355-365.html
   My bibliography  Save this article

Belgian economic policy uncertainty index: Improvement through text mining

Author

Listed:
  • Tobback, Ellen
  • Naudts, Hans
  • Daelemans, Walter
  • Junqué de Fortuny, Enric
  • Martens, David

Abstract

Recently, the literature has measured economic policy uncertainty using news references, resulting in the frequently-mentioned ‘Economic Policy Uncertainty index’ (EPU). In the original setup, a news article is assumed to address policy uncertainty if it contains certain predefined keywords. We argue that the original setup is prone to measurement error, and propose an alternative methodology using text mining techniques. We compare the original method to modality annotation and support vector machines (SVM) classification in order to create an EPU index for Belgium. Validation on an out-of-sample test set speaks in favour of using an SVM classification model for constructing a news-based policy uncertainty indicator. The indicators are then used to forecast 10 macroeconomic and financial variables. The original method of measuring EPU does not have predictive power for any of these 10 variables. The SVM indicator has a higher predictive power and, notably, changes in the level of policy uncertainty during tumultuous periods of high uncertainty and risk can predict changes in the sovereign bond yield and spread, the credit default swap spread, and consumer confidence.

Suggested Citation

  • Tobback, Ellen & Naudts, Hans & Daelemans, Walter & Junqué de Fortuny, Enric & Martens, David, 2018. "Belgian economic policy uncertainty index: Improvement through text mining," International Journal of Forecasting, Elsevier, vol. 34(2), pages 355-365.
  • Handle: RePEc:eee:intfor:v:34:y:2018:i:2:p:355-365
    DOI: 10.1016/j.ijforecast.2016.08.006
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S016920701630098X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2016.08.006?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    2. Shujaat Khan & Edward S. Knotek, 2011. "How do households respond to uncertainty shocks?," Economic Review, Federal Reserve Bank of Kansas City, vol. 96(Q II).
    3. Todd Clark & Michael McCracken, 2012. "Reality Checks and Comparisons of Nested Predictive Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(1), pages 53-66.
    4. Nicholas Bloom, 2009. "The Impact of Uncertainty Shocks," Econometrica, Econometric Society, vol. 77(3), pages 623-685, May.
    5. Paul Neisingh & Ad Stokman, 2013. "What drives consumer confidence in times of financial crises? Evidence for the Netherlands," DNB Working Papers 394, Netherlands Central Bank, Research Department.
    6. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    7. Francis X. Diebold, 2015. "Comparing Predictive Accuracy, Twenty Years Later: A Personal Perspective on the Use and Abuse of Diebold-Mariano Tests," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(1), pages 1-1, January.
    8. Scott R. Baker & Nicholas Bloom & Steven J. Davis, 2016. "Measuring Economic Policy Uncertainty," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1593-1636.
    9. R?diger Bachmann & Steffen Elstner & Eric R. Sims, 2013. "Uncertainty and Economic Activity: Evidence from Business Survey Data," American Economic Journal: Macroeconomics, American Economic Association, vol. 5(2), pages 217-249, April.
    10. Narcissa Balta & Ismael Valdes Fernandez & Eric Ruscher, 2013. "Assessing the impact of uncertainty on consumption and investment," Quarterly Report on the Euro Area (QREA), Directorate General Economic and Financial Affairs (DG ECFIN), European Commission, vol. 12(2), pages 7-16, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mawuli Segnon & Rangan Gupta & Stelios Bekiros & Mark E. Wohar, 2018. "Forecasting US GNP growth: The role of uncertainty," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 37(5), pages 541-559, August.
    2. Granziera, Eleonora & Sekhposyan, Tatevik, 2019. "Predicting relative forecasting performance: An empirical investigation," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1636-1657.
    3. Wensheng Kang & Ronald A. Ratti & Joaquin Vespignani, 2020. "Impact of global uncertainty on the global economy and large developed and developing economies," Applied Economics, Taylor & Francis Journals, vol. 52(22), pages 2392-2407, May.
    4. Magnus Reif, 2020. "Macroeconomics, Nonlinearities, and the Business Cycle," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 87.
    5. Ahmed Ali & Granberg Mark & Uddin Gazi Salah & Troster Victor, 2022. "Asymmetric dynamics between uncertainty and unemployment flows in the United States," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 26(1), pages 155-172, February.
    6. Angus Moore, 2017. "Measuring Economic Uncertainty and Its Effects," The Economic Record, The Economic Society of Australia, vol. 93(303), pages 550-575, December.
    7. Tosapol Apaitan & Pongsak Luangaram & Pym Manopimoke, 2022. "Uncertainty in an emerging market economy: evidence from Thailand," Empirical Economics, Springer, vol. 62(3), pages 933-989, March.
    8. Reif Magnus, 2021. "Macroeconomic uncertainty and forecasting macroeconomic aggregates," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 25(2), pages 1-20, April.
    9. Bas Aarle & Cindy Moons, 2017. "Sentiment and Uncertainty Fluctuations and Their Effects on the Euro Area Business Cycle," Journal of Business Cycle Research, Springer;Centre for International Research on Economic Tendency Surveys (CIRET), vol. 13(2), pages 225-251, November.
    10. Joëts, Marc & Mignon, Valérie & Razafindrabe, Tovonony, 2017. "Does the volatility of commodity prices reflect macroeconomic uncertainty?," Energy Economics, Elsevier, vol. 68(C), pages 313-326.
    11. Christou, Christina & Gupta, Rangan, 2020. "Forecasting equity premium in a panel of OECD countries: The role of economic policy uncertainty," The Quarterly Review of Economics and Finance, Elsevier, vol. 76(C), pages 243-248.
    12. Daniel Borup & Jonas N. Eriksen & Mads M. Kjær & Martin Thyrsgaard, 2020. "Predicting bond return predictability," CREATES Research Papers 2020-09, Department of Economics and Business Economics, Aarhus University.
    13. Tosapol Apaitan & Pongsak Luangaram & Pym Manopimoke, 2020. "Uncertainty and Economic Activity: Does it Matter for Thailand?," PIER Discussion Papers 130, Puey Ungphakorn Institute for Economic Research.
    14. Jerow, Sam & Wolff, Jonathan, 2022. "Fiscal policy and uncertainty," Journal of Economic Dynamics and Control, Elsevier, vol. 145(C).
    15. Balcilar, Mehmet & Demirer, Riza & Gupta, Rangan & van Eyden, Reneé, 2017. "The impact of US policy uncertainty on the monetary effectiveness in the Euro area," Journal of Policy Modeling, Elsevier, vol. 39(6), pages 1052-1064.
    16. Mehmet Balcilar & Riza Demirer & Rangan Gupta & Reneé van Eyden, 2016. "Effectiveness of Monetary Policy in the Euro Area: The Role of US Economic Policy Uncertainty," Working Papers 201620, University of Pretoria, Department of Economics.
    17. M. E. Bontempi & R. Golinelli & M. Squadrani, 2016. "A New Index of Uncertainty Based on Internet Searches: A Friend or Foe of Other Indicators?," Working Papers wp1062, Dipartimento Scienze Economiche, Universita' di Bologna.
    18. Claeys, Peter & Vašíček, Bořek, 2019. "Transmission of uncertainty shocks: Learning from heterogeneous responses on a panel of EU countries," International Review of Economics & Finance, Elsevier, vol. 64(C), pages 62-83.
    19. Śmiech, Sławomir & Papież, Monika, 2018. "Volatility spillovers among uncertainty measures. The case of EU member states," MPRA Paper 90319, University Library of Munich, Germany.
    20. Bucci, Andrea & Palomba, Giulio & Rossi, Eduardo, 2023. "The role of uncertainty in forecasting volatility comovements across stock markets," Economic Modelling, Elsevier, vol. 125(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:34:y:2018:i:2:p:355-365. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.