IDEAS home Printed from https://ideas.repec.org/p/bde/wpaper/2235.html
   My bibliography  Save this paper

Using newspapers for textual indicators: which and how many?

Author

Listed:
  • Erik Andres-Escayola

    (European Central Bank)

  • Corinna Ghirelli

    (Banco de España)

  • Luis Molina

    (Banco de España)

  • Javier J. Pérez

    (Banco de España)

  • Elena Vidal

    (Banco de España)

Abstract

This paper investigates the role that two key methodological choices play in the construction of textual indicators: the selection of local versus foreign newspapers and the breadth of the press coverage (i.e. the number of newspapers considered). The large literature in this field is almost silent about the robustness of research results to these two choices. We use as a case study the well-known economic policy uncertainty (EPU) index, taking as examples Latin America and Spain. First, we develop EPU measures based on press with different levels of proximity, i.e. local versus foreign, and corroborate that they deliver broadly similar narratives. Second, we examine the macroeconomic effects of EPU shocks computed using these different sources by means of a structural Bayesian vector autoregression framework and find similar responses from the statistical point of view. Third, we show that constructing EPU indexes based on only one newspaper may yield biased responses. This suggests that it is important to maximize the breadth of press coverage when building text-based indicators, since this improves the credibility of results. In this regard, our first and second results are good news for researchers, given that they provide a justification for the combined use of a larger amount of data from local and foreign sources.

Suggested Citation

  • Erik Andres-Escayola & Corinna Ghirelli & Luis Molina & Javier J. Pérez & Elena Vidal, 2022. "Using newspapers for textual indicators: which and how many?," Working Papers 2235, Banco de España.
  • Handle: RePEc:bde:wpaper:2235
    as

    Download full text from publisher

    File URL: https://www.bde.es/f/webbde/SES/Secciones/Publicaciones/PublicacionesSeriadas/DocumentosTrabajo/22/Files/dt2235e.pdf
    File Function: First version, October 2022
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Huang, Yun & Luk, Paul, 2020. "Measuring economic policy uncertainty in China," China Economic Review, Elsevier, vol. 59(C).
    2. Nyman, Rickard & Kapadia, Sujit & Tuckett, David, 2021. "News and narratives in financial systems: Exploiting big data for systemic risk assessment," Journal of Economic Dynamics and Control, Elsevier, vol. 127(C).
    3. Caldara, Dario & Fuentes-Albero, Cristina & Gilchrist, Simon & Zakrajšek, Egon, 2016. "The macroeconomic impact of financial and uncertainty shocks," European Economic Review, Elsevier, vol. 88(C), pages 185-207.
    4. Scott R. Baker & Nicholas Bloom & Steven J. Davis, 2016. "Measuring Economic Policy Uncertainty," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1593-1636.
    5. Fraiberger, Samuel P. & Lee, Do & Puy, Damien & Ranciere, Romain, 2021. "Media sentiment and international asset prices," Journal of International Economics, Elsevier, vol. 133(C).
    6. Alexopoulos, Michelle & Cohen, Jon, 2015. "The power of print: Uncertainty shocks, markets, and the economy," International Review of Economics & Finance, Elsevier, vol. 40(C), pages 8-28.
    7. Mueller, Hannes & Rauh, Christopher, 2018. "Reading Between the Lines: Prediction of Political Violence Using Newspaper Text," American Political Science Review, Cambridge University Press, vol. 112(2), pages 358-375, May.
    8. Aguilar, Pablo & Ghirelli, Corinna & Pacce, Matías & Urtasun, Alberto, 2021. "Can news help measure economic sentiment? An application in COVID-19 times," Economics Letters, Elsevier, vol. 199(C).
    9. Rodrigo Cerda & Álvaro Silva & José Tomás Valente, 2018. "Impact of economic uncertainty in a small open economy: the case of Chile," Applied Economics, Taylor & Francis Journals, vol. 50(26), pages 2894-2908, June.
    10. Eleni Kalamara & Arthur Turrell & Chris Redl & George Kapetanios & Sujit Kapadia, 2022. "Making text count: Economic forecasting using newspaper text," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 896-919, August.
    11. Ghirelli, Corinna & Pérez, Javier J. & Urtasun, Alberto, 2021. "The spillover effects of economic policy uncertainty in Latin America on the Spanish economy," Latin American Journal of Central Banking (previously Monetaria), Elsevier, vol. 2(2).
    12. Ghirelli, Corinna & Pérez, Javier J. & Urtasun, Alberto, 2019. "A new economic policy uncertainty index for Spain," Economics Letters, Elsevier, vol. 182(C), pages 64-67.
    13. Leif Anders Thorsrud, 2020. "Words are the New Numbers: A Newsy Coincident Index of the Business Cycle," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(2), pages 393-409, April.
    14. Scotti, Chiara, 2016. "Surprise and uncertainty indexes: Real-time aggregation of real-activity macro-surprises," Journal of Monetary Economics, Elsevier, vol. 82(C), pages 1-19.
    15. R?diger Bachmann & Steffen Elstner & Eric R. Sims, 2013. "Uncertainty and Economic Activity: Evidence from Business Survey Data," American Economic Journal: Macroeconomics, American Economic Association, vol. 5(2), pages 217-249, April.
    16. Shapiro, Adam Hale & Sudhof, Moritz & Wilson, Daniel J., 2022. "Measuring news sentiment," Journal of Econometrics, Elsevier, vol. 228(2), pages 221-243.
    17. Ardia, David & Bluteau, Keven & Boudt, Kris, 2019. "Questioning the news about economic growth: Sparse forecasting using thousands of news-based sentiment values," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1370-1386.
    18. Michelle T. Armesto & Rub…N Hern¡Ndez-Murillo & Michael T. Owyang & Jeremy Piger, 2009. "Measuring the Information Content of the Beige Book: A Mixed Data Sampling Approach," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 41(1), pages 35-55, February.
    19. Rambaccussing, Dooruj & Kwiatkowski, Andrzej, 2020. "Forecasting with news sentiment: Evidence with UK newspapers," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1501-1516.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Aprigliano, Valentina & Emiliozzi, Simone & Guaitoli, Gabriele & Luciani, Andrea & Marcucci, Juri & Monteforte, Libero, 2023. "The power of text-based indicators in forecasting Italian economic activity," International Journal of Forecasting, Elsevier, vol. 39(2), pages 791-808.
    2. Saiz, Lorena & Ashwin, Julian & Kalamara, Eleni, 2021. "Nowcasting euro area GDP with news sentiment: a tale of two crises," Working Paper Series 2616, European Central Bank.
    3. Dooruj Rambaccussing & Craig Menzies & Andrzej Kwiatkowski, 2022. "Look who’s Talking: Individual Committee members’ impact on inflation expectations," Dundee Discussion Papers in Economics 305, Economic Studies, University of Dundee.
    4. Tosapol Apaitan & Pongsak Luangaram & Pym Manopimoke, 2022. "Uncertainty in an emerging market economy: evidence from Thailand," Empirical Economics, Springer, vol. 62(3), pages 933-989, March.
    5. Oscar Claveria, 2021. "On the Aggregation of Survey-Based Economic Uncertainty Indicators Between Different Agents and Across Variables," Journal of Business Cycle Research, Springer;Centre for International Research on Economic Tendency Surveys (CIRET), vol. 17(1), pages 1-26, April.
    6. Eleni Kalamara & Arthur Turrell & Chris Redl & George Kapetanios & Sujit Kapadia, 2022. "Making text count: Economic forecasting using newspaper text," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 896-919, August.
    7. Nyman, Rickard & Kapadia, Sujit & Tuckett, David, 2021. "News and narratives in financial systems: Exploiting big data for systemic risk assessment," Journal of Economic Dynamics and Control, Elsevier, vol. 127(C).
    8. Dorinth van Dijk & Jasper de Winter, 2023. "Nowcasting GDP using tone-adjusted time varying news topics: Evidence from the financial press," Working Papers 766, DNB.
    9. Oscar Claveria, 2021. "Disagreement on expectations: firms versus consumers," SN Business & Economics, Springer, vol. 1(12), pages 1-23, December.
    10. Oscar Claveria, 2020. "“Measuring and assessing economic uncertainty”," AQR Working Papers 2012003, University of Barcelona, Regional Quantitative Analysis Group, revised Jul 2020.
    11. Oscar Claveria, 2021. "Uncertainty indicators based on expectations of business and consumer surveys," Empirica, Springer;Austrian Institute for Economic Research;Austrian Economic Association, vol. 48(2), pages 483-505, May.
    12. Simionescu, Mihaela, 2022. "Econometrics of sentiments- sentometrics and machine learning: The improvement of inflation predictions in Romania using sentiment analysis," Technological Forecasting and Social Change, Elsevier, vol. 182(C).
    13. Marc Burri & Daniel Kaufmann, 2020. "A daily fever curve for the Swiss economy," Swiss Journal of Economics and Statistics, Springer;Swiss Society of Economics and Statistics, vol. 156(1), pages 1-11, December.
    14. Meinen, Philipp & Roehe, Oke, 2018. "To sign or not to sign? On the response of prices to financial and uncertainty shocks," Economics Letters, Elsevier, vol. 171(C), pages 189-192.
    15. Himounet, Nicolas, 2022. "Searching the nature of uncertainty: Macroeconomic and financial risks VS geopolitical and pandemic risks," International Economics, Elsevier, vol. 170(C), pages 1-31.
    16. Efrem Castelnuovo, 2019. "Yield Curve and Financial Uncertainty: Evidence Based on US Data," Australian Economic Review, The University of Melbourne, Melbourne Institute of Applied Economic and Social Research, vol. 52(3), pages 323-335, September.
    17. Morikawa, Masayuki, 2019. "Uncertainty over production forecasts: An empirical analysis using monthly quantitative survey data," Journal of Macroeconomics, Elsevier, vol. 60(C), pages 163-179.
    18. Josué Diwambuena & Jean-Paul K. Tsasa, 2021. "The Real Effects of Uncertainty Shocks: New Evidence from Linear and Nonlinear SVAR Models," BEMPS - Bozen Economics & Management Paper Series BEMPS87, Faculty of Economics and Management at the Free University of Bozen.
    19. Giovanni Caggiano & Efrem Castelnuovo & Gabriela Nodari, 2014. "Uncertainty and Monetary Policy in Good and Bad Times," "Marco Fanno" Working Papers 0188, Dipartimento di Scienze Economiche "Marco Fanno".
    20. Shinohara, Takeshi & Okuda, Tatsushi & Nakajima, Jouchi, 2021. "Characteristics of Uncertainty Indices in the Macroeconomy," Economic Review, Hitotsubashi University, vol. 72(3), pages 246-267, July.

    More about this item

    Keywords

    economic policy uncertainty; textual analysis; press coverage; Latin American economies; business cycles;
    All these keywords.

    JEL classification:

    • D80 - Microeconomics - - Information, Knowledge, and Uncertainty - - - General
    • C43 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Index Numbers and Aggregation
    • E32 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Business Fluctuations; Cycles
    • O11 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Macroeconomic Analyses of Economic Development

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bde:wpaper:2235. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Ángel Rodríguez. Electronic Dissemination of Information Unit. Research Department. Banco de España (email available below). General contact details of provider: https://edirc.repec.org/data/bdegves.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.