IDEAS home Printed from https://ideas.repec.org/p/bdi/wptemi/td_1321_21.html
   My bibliography  Save this paper

The power of text-based indicators in forecasting the Italian economic activity

Author

Listed:
  • Valentina Aprigliano

    (Bank of Italy)

  • Simone Emiliozzi

    (Bank of Italy)

  • Gabriele Guaitoli

    (University of Warwick)

  • Andrea Luciani

    (Bank of Italy)

  • Juri Marcucci

    (Bank of Italy)

  • Libero Monteforte

    (Ufficio Parlamentare di Bilancio, Bank of Italy)

Abstract

Can we use newspaper articles to forecast economic activity? Our answer is yes and, to this end, we propose a brand new economic dictionary in Italian with valence shifters, and we apply it to a corpus of about two million articles from four popular newspapers. We produce a set of high-frequency text-based sentiment and policy uncertainty indicators (TESI and TEPU respectively), which are constantly updated, not revised and computed both for the whole economy and for specific sectors or economic topics. To test the predictive power of our text-based indicators, we propose two forecasting exercises. First, by using Bayesian Model Averaging (BMA) techniques, we show that our monthly text-based indicators greatly reduce the uncertainty surrounding the short-term forecasts of the main macroeconomic aggregates, especially during recessions. Secondly, we employ these indices in a weekly GDP growth tracker, achieving sizeable gains in forecasting accuracy in both normal and turbulent times.

Suggested Citation

  • Valentina Aprigliano & Simone Emiliozzi & Gabriele Guaitoli & Andrea Luciani & Juri Marcucci & Libero Monteforte, 2021. "The power of text-based indicators in forecasting the Italian economic activity," Temi di discussione (Economic working papers) 1321, Bank of Italy, Economic Research and International Relations Area.
  • Handle: RePEc:bdi:wptemi:td_1321_21
    as

    Download full text from publisher

    File URL: https://www.bancaditalia.it/pubblicazioni/temi-discussione/2021/2021-1321/en_tema_1321.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Olivier Armantier & Scott Nelson & Giorgio Topa & Wilbert van der Klaauw & Basit Zafar, 2016. "The Price Is Right: Updating Inflation Expectations in a Randomized Price Information Experiment," The Review of Economics and Statistics, MIT Press, vol. 98(3), pages 503-523, July.
    2. Matthew Gentzkow & Bryan Kelly & Matt Taddy, 2019. "Text as Data," Journal of Economic Literature, American Economic Association, vol. 57(3), pages 535-574, September.
    3. Fernandez, Carmen & Ley, Eduardo & Steel, Mark F. J., 2001. "Benchmark priors for Bayesian model averaging," Journal of Econometrics, Elsevier, vol. 100(2), pages 381-427, February.
    4. Guerino Ardizzi & Simone Emiliozzi & Juri Marcucci & Libero Monteforte, 2019. "News and consumer card payments," Temi di discussione (Economic working papers) 1233, Bank of Italy, Economic Research and International Relations Area.
    5. Eleni Kalamara & Arthur Turrell & Chris Redl & George Kapetanios & Sujit Kapadia, 2022. "Making text count: Economic forecasting using newspaper text," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 896-919, August.
    6. R?diger Bachmann & Steffen Elstner & Eric R. Sims, 2013. "Uncertainty and Economic Activity: Evidence from Business Survey Data," American Economic Journal: Macroeconomics, American Economic Association, vol. 5(2), pages 217-249, April.
    7. Leland Bybee & Bryan T. Kelly & Asaf Manela & Dacheng Xiu, 2021. "Business News and Business Cycles," NBER Working Papers 29344, National Bureau of Economic Research, Inc.
    8. Stefano Neri & Stefano Siviero, 2019. "The non-standard monetary policy measures of the ECB: motivations, effectiveness and risks," Questioni di Economia e Finanza (Occasional Papers) 486, Bank of Italy, Economic Research and International Relations Area.
    9. Scott R. Baker & Nicholas Bloom & Steven J. Davis, 2016. "Measuring Economic Policy Uncertainty," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1593-1636.
    10. Brandyn Bok & Daniele Caratelli & Domenico Giannone & Argia M. Sbordone & Andrea Tambalotti, 2018. "Macroeconomic Nowcasting and Forecasting with Big Data," Annual Review of Economics, Annual Reviews, vol. 10(1), pages 615-643, August.
    11. Tim Loughran & Bill Mcdonald, 2014. "Measuring Readability in Financial Disclosures," Journal of Finance, American Finance Association, vol. 69(4), pages 1643-1671, August.
    12. Carmen Fernandez & Eduardo Ley & Mark F. J. Steel, 2001. "Model uncertainty in cross-country growth regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 16(5), pages 563-576.
    13. Tim Groseclose & Jeffrey Milyo, 2005. "A Measure of Media Bias," The Quarterly Journal of Economics, Oxford University Press, vol. 120(4), pages 1191-1237.
    14. Bartosz Maćkowiak & Filip Matějka & Mirko Wiederholt, 2023. "Rational Inattention: A Review," Journal of Economic Literature, American Economic Association, vol. 61(1), pages 226-273, March.
    15. Lorenzo Bencivelli & Massimiliano Marcellino & Gianluca Moretti, 2017. "Forecasting economic activity by Bayesian bridge model averaging," Empirical Economics, Springer, vol. 53(1), pages 21-40, August.
    16. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    17. Angelico, Cristina & Marcucci, Juri & Miccoli, Marcello & Quarta, Filippo, 2022. "Can we measure inflation expectations using Twitter?," Journal of Econometrics, Elsevier, vol. 228(2), pages 259-277.
    18. Paul C. Tetlock, 2007. "Giving Content to Investor Sentiment: The Role of Media in the Stock Market," Journal of Finance, American Finance Association, vol. 62(3), pages 1139-1168, June.
    19. Altig, Dave & Baker, Scott & Barrero, Jose Maria & Bloom, Nicholas & Bunn, Philip & Chen, Scarlet & Davis, Steven J. & Leather, Julia & Meyer, Brent & Mihaylov, Emil & Mizen, Paul & Parker, Nicholas &, 2020. "Economic uncertainty before and during the COVID-19 pandemic," Journal of Public Economics, Elsevier, vol. 191(C).
    20. Chow, Gregory C & Lin, An-loh, 1971. "Best Linear Unbiased Interpolation, Distribution, and Extrapolation of Time Series by Related Series," The Review of Economics and Statistics, MIT Press, vol. 53(4), pages 372-375, November.
    21. Shapiro, Adam Hale & Sudhof, Moritz & Wilson, Daniel J., 2022. "Measuring news sentiment," Journal of Econometrics, Elsevier, vol. 228(2), pages 221-243.
    22. Matthew Gentzkow & Jesse M. Shapiro, 2010. "What Drives Media Slant? Evidence From U.S. Daily Newspapers," Econometrica, Econometric Society, vol. 78(1), pages 35-71, January.
    23. Serena Ng & Jonathan H. Wright, 2013. "Facts and Challenges from the Great Recession for Forecasting and Macroeconomic Modeling," Journal of Economic Literature, American Economic Association, vol. 51(4), pages 1120-1154, December.
    24. Saiz, Lorena & Ashwin, Julian & Kalamara, Eleni, 2021. "Nowcasting euro area GDP with news sentiment: a tale of two crises," Working Paper Series 2616, European Central Bank.
    25. Amisano, Gianni & Giacomini, Raffaella, 2007. "Comparing Density Forecasts via Weighted Likelihood Ratio Tests," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 177-190, April.
    26. Leland Bybee & Bryan T. Kelly & Asaf Manela & Dacheng Xiu, 2020. "The Structure of Economic News," NBER Working Papers 26648, National Bureau of Economic Research, Inc.
    27. Sims, Christopher A., 2003. "Implications of rational inattention," Journal of Monetary Economics, Elsevier, vol. 50(3), pages 665-690, April.
    28. Daniel J. Lewis & Karel Mertens & James H. Stock & Mihir Trivedi, 2022. "Measuring real activity using a weekly economic index," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(4), pages 667-687, June.
    29. George-Marios Angeletos & Chen Lian, 2016. "Incomplete Information in Macroeconomics: Accommodating Frictions in Coordination," NBER Working Papers 22297, National Bureau of Economic Research, Inc.
    30. Donadelli, Michael & Gufler, Ivan & Pellizzari, Paolo, 2020. "The macro and asset pricing implications of rising Italian uncertainty: Evidence from a novel news-based macroeconomic policy uncertainty index," Economics Letters, Elsevier, vol. 197(C).
    31. Matthew Gentzkow & Jesse M. Shapiro & Matt Taddy, 2019. "Measuring Group Differences in High‐Dimensional Choices: Method and Application to Congressional Speech," Econometrica, Econometric Society, vol. 87(4), pages 1307-1340, July.
    32. Tim Loughran & Bill Mcdonald, 2011. "When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10‐Ks," Journal of Finance, American Finance Association, vol. 66(1), pages 35-65, February.
    33. Hartmann, Philipp & Smets, Frank, 2018. "The first twenty years of the European Central Bank: monetary policy," Working Paper Series 2219, European Central Bank.
    34. Eraslan, Sercan & Götz, Thomas, 2021. "An unconventional weekly economic activity index for Germany," Economics Letters, Elsevier, vol. 204(C).
    35. John H. Rogers & Jiawen Xu, 2019. "How Well Does Economic Uncertainty Forecast Economic Activity?," Finance and Economics Discussion Series 2019-085, Board of Governors of the Federal Reserve System (U.S.).
    36. Angeletos, G.-M. & Lian, C., 2016. "Incomplete Information in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 1065-1240, Elsevier.
    37. Rambaccussing, Dooruj & Kwiatkowski, Andrzej, 2020. "Forecasting with news sentiment: Evidence with UK newspapers," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1501-1516.
    38. Ardia, David & Bluteau, Keven & Boudt, Kris, 2019. "Questioning the news about economic growth: Sparse forecasting using thousands of news-based sentiment values," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1370-1386.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Audinga Baltrunaite & Mario Cannella & Sauro Mocetti & Giacomo Roma, "undated". "Board composition and performance of state-owned enterprises: Quasi-experimental evidence," Temi di discussione (Economic working papers) 1328, Bank of Italy, Economic Research and International Relations Area.
    2. Claudia Maurini & Alessandro Schiavone, 2021. "The catalytic role of IMF programs," Temi di discussione (Economic working papers) 1331, Bank of Italy, Economic Research and International Relations Area.
    3. Claudia Pacella, 2021. "Dating the euro area business cycle: an evaluation," Temi di discussione (Economic working papers) 1332, Bank of Italy, Economic Research and International Relations Area.
    4. Gerardin Mathilde, & Ranvier Martial., 2021. "Enrichment of the Banque de France’s monthly business survey: lessons from textual analysis of business leaders’ comments," Working papers 821, Banque de France.
    5. Valentina Michelangeli & Eliana Viviano, 2021. "Can internet banking affect households' participation in financial markets and financial awareness?," Temi di discussione (Economic working papers) 1329, Bank of Italy, Economic Research and International Relations Area.
    6. Saiz, Lorena & Ashwin, Julian & Kalamara, Eleni, 2021. "Nowcasting euro area GDP with news sentiment: a tale of two crises," Working Paper Series 2616, European Central Bank.
    7. Jonathan Huntley & Valentina Michelangeli & Felix Reichling, 2021. "What drives investors to chase returns?," Temi di discussione (Economic working papers) 1334, Bank of Italy, Economic Research and International Relations Area.
    8. Lorenzo Bencivelli & Beniamino Pisicoli, 2021. "Foreign investors and target firms’ financial structure: cavalry or locusts?," Temi di discussione (Economic working papers) 1327, Bank of Italy, Economic Research and International Relations Area.
    9. Valentina Aprigliano & Guerino Ardizzi & Alessia Cassetta & Alessandro Cavallero & Simone Emiliozzi & Alessandro Gambini & Nazzareno Renzi & Roberta Zizza, 2021. "Exploiting payments to track Italian economic activity: the experience at Banca d’Italia," Questioni di Economia e Finanza (Occasional Papers) 609, Bank of Italy, Economic Research and International Relations Area.
    10. De Bandt Olivier & Bricongne Jean-Charles & Denes Julien & Dhenin Alexandre & De Gaye Annabelle & Robert Pierre-Antoine, 2023. "Using the Press to Construct a New Indicator of Inflation Perceptions in France," Working papers 921, Banque de France.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jon Ellingsen & Vegard H. Larsen & Leif Anders Thorsrud, 2022. "News media versus FRED‐MD for macroeconomic forecasting," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(1), pages 63-81, January.
    2. Saiz, Lorena & Ashwin, Julian & Kalamara, Eleni, 2021. "Nowcasting euro area GDP with news sentiment: a tale of two crises," Working Paper Series 2616, European Central Bank.
    3. Eleni Kalamara & Arthur Turrell & Chris Redl & George Kapetanios & Sujit Kapadia, 2022. "Making text count: Economic forecasting using newspaper text," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 896-919, August.
    4. Dorinth van Dijk & Jasper de Winter, 2023. "Nowcasting GDP using tone-adjusted time varying news topics: Evidence from the financial press," Working Papers 766, DNB.
    5. Andres Algaba & David Ardia & Keven Bluteau & Samuel Borms & Kris Boudt, 2020. "Econometrics Meets Sentiment: An Overview Of Methodology And Applications," Journal of Economic Surveys, Wiley Blackwell, vol. 34(3), pages 512-547, July.
    6. Bennani, Hamza, 2018. "Media coverage and ECB policy-making: Evidence from an augmented Taylor rule," Journal of Macroeconomics, Elsevier, vol. 57(C), pages 26-38.
    7. Jon Ellingsen & Vegard H. Larsen & Leif Anders Thorsrud, 2020. "News Media vs. FRED-MD for Macroeconomic Forecasting," CESifo Working Paper Series 8639, CESifo.
    8. Erik Andres-Escayola & Corinna Ghirelli & Luis Molina & Javier J. Pérez & Elena Vidal, 2022. "Using newspapers for textual indicators: which and how many?," Working Papers 2235, Banco de España.
    9. Vegard H�ghaug Larsen & Leif Anders Thorsrud, 2018. "Business cycle narratives," Working Papers No 6/2018, Centre for Applied Macro- and Petroleum economics (CAMP), BI Norwegian Business School.
    10. Hansen, Stephen & Davis, Steven & Seminario-Amez, Cristhian, 2020. "Firm-level Risk Exposures and Stock Returns in the Wake of COVID-19," CEPR Discussion Papers 15314, C.E.P.R. Discussion Papers.
    11. Nyman, Rickard & Kapadia, Sujit & Tuckett, David, 2021. "News and narratives in financial systems: Exploiting big data for systemic risk assessment," Journal of Economic Dynamics and Control, Elsevier, vol. 127(C).
    12. Matthew Gentzkow & Bryan T. Kelly & Matt Taddy, 2017. "Text as Data," NBER Working Papers 23276, National Bureau of Economic Research, Inc.
    13. Martin Baumgaertner & Johannes Zahner, 2021. "Whatever it takes to understand a central banker - Embedding their words using neural networks," MAGKS Papers on Economics 202130, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
    14. Stolbov, Mikhail & Shchepeleva, Maria & Karminsky, Alexander, 2022. "When central bank research meets Google search: A sentiment index of global financial stress," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 81(C).
    15. Gómez-Cram, Roberto & Grotteria, Marco, 2022. "Real-time price discovery via verbal communication: Method and application to Fedspeak," Journal of Financial Economics, Elsevier, vol. 143(3), pages 993-1025.
    16. Consoli, Sergio & Pezzoli, Luca Tiozzo & Tosetti, Elisa, 2021. "Emotions in macroeconomic news and their impact on the European bond market," Journal of International Money and Finance, Elsevier, vol. 118(C).
    17. Dooruj Rambaccussing & Craig Menzies & Andrzej Kwiatkowski, 2022. "Look who’s Talking: Individual Committee members’ impact on inflation expectations," Dundee Discussion Papers in Economics 305, Economic Studies, University of Dundee.
    18. Heng Chen & Li Han, 2022. "Do the Media Bow to Foreign Economic Powers? Evidence from a News Website Crackdown," HKUST CEP Working Papers Series 202201, HKUST Center for Economic Policy.
    19. Anesti, Nikoleta & Kalamara, Eleni & Kapetanios, George, 2021. "Forecasting UK GDP growth with large survey panels," Bank of England working papers 923, Bank of England.
    20. Ashwin,Julian & Rao,Vijayendra & Biradavolu,Monica Rao & Chhabra,Aditya & Haque,Arshia & Khan,Afsana Iffat & Krishnan,Nandini, 2022. "A Method to Scale-Up Interpretative Qualitative Analysis, with an Application toAspirations in Cox’s Bazaar, Bangladesh," Policy Research Working Paper Series 10046, The World Bank.

    More about this item

    Keywords

    Forecasting; Text Mining; Sentiment; Economic Policy Uncertainty; Big data; BMA.;
    All these keywords.

    JEL classification:

    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C43 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Index Numbers and Aggregation
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C55 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Large Data Sets: Modeling and Analysis
    • E52 - Macroeconomics and Monetary Economics - - Monetary Policy, Central Banking, and the Supply of Money and Credit - - - Monetary Policy
    • E58 - Macroeconomics and Monetary Economics - - Monetary Policy, Central Banking, and the Supply of Money and Credit - - - Central Banks and Their Policies

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bdi:wptemi:td_1321_21. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/bdigvit.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.