IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v39y2023i2p791-808.html
   My bibliography  Save this article

The power of text-based indicators in forecasting Italian economic activity

Author

Listed:
  • Aprigliano, Valentina
  • Emiliozzi, Simone
  • Guaitoli, Gabriele
  • Luciani, Andrea
  • Marcucci, Juri
  • Monteforte, Libero

Abstract

Can we use newspaper articles to forecast economic activity? Our answer is yes; and, to this end, we propose a high-frequency Text-based Economic Sentiment Index (TESI) and a Text-based Economic Policy Uncertainty (TEPU) for Italy. Novel survey evidence regarding Italian firms and households supports the rationale behind studying text data for the purposes of forecasting. Such indices are extracted from approximately 1.5 million articles from 4 popular newspapers, using a novel Italian economic dictionary with valence shifters. The TESI and TEPU can be updated daily for the whole economy and for specific sectors or economic topics. To test the predictive power of our indicators, we propose two forecasting exercises. Firstly, we use Bayesian Model Averaging (BMA) techniques to show that our monthly text-based indicators greatly reduce the uncertainty surrounding the short-term predictions of the main macroeconomic aggregates, especially during recessions. Secondly, we employ these indices in a weekly GDP tracker, achieving sizeable gains in forecasting accuracy, both in normal and turbulent times.

Suggested Citation

  • Aprigliano, Valentina & Emiliozzi, Simone & Guaitoli, Gabriele & Luciani, Andrea & Marcucci, Juri & Monteforte, Libero, 2023. "The power of text-based indicators in forecasting Italian economic activity," International Journal of Forecasting, Elsevier, vol. 39(2), pages 791-808.
  • Handle: RePEc:eee:intfor:v:39:y:2023:i:2:p:791-808
    DOI: 10.1016/j.ijforecast.2022.02.006
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207022000358
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2022.02.006?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Olivier Armantier & Scott Nelson & Giorgio Topa & Wilbert van der Klaauw & Basit Zafar, 2016. "The Price Is Right: Updating Inflation Expectations in a Randomized Price Information Experiment," The Review of Economics and Statistics, MIT Press, vol. 98(3), pages 503-523, July.
    2. Tim Loughran & Bill Mcdonald, 2014. "Measuring Readability in Financial Disclosures," Journal of Finance, American Finance Association, vol. 69(4), pages 1643-1671, August.
    3. Altig, Dave & Baker, Scott & Barrero, Jose Maria & Bloom, Nicholas & Bunn, Philip & Chen, Scarlet & Davis, Steven J. & Leather, Julia & Meyer, Brent & Mihaylov, Emil & Mizen, Paul & Parker, Nicholas &, 2020. "Economic uncertainty before and during the COVID-19 pandemic," Journal of Public Economics, Elsevier, vol. 191(C).
    4. Serena Ng & Jonathan H. Wright, 2013. "Facts and Challenges from the Great Recession for Forecasting and Macroeconomic Modeling," Journal of Economic Literature, American Economic Association, vol. 51(4), pages 1120-1154, December.
    5. Leland Bybee & Bryan T. Kelly & Asaf Manela & Dacheng Xiu, 2020. "The Structure of Economic News," NBER Working Papers 26648, National Bureau of Economic Research, Inc.
    6. Scott R. Baker & Nicholas Bloom & Steven J. Davis, 2016. "Measuring Economic Policy Uncertainty," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1593-1636.
    7. Amisano, Gianni & Giacomini, Raffaella, 2007. "Comparing Density Forecasts via Weighted Likelihood Ratio Tests," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 177-190, April.
    8. Carmen Fernandez & Eduardo Ley & Mark F. J. Steel, 2001. "Model uncertainty in cross-country growth regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 16(5), pages 563-576.
    9. Brandyn Bok & Daniele Caratelli & Domenico Giannone & Argia M. Sbordone & Andrea Tambalotti, 2018. "Macroeconomic Nowcasting and Forecasting with Big Data," Annual Review of Economics, Annual Reviews, vol. 10(1), pages 615-643, August.
    10. Matthew Gentzkow & Bryan Kelly & Matt Taddy, 2019. "Text as Data," Journal of Economic Literature, American Economic Association, vol. 57(3), pages 535-574, September.
    11. Fernandez, Carmen & Ley, Eduardo & Steel, Mark F. J., 2001. "Benchmark priors for Bayesian model averaging," Journal of Econometrics, Elsevier, vol. 100(2), pages 381-427, February.
    12. Guerino Ardizzi & Simone Emiliozzi & Juri Marcucci & Libero Monteforte, 2019. "News and consumer card payments," Temi di discussione (Economic working papers) 1233, Bank of Italy, Economic Research and International Relations Area.
    13. Eleni Kalamara & Arthur Turrell & Chris Redl & George Kapetanios & Sujit Kapadia, 2022. "Making text count: Economic forecasting using newspaper text," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 896-919, August.
    14. Tim Groseclose & Jeffrey Milyo, 2005. "A Measure of Media Bias," The Quarterly Journal of Economics, Oxford University Press, vol. 120(4), pages 1191-1237.
    15. Chow, Gregory C & Lin, An-loh, 1971. "Best Linear Unbiased Interpolation, Distribution, and Extrapolation of Time Series by Related Series," The Review of Economics and Statistics, MIT Press, vol. 53(4), pages 372-375, November.
    16. R?diger Bachmann & Steffen Elstner & Eric R. Sims, 2013. "Uncertainty and Economic Activity: Evidence from Business Survey Data," American Economic Journal: Macroeconomics, American Economic Association, vol. 5(2), pages 217-249, April.
    17. Matthew Gentzkow & Jesse M. Shapiro, 2010. "What Drives Media Slant? Evidence From U.S. Daily Newspapers," Econometrica, Econometric Society, vol. 78(1), pages 35-71, January.
    18. Saiz, Lorena & Ashwin, Julian & Kalamara, Eleni, 2021. "Nowcasting euro area GDP with news sentiment: a tale of two crises," Working Paper Series 2616, European Central Bank.
    19. Sims, Christopher A., 2003. "Implications of rational inattention," Journal of Monetary Economics, Elsevier, vol. 50(3), pages 665-690, April.
    20. Shapiro, Adam Hale & Sudhof, Moritz & Wilson, Daniel J., 2022. "Measuring news sentiment," Journal of Econometrics, Elsevier, vol. 228(2), pages 221-243.
    21. George-Marios Angeletos & Chen Lian, 2016. "Incomplete Information in Macroeconomics: Accommodating Frictions in Coordination," NBER Working Papers 22297, National Bureau of Economic Research, Inc.
    22. Matthew Gentzkow & Jesse M. Shapiro & Matt Taddy, 2019. "Measuring Group Differences in High‐Dimensional Choices: Method and Application to Congressional Speech," Econometrica, Econometric Society, vol. 87(4), pages 1307-1340, July.
    23. Hartmann, Philipp & Smets, Frank, 2018. "The first twenty years of the European Central Bank: monetary policy," Working Paper Series 2219, European Central Bank.
    24. Angelico, Cristina & Marcucci, Juri & Miccoli, Marcello & Quarta, Filippo, 2022. "Can we measure inflation expectations using Twitter?," Journal of Econometrics, Elsevier, vol. 228(2), pages 259-277.
    25. Bartosz Maćkowiak & Filip Matějka & Mirko Wiederholt, 2023. "Rational Inattention: A Review," Journal of Economic Literature, American Economic Association, vol. 61(1), pages 226-273, March.
    26. Ardia, David & Bluteau, Keven & Boudt, Kris, 2019. "Questioning the news about economic growth: Sparse forecasting using thousands of news-based sentiment values," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1370-1386.
    27. Stefano Neri & Stefano Siviero, 2019. "The non-standard monetary policy measures of the ECB: motivations, effectiveness and risks," Questioni di Economia e Finanza (Occasional Papers) 486, Bank of Italy, Economic Research and International Relations Area.
    28. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    29. Daniel J. Lewis & Karel Mertens & James H. Stock & Mihir Trivedi, 2022. "Measuring real activity using a weekly economic index," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(4), pages 667-687, June.
    30. Donadelli, Michael & Gufler, Ivan & Pellizzari, Paolo, 2020. "The macro and asset pricing implications of rising Italian uncertainty: Evidence from a novel news-based macroeconomic policy uncertainty index," Economics Letters, Elsevier, vol. 197(C).
    31. Eraslan, Sercan & Götz, Thomas, 2021. "An unconventional weekly economic activity index for Germany," Economics Letters, Elsevier, vol. 204(C).
    32. John H. Rogers & Jiawen Xu, 2019. "How Well Does Economic Uncertainty Forecast Economic Activity?," Finance and Economics Discussion Series 2019-085, Board of Governors of the Federal Reserve System (U.S.).
    33. Leland Bybee & Bryan T. Kelly & Asaf Manela & Dacheng Xiu, 2021. "Business News and Business Cycles," NBER Working Papers 29344, National Bureau of Economic Research, Inc.
    34. Lorenzo Bencivelli & Massimiliano Marcellino & Gianluca Moretti, 2017. "Forecasting economic activity by Bayesian bridge model averaging," Empirical Economics, Springer, vol. 53(1), pages 21-40, August.
    35. Paul C. Tetlock, 2007. "Giving Content to Investor Sentiment: The Role of Media in the Stock Market," Journal of Finance, American Finance Association, vol. 62(3), pages 1139-1168, June.
    36. Tim Loughran & Bill Mcdonald, 2011. "When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10‐Ks," Journal of Finance, American Finance Association, vol. 66(1), pages 35-65, February.
    37. Angeletos, G.-M. & Lian, C., 2016. "Incomplete Information in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 1065-1240, Elsevier.
    38. Rambaccussing, Dooruj & Kwiatkowski, Andrzej, 2020. "Forecasting with news sentiment: Evidence with UK newspapers," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1501-1516.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lorenzo Bencivelli & Beniamino Pisicoli, 2021. "Foreign investors and target firms’ financial structure: cavalry or locusts?," Temi di discussione (Economic working papers) 1327, Bank of Italy, Economic Research and International Relations Area.
    2. Valentina Michelangeli & Eliana Viviano, 2021. "Can internet banking affect households' participation in financial markets and financial awareness?," Temi di discussione (Economic working papers) 1329, Bank of Italy, Economic Research and International Relations Area.
    3. Audinga Baltrunaite & Mario Cannella & Sauro Mocetti & Giacomo Roma, "undated". "Board composition and performance of state-owned enterprises: Quasi-experimental evidence," Temi di discussione (Economic working papers) 1328, Bank of Italy, Economic Research and International Relations Area.
    4. De Bandt Olivier & Bricongne Jean-Charles & Denes Julien & Dhenin Alexandre & De Gaye Annabelle & Robert Pierre-Antoine, 2023. "Using the Press to Construct a New Indicator of Inflation Perceptions in France," Working papers 921, Banque de France.
    5. Claudia Pacella, 2021. "Dating the euro area business cycle: an evaluation," Temi di discussione (Economic working papers) 1332, Bank of Italy, Economic Research and International Relations Area.
    6. Valentina Aprigliano & Guerino Ardizzi & Alessia Cassetta & Alessandro Cavallero & Simone Emiliozzi & Alessandro Gambini & Nazzareno Renzi & Roberta Zizza, 2021. "Exploiting payments to track Italian economic activity: the experience at Banca d’Italia," Questioni di Economia e Finanza (Occasional Papers) 609, Bank of Italy, Economic Research and International Relations Area.
    7. Saiz, Lorena & Ashwin, Julian & Kalamara, Eleni, 2021. "Nowcasting euro area GDP with news sentiment: a tale of two crises," Working Paper Series 2616, European Central Bank.
    8. Jonathan Huntley & Valentina Michelangeli & Felix Reichling, 2021. "What drives investors to chase returns?," Temi di discussione (Economic working papers) 1334, Bank of Italy, Economic Research and International Relations Area.
    9. Claudia Maurini & Alessandro Schiavone, 2021. "The catalytic role of IMF programs," Temi di discussione (Economic working papers) 1331, Bank of Italy, Economic Research and International Relations Area.
    10. Gerardin Mathilde, & Ranvier Martial., 2021. "Enrichment of the Banque de France’s monthly business survey: lessons from textual analysis of business leaders’ comments," Working papers 821, Banque de France.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dorinth van Dijk & Jasper de Winter, 2023. "Nowcasting GDP using tone-adjusted time varying news topics: Evidence from the financial press," Working Papers 766, DNB.
    2. Jon Ellingsen & Vegard H. Larsen & Leif Anders Thorsrud, 2022. "News media versus FRED‐MD for macroeconomic forecasting," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(1), pages 63-81, January.
    3. Saiz, Lorena & Ashwin, Julian & Kalamara, Eleni, 2021. "Nowcasting euro area GDP with news sentiment: a tale of two crises," Working Paper Series 2616, European Central Bank.
    4. Eleni Kalamara & Arthur Turrell & Chris Redl & George Kapetanios & Sujit Kapadia, 2022. "Making text count: Economic forecasting using newspaper text," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 896-919, August.
    5. Andres Algaba & David Ardia & Keven Bluteau & Samuel Borms & Kris Boudt, 2020. "Econometrics Meets Sentiment: An Overview Of Methodology And Applications," Journal of Economic Surveys, Wiley Blackwell, vol. 34(3), pages 512-547, July.
    6. Bennani, Hamza, 2018. "Media coverage and ECB policy-making: Evidence from an augmented Taylor rule," Journal of Macroeconomics, Elsevier, vol. 57(C), pages 26-38.
    7. Jon Ellingsen & Vegard H. Larsen & Leif Anders Thorsrud, 2020. "News Media vs. FRED-MD for Macroeconomic Forecasting," CESifo Working Paper Series 8639, CESifo.
    8. Vegard H. Larsen & Leif Anders Thorsrud, 2018. "Business cycle narratives," Working Paper 2018/3, Norges Bank.
    9. Hansen, Stephen & Davis, Steven & Seminario-Amez, Cristhian, 2020. "Firm-level Risk Exposures and Stock Returns in the Wake of COVID-19," CEPR Discussion Papers 15314, C.E.P.R. Discussion Papers.
    10. Nyman, Rickard & Kapadia, Sujit & Tuckett, David, 2021. "News and narratives in financial systems: Exploiting big data for systemic risk assessment," Journal of Economic Dynamics and Control, Elsevier, vol. 127(C).
    11. Erik Andres-Escayola & Corinna Ghirelli & Luis Molina & Javier J. Pérez & Elena Vidal, 2022. "Using newspapers for textual indicators: which and how many?," Working Papers 2235, Banco de España.
    12. Matthew Gentzkow & Bryan T. Kelly & Matt Taddy, 2017. "Text as Data," NBER Working Papers 23276, National Bureau of Economic Research, Inc.
    13. Martin Baumgaertner & Johannes Zahner, 2021. "Whatever it takes to understand a central banker - Embedding their words using neural networks," MAGKS Papers on Economics 202130, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
    14. Gómez-Cram, Roberto & Grotteria, Marco, 2022. "Real-time price discovery via verbal communication: Method and application to Fedspeak," Journal of Financial Economics, Elsevier, vol. 143(3), pages 993-1025.
    15. Heng Chen & Li Han, 2022. "Do the Media Bow to Foreign Economic Powers? Evidence from a News Website Crackdown," HKUST CEP Working Papers Series 202201, HKUST Center for Economic Policy.
    16. Ashwin,Julian & Rao,Vijayendra & Biradavolu,Monica Rao & Chhabra,Aditya & Haque,Arshia & Khan,Afsana Iffat & Krishnan,Nandini, 2022. "A Method to Scale-Up Interpretative Qualitative Analysis, with an Application toAspirations in Cox’s Bazaar, Bangladesh," Policy Research Working Paper Series 10046, The World Bank.
    17. Hamza Bennani, 2016. "Media Coverage and ECB Policy-Making: Evidence from a New Index," Working Papers hal-04141572, HAL.
    18. Hamza Bennani, 2016. "Media Coverage and ECB Policy-Making: Evidence from a New Index," EconomiX Working Papers 2016-38, University of Paris Nanterre, EconomiX.
    19. Amarasinghe, Ashani, 2022. "Diverting domestic turmoil," Journal of Public Economics, Elsevier, vol. 208(C).
    20. Consoli, Sergio & Pezzoli, Luca Tiozzo & Tosetti, Elisa, 2021. "Emotions in macroeconomic news and their impact on the European bond market," Journal of International Money and Finance, Elsevier, vol. 118(C).

    More about this item

    Keywords

    Forecasting; Text mining; Sentiment; Economic policy uncertainty; Big data; BMA;
    All these keywords.

    JEL classification:

    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C43 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Index Numbers and Aggregation
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C55 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Large Data Sets: Modeling and Analysis
    • E52 - Macroeconomics and Monetary Economics - - Monetary Policy, Central Banking, and the Supply of Money and Credit - - - Monetary Policy
    • E58 - Macroeconomics and Monetary Economics - - Monetary Policy, Central Banking, and the Supply of Money and Credit - - - Central Banks and Their Policies

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:39:y:2023:i:2:p:791-808. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.