IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2209.00948.html
   My bibliography  Save this paper

Macroeconomic Predictions using Payments Data and Machine Learning

Author

Listed:
  • James T. E. Chapman
  • Ajit Desai

Abstract

Predicting the economy's short-term dynamics -- a vital input to economic agents' decision-making process -- often uses lagged indicators in linear models. This is typically sufficient during normal times but could prove inadequate during crisis periods. This paper aims to demonstrate that non-traditional and timely data such as retail and wholesale payments, with the aid of nonlinear machine learning approaches, can provide policymakers with sophisticated models to accurately estimate key macroeconomic indicators in near real-time. Moreover, we provide a set of econometric tools to mitigate overfitting and interpretability challenges in machine learning models to improve their effectiveness for policy use. Our models with payments data, nonlinear methods, and tailored cross-validation approaches help improve macroeconomic nowcasting accuracy up to 40\% -- with higher gains during the COVID-19 period. We observe that the contribution of payments data for economic predictions is small and linear during low and normal growth periods. However, the payments data contribution is large, asymmetrical, and nonlinear during strong negative or positive growth periods.

Suggested Citation

  • James T. E. Chapman & Ajit Desai, 2022. "Macroeconomic Predictions using Payments Data and Machine Learning," Papers 2209.00948, arXiv.org.
  • Handle: RePEc:arx:papers:2209.00948
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2209.00948
    File Function: Latest version
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Elena Angelini & Gonzalo Camba‐Mendez & Domenico Giannone & Lucrezia Reichlin & Gerhard Rünstler, 2011. "Short‐term forecasts of euro area GDP growth," Econometrics Journal, Royal Economic Society, vol. 14(1), pages 25-44, February.
    2. Thibaut Duprey, 2020. "Canadian Financial Stress and Macroeconomic Condition," Canadian Public Policy, University of Toronto Press, vol. 46(S3), pages 236-260, October.
    3. Giannone, Domenico & Reichlin, Lucrezia & Small, David, 2008. "Nowcasting: The real-time informational content of macroeconomic data," Journal of Monetary Economics, Elsevier, vol. 55(4), pages 665-676, May.
    4. Goulet Coulombe, Philippe & Marcellino, Massimiliano & Stevanović, Dalibor, 2021. "Can Machine Learning Catch The Covid-19 Recession?," National Institute Economic Review, National Institute of Economic and Social Research, vol. 256, pages 71-109, April.
    5. Valentina Aprigliano & Guerino Ardizzi & Libero Monteforte, 2019. "Using Payment System Data to Forecast Economic Activity," International Journal of Central Banking, International Journal of Central Banking, vol. 15(4), pages 55-80, October.
    6. Tatjana Dahlhaus & Angelika Welte, 2021. "Payment Habits During COVID-19: Evidence from High-Frequency Transaction Data," Staff Working Papers 21-43, Bank of Canada.
    7. Bergmeir, Christoph & Hyndman, Rob J. & Koo, Bonsoo, 2018. "A note on the validity of cross-validation for evaluating autoregressive time series prediction," Computational Statistics & Data Analysis, Elsevier, vol. 120(C), pages 70-83.
    8. Chakraborty, Chiranjit & Joseph, Andreas, 2017. "Machine learning at central banks," Bank of England working papers 674, Bank of England.
    9. Philippe Goulet Coulombe & Maxime Leroux & Dalibor Stevanovic & Stéphane Surprenant, 2022. "How is machine learning useful for macroeconomic forecasting?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 920-964, August.
    10. Barnett, William & Chauvet, Marcelle & Leiva-Leon, Danilo & Su, Liting, 2016. "Nowcasting Nominal GDP with the Credit-Card Augmented Divisia Monetary," Studies in Applied Economics 59, The Johns Hopkins Institute for Applied Economics, Global Health, and the Study of Business Enterprise.
    11. Foroni, Claudia & Marcellino, Massimiliano & Stevanovic, Dalibor, 2022. "Forecasting the Covid-19 recession and recovery: Lessons from the financial crisis," International Journal of Forecasting, Elsevier, vol. 38(2), pages 596-612.
    12. Bragoli, Daniela, 2017. "Now-casting the Japanese economy," International Journal of Forecasting, Elsevier, vol. 33(2), pages 390-402.
    13. Cimadomo, Jacopo & Giannone, Domenico & Lenza, Michele & Monti, Francesca & Sokol, Andrej, 2022. "Nowcasting with large Bayesian vector autoregressions," Journal of Econometrics, Elsevier, vol. 231(2), pages 500-519.
    14. Galbraith, John W. & Tkacz, Greg, 2018. "Nowcasting with payments system data," International Journal of Forecasting, Elsevier, vol. 34(2), pages 366-376.
    15. George Kapetanios & Fotis Papailias, 2018. "Big Data & Macroeconomic Nowcasting: Methodological Review," Economic Statistics Centre of Excellence (ESCoE) Discussion Papers ESCoE DP-2018-12, Economic Statistics Centre of Excellence (ESCoE).
    16. Sendhil Mullainathan & Jann Spiess, 2017. "Machine Learning: An Applied Econometric Approach," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 87-106, Spring.
    17. Tony Chernis & Rodrigo Sekkel, 2017. "A dynamic factor model for nowcasting Canadian GDP growth," Empirical Economics, Springer, vol. 53(1), pages 217-234, August.
    18. Gary Koop & Luca Onorante, 2019. "Macroeconomic Nowcasting Using Google Probabilities☆," Advances in Econometrics, in: Topics in Identification, Limited Dependent Variables, Partial Observability, Experimentation, and Flexible Modeling: Part A, volume 40, pages 17-40, Emerald Group Publishing Limited.
    19. Brandyn Bok & Daniele Caratelli & Domenico Giannone & Argia M. Sbordone & Andrea Tambalotti, 2018. "Macroeconomic Nowcasting and Forecasting with Big Data," Annual Review of Economics, Annual Reviews, vol. 10(1), pages 615-643, August.
    20. Ajit Desai & Zhentong Lu & Hiru Rodrigo & Jacob Sharples & Phoebe Tian & Nellie Zhang, 2023. "From LVTS to Lynx: Quantitative Assessment of Payment System Transition," Staff Working Papers 23-24, Bank of Canada.
    21. Hansen, Stephen & Carvalho, Vasco & García, Juan Ramón & Ortiz, Alvaro & Rodrigo, Tomasa & Rodríguez Mora, José V & Ruiz, Pep, 2020. "Tracking the COVID-19 Crisis with High-Resolution Transaction Data," CEPR Discussion Papers 14642, C.E.P.R. Discussion Papers.
    22. David Bounie & Youssouf Camara & John Galbraith, 2020. "Consumers’ Mobility, Expenditure and Online-Offline Substitution Response to COVID-19: Evidence from French Transaction Data," Cahiers de recherche 14-2020, Centre interuniversitaire de recherche en économie quantitative, CIREQ.
    23. Martin J. Osborne & Ariel Rubinstein, 1994. "A Course in Game Theory," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262650401, December.
    24. Kohei Maehashi & Mototsugu Shintani, 2020. "Macroeconomic Forecasting Using Factor Models and Machine Learning: An Application to Japan," CIRJE F-Series CIRJE-F-1146, CIRJE, Faculty of Economics, University of Tokyo.
    25. Andy C.C. Kwan & John A. Cotsomitis, 2006. "The Usefulness of Consumer Confidence in Forecasting Household Spending in Canada: A National and Regional Analysis," Economic Inquiry, Western Economic Association International, vol. 44(1), pages 185-197, January.
    26. Robin Greenwood & Samuel G. Hanson & Andrei Shleifer & Jakob Ahm Sørensen, 2022. "Predictable Financial Crises," Journal of Finance, American Finance Association, vol. 77(2), pages 863-921, April.
    27. Desai, Ajit & Lu, Zhentong & Rodrigo, Hiru & Sharples, Jacob & Tian, Phoebe & Zhang, Nellie, 2023. "From LVTS to Lynx: Quantitative assessment of payment system transition in Canada," Journal of Payments Strategy & Systems, Henry Stewart Publications, vol. 17(3), pages 291-314, September.
    28. Susan Athey & Guido W. Imbens, 2019. "Machine Learning Methods That Economists Should Know About," Annual Review of Economics, Annual Reviews, vol. 11(1), pages 685-725, August.
    29. Hyunyoung Choi & Hal Varian, 2012. "Predicting the Present with Google Trends," The Economic Record, The Economic Society of Australia, vol. 88(s1), pages 2-9, June.
    30. Athey, Susan & Imbens, Guido W., 2019. "Machine Learning Methods Economists Should Know About," Research Papers 3776, Stanford University, Graduate School of Business.
    31. Hindrayanto, Irma & Koopman, Siem Jan & de Winter, Jasper, 2016. "Forecasting and nowcasting economic growth in the euro area using factor models," International Journal of Forecasting, Elsevier, vol. 32(4), pages 1284-1305.
    32. Marta Bańbura & Michele Modugno, 2014. "Maximum Likelihood Estimation Of Factor Models On Datasets With Arbitrary Pattern Of Missing Data," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(1), pages 133-160, January.
    33. John Galbraith & Greg Tkacz, 2007. "Electronic Transactions as High-Frequency Indicators of Economic Activity," Staff Working Papers 07-58, Bank of Canada.
    34. Hui Zou & Trevor Hastie, 2005. "Addendum: Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(5), pages 768-768, November.
    35. Hal R. Varian, 2014. "Big Data: New Tricks for Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 28(2), pages 3-28, Spring.
    36. Nesreen Ahmed & Amir Atiya & Neamat El Gayar & Hisham El-Shishiny, 2010. "An Empirical Comparison of Machine Learning Models for Time Series Forecasting," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 594-621.
    37. Chernis, Tony & Cheung, Calista & Velasco, Gabriella, 2020. "A three-frequency dynamic factor model for nowcasting Canadian provincial GDP growth," International Journal of Forecasting, Elsevier, vol. 36(3), pages 851-872.
    38. Domenico Giannone & Lucrezia Reichlin & David Small, 2008. "Nowcasting: the real time informational content of macroeconomic data releases," ULB Institutional Repository 2013/6409, ULB -- Universite Libre de Bruxelles.
    39. Stock, J.H. & Watson, M.W., 2016. "Dynamic Factor Models, Factor-Augmented Vector Autoregressions, and Structural Vector Autoregressions in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 415-525, Elsevier.
    40. Hamilton, James D., 2011. "Calling recessions in real time," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1006-1026, October.
    41. Reichlin, Lucrezia & Giannone, Domenico & Small, David, 2005. "Nowcasting GDP and Inflation: The Real Time Informational Content of Macroeconomic Data Releases," CEPR Discussion Papers 5178, C.E.P.R. Discussion Papers.
    42. Hui Zou & Trevor Hastie, 2005. "Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(2), pages 301-320, April.
    43. Maehashi, Kohei & Shintani, Mototsugu, 2020. "Macroeconomic forecasting using factor models and machine learning: an application to Japan," Journal of the Japanese and International Economies, Elsevier, vol. 58(C).
    44. Susan Athey, 2018. "The Impact of Machine Learning on Economics," NBER Chapters, in: The Economics of Artificial Intelligence: An Agenda, pages 507-547, National Bureau of Economic Research, Inc.
    45. Duarte, Cláudia & Rodrigues, Paulo M.M. & Rua, António, 2017. "A mixed frequency approach to the forecasting of private consumption with ATM/POS data," International Journal of Forecasting, Elsevier, vol. 33(1), pages 61-75.
    46. James Chapman & Ajit Desai, 2021. "Using Payments Data to Nowcast Macroeconomic Variables During the Onset of COVID-19," Staff Working Papers 21-2, Bank of Canada.
    47. Jaehyun Yoon, 2021. "Forecasting of Real GDP Growth Using Machine Learning Models: Gradient Boosting and Random Forest Approach," Computational Economics, Springer;Society for Computational Economics, vol. 57(1), pages 247-265, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bogner Alexandra & Jerger Jürgen, 2023. "Big data in monetary policy analysis—a critical assessment," Economics and Business Review, Sciendo, vol. 9(2), pages 27-40, April.
    2. Laura Felber & Dr. Simon Beyeler, 2023. "Nowcasting economic activity using transaction payments data," Working Papers 2023-01, Swiss National Bank.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. James Chapman & Ajit Desai, 2021. "Using Payments Data to Nowcast Macroeconomic Variables During the Onset of COVID-19," Staff Working Papers 21-2, Bank of Canada.
    2. Zhang, Qin & Ni, He & Xu, Hao, 2023. "Nowcasting Chinese GDP in a data-rich environment: Lessons from machine learning algorithms," Economic Modelling, Elsevier, vol. 122(C).
    3. Raquel Nadal Cesar Gonçalves, 2022. "Nowcasting Brazilian GDP with Electronic Payments Data," Working Papers Series 564, Central Bank of Brazil, Research Department.
    4. Knut Are Aastveit & Tuva Marie Fastbø & Eleonora Granziera & Kenneth Sæterhagen Paulsen & Kjersti Næss Torstensen, 2020. "Nowcasting Norwegian household consumption with debit card transaction data," Working Paper 2020/17, Norges Bank.
    5. Longo, Luigi & Riccaboni, Massimo & Rungi, Armando, 2022. "A neural network ensemble approach for GDP forecasting," Journal of Economic Dynamics and Control, Elsevier, vol. 134(C).
    6. Dennis Kant & Andreas Pick & Jasper de Winter, 2022. "Nowcasting GDP using machine learning methods," Working Papers 754, DNB.
    7. Richard Schnorrenberger & Aishameriane Schmidt & Guilherme Valle Moura, 2024. "Harnessing Machine Learning for Real-Time Inflation Nowcasting," Working Papers 806, DNB.
    8. Laurent Ferrara & Anna Simoni, 2023. "When are Google Data Useful to Nowcast GDP? An Approach via Preselection and Shrinkage," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 41(4), pages 1188-1202, October.
    9. Poncela, Pilar & Ruiz, Esther & Miranda, Karen, 2021. "Factor extraction using Kalman filter and smoothing: This is not just another survey," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1399-1425.
    10. Byron Botha & Rulof Burger & Kevin Kotzé & Neil Rankin & Daan Steenkamp, 2023. "Big data forecasting of South African inflation," Empirical Economics, Springer, vol. 65(1), pages 149-188, July.
    11. Anesti, Nikoleta & Kalamara, Eleni & Kapetanios, George, 2021. "Forecasting UK GDP growth with large survey panels," Bank of England working papers 923, Bank of England.
    12. Danilo Cascaldi-Garcia & Matteo Luciani & Michele Modugno, 2023. "Lessons from Nowcasting GDP across the World," International Finance Discussion Papers 1385, Board of Governors of the Federal Reserve System (U.S.).
    13. Bennedsen, Mikkel & Hillebrand, Eric & Koopman, Siem Jan, 2021. "Modeling, forecasting, and nowcasting U.S. CO2 emissions using many macroeconomic predictors," Energy Economics, Elsevier, vol. 96(C).
    14. Samuel N. Cohen & Silvia Lui & Will Malpass & Giulia Mantoan & Lars Nesheim & 'Aureo de Paula & Andrew Reeves & Craig Scott & Emma Small & Lingyi Yang, 2023. "Nowcasting with signature methods," Papers 2305.10256, arXiv.org.
    15. Cascaldi-Garcia, Danilo & Ferreira, Thiago R.T. & Giannone, Domenico & Modugno, Michele, 2024. "Back to the present: Learning about the euro area through a now-casting model," International Journal of Forecasting, Elsevier, vol. 40(2), pages 661-686.
    16. Elena Ivona DUMITRESCU & Sullivan HUE & Christophe HURLIN & Sessi TOKPAVI, 2020. "Machine Learning or Econometrics for Credit Scoring: Let’s Get the Best of Both Worlds," LEO Working Papers / DR LEO 2839, Orleans Economics Laboratory / Laboratoire d'Economie d'Orleans (LEO), University of Orleans.
    17. Carlos León & Fabio Ortega, 2018. "Nowcasting Economic Activity with Electronic Payments Data: A Predictive Modeling Approach," Revista de Economía del Rosario, Universidad del Rosario, vol. 21(2), pages 381-407, December.
    18. Jeffrey C. Chen & Abe Dunn & Kyle Hood & Alexander Driessen & Andrea Batch, 2019. "Off to the Races: A Comparison of Machine Learning and Alternative Data for Predicting Economic Indicators," NBER Chapters, in: Big Data for Twenty-First-Century Economic Statistics, pages 373-402, National Bureau of Economic Research, Inc.
    19. Chernis, Tony & Cheung, Calista & Velasco, Gabriella, 2020. "A three-frequency dynamic factor model for nowcasting Canadian provincial GDP growth," International Journal of Forecasting, Elsevier, vol. 36(3), pages 851-872.
    20. Bulligan, Guido & Marcellino, Massimiliano & Venditti, Fabrizio, 2015. "Forecasting economic activity with targeted predictors," International Journal of Forecasting, Elsevier, vol. 31(1), pages 188-206.

    More about this item

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C55 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Large Data Sets: Modeling and Analysis
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications
    • E42 - Macroeconomics and Monetary Economics - - Money and Interest Rates - - - Monetary Sytsems; Standards; Regimes; Government and the Monetary System
    • E52 - Macroeconomics and Monetary Economics - - Monetary Policy, Central Banking, and the Supply of Money and Credit - - - Monetary Policy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2209.00948. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.