IDEAS home Printed from https://ideas.repec.org/a/gam/jforec/v5y2023i4p36-683d1288660.html
   My bibliography  Save this article

Macroeconomic Predictions Using Payments Data and Machine Learning

Author

Listed:
  • James T. E. Chapman

    (Bank of Canada, Ottawa, ON K1A 0G9, Canada
    Note: the opinions expressed herein are those of the authors and do not necessarily reflects those of the bank of Canada.)

  • Ajit Desai

    (Bank of Canada, Ottawa, ON K1A 0G9, Canada
    Note: the opinions expressed herein are those of the authors and do not necessarily reflects those of the bank of Canada.)

Abstract

This paper assesses the usefulness of comprehensive payments data for macroeconomic predictions in Canada. Specifically, we evaluate which type of payments data are useful, when they are useful, why they are useful, and whether machine learning (ML) models enhance their predictive value. We find payments data with a factor model can help improve accuracy up to 25% in predicting GDP, retail, and wholesale sales; and nonlinear ML models can further improve the accuracy up to 20%. Furthermore, we find the retail payments data are more useful than the data from the wholesale system; and they add more value during crisis and at the nowcasting horizon due to the timeliness. The contribution of the payments data and ML models is small and linear during low and normal economic growth periods. However, their contribution is large, asymmetrical, and nonlinear during crises such as COVID-19. Moreover, we propose a cross-validation approach to mitigate overfitting and use tools to overcome interpretability in the ML models to improve their effectiveness for policy use.

Suggested Citation

  • James T. E. Chapman & Ajit Desai, 2023. "Macroeconomic Predictions Using Payments Data and Machine Learning," Forecasting, MDPI, vol. 5(4), pages 1-32, November.
  • Handle: RePEc:gam:jforec:v:5:y:2023:i:4:p:36-683:d:1288660
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2571-9394/5/4/36/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2571-9394/5/4/36/
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Giannone, Domenico & Reichlin, Lucrezia & Small, David, 2008. "Nowcasting: The real-time informational content of macroeconomic data," Journal of Monetary Economics, Elsevier, vol. 55(4), pages 665-676, May.
    2. Bergmeir, Christoph & Hyndman, Rob J. & Koo, Bonsoo, 2018. "A note on the validity of cross-validation for evaluating autoregressive time series prediction," Computational Statistics & Data Analysis, Elsevier, vol. 120(C), pages 70-83.
    3. Chakraborty, Chiranjit & Joseph, Andreas, 2017. "Machine learning at central banks," Bank of England working papers 674, Bank of England.
    4. Gary Koop & Luca Onorante, 2019. "Macroeconomic Nowcasting Using Google Probabilities☆," Advances in Econometrics, in: Topics in Identification, Limited Dependent Variables, Partial Observability, Experimentation, and Flexible Modeling: Part A, volume 40, pages 17-40, Emerald Group Publishing Limited.
    5. Philippe Goulet Coulombe & Maxime Leroux & Dalibor Stevanovic & Stéphane Surprenant, 2022. "How is machine learning useful for macroeconomic forecasting?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 920-964, August.
    6. Robin Greenwood & Samuel G. Hanson & Andrei Shleifer & Jakob Ahm Sørensen, 2022. "Predictable Financial Crises," Journal of Finance, American Finance Association, vol. 77(2), pages 863-921, April.
    7. David Bounie & Youssouf Camara & John Galbraith, 2020. "Consumers’ Mobility, Expenditure and Online-Offline Substitution Response to COVID-19: Evidence from French Transaction Data," Cahiers de recherche 14-2020, Centre interuniversitaire de recherche en économie quantitative, CIREQ.
    8. Nesreen Ahmed & Amir Atiya & Neamat El Gayar & Hisham El-Shishiny, 2010. "An Empirical Comparison of Machine Learning Models for Time Series Forecasting," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 594-621.
    9. Chernis, Tony & Cheung, Calista & Velasco, Gabriella, 2020. "A three-frequency dynamic factor model for nowcasting Canadian provincial GDP growth," International Journal of Forecasting, Elsevier, vol. 36(3), pages 851-872.
    10. Elena Angelini & Gonzalo Camba‐Mendez & Domenico Giannone & Lucrezia Reichlin & Gerhard Rünstler, 2011. "Short‐term forecasts of euro area GDP growth," Econometrics Journal, Royal Economic Society, vol. 14(1), pages 25-44, February.
    11. Brandyn Bok & Daniele Caratelli & Domenico Giannone & Argia M. Sbordone & Andrea Tambalotti, 2018. "Macroeconomic Nowcasting and Forecasting with Big Data," Annual Review of Economics, Annual Reviews, vol. 10(1), pages 615-643, August.
    12. Reichlin, Lucrezia & Giannone, Domenico & Small, David, 2005. "Nowcasting GDP and Inflation: The Real Time Informational Content of Macroeconomic Data Releases," CEPR Discussion Papers 5178, C.E.P.R. Discussion Papers.
    13. Maehashi, Kohei & Shintani, Mototsugu, 2020. "Macroeconomic forecasting using factor models and machine learning: an application to Japan," Journal of the Japanese and International Economies, Elsevier, vol. 58(C).
    14. James Chapman & Ajit Desai, 2021. "Using Payments Data to Nowcast Macroeconomic Variables During the Onset of COVID-19," Staff Working Papers 21-2, Bank of Canada.
    15. Goulet Coulombe, Philippe & Marcellino, Massimiliano & Stevanović, Dalibor, 2021. "Can Machine Learning Catch The Covid-19 Recession?," National Institute Economic Review, National Institute of Economic and Social Research, vol. 256, pages 71-109, April.
    16. Cimadomo, Jacopo & Giannone, Domenico & Lenza, Michele & Monti, Francesca & Sokol, Andrej, 2022. "Nowcasting with large Bayesian vector autoregressions," Journal of Econometrics, Elsevier, vol. 231(2), pages 500-519.
    17. Galbraith, John W. & Tkacz, Greg, 2018. "Nowcasting with payments system data," International Journal of Forecasting, Elsevier, vol. 34(2), pages 366-376.
    18. Tony Chernis & Rodrigo Sekkel, 2017. "A dynamic factor model for nowcasting Canadian GDP growth," Empirical Economics, Springer, vol. 53(1), pages 217-234, August.
    19. Foroni, Claudia & Marcellino, Massimiliano & Stevanovic, Dalibor, 2022. "Forecasting the Covid-19 recession and recovery: Lessons from the financial crisis," International Journal of Forecasting, Elsevier, vol. 38(2), pages 596-612.
    20. Martin J. Osborne & Ariel Rubinstein, 1994. "A Course in Game Theory," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262650401, December.
    21. Carvalho, V & Garcia, Juan R. & Hansen, S. & Ortiz, A. & Rodrigo, T. & More, J. V. R., 2020. "Tracking the COVID-19 Crisis with High-Resolution Transaction Data," Cambridge Working Papers in Economics 2030, Faculty of Economics, University of Cambridge.
    22. Desai, Ajit & Lu, Zhentong & Rodrigo, Hiru & Sharples, Jacob & Tian, Phoebe & Zhang, Nellie, 2023. "From LVTS to Lynx: Quantitative assessment of payment system transition in Canada," Journal of Payments Strategy & Systems, Henry Stewart Publications, vol. 17(3), pages 291-314, September.
    23. Athey, Susan & Imbens, Guido W., 2019. "Machine Learning Methods Economists Should Know About," Research Papers 3776, Stanford University, Graduate School of Business.
    24. Hindrayanto, Irma & Koopman, Siem Jan & de Winter, Jasper, 2016. "Forecasting and nowcasting economic growth in the euro area using factor models," International Journal of Forecasting, Elsevier, vol. 32(4), pages 1284-1305.
    25. Marta Bańbura & Michele Modugno, 2014. "Maximum Likelihood Estimation Of Factor Models On Datasets With Arbitrary Pattern Of Missing Data," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(1), pages 133-160, January.
    26. Hal R. Varian, 2014. "Big Data: New Tricks for Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 28(2), pages 3-28, Spring.
    27. Stock, J.H. & Watson, M.W., 2016. "Dynamic Factor Models, Factor-Augmented Vector Autoregressions, and Structural Vector Autoregressions in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 415-525, Elsevier.
    28. John Galbraith & Greg Tkacz, 2007. "Electronic Transactions as High-Frequency Indicators of Economic Activity," Staff Working Papers 07-58, Bank of Canada.
    29. Jaehyun Yoon, 2021. "Forecasting of Real GDP Growth Using Machine Learning Models: Gradient Boosting and Random Forest Approach," Computational Economics, Springer;Society for Computational Economics, vol. 57(1), pages 247-265, January.
    30. Hamilton, James D., 2011. "Calling recessions in real time," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1006-1026, October.
    31. Valentina Aprigliano & Guerino Ardizzi & Libero Monteforte, 2019. "Using Payment System Data to Forecast Economic Activity," International Journal of Central Banking, International Journal of Central Banking, vol. 15(4), pages 55-80, October.
    32. Bragoli, Daniela, 2017. "Now-casting the Japanese economy," International Journal of Forecasting, Elsevier, vol. 33(2), pages 390-402.
    33. George Kapetanios & Fotis Papailias, 2018. "Big Data & Macroeconomic Nowcasting: Methodological Review," Economic Statistics Centre of Excellence (ESCoE) Discussion Papers ESCoE DP-2018-12, Economic Statistics Centre of Excellence (ESCoE).
    34. Ajit Desai & Zhentong Lu & Hiru Rodrigo & Jacob Sharples & Phoebe Tian & Nellie Zhang, 2023. "From LVTS to Lynx: Quantitative Assessment of Payment System Transition," Staff Working Papers 23-24, Bank of Canada.
    35. Susan Athey & Guido W. Imbens, 2019. "Machine Learning Methods That Economists Should Know About," Annual Review of Economics, Annual Reviews, vol. 11(1), pages 685-725, August.
    36. Hyunyoung Choi & Hal Varian, 2012. "Predicting the Present with Google Trends," The Economic Record, The Economic Society of Australia, vol. 88(s1), pages 2-9, June.
    37. Domenico Giannone & Lucrezia Reichlin & David Small, 2008. "Nowcasting: the real time informational content of macroeconomic data releases," ULB Institutional Repository 2013/6409, ULB -- Universite Libre de Bruxelles.
    38. Susan Athey, 2018. "The Impact of Machine Learning on Economics," NBER Chapters, in: The Economics of Artificial Intelligence: An Agenda, pages 507-547, National Bureau of Economic Research, Inc.
    39. Thibaut Duprey, 2020. "Canadian Financial Stress and Macroeconomic Condition," Canadian Public Policy, University of Toronto Press, vol. 46(S3), pages 236-260, October.
    40. Tatjana Dahlhaus & Angelika Welte, 2021. "Payment Habits During COVID-19: Evidence from High-Frequency Transaction Data," Staff Working Papers 21-43, Bank of Canada.
    41. Barnett, William & Chauvet, Marcelle & Leiva-Leon, Danilo & Su, Liting, 2016. "Nowcasting Nominal GDP with the Credit-Card Augmented Divisia Monetary," Studies in Applied Economics 59, The Johns Hopkins Institute for Applied Economics, Global Health, and the Study of Business Enterprise.
    42. Sendhil Mullainathan & Jann Spiess, 2017. "Machine Learning: An Applied Econometric Approach," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 87-106, Spring.
    43. Kohei Maehashi & Mototsugu Shintani, 2020. "Macroeconomic Forecasting Using Factor Models and Machine Learning: An Application to Japan," CIRJE F-Series CIRJE-F-1146, CIRJE, Faculty of Economics, University of Tokyo.
    44. Andy C.C. Kwan & John A. Cotsomitis, 2006. "The Usefulness of Consumer Confidence in Forecasting Household Spending in Canada: A National and Regional Analysis," Economic Inquiry, Western Economic Association International, vol. 44(1), pages 185-197, January.
    45. Hui Zou & Trevor Hastie, 2005. "Addendum: Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(5), pages 768-768, November.
    46. Hui Zou & Trevor Hastie, 2005. "Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(2), pages 301-320, April.
    47. Duarte, Cláudia & Rodrigues, Paulo M.M. & Rua, António, 2017. "A mixed frequency approach to the forecasting of private consumption with ATM/POS data," International Journal of Forecasting, Elsevier, vol. 33(1), pages 61-75.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Laura Felber & Dr. Simon Beyeler, 2023. "Nowcasting economic activity using transaction payments data," Working Papers 2023-01, Swiss National Bank.
    2. Bogner Alexandra & Jerger Jürgen, 2023. "Big data in monetary policy analysis—a critical assessment," Economics and Business Review, Sciendo, vol. 9(2), pages 27-40, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. James Chapman & Ajit Desai, 2021. "Using Payments Data to Nowcast Macroeconomic Variables During the Onset of COVID-19," Staff Working Papers 21-2, Bank of Canada.
    2. Zhang, Qin & Ni, He & Xu, Hao, 2023. "Nowcasting Chinese GDP in a data-rich environment: Lessons from machine learning algorithms," Economic Modelling, Elsevier, vol. 122(C).
    3. Raquel Nadal Cesar Gonçalves, 2022. "Nowcasting Brazilian GDP with Electronic Payments Data," Working Papers Series 564, Central Bank of Brazil, Research Department.
    4. Knut Are Aastveit & Tuva Marie Fastbø & Eleonora Granziera & Kenneth Sæterhagen Paulsen & Kjersti Næss Torstensen, 2020. "Nowcasting Norwegian household consumption with debit card transaction data," Working Paper 2020/17, Norges Bank.
    5. Longo, Luigi & Riccaboni, Massimo & Rungi, Armando, 2022. "A neural network ensemble approach for GDP forecasting," Journal of Economic Dynamics and Control, Elsevier, vol. 134(C).
    6. Dennis Kant & Andreas Pick & Jasper de Winter, 2022. "Nowcasting GDP using machine learning methods," Working Papers 754, DNB.
    7. Richard Schnorrenberger & Aishameriane Schmidt & Guilherme Valle Moura, 2024. "Harnessing Machine Learning for Real-Time Inflation Nowcasting," Working Papers 806, DNB.
    8. Laurent Ferrara & Anna Simoni, 2023. "When are Google Data Useful to Nowcast GDP? An Approach via Preselection and Shrinkage," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 41(4), pages 1188-1202, October.
    9. Poncela, Pilar & Ruiz, Esther & Miranda, Karen, 2021. "Factor extraction using Kalman filter and smoothing: This is not just another survey," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1399-1425.
    10. Byron Botha & Rulof Burger & Kevin Kotzé & Neil Rankin & Daan Steenkamp, 2023. "Big data forecasting of South African inflation," Empirical Economics, Springer, vol. 65(1), pages 149-188, July.
    11. Anesti, Nikoleta & Kalamara, Eleni & Kapetanios, George, 2021. "Forecasting UK GDP growth with large survey panels," Bank of England working papers 923, Bank of England.
    12. Danilo Cascaldi-Garcia & Matteo Luciani & Michele Modugno, 2023. "Lessons from Nowcasting GDP across the World," International Finance Discussion Papers 1385, Board of Governors of the Federal Reserve System (U.S.).
    13. Bennedsen, Mikkel & Hillebrand, Eric & Koopman, Siem Jan, 2021. "Modeling, forecasting, and nowcasting U.S. CO2 emissions using many macroeconomic predictors," Energy Economics, Elsevier, vol. 96(C).
    14. Samuel N. Cohen & Silvia Lui & Will Malpass & Giulia Mantoan & Lars Nesheim & 'Aureo de Paula & Andrew Reeves & Craig Scott & Emma Small & Lingyi Yang, 2023. "Nowcasting with signature methods," Papers 2305.10256, arXiv.org.
    15. Cascaldi-Garcia, Danilo & Ferreira, Thiago R.T. & Giannone, Domenico & Modugno, Michele, 2024. "Back to the present: Learning about the euro area through a now-casting model," International Journal of Forecasting, Elsevier, vol. 40(2), pages 661-686.
    16. Elena Ivona DUMITRESCU & Sullivan HUE & Christophe HURLIN & Sessi TOKPAVI, 2020. "Machine Learning or Econometrics for Credit Scoring: Let’s Get the Best of Both Worlds," LEO Working Papers / DR LEO 2839, Orleans Economics Laboratory / Laboratoire d'Economie d'Orleans (LEO), University of Orleans.
    17. Carlos León & Fabio Ortega, 2018. "Nowcasting Economic Activity with Electronic Payments Data: A Predictive Modeling Approach," Revista de Economía del Rosario, Universidad del Rosario, vol. 21(2), pages 381-407, December.
    18. Jeffrey C. Chen & Abe Dunn & Kyle Hood & Alexander Driessen & Andrea Batch, 2019. "Off to the Races: A Comparison of Machine Learning and Alternative Data for Predicting Economic Indicators," NBER Chapters, in: Big Data for Twenty-First-Century Economic Statistics, pages 373-402, National Bureau of Economic Research, Inc.
    19. Chernis, Tony & Cheung, Calista & Velasco, Gabriella, 2020. "A three-frequency dynamic factor model for nowcasting Canadian provincial GDP growth," International Journal of Forecasting, Elsevier, vol. 36(3), pages 851-872.
    20. Bulligan, Guido & Marcellino, Massimiliano & Venditti, Fabrizio, 2015. "Forecasting economic activity with targeted predictors," International Journal of Forecasting, Elsevier, vol. 31(1), pages 188-206.

    More about this item

    Keywords

    nowcasting; payments data; machine learning; interpretability; overfitting;
    All these keywords.

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C55 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Large Data Sets: Modeling and Analysis
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications
    • E42 - Macroeconomics and Monetary Economics - - Money and Interest Rates - - - Monetary Sytsems; Standards; Regimes; Government and the Monetary System
    • E52 - Macroeconomics and Monetary Economics - - Monetary Policy, Central Banking, and the Supply of Money and Credit - - - Monetary Policy

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jforec:v:5:y:2023:i:4:p:36-683:d:1288660. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.