IDEAS home Printed from https://ideas.repec.org/p/bca/bocawp/22-10.html
   My bibliography  Save this paper

Macroeconomic Predictions Using Payments Data and Machine Learning

Author

Listed:
  • James Chapman
  • Ajit Desai

Abstract

Predicting the economy’s short-term dynamics—a vital input to economic agents’ decision-making process—often uses lagged indicators in linear models. This is typically sufficient during normal times but could prove inadequate during crisis periods such as COVID-19. This paper demonstrates: (a) that payments systems data which capture a variety of economic transactions can assist in estimating the state of the economy in real time and (b) that machine learning can provide a set of econometric tools to effectively handle a wide variety in payments data and capture sudden and large effects from a crisis. Further, we mitigate the interpretability and overfitting challenges of machine learning models by using the Shapley value-based approach to quantify the marginal contribution of payments data and by devising a novel cross-validation strategy tailored to macroeconomic prediction models.

Suggested Citation

  • James Chapman & Ajit Desai, 2022. "Macroeconomic Predictions Using Payments Data and Machine Learning," Staff Working Papers 22-10, Bank of Canada.
  • Handle: RePEc:bca:bocawp:22-10
    as

    Download full text from publisher

    File URL: https://www.bankofcanada.ca/wp-content/uploads/2022/03/swp2022-10.pdf
    File Function: Full text
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Giannone, Domenico & Reichlin, Lucrezia & Small, David, 2008. "Nowcasting: The real-time informational content of macroeconomic data," Journal of Monetary Economics, Elsevier, vol. 55(4), pages 665-676, May.
    2. Bergmeir, Christoph & Hyndman, Rob J. & Koo, Bonsoo, 2018. "A note on the validity of cross-validation for evaluating autoregressive time series prediction," Computational Statistics & Data Analysis, Elsevier, vol. 120(C), pages 70-83.
    3. Chakraborty, Chiranjit & Joseph, Andreas, 2017. "Machine learning at central banks," Bank of England working papers 674, Bank of England.
    4. Gary Koop & Luca Onorante, 2019. "Macroeconomic Nowcasting Using Google Probabilities☆," Advances in Econometrics, in: Topics in Identification, Limited Dependent Variables, Partial Observability, Experimentation, and Flexible Modeling: Part A, volume 40, pages 17-40, Emerald Group Publishing Limited.
    5. Robin Greenwood & Samuel G. Hanson & Andrei Shleifer & Jakob Ahm Sørensen, 2022. "Predictable Financial Crises," Journal of Finance, American Finance Association, vol. 77(2), pages 863-921, April.
    6. David Bounie & Youssouf Camara & John Galbraith, 2020. "Consumers’ Mobility, Expenditure and Online-Offline Substitution Response to COVID-19: Evidence from French Transaction Data," Cahiers de recherche 14-2020, Centre interuniversitaire de recherche en économie quantitative, CIREQ.
    7. Nesreen Ahmed & Amir Atiya & Neamat El Gayar & Hisham El-Shishiny, 2010. "An Empirical Comparison of Machine Learning Models for Time Series Forecasting," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 594-621.
    8. Chernis, Tony & Cheung, Calista & Velasco, Gabriella, 2020. "A three-frequency dynamic factor model for nowcasting Canadian provincial GDP growth," International Journal of Forecasting, Elsevier, vol. 36(3), pages 851-872.
    9. Elena Angelini & Gonzalo Camba‐Mendez & Domenico Giannone & Lucrezia Reichlin & Gerhard Rünstler, 2011. "Short‐term forecasts of euro area GDP growth," Econometrics Journal, Royal Economic Society, vol. 14(1), pages 25-44, February.
    10. Brandyn Bok & Daniele Caratelli & Domenico Giannone & Argia M. Sbordone & Andrea Tambalotti, 2018. "Macroeconomic Nowcasting and Forecasting with Big Data," Annual Review of Economics, Annual Reviews, vol. 10(1), pages 615-643, August.
    11. Domenico Giannone & Lucrezia Reichlin & David H. Small, 2005. "Nowcasting GDP and inflation: the real-time informational content of macroeconomic data releases," Finance and Economics Discussion Series 2005-42, Board of Governors of the Federal Reserve System (U.S.).
    12. Maehashi, Kohei & Shintani, Mototsugu, 2020. "Macroeconomic forecasting using factor models and machine learning: an application to Japan," Journal of the Japanese and International Economies, Elsevier, vol. 58(C).
    13. James Chapman & Ajit Desai, 2021. "Using Payments Data to Nowcast Macroeconomic Variables During the Onset of COVID-19," Staff Working Papers 21-2, Bank of Canada.
    14. Galbraith, John W. & Tkacz, Greg, 2018. "Nowcasting with payments system data," International Journal of Forecasting, Elsevier, vol. 34(2), pages 366-376.
    15. Tony Chernis & Rodrigo Sekkel, 2017. "A dynamic factor model for nowcasting Canadian GDP growth," Empirical Economics, Springer, vol. 53(1), pages 217-234, August.
    16. Foroni, Claudia & Marcellino, Massimiliano & Stevanovic, Dalibor, 2022. "Forecasting the Covid-19 recession and recovery: Lessons from the financial crisis," International Journal of Forecasting, Elsevier, vol. 38(2), pages 596-612.
    17. Martin J. Osborne & Ariel Rubinstein, 1994. "A Course in Game Theory," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262650401, December.
    18. Carvalho, V & Garcia, Juan R. & Hansen, S. & Ortiz, A. & Rodrigo, T. & More, J. V. R., 2020. "Tracking the COVID-19 Crisis with High-Resolution Transaction Data," Cambridge Working Papers in Economics 2030, Faculty of Economics, University of Cambridge.
    19. Athey, Susan & Imbens, Guido W., 2019. "Machine Learning Methods Economists Should Know About," Research Papers 3776, Stanford University, Graduate School of Business.
    20. Hindrayanto, Irma & Koopman, Siem Jan & de Winter, Jasper, 2016. "Forecasting and nowcasting economic growth in the euro area using factor models," International Journal of Forecasting, Elsevier, vol. 32(4), pages 1284-1305.
    21. Marta Bańbura & Michele Modugno, 2014. "Maximum Likelihood Estimation Of Factor Models On Datasets With Arbitrary Pattern Of Missing Data," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(1), pages 133-160, January.
    22. Hal R. Varian, 2014. "Big Data: New Tricks for Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 28(2), pages 3-28, Spring.
    23. John Galbraith & Greg Tkacz, 2007. "Electronic Transactions as High-Frequency Indicators of Economic Activity," Staff Working Papers 07-58, Bank of Canada.
    24. Jaehyun Yoon, 2021. "Forecasting of Real GDP Growth Using Machine Learning Models: Gradient Boosting and Random Forest Approach," Computational Economics, Springer;Society for Computational Economics, vol. 57(1), pages 247-265, January.
    25. Hamilton, James D., 2011. "Calling recessions in real time," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1006-1026, October.
    26. Valentina Aprigliano & Guerino Ardizzi & Libero Monteforte, 2019. "Using Payment System Data to Forecast Economic Activity," International Journal of Central Banking, International Journal of Central Banking, vol. 15(4), pages 55-80, October.
    27. Bragoli, Daniela, 2017. "Now-casting the Japanese economy," International Journal of Forecasting, Elsevier, vol. 33(2), pages 390-402.
    28. George Kapetanios & Fotis Papailias, 2018. "Big Data & Macroeconomic Nowcasting: Methodological Review," Economic Statistics Centre of Excellence (ESCoE) Discussion Papers ESCoE DP-2018-12, Economic Statistics Centre of Excellence (ESCoE).
    29. Susan Athey & Guido W. Imbens, 2019. "Machine Learning Methods That Economists Should Know About," Annual Review of Economics, Annual Reviews, vol. 11(1), pages 685-725, August.
    30. Hyunyoung Choi & Hal Varian, 2012. "Predicting the Present with Google Trends," The Economic Record, The Economic Society of Australia, vol. 88(s1), pages 2-9, June.
    31. Domenico Giannone & Lucrezia Reichlin & David Small, 2008. "Nowcasting: the real time informational content of macroeconomic data releases," ULB Institutional Repository 2013/6409, ULB -- Universite Libre de Bruxelles.
    32. Thibaut Duprey, 2020. "Canadian Financial Stress and Macroeconomic Condition," Canadian Public Policy, University of Toronto Press, vol. 46(S3), pages 236-260, October.
    33. Tatjana Dahlhaus & Angelika Welte, 2021. "Payment Habits During COVID-19: Evidence from High-Frequency Transaction Data," Staff Working Papers 21-43, Bank of Canada.
    34. Barnett, William & Chauvet, Marcelle & Leiva-Leon, Danilo & Su, Liting, 2016. "Nowcasting Nominal GDP with the Credit-Card Augmented Divisia Monetary," Studies in Applied Economics 59, The Johns Hopkins Institute for Applied Economics, Global Health, and the Study of Business Enterprise.
    35. Sendhil Mullainathan & Jann Spiess, 2017. "Machine Learning: An Applied Econometric Approach," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 87-106, Spring.
    36. Kohei Maehashi & Mototsugu Shintani, 2020. "Macroeconomic Forecasting Using Factor Models and Machine Learning: An Application to Japan," CIRJE F-Series CIRJE-F-1146, CIRJE, Faculty of Economics, University of Tokyo.
    37. Andy C.C. Kwan & John A. Cotsomitis, 2006. "The Usefulness of Consumer Confidence in Forecasting Household Spending in Canada: A National and Regional Analysis," Economic Inquiry, Western Economic Association International, vol. 44(1), pages 185-197, January.
    38. Hui Zou & Trevor Hastie, 2005. "Addendum: Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(5), pages 768-768, November.
    39. Hui Zou & Trevor Hastie, 2005. "Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(2), pages 301-320, April.
    40. Duarte, Cláudia & Rodrigues, Paulo M.M. & Rua, António, 2017. "A mixed frequency approach to the forecasting of private consumption with ATM/POS data," International Journal of Forecasting, Elsevier, vol. 33(1), pages 61-75.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Laura Felber & Dr. Simon Beyeler, 2023. "Nowcasting economic activity using transaction payments data," Working Papers 2023-01, Swiss National Bank.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. James Chapman & Ajit Desai, 2021. "Using Payments Data to Nowcast Macroeconomic Variables During the Onset of COVID-19," Staff Working Papers 21-2, Bank of Canada.
    2. Raquel Nadal Cesar Gonçalves, 2022. "Nowcasting Brazilian GDP with Electronic Payments Data," Working Papers Series 564, Central Bank of Brazil, Research Department.
    3. Knut Are Aastveit & Tuva Marie Fastbø & Eleonora Granziera & Kenneth Sæterhagen Paulsen & Kjersti Næss Torstensen, 2020. "Nowcasting Norwegian household consumption with debit card transaction data," Working Paper 2020/17, Norges Bank.
    4. Dennis Kant & Andreas Pick & Jasper de Winter, 2022. "Nowcasting GDP using machine learning methods," Working Papers 754, DNB.
    5. Laurent Ferrara & Anna Simoni, 2023. "When are Google Data Useful to Nowcast GDP? An Approach via Preselection and Shrinkage," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 41(4), pages 1188-1202, October.
    6. Zhang, Qin & Ni, He & Xu, Hao, 2023. "Nowcasting Chinese GDP in a data-rich environment: Lessons from machine learning algorithms," Economic Modelling, Elsevier, vol. 122(C).
    7. Samuel N. Cohen & Silvia Lui & Will Malpass & Giulia Mantoan & Lars Nesheim & 'Aureo de Paula & Andrew Reeves & Craig Scott & Emma Small & Lingyi Yang, 2023. "Nowcasting with signature methods," Papers 2305.10256, arXiv.org.
    8. Poncela, Pilar & Ruiz, Esther & Miranda, Karen, 2021. "Factor extraction using Kalman filter and smoothing: This is not just another survey," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1399-1425.
    9. Danilo Cascaldi-Garcia & Thiago Revil T. Ferreira & Domenico Giannone & Michele Modugno, 2021. "Back to the Present: Learning about the Euro Area through a Now-casting Model," International Finance Discussion Papers 1313, Board of Governors of the Federal Reserve System (U.S.).
    10. Anesti, Nikoleta & Kalamara, Eleni & Kapetanios, George, 2021. "Forecasting UK GDP growth with large survey panels," Bank of England working papers 923, Bank of England.
    11. Danilo Cascaldi-Garcia & Matteo Luciani & Michele Modugno, 2023. "Lessons from Nowcasting GDP across the World," International Finance Discussion Papers 1385, Board of Governors of the Federal Reserve System (U.S.).
    12. Carlos León & Fabio Ortega, 2018. "Nowcasting Economic Activity with Electronic Payments Data: A Predictive Modeling Approach," Revista de Economía del Rosario, Universidad del Rosario, vol. 21(2), pages 381-407, December.
    13. Jeffrey C. Chen & Abe Dunn & Kyle Hood & Alexander Driessen & Andrea Batch, 2019. "Off to the Races: A Comparison of Machine Learning and Alternative Data for Predicting Economic Indicators," NBER Chapters, in: Big Data for Twenty-First-Century Economic Statistics, pages 373-402, National Bureau of Economic Research, Inc.
    14. Chernis, Tony & Cheung, Calista & Velasco, Gabriella, 2020. "A three-frequency dynamic factor model for nowcasting Canadian provincial GDP growth," International Journal of Forecasting, Elsevier, vol. 36(3), pages 851-872.
    15. Bulligan, Guido & Marcellino, Massimiliano & Venditti, Fabrizio, 2015. "Forecasting economic activity with targeted predictors," International Journal of Forecasting, Elsevier, vol. 31(1), pages 188-206.
    16. Cepni, Oguzhan & Güney, I. Ethem & Swanson, Norman R., 2019. "Nowcasting and forecasting GDP in emerging markets using global financial and macroeconomic diffusion indexes," International Journal of Forecasting, Elsevier, vol. 35(2), pages 555-572.
    17. Magnus Reif, 2020. "Macroeconomics, Nonlinearities, and the Business Cycle," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 87.
    18. Leif Anders Thorsrud, 2016. "Nowcasting using news topics Big Data versus big bank," Working Papers No 6/2016, Centre for Applied Macro- and Petroleum economics (CAMP), BI Norwegian Business School.
    19. Baumeister, Christiane & Guérin, Pierre, 2021. "A comparison of monthly global indicators for forecasting growth," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1276-1295.
    20. Knut Are Aastveit & Francesco Ravazzolo & Herman K. van Dijk, 2018. "Combined Density Nowcasting in an Uncertain Economic Environment," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 36(1), pages 131-145, January.

    More about this item

    Keywords

    Business fluctuations and cycles; Econometric and statistical methods; Payment clearing and settlement systems;
    All these keywords.

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C55 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Large Data Sets: Modeling and Analysis
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications
    • E42 - Macroeconomics and Monetary Economics - - Money and Interest Rates - - - Monetary Sytsems; Standards; Regimes; Government and the Monetary System
    • E52 - Macroeconomics and Monetary Economics - - Monetary Policy, Central Banking, and the Supply of Money and Credit - - - Monetary Policy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bca:bocawp:22-10. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/bocgvca.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.