IDEAS home Printed from https://ideas.repec.org/p/rim/rimwps/18-30.html
   My bibliography  Save this paper

Machine Learning Macroeconometrics: A Primer

Author

Listed:
  • Dimitris Korobilis

    (University of Essex, UK; Rimini Centre for Economic Analysis)

Abstract

This Chapter reviews econometric methods that can be used in order to deal with the challenges of inference in high-dimensional empirical macro models with possibly “more parameters than observations”. These methods broadly include machine learning algorithms for Big Data, but also more traditional estimation algorithms for data with a short span of observations relative to the number of explanatory variables. While building mainly on a univariate linear regression setting, I show how machine learning ideas can be generalized to classes of models that are interesting to applied macroeconomists, such as time-varying parameter models and vector autoregressions.

Suggested Citation

  • Dimitris Korobilis, 2018. "Machine Learning Macroeconometrics: A Primer," Working Paper series 18-30, Rimini Centre for Economic Analysis.
  • Handle: RePEc:rim:rimwps:18-30
    as

    Download full text from publisher

    File URL: http://rcea.org/RePEc/pdf/wp18-30.pdf
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. Roberto S. Mariano & Yasutomo Murasawa, 2003. "A new coincident index of business cycles based on monthly and quarterly series," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 18(4), pages 427-443.
    2. Korobilis, Dimitris, 2013. "Hierarchical shrinkage priors for dynamic regressions with many predictors," International Journal of Forecasting, Elsevier, vol. 29(1), pages 43-59.
    3. Marta Bańbura, 2008. "Large Bayesian VARs," 2008 Meeting Papers 334, Society for Economic Dynamics.
    4. Dimitris Korobilis, 2013. "Var Forecasting Using Bayesian Variable Selection," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(2), pages 204-230, March.
    5. Gary Koop & Dimitris Korobilis, 2012. "Forecasting Inflation Using Dynamic Model Averaging," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 53(3), pages 867-886, August.
    6. Winford H. Masanjala & Chris Papageorgiou, 2008. "Rough and lonely road to prosperity: a reexamination of the sources of growth in Africa using Bayesian model averaging," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(5), pages 671-682.
    7. repec:eee:moneco:v:90:y:2017:i:c:p:13-27 is not listed on IDEAS
    8. Dimitris Korobilis & Davide Pettenuzzo, 2017. "Adaptive Hierarchical Priors for High-Dimensional Vector Autoregessions," Working Papers 115, Brandeis University, Department of Economics and International Businesss School.
    9. repec:taf:jnlbes:v:34:y:2016:i:4:p:574-589 is not listed on IDEAS
    10. James H. Stock & Mark W. Watson, 2005. "Implications of Dynamic Factor Models for VAR Analysis," NBER Working Papers 11467, National Bureau of Economic Research, Inc.
    11. Valen E. Johnson & David Rossell, 2012. "Bayesian Model Selection in High-Dimensional Settings," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(498), pages 649-660, June.
    12. Dimitris Korobilis, 2013. "Assessing the Transmission of Monetary Policy Using Time-varying Parameter Dynamic Factor Models-super-," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 75(2), pages 157-179, April.
    13. Enrique Moral-Benito, 2012. "Determinants of Economic Growth: A Bayesian Panel Data Approach," The Review of Economics and Statistics, MIT Press, vol. 94(2), pages 566-579, May.
    14. David F. Hendry & Hans-Martin Krolzig, 2005. "The Properties of Automatic "GETS" Modelling," Economic Journal, Royal Economic Society, vol. 115(502), pages 32-61, March.
    15. Frühwirth-Schnatter, Sylvia & Wagner, Helga, 2010. "Stochastic model specification search for Gaussian and partial non-Gaussian state space models," Journal of Econometrics, Elsevier, vol. 154(1), pages 85-100, January.
    16. Forni, Mario & Gambetti, Luca, 2014. "Sufficient information in structural VARs," Journal of Monetary Economics, Elsevier, vol. 66(C), pages 124-136.
    17. Carmen Fernandez & Eduardo Ley & Mark F. J. Steel, 2001. "Model uncertainty in cross-country growth regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 16(5), pages 563-576.
    18. Catherine Doz & Domenico Giannone & Lucrezia Reichlin, 2012. "A Quasi–Maximum Likelihood Approach for Large, Approximate Dynamic Factor Models," The Review of Economics and Statistics, MIT Press, vol. 94(4), pages 1014-1024, November.
    19. Boivin, Jean & Ng, Serena, 2006. "Are more data always better for factor analysis?," Journal of Econometrics, Elsevier, vol. 132(1), pages 169-194, May.
    20. Leamer, Edward E, 1983. "Let's Take the Con Out of Econometrics," American Economic Review, American Economic Association, vol. 73(1), pages 31-43, March.
    21. Stock, James H. & Watson, Mark W., 1999. "Forecasting inflation," Journal of Monetary Economics, Elsevier, vol. 44(2), pages 293-335, October.
    22. Korobilis, Dimitris, 2016. "Prior selection for panel vector autoregressions," Computational Statistics & Data Analysis, Elsevier, vol. 101(C), pages 110-120.
    23. Christ, Carl F, 1994. "The Cowles Commission's Contributions to Econometrics at Chicago, 1939-1955," Journal of Economic Literature, American Economic Association, vol. 32(1), pages 30-59, March.
    24. repec:oup:biomet:v:103:y:2016:i:4:p:955-969. is not listed on IDEAS
    25. Wright, Jonathan H., 2008. "Bayesian Model Averaging and exchange rate forecasts," Journal of Econometrics, Elsevier, vol. 146(2), pages 329-341, October.
    26. Rajarshi Guhaniyogi & David B. Dunson, 2015. "Bayesian Compressed Regression," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(512), pages 1500-1514, December.
    27. Sala-i-Martin, Xavier, 1997. "I Just Ran Two Million Regressions," American Economic Review, American Economic Association, vol. 87(2), pages 178-183, May.
    28. Fernandez, Carmen & Ley, Eduardo & Steel, Mark F. J., 2001. "Benchmark priors for Bayesian model averaging," Journal of Econometrics, Elsevier, vol. 100(2), pages 381-427, February.
    29. Davide Pettenuzzo & Allan Timmermann, 2017. "Forecasting Macroeconomic Variables Under Model Instability," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 35(2), pages 183-201, April.
    30. Granger, Clive W. J. & Uhlig, Harald F., 1990. "Reasonable extreme-bounds analysis," Journal of Econometrics, Elsevier, vol. 44(1-2), pages 159-170.
    31. Kapetanios, George & Labhard, Vincent & Price, Simon, 2008. "Forecasting Using Bayesian and Information-Theoretic Model Averaging: An Application to U.K. Inflation," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 33-41, January.
    32. McAleer, Michael & Pagan, Adrian R & Volker, Paul A, 1985. "What Will Take the Con out of Econometrics?," American Economic Review, American Economic Association, vol. 75(3), pages 293-307, June.
    33. Levine, Ross & Renelt, David, 1992. "A Sensitivity Analysis of Cross-Country Growth Regressions," American Economic Review, American Economic Association, vol. 82(4), pages 942-963, September.
    34. repec:eee:econom:v:201:y:2017:i:2:p:384-399 is not listed on IDEAS
    35. Domenico Giannone & Michele Lenza & Giorgio E. Primiceri, 2015. "Prior Selection for Vector Autoregressions," The Review of Economics and Statistics, MIT Press, vol. 97(2), pages 436-451, May.
    36. Garratt, Anthony & Koop, Gary & Mise, Emi & Vahey, Shaun P., 2009. "Real-Time Prediction With U.K. Monetary Aggregates in the Presence of Model Uncertainty," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 480-491.
    37. Durham, J. Benson, 2001. "Sensitivity analyses of anomalies in developed stock markets," Journal of Banking & Finance, Elsevier, vol. 25(8), pages 1503-1541, August.
    38. Elliott, Graham & Gargano, Antonio & Timmermann, Allan, 2013. "Complete subset regressions," Journal of Econometrics, Elsevier, vol. 177(2), pages 357-373.
    39. Ben S. Bernanke & Jean Boivin & Piotr Eliasz, 2005. "Measuring the Effects of Monetary Policy: A Factor-Augmented Vector Autoregressive (FAVAR) Approach," The Quarterly Journal of Economics, Oxford University Press, vol. 120(1), pages 387-422.
    40. Marta Banbura & Domenico Giannone & Lucrezia Reichlin, 2010. "Large Bayesian vector auto regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 71-92.
    41. Kelly, Bryan & Pruitt, Seth, 2015. "The three-pass regression filter: A new approach to forecasting using many predictors," Journal of Econometrics, Elsevier, vol. 186(2), pages 294-316.
    42. Belviso Francesco & Milani Fabio, 2006. "Structural Factor-Augmented VARs (SFAVARs) and the Effects of Monetary Policy," The B.E. Journal of Macroeconomics, De Gruyter, vol. 6(3), pages 1-46, December.
    43. Korobilis, D, 2017. "Forecasting with many predictors using message passing algorithms," Essex Finance Centre Working Papers 19565, University of Essex, Essex Business School.
    44. Robert Tibshirani & Michael Saunders & Saharon Rosset & Ji Zhu & Keith Knight, 2005. "Sparsity and smoothness via the fused lasso," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(1), pages 91-108.
    45. Korobilis, Dimitris & Koop, Gary, 2018. "Variational Bayes inference in high-dimensional time-varying parameter models," Essex Finance Centre Working Papers 22665, University of Essex, Essex Business School.
    46. Nicoletti-Altimari, Sergio, 2001. "Does money lead inflation in the euro area?," Working Paper Series 0063, European Central Bank.
    47. Min, Chung-ki & Zellner, Arnold, 1993. "Bayesian and non-Bayesian methods for combining models and forecasts with applications to forecasting international growth rates," Journal of Econometrics, Elsevier, vol. 56(1-2), pages 89-118, March.
    48. repec:aea:jecper:v:31:y:2017:i:2:p:87-106 is not listed on IDEAS
    49. James H. Stock & Mark W. Watson, 2007. "Why Has U.S. Inflation Become Harder to Forecast?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(s1), pages 3-33, February.
    50. P. Richard Hahn & Carlos M. Carvalho & Sayan Mukherjee, 2013. "Partial Factor Modeling: Predictor-Dependent Shrinkage for Linear Regression," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 108(503), pages 999-1008, September.
    51. Pesaran, M Hashem & Timmermann, Allan, 1995. " Predictability of Stock Returns: Robustness and Economic Significance," Journal of Finance, American Finance Association, vol. 50(4), pages 1201-1228, September.
    52. Pena, Daniel & Poncela, Pilar, 2004. "Forecasting with nonstationary dynamic factor models," Journal of Econometrics, Elsevier, vol. 119(2), pages 291-321, April.
    53. Xavier Sala-I-Martin & Gernot Doppelhofer & Ronald I. Miller, 2004. "Determinants of Long-Term Growth: A Bayesian Averaging of Classical Estimates (BACE) Approach," American Economic Review, American Economic Association, vol. 94(4), pages 813-835, September.
    54. Korobilis, Dimitris, 2008. "Forecasting in vector autoregressions with many predictors," MPRA Paper 21122, University Library of Munich, Germany.
    55. Cooley, Thomas F & Prescott, Edward C, 1976. "Estimation in the Presence of Stochastic Parameter Variation," Econometrica, Econometric Society, vol. 44(1), pages 167-184, January.
    56. George, Edward I. & Sun, Dongchu & Ni, Shawn, 2008. "Bayesian stochastic search for VAR model restrictions," Journal of Econometrics, Elsevier, vol. 142(1), pages 553-580, January.
    57. Yeung Lewis Chan & James H. Stock & Mark W. Watson, 1999. "A dynamic factor model framework for forecast combination," Spanish Economic Review, Springer;Spanish Economic Association, vol. 1(2), pages 91-121.
    58. Michael W. McCracken & Serena Ng, 2016. "FRED-MD: A Monthly Database for Macroeconomic Research," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(4), pages 574-589, October.
    59. Ronald L. Wasserstein & Nicole A. Lazar, 2016. "The ASA's Statement on p -Values: Context, Process, and Purpose," The American Statistician, Taylor & Francis Journals, vol. 70(2), pages 129-133, May.
    60. Hui Zou & Trevor Hastie, 2005. "Addendum: Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(5), pages 768-768.
    61. Ellahie, Atif & Ricco, Giovanni, 2017. "Government purchases reloaded: Informational insufficiency and heterogeneity in fiscal VARs," Journal of Monetary Economics, Elsevier, vol. 90(C), pages 13-27.
    62. Alin T Mirestean & Charalambos G Tsangarides & Huigang Chen, 2009. "Limited Information Bayesian Model Averaging for Dynamic Panels with Short Time Periods," IMF Working Papers 09/74, International Monetary Fund.
    63. repec:taf:jnlasa:v:112:y:2017:i:517:p:137-168 is not listed on IDEAS
    64. Bai, Jushan & Ng, Serena, 2008. "Large Dimensional Factor Analysis," Foundations and Trends(R) in Econometrics, now publishers, vol. 3(2), pages 89-163, June.
    65. Geisel, Martin S, 1973. "Bayesian Comparisons of Simple Macroeconomic Models," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 5(3), pages 751-772, August.
    66. Stock J.H. & Watson M.W., 2002. "Forecasting Using Principal Components From a Large Number of Predictors," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1167-1179, December.
    67. Hui Zou & Trevor Hastie, 2005. "Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(2), pages 301-320.
    68. Chang-Jin Kim & Charles R. Nelson, 1999. "State-Space Models with Regime Switching: Classical and Gibbs-Sampling Approaches with Applications," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262112388, January.
    Full references (including those not matched with items on IDEAS)

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:rim:rimwps:18-30. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Marco Savioli). General contact details of provider: http://edirc.repec.org/data/rcfeait.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.