IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2009.00401.html
   My bibliography  Save this paper

Time-Varying Parameters as Ridge Regressions

Author

Listed:
  • Philippe Goulet Coulombe

Abstract

Time-varying parameters (TVPs) models are frequently used in economics to capture structural change. I highlight a rather underutilized fact -- that these are actually ridge regressions. Instantly, this makes computations, tuning, and implementation much easier than in the state-space paradigm. Among other things, solving the equivalent dual ridge problem is computationally very fast even in high dimensions, and the crucial "amount of time variation" is tuned by cross-validation. Evolving volatility is dealt with using a two-step ridge regression. I consider extensions that incorporate sparsity (the algorithm selects which parameters vary and which do not) and reduced-rank restrictions (variation is tied to a factor model). To demonstrate the usefulness of the approach, I use it to study the evolution of monetary policy in Canada using large time-varying local projections. The application requires the estimation of about 4600 TVPs, a task well within the reach of the new method.

Suggested Citation

  • Philippe Goulet Coulombe, 2020. "Time-Varying Parameters as Ridge Regressions," Papers 2009.00401, arXiv.org, revised Apr 2023.
  • Handle: RePEc:arx:papers:2009.00401
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2009.00401
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Robert Tibshirani & Michael Saunders & Saharon Rosset & Ji Zhu & Keith Knight, 2005. "Sparsity and smoothness via the fused lasso," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(1), pages 91-108, February.
    2. Stevanovic Dalibor, 2016. "Common time variation of parameters in reduced-form macroeconomic models," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 20(2), pages 159-183, April.
    3. Christina D. Romer & David H. Romer, 2004. "A New Measure of Monetary Shocks: Derivation and Implications," American Economic Review, American Economic Association, vol. 94(4), pages 1055-1084, September.
    4. Marta Banbura & Domenico Giannone & Lucrezia Reichlin, 2010. "Large Bayesian vector auto regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 71-92.
    5. Timothy Cogley & Thomas J. Sargent, 2005. "Drift and Volatilities: Monetary Policies and Outcomes in the Post WWII U.S," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 8(2), pages 262-302, April.
    6. Gary M. Koop, 2013. "Forecasting with Medium and Large Bayesian VARS," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(2), pages 177-203, March.
    7. Zou, Hui, 2006. "The Adaptive Lasso and Its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1418-1429, December.
    8. Bergmeir, Christoph & Hyndman, Rob J. & Koo, Bonsoo, 2018. "A note on the validity of cross-validation for evaluating autoregressive time series prediction," Computational Statistics & Data Analysis, Elsevier, vol. 120(C), pages 70-83.
    9. Philippe Goulet Coulombe & Maxime Leroux & Dalibor Stevanovic & Stéphane Surprenant, 2022. "How is machine learning useful for macroeconomic forecasting?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 920-964, August.
    10. Maxime Leroux & Rachidi Kotchoni & Dalibor Stevanovic, 2017. "Forecasting economic activity in data-rich environment," EconomiX Working Papers 2017-5, University of Paris Nanterre, EconomiX.
    11. Timothy Cogley & Thomas J. Sargent, 2002. "Evolving Post-World War II US Inflation Dynamics," NBER Chapters, in: NBER Macroeconomics Annual 2001, Volume 16, pages 331-388, National Bureau of Economic Research, Inc.
    12. Korobilis, Dimitris, 2014. "Data-based priors for vector autoregressions with drifting coefficients," MPRA Paper 53772, University Library of Munich, Germany.
    13. Goulet Coulombe, Philippe & Leroux, Maxime & Stevanovic, Dalibor & Surprenant, Stéphane, 2021. "Macroeconomic data transformations matter," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1338-1354.
    14. Alan J. Auerbach & Yuriy Gorodnichenko, 2012. "Fiscal Multipliers in Recession and Expansion," NBER Chapters, in: Fiscal Policy after the Financial Crisis, pages 63-98, National Bureau of Economic Research, Inc.
    15. Liudas Giraitis & George Kapetanios & Tony Yates, 2018. "Inference on Multivariate Heteroscedastic Time Varying Random Coefficient Models," Journal of Time Series Analysis, Wiley Blackwell, vol. 39(2), pages 129-149, March.
    16. Miguel A.G. Belmonte & Gary Koop & Dimitris Korobilis, 2014. "Hierarchical Shrinkage in Time‐Varying Parameter Models," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 33(1), pages 80-94, January.
    17. Mikio Ito & Akihiko Noda & Tatsuma Wada, 2014. "International stock market efficiency: a non-Bayesian time-varying model approach," Applied Economics, Taylor & Francis Journals, vol. 46(23), pages 2744-2754, August.
    18. Kilian,Lutz & Lütkepohl,Helmut, 2018. "Structural Vector Autoregressive Analysis," Cambridge Books, Cambridge University Press, number 9781107196575.
    19. Florian Frommlet & Grégory Nuel, 2016. "An Adaptive Ridge Procedure for L0 Regularization," PLOS ONE, Public Library of Science, vol. 11(2), pages 1-23, February.
    20. Jennifer L. Castle & Jurgen A. Doornik & David F. Hendry & Felix Pretis, 2015. "Detecting Location Shifts during Model Selection by Step-Indicator Saturation," Econometrics, MDPI, vol. 3(2), pages 1-25, April.
    21. Christiane Baumeister & Lutz Kilian, 2014. "What Central Bankers Need To Know About Forecasting Oil Prices," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 55, pages 869-889, August.
    22. James Cloyne & Patrick Hürtgen, 2016. "The Macroeconomic Effects of Monetary Policy: A New Measure for the United Kingdom," American Economic Journal: Macroeconomics, American Economic Association, vol. 8(4), pages 75-102, October.
    23. Ramey, V.A., 2016. "Macroeconomic Shocks and Their Propagation," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 71-162, Elsevier.
    24. Marta Banbura & Domenico Giannone & Lucrezia Reichlin, 2010. "Large Bayesian vector auto regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 71-92.
    25. Michael W. McCracken & Serena Ng, 2021. "FRED-QD: A Quarterly Database for Macroeconomic Research," Review, Federal Reserve Bank of St. Louis, vol. 103(1), pages 1-44, January.
    26. Blanchard, Oliver & Cerutti, Eugenio & SUmmers, Lawrence, 2015. "Inflation and Activity - Two Explorations and Their Monetary Policy Implications," Working Paper Series 15-070, Harvard University, John F. Kennedy School of Government.
    27. George Kapetanios & Massimiliano Marcellino & Fabrizio Venditti, 2019. "Large time‐varying parameter VARs: A nonparametric approach," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(7), pages 1027-1049, November.
    28. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    29. Stock, James H & Watson, Mark W, 1996. "Evidence on Structural Instability in Macroeconomic Time Series Relations," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(1), pages 11-30, January.
    30. Germano Ruisi, 2019. "Time-Varying Local Projections," Working Papers 891, Queen Mary University of London, School of Economics and Finance.
    31. Giraitis, L. & Kapetanios, G. & Yates, T., 2014. "Inference on stochastic time-varying coefficient models," Journal of Econometrics, Elsevier, vol. 179(1), pages 46-65.
    32. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-162, April.
    33. Koop, Gary & Korobilis, Dimitris, 2013. "Large time-varying parameter VARs," Journal of Econometrics, Elsevier, vol. 177(2), pages 185-198.
    34. Kadiyala, K Rao & Karlsson, Sune, 1997. "Numerical Methods for Estimation and Inference in Bayesian VAR-Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 12(2), pages 99-132, March-Apr.
    35. Champagne, Julien & Sekkel, Rodrigo, 2018. "Changes in monetary regimes and the identification of monetary policy shocks: Narrative evidence from Canada," Journal of Monetary Economics, Elsevier, vol. 99(C), pages 72-87.
    36. Mikio Ito & Akihiko Noda & Tatsuma Wada, 2017. "An Alternative Estimation Method of a Time-Varying Parameter Model," Papers 1707.06837, arXiv.org, revised Dec 2017.
    37. Boivin, Jean, 2006. "Has U.S. Monetary Policy Changed? Evidence from Drifting Coefficients and Real-Time Data," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 38(5), pages 1149-1173, August.
    38. Lusompa, Amaze, 2019. "Local Projections, Autocorrelation, and Efficiency," MPRA Paper 99856, University Library of Munich, Germany, revised 11 Apr 2020.
    39. Giorgio E. Primiceri, 2005. "Time Varying Structural Vector Autoregressions and Monetary Policy," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(3), pages 821-852.
    40. Davide Pettenuzzo & Allan Timmermann, 2017. "Forecasting Macroeconomic Variables Under Model Instability," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 35(2), pages 183-201, April.
    41. Joshua C.C. Chan & Eric Eisenstat & Rodney W. Strachan, 2018. "Reducing dimensions in a large TVP-VAR," CAMA Working Papers 2018-49, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
    42. Andrea Carriero & George Kapetanios & Massimiliano Marcellino, 2011. "Forecasting large datasets with Bayesian reduced rank multivariate models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(5), pages 735-761, August.
    43. Marco Del Negro & Giorgio E. Primiceri, 2015. "Time Varying Structural Vector Autoregressions and Monetary Policy: A Corrigendum," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 82(4), pages 1342-1345.
    44. Antonello D'Agostino & Luca Gambetti & Domenico Giannone, 2013. "Macroeconomic forecasting and structural change," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(1), pages 82-101, January.
    45. Valerie A. Ramey & Sarah Zubairy, 2018. "Government Spending Multipliers in Good Times and in Bad: Evidence from US Historical Data," Journal of Political Economy, University of Chicago Press, vol. 126(2), pages 850-901.
    46. Pooyan Amir-Ahmadi & Christian Matthes & Mu-Chun Wang, 2020. "Choosing Prior Hyperparameters: With Applications to Time-Varying Parameter Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(1), pages 124-136, January.
    47. Joris de Wind & Luca Gambetti, 2014. "Reduced-rank time-varying vector autoregressions," CPB Discussion Paper 270.rdf, CPB Netherlands Bureau for Economic Policy Analysis.
    48. Barakchian, S. Mahdi & Crowe, Christopher, 2013. "Monetary policy matters: Evidence from new shocks data," Journal of Monetary Economics, Elsevier, vol. 60(8), pages 950-966.
    49. Jushan Bai & Serena Ng, 2017. "Principal Components and Regularized Estimation of Factor Models," Papers 1708.08137, arXiv.org, revised Nov 2017.
    50. Joris de Wind & Luca Gambetti, 2014. "Reduced-rank time-varying vector autoregressions," CPB Discussion Paper 270, CPB Netherlands Bureau for Economic Policy Analysis.
    51. Bin Chen & Yongmiao Hong, 2012. "Testing for Smooth Structural Changes in Time Series Models via Nonparametric Regression," Econometrica, Econometric Society, vol. 80(3), pages 1157-1183, May.
    52. Chan, Joshua C.C. & Eisenstat, Eric, 2018. "Comparing hybrid time-varying parameter VARs," Economics Letters, Elsevier, vol. 171(C), pages 1-5.
    53. Götz, Thomas B. & Hauzenberger, Klemens, 2018. "Large mixed-frequency VARs with a parsimonious time-varying parameter structure," Discussion Papers 40/2018, Deutsche Bundesbank.
    54. Petrova, Katerina, 2019. "A quasi-Bayesian local likelihood approach to time varying parameter VAR models," Journal of Econometrics, Elsevier, vol. 212(1), pages 286-306.
    55. James H. Stock & Mark W. Watson, 1998. "A Comparison of Linear and Nonlinear Univariate Models for Forecasting Macroeconomic Time Series," NBER Working Papers 6607, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Philippe Goulet Coulombe, 2021. "The Macroeconomy as a Random Forest," Working Papers 21-05, Chair in macroeconomics and forecasting, University of Quebec in Montreal's School of Management.
    2. Philippe Goulet Coulombe, 2020. "The Macroeconomy as a Random Forest," Papers 2006.12724, arXiv.org, revised Mar 2021.
    3. Marta Banbura & Andries van Vlodrop, 2018. "Forecasting with Bayesian Vector Autoregressions with Time Variation in the Mean," Tinbergen Institute Discussion Papers 18-025/IV, Tinbergen Institute.
    4. Andrea Carriero & Francesco Corsello & Massimiliano Marcellino, 2022. "The global component of inflation volatility," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(4), pages 700-721, June.
    5. Magnus Reif, 2020. "Macroeconomics, Nonlinearities, and the Business Cycle," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 87.
    6. Carriero, Andrea & Mumtaz, Haroon & Theophilopoulou, Angeliki, 2015. "Macroeconomic information, structural change, and the prediction of fiscal aggregates," International Journal of Forecasting, Elsevier, vol. 31(2), pages 325-348.
    7. Chan, Joshua C.C., 2023. "Comparing stochastic volatility specifications for large Bayesian VARs," Journal of Econometrics, Elsevier, vol. 235(2), pages 1419-1446.
    8. Giacomo Rella, 2021. "The Fed, housing and household debt over time," Department of Economics University of Siena 850, Department of Economics, University of Siena.
    9. Chan, Joshua C.C., 2021. "Minnesota-type adaptive hierarchical priors for large Bayesian VARs," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1212-1226.
    10. Karlsson, Sune, 2013. "Forecasting with Bayesian Vector Autoregression," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 791-897, Elsevier.
    11. Koop, Gary & Korobilis, Dimitris & Pettenuzzo, Davide, 2019. "Bayesian compressed vector autoregressions," Journal of Econometrics, Elsevier, vol. 210(1), pages 135-154.
    12. Nima Nonejad, 2021. "An Overview Of Dynamic Model Averaging Techniques In Time‐Series Econometrics," Journal of Economic Surveys, Wiley Blackwell, vol. 35(2), pages 566-614, April.
    13. Andrea Carriero & Francesco Corsello & Massimiliano Marcellino, 2020. "The economic drivers of volatility and uncertainty," Temi di discussione (Economic working papers) 1285, Bank of Italy, Economic Research and International Relations Area.
    14. Joshua C.C. Chan & Rodney W. Strachan, 2023. "Bayesian State Space Models In Macroeconometrics," Journal of Economic Surveys, Wiley Blackwell, vol. 37(1), pages 58-75, February.
    15. George Kapetanios & Massimiliano Marcellino & Fabrizio Venditti, 2019. "Large time‐varying parameter VARs: A nonparametric approach," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(7), pages 1027-1049, November.
    16. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2016. "Common Drifting Volatility in Large Bayesian VARs," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(3), pages 375-390, July.
    17. Yousuf, Kashif & Ng, Serena, 2021. "Boosting high dimensional predictive regressions with time varying parameters," Journal of Econometrics, Elsevier, vol. 224(1), pages 60-87.
    18. Barbara Rossi, 2019. "Forecasting in the presence of instabilities: How do we know whether models predict well and how to improve them," Economics Working Papers 1711, Department of Economics and Business, Universitat Pompeu Fabra, revised Jul 2021.
    19. Joshua C. C. Chan, 2019. "Large Bayesian vector autoregressions," CAMA Working Papers 2019-19, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
    20. Knut Are Aastveit & Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2017. "Have Standard VARS Remained Stable Since the Crisis?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(5), pages 931-951, August.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2009.00401. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.