IDEAS home Printed from https://ideas.repec.org/a/eee/ecosta/v37y2026icp250-269.html

A computationally efficient mixture innovation model for time-varying parameter regressions

Author

Listed:
  • He, Zhongfang

Abstract

The mixture innovation (MI) model places a spike-and-slab mixture distribution for the innovations of time-varying regression coefficients and permits flexible time variation patterns while allowing for dynamic shrinkage. Despite its appeal, the standard Bayesian algorithm to block sample the vector of 0/1 mixture indicators at each time t needs to evaluate the model likelihood over all its 2K scenarios for a regression model with K regressors and becomes impractical when K grows. As an alternative, a new specification of the MI model is proposed in which the 0/1 mixture indicators in the original MI model are approximated by a logistic function of latent continuous variables. As such the model likelihood only needs to be evaluated twice in an Metropolis-Hastings step to block update the latent variables and hence the approximated mixture indicators at each time t, offering large improvement in computational efficiency while keeping the benefits of the MI model. An efficient MCMC algorithm is developed to estimate the new model. A simulation study shows that the new model can achieve the same level of estimation accuracy as the original MI model but at a much smaller computation cost. The new model is further tested in two empirical applications where block sampling the mixture indicators at each time t in the original MI model is practically infeasible.

Suggested Citation

  • He, Zhongfang, 2026. "A computationally efficient mixture innovation model for time-varying parameter regressions," Econometrics and Statistics, Elsevier, vol. 37(C), pages 250-269.
  • Handle: RePEc:eee:ecosta:v:37:y:2026:i:c:p:250-269
    DOI: 10.1016/j.ecosta.2023.08.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S245230622300059X
    Download Restriction: Full text for ScienceDirect subscribers only. Contains open access articles

    File URL: https://libkey.io/10.1016/j.ecosta.2023.08.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Kalli, Maria & Griffin, Jim E., 2014. "Time-varying sparsity in dynamic regression models," Journal of Econometrics, Elsevier, vol. 178(2), pages 779-793.
    2. Bitto, Angela & Frühwirth-Schnatter, Sylvia, 2019. "Achieving shrinkage in a time-varying parameter model framework," Journal of Econometrics, Elsevier, vol. 210(1), pages 75-97.
    3. Miguel A.G. Belmonte & Gary Koop & Dimitris Korobilis, 2014. "Hierarchical Shrinkage in Time‐Varying Parameter Models," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 33(1), pages 80-94, January.
    4. Hauzenberger, Niko, 2021. "Flexible Mixture Priors for Large Time-varying Parameter Models," Econometrics and Statistics, Elsevier, vol. 20(C), pages 87-108.
    5. Carlos M. Carvalho & Nicholas G. Polson & James G. Scott, 2010. "The horseshoe estimator for sparse signals," Biometrika, Biometrika Trust, vol. 97(2), pages 465-480.
    6. Chang, Yoosoon & Choi, Yongok & Park, Joon Y., 2017. "A new approach to model regime switching," Journal of Econometrics, Elsevier, vol. 196(1), pages 127-143.
    7. Daniel R. Kowal & David S. Matteson & David Ruppert, 2019. "Dynamic shrinkage processes," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 81(4), pages 781-804, September.
    8. John M. Maheu & Stephen Gordon, 2008. "Learning, forecasting and structural breaks," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(5), pages 553-583.
    9. McCausland, William J. & Miller, Shirley & Pelletier, Denis, 2011. "Simulation smoothing for state-space models: A computational efficiency analysis," Computational Statistics & Data Analysis, Elsevier, vol. 55(1), pages 199-212, January.
    10. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    11. Kastner, Gregor & Frühwirth-Schnatter, Sylvia, 2014. "Ancillarity-sufficiency interweaving strategy (ASIS) for boosting MCMC estimation of stochastic volatility models," Computational Statistics & Data Analysis, Elsevier, vol. 76(C), pages 408-423.
    12. Prüser, Jan, 2021. "The horseshoe prior for time-varying parameter VARs and Monetary Policy," Journal of Economic Dynamics and Control, Elsevier, vol. 129(C).
    13. Geweke, John & Amisano, Gianni, 2010. "Comparing and evaluating Bayesian predictive distributions of asset returns," International Journal of Forecasting, Elsevier, vol. 26(2), pages 216-230, April.
    14. Frühwirth-Schnatter, Sylvia & Wagner, Helga, 2010. "Stochastic model specification search for Gaussian and partial non-Gaussian state space models," Journal of Econometrics, Elsevier, vol. 154(1), pages 85-100, January.
    15. Annalisa Cadonna & Sylvia Frühwirth-Schnatter & Peter Knaus, 2020. "Triple the Gamma—A Unifying Shrinkage Prior for Variance and Variable Selection in Sparse State Space and TVP Models," Econometrics, MDPI, vol. 8(2), pages 1-36, May.
    16. Giordani, Paolo & Kohn, Robert & van Dijk, Dick, 2007. "A unified approach to nonlinearity, structural change, and outliers," Journal of Econometrics, Elsevier, vol. 137(1), pages 112-133, March.
    17. Arnaud Dufays & Zhuo Li & Jeroen V.K. Rombouts & Yong Song, 2021. "Sparse change‐point VAR models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(6), pages 703-727, September.
    18. Gary Koop & Simon M. Potter, 2007. "Estimation and Forecasting in Models with Multiple Breaks," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 74(3), pages 763-789.
    19. P. H. Garthwaite & Y. Fan & S. A. Sisson, 2016. "Adaptive optimal scaling of Metropolis–Hastings algorithms using the Robbins–Monro process," Communications in Statistics - Theory and Methods, Taylor & Francis Journals, vol. 45(17), pages 5098-5111, September.
    20. Marco Del Negro & Giorgio E. Primiceri, 2015. "Time Varying Structural Vector Autoregressions and Monetary Policy: A Corrigendum," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 82(4), pages 1342-1345.
    21. Florian Huber & Gregor Kastner & Martin Feldkircher, 2019. "Should I stay or should I go? A latent threshold approach to large‐scale mixture innovation models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(5), pages 621-640, August.
    22. Jouchi Nakajima & Mike West, 2013. "Bayesian Analysis of Latent Threshold Dynamic Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(2), pages 151-164, April.
    23. Chib, Siddhartha, 1998. "Estimation and comparison of multiple change-point models," Journal of Econometrics, Elsevier, vol. 86(2), pages 221-241, June.
    24. John Y. Campbell, Robert J. Shiller, 1988. "The Dividend-Price Ratio and Expectations of Future Dividends and Discount Factors," The Review of Financial Studies, Society for Financial Studies, vol. 1(3), pages 195-228.
    25. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    26. Giordani, Paolo & Kohn, Robert, 2008. "Efficient Bayesian Inference for Multiple Change-Point and Mixture Innovation Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 66-77, January.
    27. Florian Huber & Michael Pfarrhofer, 2021. "Dynamic shrinkage in time‐varying parameter stochastic volatility in mean models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(2), pages 262-270, March.
    28. Hamilton, James D, 1989. "A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle," Econometrica, Econometric Society, vol. 57(2), pages 357-384, March.
    29. Omori, Yasuhiro & Chib, Siddhartha & Shephard, Neil & Nakajima, Jouchi, 2007. "Stochastic volatility with leverage: Fast and efficient likelihood inference," Journal of Econometrics, Elsevier, vol. 140(2), pages 425-449, October.
    30. Carriero, Andrea & Clark, Todd E. & Marcellino, Massimiliano, 2019. "Large Bayesian vector autoregressions with stochastic volatility and non-conjugate priors," Journal of Econometrics, Elsevier, vol. 212(1), pages 137-154.
    31. Joshua C.C. Chan & Gary Koop & Roberto Leon-Gonzalez & Rodney W. Strachan, 2012. "Time Varying Dimension Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(3), pages 358-367, January.
    32. J. Durbin, 2002. "A simple and efficient simulation smoother for state space time series analysis," Biometrika, Biometrika Trust, vol. 89(3), pages 603-616, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhongfang He, 2024. "Locally time-varying parameter regression," Econometric Reviews, Taylor & Francis Journals, vol. 43(5), pages 269-300, May.
    2. Niko Hauzenberger, 2020. "Flexible Mixture Priors for Large Time-varying Parameter Models," Papers 2006.10088, arXiv.org, revised Nov 2020.
    3. Hauzenberger, Niko, 2021. "Flexible Mixture Priors for Large Time-varying Parameter Models," Econometrics and Statistics, Elsevier, vol. 20(C), pages 87-108.
    4. Dufays, Arnaud & Rombouts, Jeroen V.K., 2020. "Relevant parameter changes in structural break models," Journal of Econometrics, Elsevier, vol. 217(1), pages 46-78.
    5. Peter Knaus & Sylvia Fruhwirth-Schnatter, 2023. "The Dynamic Triple Gamma Prior as a Shrinkage Process Prior for Time-Varying Parameter Models," Papers 2312.10487, arXiv.org, revised Jan 2025.
    6. Arnaud Dufays & Zhuo Li & Jeroen V.K. Rombouts & Yong Song, 2021. "Sparse change‐point VAR models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(6), pages 703-727, September.
    7. Bitto, Angela & Frühwirth-Schnatter, Sylvia, 2019. "Achieving shrinkage in a time-varying parameter model framework," Journal of Econometrics, Elsevier, vol. 210(1), pages 75-97.
    8. Florian Huber & Gregor Kastner & Michael Pfarrhofer, 2025. "Introducing shrinkage in heavy-tailed state space models to predict equity excess returns," Empirical Economics, Springer, vol. 68(2), pages 535-553, February.
    9. Sylvia Fruhwirth-Schnatter & Peter Knaus, 2022. "Sparse Bayesian State-Space and Time-Varying Parameter Models," Papers 2207.12147, arXiv.org.
    10. Hauzenberger, Niko & Huber, Florian & Klieber, Karin & Marcellino, Massimiliano, 2025. "Bayesian neural networks for macroeconomic analysis," Journal of Econometrics, Elsevier, vol. 249(PC).
    11. Joshua C.C. Chan & Rodney W. Strachan, 2023. "Bayesian State Space Models In Macroeconometrics," Journal of Economic Surveys, Wiley Blackwell, vol. 37(1), pages 58-75, February.
    12. Dimitris Korobilis & Kenichi Shimizu, 2022. "Bayesian Approaches to Shrinkage and Sparse Estimation," Foundations and Trends(R) in Econometrics, now publishers, vol. 11(4), pages 230-354, June.
    13. Florian Huber & Gregor Kastner & Martin Feldkircher, 2016. "Should I stay or should I go? Bayesian inference in the threshold time varying parameter (TTVP) model," Department of Economics Working Papers wuwp235, Vienna University of Economics and Business, Department of Economics.
    14. Hauzenberger Niko & Huber Florian & Koop Gary, 2024. "Dynamic Shrinkage Priors for Large Time-Varying Parameter Regressions Using Scalable Markov Chain Monte Carlo Methods," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 28(2), pages 201-225, April.
    15. Fischer, Manfred M. & Hauzenberger, Niko & Huber, Florian & Pfarrhofer, Michael, 2022. "General Bayesian time-varying parameter VARs for modeling government bond yields," Working Papers in Regional Science 2021/01, WU Vienna University of Economics and Business.
    16. Hauzenberger, Niko & Huber, Florian & Klieber, Karin, 2023. "Real-time inflation forecasting using non-linear dimension reduction techniques," International Journal of Forecasting, Elsevier, vol. 39(2), pages 901-921.
    17. Dima, Bogdan & Dima, Ştefana Maria & Ioan, Roxana, 2025. "The short-run impact of investor expectations’ past volatility on current predictions: The case of VIX," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 98(C).
    18. repec:rim:rimwps:18-31 is not listed on IDEAS
    19. Yu Bai & Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2022. "Macroeconomic forecasting in a multi‐country context," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(6), pages 1230-1255, September.
    20. Helmut Lütkepohl & Fei Shang & Luis Uzeda & Tomasz Woźniak, 2024. "Partial Identification of Heteroskedastic Structural VARs: Theory and Bayesian Inference," Discussion Papers of DIW Berlin 2081, DIW Berlin, German Institute for Economic Research.
    21. Manfred M. Fischer & Niko Hauzenberger & Florian Huber & Michael Pfarrhofer, 2021. "General Bayesian time-varying parameter VARs for predicting government bond yields," Papers 2102.13393, arXiv.org.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    JEL classification:

    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications
    • G17 - Financial Economics - - General Financial Markets - - - Financial Forecasting and Simulation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecosta:v:37:y:2026:i:c:p:250-269. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/econometrics-and-statistics .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.