IDEAS home Printed from https://ideas.repec.org/a/spr/compst/v38y2023i2d10.1007_s00180-022-01258-9.html
   My bibliography  Save this article

Model averaging for sparse seemingly unrelated regression using Bayesian networks among the errors

Author

Listed:
  • Abdul Salam

    (Bernoulli Institute, Groningen University
    University of Malakand)

  • Marco Grzegorczyk

    (Bernoulli Institute, Groningen University)

Abstract

Multivariate Bayesian linear regression (MBLR) is a popular statistical tool with many applications in a variety of scientific fields. However, a shortcoming is potential model over-complexity, as the model assumes that all responses depend on the same covariates and that all errors are mutually pairwise correlated. The class of Bayesian seemingly unrelated regression (SUR) models generalizes the class of MBLR models by allowing for response-specific covariate sets. In a recent work it has been proposed to employ Gaussian graphical models for learning sparse SUR (SSUR) models with conditional independencies among the errors. The proposed SSUR model infers undirected edges among the errors, and the proposed Reversible Jump Markov Chain Monte Carlo (RJMCMC) inference algorithm relies on approximations of the marginal likelihoods. In this paper, we propose a new refined SSUR model that replaces the undirected graphs (Gaussian graphical models) by directed acyclic graphs (Gaussian Bayesian networks). Unlike the earlier proposed model, our new model is therefore able to learn some directed edges among the errors. And we derive a RJMCMC algorithm that does not require approximations of the marginal likelihoods. In particular, we present an algorithm for sampling covariance matrices that are coherent with a given directed acyclic graph. The proposed RJMCMC algorithm allows for exact Bayesian model averaging across both: the response-specific covariate sets and the directed acyclic graphs.

Suggested Citation

  • Abdul Salam & Marco Grzegorczyk, 2023. "Model averaging for sparse seemingly unrelated regression using Bayesian networks among the errors," Computational Statistics, Springer, vol. 38(2), pages 779-808, June.
  • Handle: RePEc:spr:compst:v:38:y:2023:i:2:d:10.1007_s00180-022-01258-9
    DOI: 10.1007/s00180-022-01258-9
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00180-022-01258-9
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s00180-022-01258-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Marta Banbura & Domenico Giannone & Lucrezia Reichlin, 2010. "Large Bayesian vector auto regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 71-92.
    2. Tiago M. Fragoso & Wesley Bertoli & Francisco Louzada, 2018. "Bayesian Model Averaging: A Systematic Review and Conceptual Classification," International Statistical Review, International Statistical Institute, vol. 86(1), pages 1-28, April.
    3. Wang, Hao, 2010. "Sparse seemingly unrelated regression modelling: Applications in finance and econometrics," Computational Statistics & Data Analysis, Elsevier, vol. 54(11), pages 2866-2877, November.
    4. Marta Banbura & Domenico Giannone & Lucrezia Reichlin, 2010. "Large Bayesian vector auto regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 71-92.
    5. Hans, Chris & Dobra, Adrian & West, Mike, 2007. "Shotgun Stochastic Search for," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 507-516, June.
    6. Marick S. Sinay & John S. J. Hsu, 2014. "Bayesian Inference of a Multivariate Regression Model," Journal of Probability and Statistics, Hindawi, vol. 2014, pages 1-13, November.
    7. Koop, Gary & Korobilis, Dimitris, 2013. "Large time-varying parameter VARs," Journal of Econometrics, Elsevier, vol. 177(2), pages 185-198.
    8. Ross D. Shachter & C. Robert Kenley, 1989. "Gaussian Influence Diagrams," Management Science, INFORMS, vol. 35(5), pages 527-550, May.
    9. Zellner, Arnold & Ando, Tomohiro, 2010. "A direct Monte Carlo approach for Bayesian analysis of the seemingly unrelated regression model," Journal of Econometrics, Elsevier, vol. 159(1), pages 33-45, November.
    10. repec:ulb:ulbeco:2013/13388 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Daniel Felix Ahelegbey & Monica Billio & Roberto Casarin, 2016. "Sparse Graphical Vector Autoregression: A Bayesian Approach," Annals of Economics and Statistics, GENES, issue 123-124, pages 333-361.
    2. Billio, Monica & Casarin, Roberto & Rossini, Luca, 2019. "Bayesian nonparametric sparse VAR models," Journal of Econometrics, Elsevier, vol. 212(1), pages 97-115.
    3. Hadjiantoni, Stella & Kontoghiorghes, Erricos John, 2022. "An alternative numerical method for estimating large-scale time-varying parameter seemingly unrelated regressions models," Econometrics and Statistics, Elsevier, vol. 21(C), pages 1-18.
    4. Monica Billio & Roberto Casarin & Luca Rossini, 2016. "Bayesian nonparametric sparse seemingly unrelated regression model (SUR)," Working Papers 2016:20, Department of Economics, University of Venice "Ca' Foscari".
    5. Tallman, Ellis W. & Zaman, Saeed, 2020. "Combining survey long-run forecasts and nowcasts with BVAR forecasts using relative entropy," International Journal of Forecasting, Elsevier, vol. 36(2), pages 373-398.
    6. Gary Koop & Dimitris Korobilis, 2019. "Forecasting with High‐Dimensional Panel VARs," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 81(5), pages 937-959, October.
    7. Deborah Gefang & Gary Koop & Aubrey Poon, 2019. "Variational Bayesian Inference in Large Vector Autoregressions with Hierarchical Shrinkage," Economic Statistics Centre of Excellence (ESCoE) Discussion Papers ESCoE DP-2019-07, Economic Statistics Centre of Excellence (ESCoE).
    8. Michael Pfarrhofer, 2024. "Forecasts with Bayesian vector autoregressions under real time conditions," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(3), pages 771-801, April.
    9. Michael S. Smith & Shaun P. Vahey, 2016. "Asymmetric Forecast Densities for U.S. Macroeconomic Variables from a Gaussian Copula Model of Cross-Sectional and Serial Dependence," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(3), pages 416-434, July.
    10. Gary Koop, 2012. "Using VARs and TVP-VARs with Many Macroeconomic Variables," Central European Journal of Economic Modelling and Econometrics, Central European Journal of Economic Modelling and Econometrics, vol. 4(3), pages 143-167, September.
    11. Koop, Gary & Korobilis, Dimitris & Pettenuzzo, Davide, 2019. "Bayesian compressed vector autoregressions," Journal of Econometrics, Elsevier, vol. 210(1), pages 135-154.
    12. Nima Nonejad, 2021. "An Overview Of Dynamic Model Averaging Techniques In Time‐Series Econometrics," Journal of Economic Surveys, Wiley Blackwell, vol. 35(2), pages 566-614, April.
    13. Kastner, Gregor, 2019. "Sparse Bayesian time-varying covariance estimation in many dimensions," Journal of Econometrics, Elsevier, vol. 210(1), pages 98-115.
    14. Pestova, Anna & Mamonov, Mikhail, 2019. "Should we care? : The economic effects of financial sanctions on the Russian economy," BOFIT Discussion Papers 13/2019, Bank of Finland, Institute for Economies in Transition.
    15. Ping Wu & Gary Koop, 2022. "Fast, Order-Invariant Bayesian Inference in VARs using the Eigendecomposition of the Error Covariance Matrix," Working Papers 2310, University of Strathclyde Business School, Department of Economics.
    16. Till Weigt & Bernd Wilfling, 2021. "An approach to increasing forecast‐combination accuracy through VAR error modeling," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(4), pages 686-699, July.
    17. Nalan Basturk & Cem Cakmakli & S. Pinar Ceyhan & Herman K. van Dijk, 2014. "On the Rise of Bayesian Econometrics after Cowles Foundation Monographs 10, 14," Tinbergen Institute Discussion Papers 14-085/III, Tinbergen Institute, revised 04 Sep 2014.
    18. Philippe Goulet Coulombe, 2024. "The macroeconomy as a random forest," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 39(3), pages 401-421, April.
    19. Gregor Kastner & Florian Huber, 2020. "Sparse Bayesian vector autoregressions in huge dimensions," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(7), pages 1142-1165, November.
    20. Hauzenberger, Niko, 2021. "Flexible Mixture Priors for Large Time-varying Parameter Models," Econometrics and Statistics, Elsevier, vol. 20(C), pages 87-108.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:compst:v:38:y:2023:i:2:d:10.1007_s00180-022-01258-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.