IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v202y2025ics0167947324001397.html
   My bibliography  Save this article

A variational inference framework for inverse problems

Author

Listed:
  • Maestrini, Luca
  • Aykroyd, Robert G.
  • Wand, Matt P.

Abstract

A framework is presented for fitting inverse problem models via variational Bayes approximations. This methodology guarantees flexibility to statistical model specification for a broad range of applications, good accuracy and reduced model fitting times. The message passing and factor graph fragment approach to variational Bayes that is also described facilitates streamlined implementation of approximate inference algorithms and allows for supple inclusion of numerous response distributions and penalizations into the inverse problem model. Models for one- and two-dimensional response variables are examined and an infrastructure is laid down where efficient algorithm updates based on nullifying weak interactions between variables can also be derived for inverse problems in higher dimensions. An image processing application and a simulation exercise motivated by biomedical problems reveal the computational advantage offered by efficient implementation of variational Bayes over Markov chain Monte Carlo.

Suggested Citation

  • Maestrini, Luca & Aykroyd, Robert G. & Wand, Matt P., 2025. "A variational inference framework for inverse problems," Computational Statistics & Data Analysis, Elsevier, vol. 202(C).
    • Handle: RePEc:eee:csdana:v:202:y:2025:i:c:s0167947324001397
    DOI: 10.1016/j.csda.2024.108055
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947324001397
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2024.108055?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Carlos M. Carvalho & Nicholas G. Polson & James G. Scott, 2010. "The horseshoe estimator for sparse signals," Biometrika, Biometrika Trust, vol. 97(2), pages 465-480.
    2. G. T. Allum & R. G. Aykroyd & J. G. B. Haigh, 1999. "Empirical Bayes estimation for archaeological stratigraphy," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 48(1), pages 1-14.
    3. Furrer, Reinhard & Sain, Stephan R., 2010. "spam: A Sparse Matrix R Package with Emphasis on MCMC Methods for Gaussian Markov Random Fields," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 36(i10).
    4. F. S. Nathoo & A. Babul & A. Moiseev & N. Virji-Babul & M. F. Beg, 2014. "A variational Bayes spatiotemporal model for electromagnetic brain mapping," Biometrics, The International Biometric Society, vol. 70(1), pages 132-143, March.
    5. M. P. Wand, 2017. "Fast Approximate Inference for Arbitrarily Large Semiparametric Regression Models via Message Passing," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(517), pages 137-168, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mauro Bernardi & Daniele Bianchi & Nicolas Bianco, 2022. "Variational inference for large Bayesian vector autoregressions," Papers 2202.12644, arXiv.org, revised Jun 2023.
    2. Hauzenberger, Niko & Huber, Florian & Klieber, Karin & Marcellino, Massimiliano, 2025. "Bayesian neural networks for macroeconomic analysis," Journal of Econometrics, Elsevier, vol. 249(PC).
    3. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2025. "Specification Choices in Quantile Regression for Empirical Macroeconomics," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 40(1), pages 57-73, January.
    4. Tamal Ghosh & Malay Ghosh & Jerry J. Maples & Xueying Tang, 2022. "Multivariate Global-Local Priors for Small Area Estimation," Stats, MDPI, vol. 5(3), pages 1-16, July.
    5. Martin Feldkircher & Florian Huber & Gary Koop & Michael Pfarrhofer, 2022. "APPROXIMATE BAYESIAN INFERENCE AND FORECASTING IN HUGE‐DIMENSIONAL MULTICOUNTRY VARs," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 63(4), pages 1625-1658, November.
    6. Davies, Tilman M. & Bryant, David, 2013. "On Circulant Embedding for Gaussian Random Fields in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 55(i09).
    7. Phella, Anthoulla & Gabriel, Vasco J. & Martins, Luis F., 2024. "Predicting tail risks and the evolution of temperatures," Energy Economics, Elsevier, vol. 131(C).
    8. Alla A. Petukhina & Raphael C. G. Reule & Wolfgang Karl Härdle, 2021. "Rise of the machines? Intraday high-frequency trading patterns of cryptocurrencies," The European Journal of Finance, Taylor & Francis Journals, vol. 27(1-2), pages 8-30, January.
    9. Martin Guth, 2022. "Predicting Default Probabilities for Stress Tests: A Comparison of Models," Papers 2202.03110, arXiv.org.
    10. Dimitris Korobilis, 2021. "High-Dimensional Macroeconomic Forecasting Using Message Passing Algorithms," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(2), pages 493-504, March.
    11. Hauzenberger, Niko, 2021. "Flexible Mixture Priors for Large Time-varying Parameter Models," Econometrics and Statistics, Elsevier, vol. 20(C), pages 87-108.
    12. Ander Wilson & Brian J. Reich, 2014. "Confounder selection via penalized credible regions," Biometrics, The International Biometric Society, vol. 70(4), pages 852-861, December.
    13. Yi Nengjun & Ma Shuangge, 2012. "Hierarchical Shrinkage Priors and Model Fitting for High-dimensional Generalized Linear Models," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 11(6), pages 1-25, November.
    14. Ryan Martin & Bo Ning, 2020. "Empirical Priors and Coverage of Posterior Credible Sets in a Sparse Normal Mean Model," Sankhya A: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 82(2), pages 477-498, August.
    15. Hauzenberger, Niko & Pfarrhofer, Michael & Rossini, Luca, 2025. "Sparse time-varying parameter VECMs with an application to modeling electricity prices," International Journal of Forecasting, Elsevier, vol. 41(1), pages 361-376.
    16. Joshua C. C. Chan, 2024. "BVARs and stochastic volatility," Chapters, in: Michael P. Clements & Ana Beatriz Galvão (ed.), Handbook of Research Methods and Applications in Macroeconomic Forecasting, chapter 3, pages 43-67, Edward Elgar Publishing.
    17. Virginia X. He & Matt P. Wand, 2024. "Bayesian generalized additive model selection including a fast variational option," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 108(3), pages 639-668, September.
    18. Mark F. J. Steel, 2020. "Model Averaging and Its Use in Economics," Journal of Economic Literature, American Economic Association, vol. 58(3), pages 644-719, September.
    19. Hu, Guanyu, 2021. "Spatially varying sparsity in dynamic regression models," Econometrics and Statistics, Elsevier, vol. 17(C), pages 23-34.
    20. Lee Anthony & Caron Francois & Doucet Arnaud & Holmes Chris, 2012. "Bayesian Sparsity-Path-Analysis of Genetic Association Signal using Generalized t Priors," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 11(2), pages 1-31, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:202:y:2025:i:c:s0167947324001397. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.