IDEAS home Printed from https://ideas.repec.org/a/jss/jstsof/v014i11.html
   My bibliography  Save this article

BayesX: Analyzing Bayesian Structural Additive Regression Models

Author

Listed:
  • Brezger, Andreas
  • Kneib, Thomas
  • Lang, Stefan

Abstract

There has been much recent interest in Bayesian inference for generalized additive and related models. The increasing popularity of Bayesian methods for these and other model classes is mainly caused by the introduction of Markov chain Monte Carlo (MCMC) simulation techniques which allow realistic modeling of complex problems. This paper describes the capabilities of the free software package BayesX for estimating regression models with structured additive predictor based on MCMC inference. The program extends the capabilities of existing software for semiparametric regression included in S-PLUS, SAS, R or Stata. Many model classes well known from the literature are special cases of the models supported by BayesX. Examples are generalized additive (mixed) models, dynamic models, varying coefficient models, geoadditive models, geographically weighted regression and models for space-time regression. BayesX supports the most common distributions for the response variable. For univariate responses these are Gaussian, Binomial, Poisson, Gamma, negative Binomial, zero inflated Poisson and zero inflated negative binomial. For multicategorical responses, both multinomial logit and probit models for unordered categories of the response as well as cumulative threshold models for ordered categories can be estimated. Moreover, BayesX allows the estimation of complex continuous time survival and hazard rate models.

Suggested Citation

  • Brezger, Andreas & Kneib, Thomas & Lang, Stefan, 2005. "BayesX: Analyzing Bayesian Structural Additive Regression Models," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 14(i11).
  • Handle: RePEc:jss:jstsof:v:014:i11
    DOI: http://hdl.handle.net/10.18637/jss.v014.i11
    as

    Download full text from publisher

    File URL: https://www.jstatsoft.org/index.php/jss/article/view/v014i11/v14i11.pdf
    Download Restriction: no

    File URL: https://libkey.io/http://hdl.handle.net/10.18637/jss.v014.i11?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. David J. Spiegelhalter & Nicola G. Best & Bradley P. Carlin & Angelika Van Der Linde, 2002. "Bayesian measures of model complexity and fit," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(4), pages 583-639, October.
    2. Ruppert,David & Wand,M. P. & Carroll,R. J., 2003. "Semiparametric Regression," Cambridge Books, Cambridge University Press, number 9780521785167.
    3. Ruppert,David & Wand,M. P. & Carroll,R. J., 2003. "Semiparametric Regression," Cambridge Books, Cambridge University Press, number 9780521780506.
    4. E. E. Kammann & M. P. Wand, 2003. "Geoadditive models," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 52(1), pages 1-18, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Herrera, Roberto & Pino, Gabriel, 2023. "The effect of administrative divisions on the distribution of individual income in the new territories of Chile," World Development, Elsevier, vol. 171(C).
    2. Wolfgang Brunauer & Stefan Lang & Wolfgang Feilmayr, 2013. "Hybrid multilevel STAR models for hedonic house prices," Review of Regional Research: Jahrbuch für Regionalwissenschaft, Springer;Gesellschaft für Regionalforschung (GfR), vol. 33(2), pages 151-172, October.
    3. Peter Congdon, 2010. "Random‐effects models for migration attractivity and retentivity: a Bayesian methodology," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 173(4), pages 755-774, October.
    4. Guhl, Daniel & Baumgartner, Bernhard & Kneib, Thomas & Steiner, Winfried J., 2018. "Estimating time-varying parameters in brand choice models: A semiparametric approach," International Journal of Research in Marketing, Elsevier, vol. 35(3), pages 394-414.
    5. Seongil Jo & Taeyoung Roh & Taeryon Choi, 2016. "Bayesian spectral analysis models for quantile regression with Dirichlet process mixtures," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 28(1), pages 177-206, March.
    6. Lawrence Kazembe, 2009. "Modelling individual fertility levels in Malawian women: a spatial semiparametric regression model," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 18(2), pages 237-255, July.
    7. Umlauf, Nikolaus & Adler, Daniel & Kneib, Thomas & Lang, Stefan & Zeileis, Achim, 2015. "Structured Additive Regression Models: An R Interface to BayesX," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 63(i21).
    8. Elisabeth Waldmann & Thomas Kneib & Yu Ryan Yu & Stefan Lang, 2012. "Bayesian semiparametric additive quantile regression," Working Papers 2012-06, Faculty of Economics and Statistics, Universität Innsbruck.
    9. Peter Müeller & Fernando A. Quintana & Garritt Page, 2018. "Nonparametric Bayesian inference in applications," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 27(2), pages 175-206, June.
    10. Belitz, Christiane & Lang, Stefan, 2008. "Simultaneous selection of variables and smoothing parameters in structured additive regression models," Computational Statistics & Data Analysis, Elsevier, vol. 53(1), pages 61-81, September.
    11. Philipp Aschersleben & Winfried J. Steiner, 2022. "A semiparametric approach to estimating reference price effects in sales response models," Journal of Business Economics, Springer, vol. 92(4), pages 591-643, May.
    12. W. Brunauer & S. Lang & P. Wechselberger & S. Bienert, 2010. "Additive Hedonic Regression Models with Spatial Scaling Factors: An Application for Rents in Vienna," The Journal of Real Estate Finance and Economics, Springer, vol. 41(4), pages 390-411, November.
    13. Schmidt, Paul & Mühlau, Mark & Schmid, Volker, 2017. "Fitting large-scale structured additive regression models using Krylov subspace methods," Computational Statistics & Data Analysis, Elsevier, vol. 105(C), pages 59-75.
    14. Wogba Kamara & Kathryn L Zoerhoff & Emily H Toubali & Mary H Hodges & Donal Bisanzio & Dhuly Chowdhury & Mustapha Sonnie & Edward Magbity & Mohamed Samai & Abdulai Conteh & Florence Macarthy & Margare, 2019. "Are census data accurate for estimating coverage of a lymphatic filariasis MDA campaign? Results of a survey in Sierra Leone," PLOS ONE, Public Library of Science, vol. 14(12), pages 1-14, December.
    15. Luping Zhao & Timothy E. Hanson, 2011. "Spatially Dependent Polya Tree Modeling for Survival Data," Biometrics, The International Biometric Society, vol. 67(2), pages 391-403, June.
    16. Lang, Stefan & Steiner, Winfried J. & Weber, Anett & Wechselberger, Peter, 2015. "Accommodating heterogeneity and nonlinearity in price effects for predicting brand sales and profits," European Journal of Operational Research, Elsevier, vol. 246(1), pages 232-241.
    17. Strasak, Alexander M. & Umlauf, Nikolaus & Pfeiffer, Ruth M. & Lang, Stefan, 2011. "Comparing penalized splines and fractional polynomials for flexible modelling of the effects of continuous predictor variables," Computational Statistics & Data Analysis, Elsevier, vol. 55(4), pages 1540-1551, April.
    18. A. Brezger & L. Fahrmeir & A. Hennerfeind, 2007. "Adaptive Gaussian Markov random fields with applications in human brain mapping," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 56(3), pages 327-345, May.
    19. Pebesma, Edzer & Bivand, Roger & Ribeiro, Paulo Justiniano, 2015. "Software for Spatial Statistics," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 63(i01).
    20. Djeundje, Viani Biatat & Crook, Jonathan, 2019. "Identifying hidden patterns in credit risk survival data using Generalised Additive Models," European Journal of Operational Research, Elsevier, vol. 277(1), pages 366-376.
    21. Kenneth Harttgen & Stefan Lang & Judith Santer & Johannes Seiler, 2017. "Modeling under-5 mortality through multilevel structured additive regression with varying coefficients for Asia and Sub-Saharan Africa," Working Papers 2017-15, Faculty of Economics and Statistics, Universität Innsbruck.
    22. Andreas Brezger & Stefan Lang, 2007. "Simultaneous probability statements for Bayesian P-splines," Working Papers 2007-08, Faculty of Economics and Statistics, Universität Innsbruck.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Congdon, Peter, 2006. "A model for non-parametric spatially varying regression effects," Computational Statistics & Data Analysis, Elsevier, vol. 50(2), pages 422-445, January.
    2. Brezger, Andreas & Lang, Stefan, 2006. "Generalized structured additive regression based on Bayesian P-splines," Computational Statistics & Data Analysis, Elsevier, vol. 50(4), pages 967-991, February.
    3. Jullion, Astrid & Lambert, Philippe, 2007. "Robust specification of the roughness penalty prior distribution in spatially adaptive Bayesian P-splines models," Computational Statistics & Data Analysis, Elsevier, vol. 51(5), pages 2542-2558, February.
    4. Belitz, Christiane & Lang, Stefan, 2008. "Simultaneous selection of variables and smoothing parameters in structured additive regression models," Computational Statistics & Data Analysis, Elsevier, vol. 53(1), pages 61-81, September.
    5. Ngo, Long & Wand, Matthew P., 2004. "Smoothing with Mixed Model Software," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 9(i01).
    6. Thaden, Hauke & Klein, Nadja & Kneib, Thomas, 2019. "Multivariate effect priors in bivariate semiparametric recursive Gaussian models," Computational Statistics & Data Analysis, Elsevier, vol. 137(C), pages 51-66.
    7. Kneib, Thomas, 2006. "Mixed model-based inference in geoadditive hazard regression for interval-censored survival times," Computational Statistics & Data Analysis, Elsevier, vol. 51(2), pages 777-792, November.
    8. Simon J. Bonner & Carl J. Schwarz, 2011. "Smoothing Population Size Estimates for Time-Stratified Mark–Recapture Experiments Using Bayesian P-Splines," Biometrics, The International Biometric Society, vol. 67(4), pages 1498-1507, December.
    9. Marc Aerts & Niel Hens & Jeffrey Simonoff, 2010. "Model selection in regression based on pre-smoothing," Journal of Applied Statistics, Taylor & Francis Journals, vol. 37(9), pages 1455-1472.
    10. Stefan Lang & Nikolaus Umlauf & Peter Wechselberger & Kenneth Harttgen & Thomas Kneib, 2012. "Multilevel structured additive regression," Working Papers 2012-07, Faculty of Economics and Statistics, Universität Innsbruck.
    11. Manuguerra Maurizio & Heller Gillian Z, 2010. "Ordinal Regression Models for Continuous Scales," The International Journal of Biostatistics, De Gruyter, vol. 6(1), pages 1-20, April.
    12. Julie Vercelloni & M Julian Caley & Mohsen Kayal & Samantha Low-Choy & Kerrie Mengersen, 2014. "Understanding Uncertainties in Non-Linear Population Trajectories: A Bayesian Semi-Parametric Hierarchical Approach to Large-Scale Surveys of Coral Cover," PLOS ONE, Public Library of Science, vol. 9(11), pages 1-9, November.
    13. O. Gimenez & C. Crainiceanu & C. Barbraud & S. Jenouvrier & B. J. T. Morgan, 2006. "Semiparametric Regression in Capture–Recapture Modeling," Biometrics, The International Biometric Society, vol. 62(3), pages 691-698, September.
    14. Katrien Antonio & Jan Beirlant, 2008. "Issues in Claims Reserving and Credibility: A Semiparametric Approach With Mixed Models," Journal of Risk & Insurance, The American Risk and Insurance Association, vol. 75(3), pages 643-676, September.
    15. Wolfgang Brunauer & Stefan Lang & Peter Wechselberger & Sven Bienert, 2008. "Additive Hedonic Regression Models with Spatial Scaling Factors: An Application for Rents in Vienna," Working Papers 2008-17, Faculty of Economics and Statistics, Universität Innsbruck.
    16. Paciorek, Christopher J., 2007. "Bayesian Smoothing with Gaussian Processes Using Fourier Basis Functions in the spectralGP Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 19(i02).
    17. Paciorek, Christopher J., 2007. "Computational techniques for spatial logistic regression with large data sets," Computational Statistics & Data Analysis, Elsevier, vol. 51(8), pages 3631-3653, May.
    18. Cai, Bo & Meyer, Renate, 2011. "Bayesian semiparametric modeling of survival data based on mixtures of B-spline distributions," Computational Statistics & Data Analysis, Elsevier, vol. 55(3), pages 1260-1272, March.
    19. W. Brunauer & S. Lang & P. Wechselberger & S. Bienert, 2010. "Additive Hedonic Regression Models with Spatial Scaling Factors: An Application for Rents in Vienna," The Journal of Real Estate Finance and Economics, Springer, vol. 41(4), pages 390-411, November.
    20. Nicole H. Augustin & Stefan Lang & Monica Musio & Klaus Von Wilpert, 2007. "A spatial model for the needle losses of pine‐trees in the forests of Baden‐Württemberg: an application of Bayesian structured additive regression," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 56(1), pages 29-50, January.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jss:jstsof:v:014:i11. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Christopher F. Baum (email available below). General contact details of provider: http://www.jstatsoft.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.