IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v117y2018icp162-181.html
   My bibliography  Save this article

Dual-semiparametric regression using weighted Dirichlet process mixture

Author

Listed:
  • Sun, Peng
  • Kim, Inyoung
  • Lee, Ki-Ahm

Abstract

An efficient and flexible Bayesian approach is proposed for a dual-semiparametric regression model that models mean function semiparametrically and estimates the distribution of the error term nonparametrically. Using a weighted Dirichlet process mixture (WDPM), a Bayesian approach has been developed on the assumption that the distributions of the response variables are unknown. The WDPM approach is especially useful for real applications that have heterogeneous error distributions or come from a mixture of distributions. In the mean function, the unknown functions are estimated using natural cubic smoothing splines. For the error terms, several different WDPMs are proposed using different weights that depend on the distances between the covariates. Their marginal likelihoods are derived, and the computation of marginal likelihood for WDPM is provided. Efficient Markov chain Monte Carlo (MCMC) algorithms are also provided. The Bayesian approaches based on different WDPMs are compared with the parametric error model and the Dirichlet process mixture (DPM) error model in terms of the Bayes factor using a simulation study, suggesting better performance of the Bayesian approach based on WDPM. The advantage of the proposed Bayesian approach is also demonstrated using the credit rating data.

Suggested Citation

  • Sun, Peng & Kim, Inyoung & Lee, Ki-Ahm, 2018. "Dual-semiparametric regression using weighted Dirichlet process mixture," Computational Statistics & Data Analysis, Elsevier, vol. 117(C), pages 162-181.
    • Handle: RePEc:eee:csdana:v:117:y:2018:i:c:p:162-181
    DOI: 10.1016/j.csda.2017.08.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947317301755
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2017.08.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Carlos M. Carvalho & Nicholas G. Polson & James G. Scott, 2010. "The horseshoe estimator for sparse signals," Biometrika, Biometrika Trust, vol. 97(2), pages 465-480.
    2. Jensen, Mark J. & Maheu, John M., 2013. "Bayesian semiparametric multivariate GARCH modeling," Journal of Econometrics, Elsevier, vol. 176(1), pages 3-17.
    3. Basu S. & Chib S., 2003. "Marginal Likelihood and Bayes Factors for Dirichlet Process Mixture Models," Journal of the American Statistical Association, American Statistical Association, vol. 98, pages 224-235, January.
    4. David B. Dunson & Joseph B. Stanford, 2005. "Bayesian Inferences on Predictors of Conception Probabilities," Biometrics, The International Biometric Society, vol. 61(1), pages 126-133, March.
    5. Huaiye Zhang & Inyoung Kim & Chun Gun Park, 2014. "Semiparametric Bayesian hierarchical models for heterogeneous population in nonlinear mixed effect model: application to gastric emptying studies," Journal of Applied Statistics, Taylor & Francis Journals, vol. 41(12), pages 2743-2760, December.
    6. David B. Dunson & Natesh Pillai & Ju‐Hyun Park, 2007. "Bayesian density regression," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(2), pages 163-183, April.
    7. Chib, Siddhartha & Greenberg, Edward, 2010. "Additive cubic spline regression with Dirichlet process mixture errors," Journal of Econometrics, Elsevier, vol. 156(2), pages 322-336, June.
    8. Kim, Inyoung & Cohen, Noah, 2004. "Semiparametric and nonparametric modeling for effect modification in matched studies," Computational Statistics & Data Analysis, Elsevier, vol. 46(4), pages 631-643, July.
    9. Hamdy F. F. Mahmoud & Inyoung Kim & Ho Kim, 2016. "Semiparametric single index multi change points model with an application of environmental health study on mortality and temperature," Environmetrics, John Wiley & Sons, Ltd., vol. 27(8), pages 494-506, December.
    10. Debdeep Pati & David Dunson, 2014. "Bayesian nonparametric regression with varying residual density," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 66(1), pages 1-31, February.
    11. Inyoung Kim & Noah D. Cohen & Raymond J. Carroll, 2003. "Semiparametric Regression Splines in Matched Case-Control Studies," Biometrics, The International Biometric Society, vol. 59(4), pages 1158-1169, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jin, Xin & Maheu, John M., 2016. "Bayesian semiparametric modeling of realized covariance matrices," Journal of Econometrics, Elsevier, vol. 192(1), pages 19-39.
    2. Mark J. Meyer & Haobo Cheng & Katherine Hobbs Knutson, 2023. "Bayesian Analysis of Multivariate Matched Proportions with Sparse Response," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 15(2), pages 490-509, July.
    3. Christos Merkatas & Simo Särkkä, 2023. "System identification using autoregressive Bayesian neural networks with nonparametric noise models," Journal of Time Series Analysis, Wiley Blackwell, vol. 44(3), pages 319-330, May.
    4. Hübler, Olaf, 2017. "Health and Body Mass Index: No Simple Relationship," IZA Discussion Papers 10620, Institute of Labor Economics (IZA).
    5. Debdeep Pati & David Dunson, 2014. "Bayesian nonparametric regression with varying residual density," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 66(1), pages 1-31, February.
    6. Mark J. Jensen & John M. Maheu, 2018. "Risk, Return and Volatility Feedback: A Bayesian Nonparametric Analysis," JRFM, MDPI, vol. 11(3), pages 1-29, September.
    7. Chib, Siddhartha & Greenberg, Edward, 2010. "Additive cubic spline regression with Dirichlet process mixture errors," Journal of Econometrics, Elsevier, vol. 156(2), pages 322-336, June.
    8. Hamdy F. F. Mahmoud & Inyoung Kim, 2023. "Semiparametric Integrated and Additive Spatio-Temporal Single-Index Models," Mathematics, MDPI, vol. 11(22), pages 1-15, November.
    9. Otto-Sobotka, Fabian & Salvati, Nicola & Ranalli, Maria Giovanna & Kneib, Thomas, 2019. "Adaptive semiparametric M-quantile regression," Econometrics and Statistics, Elsevier, vol. 11(C), pages 116-129.
    10. Tamal Ghosh & Malay Ghosh & Jerry J. Maples & Xueying Tang, 2022. "Multivariate Global-Local Priors for Small Area Estimation," Stats, MDPI, vol. 5(3), pages 1-16, July.
    11. Timothy K.M. Beatty & Erling Røed Larsen, 2005. "Using Engel curves to estimate bias in the Canadian CPI as a cost of living index," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 38(2), pages 482-499, May.
    12. Igari, Ryosuke & Hoshino, Takahiro, 2018. "A Bayesian data combination approach for repeated durations under unobserved missing indicators: Application to interpurchase-timing in marketing," Computational Statistics & Data Analysis, Elsevier, vol. 126(C), pages 150-166.
    13. Martin Feldkircher & Florian Huber & Gary Koop & Michael Pfarrhofer, 2022. "APPROXIMATE BAYESIAN INFERENCE AND FORECASTING IN HUGE‐DIMENSIONAL MULTICOUNTRY VARs," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 63(4), pages 1625-1658, November.
    14. Arthur Charpentier & Emmanuel Flachaire & Antoine Ly, 2017. "Econom\'etrie et Machine Learning," Papers 1708.06992, arXiv.org, revised Mar 2018.
    15. Lianming Wang & David B. Dunson, 2010. "Semiparametric Bayes Multiple Testing: Applications to Tumor Data," Biometrics, The International Biometric Society, vol. 66(2), pages 493-501, June.
    16. Hyunju Son & Youyi Fong, 2021. "Fast grid search and bootstrap‐based inference for continuous two‐phase polynomial regression models," Environmetrics, John Wiley & Sons, Ltd., vol. 32(3), May.
    17. Georges Bresson & Cheng Hsiao & Alain Pirotte, 2011. "Assessing the contribution of R&D to total factor productivity—a Bayesian approach to account for heterogeneity and heteroskedasticity," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 95(4), pages 435-452, December.
    18. Loaiza-Maya, Rubén & Smith, Michael Stanley & Nott, David J. & Danaher, Peter J., 2022. "Fast and accurate variational inference for models with many latent variables," Journal of Econometrics, Elsevier, vol. 230(2), pages 339-362.
    19. Andr'es Ram'irez-Hassan & Alejandro L'opez-Vera, 2021. "Semi-parametric estimation of the EASI model: Welfare implications of taxes identifying clusters due to unobserved preference heterogeneity," Papers 2109.07646, arXiv.org.
    20. Ley, Eduardo & Steel, Mark F.J., 2012. "Mixtures of g-priors for Bayesian model averaging with economic applications," Journal of Econometrics, Elsevier, vol. 171(2), pages 251-266.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:117:y:2018:i:c:p:162-181. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.