IDEAS home Printed from https://ideas.repec.org/p/sef/csefwp/744.html

Bayesian Nonparametric Models for Conditional Densities Based on Orthogonal Polynomials

Author

Abstract

The paper considers a nonparametric Bayesian model for conditional densities. The model considered is a mixture of orthogonal polynomials with a prior on the number of components. The use of orthogonal polynomials allows for a great deal of flexibility in applications while maintaining useful approximation properties. We provide the posterior contraction rate in the case of Legendre polynomials. The algorithm proposed allows for cross-dimensional moves, allowing it to choose the optimal number of terms in the series expansion conditional on a penalty parameter. We also provide Monte Carlo simulations that show how well the model approximates known distributions also in finite sample situations.

Suggested Citation

  • Andriy Norets & Marco Stenborg Petterson, 2024. "Bayesian Nonparametric Models for Conditional Densities Based on Orthogonal Polynomials," CSEF Working Papers 744, Centre for Studies in Economics and Finance (CSEF), University of Naples, Italy.
  • Handle: RePEc:sef:csefwp:744
    as

    Download full text from publisher

    File URL: https://www.csef.it/WP/wp744.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Norets, Andriy & Pati, Debdeep, 2017. "Adaptive Bayesian Estimation Of Conditional Densities," Econometric Theory, Cambridge University Press, vol. 33(4), pages 980-1012, August.
    2. W. R. Gilks & N. G. Best & K. K. C. Tan, 1995. "Adaptive Rejection Metropolis Sampling Within Gibbs Sampling," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 44(4), pages 455-472, December.
    3. Ghosal,Subhashis & van der Vaart,Aad, 2017. "Fundamentals of Nonparametric Bayesian Inference," Cambridge Books, Cambridge University Press, number 9780521878265, Enero-Abr.
    4. Weining Shen & Surya T. Tokdar & Subhashis Ghosal, 2013. "Adaptive Bayesian multivariate density estimation with Dirichlet mixtures," Biometrika, Biometrika Trust, vol. 100(3), pages 623-640.
    5. Norets, Andriy & Pelenis, Justinas, 2014. "Posterior Consistency In Conditional Density Estimation By Covariate Dependent Mixtures," Econometric Theory, Cambridge University Press, vol. 30(3), pages 606-646, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Norets, Andriy & Pelenis, Justinas, 2022. "Adaptive Bayesian estimation of conditional discrete-continuous distributions with an application to stock market trading activity," Journal of Econometrics, Elsevier, vol. 230(1), pages 62-82.
    2. Christopher D. Walker, 2024. "Semiparametric Bayesian Inference for a Conditional Moment Equality Model," Papers 2410.16017, arXiv.org, revised Mar 2026.
    3. Zhao, Yanyun, 2015. "Bayesian Linear Regression with Conditional Heteroskedasticity," DES - Working Papers. Statistics and Econometrics. WS ws1504, Universidad Carlos III de Madrid. Departamento de Estadística.
    4. A. R. Linero, 2017. "Bayesian nonparametric analysis of longitudinal studies in the presence of informative missingness," Biometrika, Biometrika Trust, vol. 104(2), pages 327-341.
    5. Minerva Mukhopadhyay & Didong Li & David B. Dunson, 2020. "Estimating densities with non‐linear support by using Fisher–Gaussian kernels," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 82(5), pages 1249-1271, December.
    6. Miller Jeffrey W., 2023. "Consistency of mixture models with a prior on the number of components," Dependence Modeling, De Gruyter, vol. 11(1), pages 1-9, January.
    7. Yuyang Guo & Chunjie Wang & Xiaoyu Liu, 2026. "Bayesian semiparametric partially linear cure models with partly interval-censored data," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 32(1), pages 1-34, March.
    8. Norets, Andriy & Shimizu, Kenichi, 2024. "Semiparametric Bayesian estimation of dynamic discrete choice models," Journal of Econometrics, Elsevier, vol. 238(2).
    9. England, Peter, 2002. "Addendum to "Analytic and bootstrap estimates of prediction errors in claims reserving"," Insurance: Mathematics and Economics, Elsevier, vol. 31(3), pages 461-466, December.
    10. Qianwen Tan & Subhashis Ghosal, 2021. "Bayesian Analysis of Mixed-effect Regression Models Driven by Ordinary Differential Equations," Sankhya B: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 83(1), pages 3-29, May.
    11. Laura Liu & Hyungsik Roger Moon & Frank Schorfheide, 2023. "Forecasting with a panel Tobit model," Quantitative Economics, Econometric Society, vol. 14(1), pages 117-159, January.
    12. José J. Quinlan & Fernando A. Quintana & Garritt L. Page, 2021. "On a class of repulsive mixture models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 30(2), pages 445-461, June.
    13. Rabi Bhattacharya & Rachel Oliver, 2019. "Nonparametric Analysis of Non-Euclidean Data on Shapes and Images," Sankhya A: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 81(1), pages 1-36, February.
    14. Nathaniel Tomasetti & Catherine Forbes & Anastasios Panagiotelis, 2019. "Updating Variational Bayes: Fast Sequential Posterior Inference," Monash Econometrics and Business Statistics Working Papers 13/19, Monash University, Department of Econometrics and Business Statistics.
    15. Gael M. Martin & David T. Frazier & Christian P. Robert, 2020. "Computing Bayes: Bayesian Computation from 1763 to the 21st Century," Monash Econometrics and Business Statistics Working Papers 14/20, Monash University, Department of Econometrics and Business Statistics.
    16. Ryo Kato & Takahiro Hoshino, 2020. "Semiparametric Bayesian multiple imputation for regression models with missing mixed continuous–discrete covariates," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 72(3), pages 803-825, June.
    17. repec:dau:papers:123456789/13437 is not listed on IDEAS
    18. A Stefano Caria & Grant Gordon & Maximilian Kasy & Simon Quinn & Soha Osman Shami & Alexander Teytelboym, 2024. "An Adaptive Targeted Field Experiment: Job Search Assistance for Refugees in Jordan," Journal of the European Economic Association, European Economic Association, vol. 22(2), pages 781-836.
    19. Reiß, Markus & Schmidt-Hieber, Johannes, 2020. "Posterior contraction rates for support boundary recovery," Stochastic Processes and their Applications, Elsevier, vol. 130(11), pages 6638-6656.
    20. Zhang, Michael Yuanjie & Russell, Jeffrey R. & Tsay, Ruey S., 2008. "Determinants of bid and ask quotes and implications for the cost of trading," Journal of Empirical Finance, Elsevier, vol. 15(4), pages 656-678, September.
    21. H. Abebe & F. Tan & G. Breukelen & M. Berger, 2014. "Robustness of Bayesian D-optimal design for the logistic mixed model against misspecification of autocorrelation," Computational Statistics, Springer, vol. 29(6), pages 1667-1690, December.

    More about this item

    Keywords

    ;
    ;
    ;

    JEL classification:

    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sef:csefwp:744. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Dr. Maria Carannante (email available below). General contact details of provider: https://edirc.repec.org/data/cssalit.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.