IDEAS home Printed from https://ideas.repec.org/a/eee/econom/v171y2012i2p121-133.html
   My bibliography  Save this article

Generalized smooth finite mixtures

Author

Listed:
  • Villani, Mattias
  • Kohn, Robert
  • Nott, David J.

Abstract

We propose a general class of models and a unified Bayesian inference methodology for flexibly estimating the density of a response variable conditional on a possibly high-dimensional set of covariates. Our model is a finite mixture of component models with covariate-dependent mixing weights. The component densities can belong to any parametric family, with each model parameter being a deterministic function of covariates through a link function. Our MCMC methodology allows for Bayesian variable selection among the covariates in the mixture components and in the mixing weights. The model’s parameterization and variable selection prior are chosen to prevent overfitting. We use simulated and real data sets to illustrate the methodology.

Suggested Citation

  • Villani, Mattias & Kohn, Robert & Nott, David J., 2012. "Generalized smooth finite mixtures," Journal of Econometrics, Elsevier, vol. 171(2), pages 121-133.
    • Handle: RePEc:eee:econom:v:171:y:2012:i:2:p:121-133
    DOI: 10.1016/j.jeconom.2012.06.012
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304407612001595
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jeconom.2012.06.012?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. João A. Bastos & Joaquim J. S. Ramalho, 2016. "Nonparametric Models Of Financial Leverage Decisions," Bulletin of Economic Research, Wiley Blackwell, vol. 68(4), pages 348-366, October.
    2. David J. Nott & Robert Kohn, 2005. "Adaptive sampling for Bayesian variable selection," Biometrika, Biometrika Trust, vol. 92(4), pages 747-763, December.
    3. Villani, Mattias & Kohn, Robert & Giordani, Paolo, 2009. "Regression density estimation using smooth adaptive Gaussian mixtures," Journal of Econometrics, Elsevier, vol. 153(2), pages 155-173, December.
    4. Peter J. Green & Sylvia Richardson, 2001. "Modelling Heterogeneity With and Without the Dirichlet Process," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 28(2), pages 355-375, June.
    5. Sylvia. Richardson & Peter J. Green, 1997. "On Bayesian Analysis of Mixtures with an Unknown Number of Components (with discussion)," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 59(4), pages 731-792.
    6. Giordani, Paolo & Jacobson, Tor & Schedvin, Erik von & Villani, Mattias, 2014. "Taking the Twists into Account: Predicting Firm Bankruptcy Risk with Splines of Financial Ratios," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 49(4), pages 1071-1099, August.
    7. Joseph Hilbe, 1994. "Negative binomial regression," Stata Technical Bulletin, StataCorp LP, vol. 3(18).
    8. Andreas Million & Regina T. Riphahn & Achim Wambach, 2003. "Incentive effects in the demand for health care: a bivariate panel count data estimation," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 18(4), pages 387-405.
    9. John Geweke, 1999. "Using simulation methods for bayesian econometric models: inference, development,and communication," Econometric Reviews, Taylor & Francis Journals, vol. 18(1), pages 1-73.
    10. Geweke, John & Keane, Michael, 2007. "Smoothly mixing regressions," Journal of Econometrics, Elsevier, vol. 138(1), pages 252-290, May.
    11. Rajan, Raghuram G & Zingales, Luigi, 1995. "What Do We Know about Capital Structure? Some Evidence from International Data," Journal of Finance, American Finance Association, vol. 50(5), pages 1421-1460, December.
    12. David B. Dunson & Natesh Pillai & Ju‐Hyun Park, 2007. "Bayesian density regression," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(2), pages 163-183, April.
    13. Esmeralda A. Ramalho & Joaquim J.S. Ramalho & José M.R. Murteira, 2011. "Alternative Estimating And Testing Empirical Strategies For Fractional Regression Models," Journal of Economic Surveys, Wiley Blackwell, vol. 25(1), pages 19-68, February.
    14. Li, Feng & Villani, Mattias & Kohn, Robert, 2010. "Modeling Conditional Densities Using Finite Smooth Mixtures," Working Paper Series 245, Sveriges Riksbank (Central Bank of Sweden).
    15. Norets, Andriy & Pelenis, Justinas, 2014. "Posterior Consistency In Conditional Density Estimation By Covariate Dependent Mixtures," Econometric Theory, Cambridge University Press, vol. 30(3), pages 606-646, June.
    16. Sally A. Wood, 2002. "Bayesian mixture of splines for spatially adaptive nonparametric regression," Biometrika, Biometrika Trust, vol. 89(3), pages 513-528, August.
    17. Cook, Douglas O. & Kieschnick, Robert & McCullough, B.D., 2008. "Regression analysis of proportions in finance with self selection," Journal of Empirical Finance, Elsevier, vol. 15(5), pages 860-867, December.
    18. Wayne DeSarbo & William Cron, 1988. "A maximum likelihood methodology for clusterwise linear regression," Journal of Classification, Springer;The Classification Society, vol. 5(2), pages 249-282, September.
    19. Chung, Yeonseung & Dunson, David B., 2009. "Nonparametric Bayes Conditional Distribution Modeling With Variable Selection," Journal of the American Statistical Association, American Statistical Association, vol. 104(488), pages 1646-1660.
    20. John Geweke, 1999. "Using Simulation Methods for Bayesian Econometric Models," Computing in Economics and Finance 1999 832, Society for Computational Economics.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Drobetz, Wolfgang & Merikas, Andreas & Merika, Anna & Tsionas, Mike G., 2014. "Corporate social responsibility disclosure: The case of international shipping," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 71(C), pages 18-44.
    2. Mike G. Tsionas, 2017. "“When, Where, and How” of Efficiency Estimation: Improved Procedures for Stochastic Frontier Modeling," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(519), pages 948-965, July.
    3. Li, Feng & Kang, Yanfei, 2018. "Improving forecasting performance using covariate-dependent copula models," International Journal of Forecasting, Elsevier, vol. 34(3), pages 456-476.
    4. Gregor Zens, 2018. "Bayesian shrinkage in mixture of experts models: Identifying robust determinants of class membership," Papers 1809.04853, arXiv.org, revised Jan 2019.
    5. Kalli, Maria & Griffin, Jim E., 2018. "Bayesian nonparametric vector autoregressive models," Journal of Econometrics, Elsevier, vol. 203(2), pages 267-282.
    6. Parfait Munezero, 2022. "Efficient particle smoothing for Bayesian inference in dynamic survival models," Computational Statistics, Springer, vol. 37(2), pages 975-994, April.
    7. Gregor Zens, 2019. "Bayesian shrinkage in mixture-of-experts models: identifying robust determinants of class membership," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 13(4), pages 1019-1051, December.
    8. Cozzini, Alberto & Jasra, Ajay & Montana, Giovanni & Persing, Adam, 2014. "A Bayesian mixture of lasso regressions with t-errors," Computational Statistics & Data Analysis, Elsevier, vol. 77(C), pages 84-97.
    9. Oskar Gustafsson & Mattias Villani & Pär Stockhammar, 2023. "Bayesian optimization of hyperparameters from noisy marginal likelihood estimates," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(4), pages 577-595, June.
    10. Murat K. Munkin, 2022. "Count Roy model with finite mixtures," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(6), pages 1160-1181, September.
    11. Feng Li & Mattias Villani, 2013. "Efficient Bayesian Multivariate Surface Regression," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 40(4), pages 706-723, December.
    12. Quiroz, Matias & Villani, Mattias, 2013. "Dynamic mixture-of-experts models for longitudinal and discrete-time survival data," Working Paper Series 268, Sveriges Riksbank (Central Bank of Sweden).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Villani, Mattias & Kohn, Robert & Giordani, Paolo, 2009. "Regression density estimation using smooth adaptive Gaussian mixtures," Journal of Econometrics, Elsevier, vol. 153(2), pages 155-173, December.
    2. Feng Li & Mattias Villani, 2013. "Efficient Bayesian Multivariate Surface Regression," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 40(4), pages 706-723, December.
    3. Norets, Andriy, 2015. "Bayesian regression with nonparametric heteroskedasticity," Journal of Econometrics, Elsevier, vol. 185(2), pages 409-419.
    4. Norets, Andriy & Pelenis, Justinas, 2012. "Bayesian modeling of joint and conditional distributions," Journal of Econometrics, Elsevier, vol. 168(2), pages 332-346.
    5. Norets, Andriy & Pelenis, Justinas, 2022. "Adaptive Bayesian estimation of conditional discrete-continuous distributions with an application to stock market trading activity," Journal of Econometrics, Elsevier, vol. 230(1), pages 62-82.
    6. Villani, Mattias & Kohn, Robert & Giordani, Paolo, 2007. "Nonparametric Regression Density Estimation Using Smoothly Varying Normal Mixtures," Working Paper Series 211, Sveriges Riksbank (Central Bank of Sweden).
    7. Li, Feng & Kang, Yanfei, 2018. "Improving forecasting performance using covariate-dependent copula models," International Journal of Forecasting, Elsevier, vol. 34(3), pages 456-476.
    8. Zhang, Xibin & King, Maxwell L. & Shang, Han Lin, 2014. "A sampling algorithm for bandwidth estimation in a nonparametric regression model with a flexible error density," Computational Statistics & Data Analysis, Elsevier, vol. 78(C), pages 218-234.
    9. Mike Tsionas & Christopher F. Parmeter & Valentin Zelenyuk, 2021. "Bridging the Divide? Bayesian Artificial Neural Networks for Frontier Efficiency Analysis," CEPA Working Papers Series WP082021, School of Economics, University of Queensland, Australia.
    10. Roberto Casarin & Stefano Grassi & Francesco Ravazzolo & Herman K. van Dijk, 2015. "Dynamic predictive density combinations for large data sets in economics and finance," Working Paper 2015/12, Norges Bank.
    11. Joaquim Ramalho & J. Silva, 2013. "Functional form issues in the regression analysis of financial leverage ratios," Empirical Economics, Springer, vol. 44(2), pages 799-831, April.
    12. Quiroz, Matias & Villani, Mattias, 2013. "Dynamic mixture-of-experts models for longitudinal and discrete-time survival data," Working Paper Series 268, Sveriges Riksbank (Central Bank of Sweden).
    13. Marco Berrettini & Giuliano Galimberti & Saverio Ranciati, 2023. "Semiparametric finite mixture of regression models with Bayesian P-splines," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 17(3), pages 745-775, September.
    14. Pelenis, Justinas, 2012. "Bayesian Semiparametric Regression," Economics Series 285, Institute for Advanced Studies.
    15. Oskar Gustafsson & Mattias Villani & Pär Stockhammar, 2023. "Bayesian optimization of hyperparameters from noisy marginal likelihood estimates," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(4), pages 577-595, June.
    16. Gael M. Martin & David T. Frazier & Christian P. Robert, 2020. "Computing Bayes: Bayesian Computation from 1763 to the 21st Century," Monash Econometrics and Business Statistics Working Papers 14/20, Monash University, Department of Econometrics and Business Statistics.
    17. Debdeep Pati & David Dunson, 2014. "Bayesian nonparametric regression with varying residual density," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 66(1), pages 1-31, February.
    18. Esmeralda A. Ramalho & Joaquim J.S. Ramalho & José M.R. Murteira, 2011. "Alternative Estimating And Testing Empirical Strategies For Fractional Regression Models," Journal of Economic Surveys, Wiley Blackwell, vol. 25(1), pages 19-68, February.
    19. Li, Mingliang & Tobias, Justin L., 2011. "Bayesian inference in a correlated random coefficients model: Modeling causal effect heterogeneity with an application to heterogeneous returns to schooling," Journal of Econometrics, Elsevier, vol. 162(2), pages 345-361, June.
    20. Robert, Christian P., 2004. "Bayesian computational methods," Papers 2004,18, Humboldt University of Berlin, Center for Applied Statistics and Economics (CASE).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:171:y:2012:i:2:p:121-133. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jeconom .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.