IDEAS home Printed from https://ideas.repec.org/a/eee/econom/v171y2012i2p121-133.html
   My bibliography  Save this article

Generalized smooth finite mixtures

Author

Listed:
  • Villani, Mattias
  • Kohn, Robert
  • Nott, David J.

Abstract

We propose a general class of models and a unified Bayesian inference methodology for flexibly estimating the density of a response variable conditional on a possibly high-dimensional set of covariates. Our model is a finite mixture of component models with covariate-dependent mixing weights. The component densities can belong to any parametric family, with each model parameter being a deterministic function of covariates through a link function. Our MCMC methodology allows for Bayesian variable selection among the covariates in the mixture components and in the mixing weights. The model’s parameterization and variable selection prior are chosen to prevent overfitting. We use simulated and real data sets to illustrate the methodology.

Suggested Citation

  • Villani, Mattias & Kohn, Robert & Nott, David J., 2012. "Generalized smooth finite mixtures," Journal of Econometrics, Elsevier, vol. 171(2), pages 121-133.
  • Handle: RePEc:eee:econom:v:171:y:2012:i:2:p:121-133
    DOI: 10.1016/j.jeconom.2012.06.012
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304407612001595
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. João A. Bastos & Joaquim J. S. Ramalho, 2016. "Nonparametric Models Of Financial Leverage Decisions," Bulletin of Economic Research, Wiley Blackwell, vol. 68(4), pages 348-366, October.
    2. Cook, Douglas O. & Kieschnick, Robert & McCullough, B.D., 2008. "Regression analysis of proportions in finance with self selection," Journal of Empirical Finance, Elsevier, vol. 15(5), pages 860-867, December.
    3. Wayne DeSarbo & William Cron, 1988. "A maximum likelihood methodology for clusterwise linear regression," Journal of Classification, Springer;The Classification Society, vol. 5(2), pages 249-282, September.
    4. David J. Nott & Robert Kohn, 2005. "Adaptive sampling for Bayesian variable selection," Biometrika, Biometrika Trust, vol. 92(4), pages 747-763, December.
    5. Villani, Mattias & Kohn, Robert & Giordani, Paolo, 2009. "Regression density estimation using smooth adaptive Gaussian mixtures," Journal of Econometrics, Elsevier, vol. 153(2), pages 155-173, December.
    6. Chung, Yeonseung & Dunson, David B., 2009. "Nonparametric Bayes Conditional Distribution Modeling With Variable Selection," Journal of the American Statistical Association, American Statistical Association, vol. 104(488), pages 1646-1660.
    7. Peter J. Green & Sylvia Richardson, 2001. "Modelling Heterogeneity With and Without the Dirichlet Process," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 28(2), pages 355-375, June.
    8. Giordani, Paolo & Jacobson, Tor & Schedvin, Erik von & Villani, Mattias, 2014. "Taking the Twists into Account: Predicting Firm Bankruptcy Risk with Splines of Financial Ratios," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 49(4), pages 1071-1099, August.
    9. Joseph Hilbe, 1994. "Negative binomial regression," Stata Technical Bulletin, StataCorp LP, vol. 3(18).
    10. Andreas Million & Regina T. Riphahn & Achim Wambach, 2003. "Incentive effects in the demand for health care: a bivariate panel count data estimation," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 18(4), pages 387-405.
    11. John Geweke, 1999. "Using simulation methods for bayesian econometric models: inference, development,and communication," Econometric Reviews, Taylor & Francis Journals, vol. 18(1), pages 1-73.
    12. Rajan, Raghuram G & Zingales, Luigi, 1995. "What Do We Know about Capital Structure? Some Evidence from International Data," Journal of Finance, American Finance Association, vol. 50(5), pages 1421-1460, December.
    13. Geweke, John & Keane, Michael, 2007. "Smoothly mixing regressions," Journal of Econometrics, Elsevier, vol. 138(1), pages 252-290, May.
    14. Esmeralda A. Ramalho & Joaquim J.S. Ramalho & José M.R. Murteira, 2011. "Alternative Estimating And Testing Empirical Strategies For Fractional Regression Models," Journal of Economic Surveys, Wiley Blackwell, vol. 25(1), pages 19-68, February.
    15. David B. Dunson & Natesh Pillai & Ju‐Hyun Park, 2007. "Bayesian density regression," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(2), pages 163-183, April.
    16. Norets, Andriy & Pelenis, Justinas, 2011. "Posterior Consistency in Conditional Density Estimation by Covariate Dependent Mixtures," Economics Series 282, Institute for Advanced Studies.
    17. Sally A. Wood, 2002. "Bayesian mixture of splines for spatially adaptive nonparametric regression," Biometrika, Biometrika Trust, vol. 89(3), pages 513-528, August.
    18. Norets, Andriy & Pelenis, Justinas, 2014. "Posterior Consistency In Conditional Density Estimation By Covariate Dependent Mixtures," Econometric Theory, Cambridge University Press, vol. 30(3), pages 606-646, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Drobetz, Wolfgang & Merikas, Andreas & Merika, Anna & Tsionas, Mike G., 2014. "Corporate social responsibility disclosure: The case of international shipping," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 71(C), pages 18-44.
    2. Mike G. Tsionas, 2017. "“When, Where, and How” of Efficiency Estimation: Improved Procedures for Stochastic Frontier Modeling," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(519), pages 948-965, July.
    3. Li, Feng & Kang, Yanfei, 2018. "Improving forecasting performance using covariate-dependent copula models," International Journal of Forecasting, Elsevier, vol. 34(3), pages 456-476.
    4. Gregor Zens, 2018. "Bayesian shrinkage in mixture of experts models: Identifying robust determinants of class membership," Papers 1809.04853, arXiv.org, revised Jan 2019.
    5. Kalli, Maria & Griffin, Jim E., 2018. "Bayesian nonparametric vector autoregressive models," Journal of Econometrics, Elsevier, vol. 203(2), pages 267-282.
    6. Gregor Zens, 2019. "Bayesian shrinkage in mixture-of-experts models: identifying robust determinants of class membership," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 13(4), pages 1019-1051, December.
    7. Cozzini, Alberto & Jasra, Ajay & Montana, Giovanni & Persing, Adam, 2014. "A Bayesian mixture of lasso regressions with t-errors," Computational Statistics & Data Analysis, Elsevier, vol. 77(C), pages 84-97.
    8. Feng Li & Mattias Villani, 2013. "Efficient Bayesian Multivariate Surface Regression," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 40(4), pages 706-723, December.
    9. Oskar Gustafsson & Mattias Villani & Par Stockhammar, 2020. "Bayesian Optimization of Hyperparameters when the Marginal Likelihood is Estimated by MCMC," Papers 2004.10092, arXiv.org.
    10. Quiroz, Matias & Villani, Mattias, 2013. "Dynamic mixture-of-experts models for longitudinal and discrete-time survival data," Working Paper Series 268, Sveriges Riksbank (Central Bank of Sweden).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Norets, Andriy & Pelenis, Justinas, 2012. "Bayesian modeling of joint and conditional distributions," Journal of Econometrics, Elsevier, vol. 168(2), pages 332-346.
    2. Norets, Andriy, 2015. "Bayesian regression with nonparametric heteroskedasticity," Journal of Econometrics, Elsevier, vol. 185(2), pages 409-419.
    3. Villani, Mattias & Kohn, Robert & Giordani, Paolo, 2009. "Regression density estimation using smooth adaptive Gaussian mixtures," Journal of Econometrics, Elsevier, vol. 153(2), pages 155-173, December.
    4. Feng Li & Mattias Villani, 2013. "Efficient Bayesian Multivariate Surface Regression," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 40(4), pages 706-723, December.
    5. Debdeep Pati & David Dunson, 2014. "Bayesian nonparametric regression with varying residual density," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 66(1), pages 1-31, February.
    6. Pelenis, Justinas, 2012. "Bayesian Semiparametric Regression," Economics Series 285, Institute for Advanced Studies.
    7. Li, Feng & Kang, Yanfei, 2018. "Improving forecasting performance using covariate-dependent copula models," International Journal of Forecasting, Elsevier, vol. 34(3), pages 456-476.
    8. Zhang, Xibin & King, Maxwell L. & Shang, Han Lin, 2014. "A sampling algorithm for bandwidth estimation in a nonparametric regression model with a flexible error density," Computational Statistics & Data Analysis, Elsevier, vol. 78(C), pages 218-234.
    9. Roberto Casarin & Stefano Grassi & Francesco Ravazzolo & Herman K. van Dijk, 2015. "Dynamic predictive density combinations for large data sets in economics and finance," Working Paper 2015/12, Norges Bank.
    10. Barrientos, Andrés F. & Canale, Antonio, 2021. "A Bayesian goodness-of-fit test for regression," Computational Statistics & Data Analysis, Elsevier, vol. 155(C).
    11. Joaquim Ramalho & J. Silva, 2013. "Functional form issues in the regression analysis of financial leverage ratios," Empirical Economics, Springer, vol. 44(2), pages 799-831, April.
    12. Villani, Mattias & Kohn, Robert & Giordani, Paolo, 2007. "Nonparametric Regression Density Estimation Using Smoothly Varying Normal Mixtures," Working Paper Series 211, Sveriges Riksbank (Central Bank of Sweden).
    13. Quiroz, Matias & Villani, Mattias, 2013. "Dynamic mixture-of-experts models for longitudinal and discrete-time survival data," Working Paper Series 268, Sveriges Riksbank (Central Bank of Sweden).
    14. Nguyen, Thao & Bai, Min & Hou, Greg & Vu, Manh-Chien, 2020. "State ownership and adjustment speed toward target leverage: Evidence from a transitional economy," Research in International Business and Finance, Elsevier, vol. 53(C).
    15. Greene, William, 2007. "Functional Form and Heterogeneity in Models for Count Data," Foundations and Trends(R) in Econometrics, now publishers, vol. 1(2), pages 113-218, August.
    16. Chang, Ya-Kai & Chou, Robin K. & Huang, Tai-Hsin, 2014. "Corporate governance and the dynamics of capital structure: New evidence," Journal of Banking & Finance, Elsevier, vol. 48(C), pages 374-385.
    17. Igari, Ryosuke & Hoshino, Takahiro, 2018. "A Bayesian data combination approach for repeated durations under unobserved missing indicators: Application to interpurchase-timing in marketing," Computational Statistics & Data Analysis, Elsevier, vol. 126(C), pages 150-166.
    18. Latouche, Karine & Rouviere, Elodie, 2011. "Brokers vs. Retailers: Evidence from the French Imports Industry of Fresh Produce," 2011 International Congress, August 30-September 2, 2011, Zurich, Switzerland 114398, European Association of Agricultural Economists.
    19. Pati, Debdeep & Dunson, David B. & Tokdar, Surya T., 2013. "Posterior consistency in conditional distribution estimation," Journal of Multivariate Analysis, Elsevier, vol. 116(C), pages 456-472.
    20. Harald Oberhofer & Michael Pfaffermayr, 2014. "Two-Part Models for Fractional Responses Defined as Ratios of Integers," Econometrics, MDPI, Open Access Journal, vol. 2(3), pages 1-22, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:171:y:2012:i:2:p:121-133. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Nithya Sathishkumar). General contact details of provider: http://www.elsevier.com/locate/jeconom .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.