IDEAS home Printed from https://ideas.repec.org/a/spr/advdac/v13y2019i4d10.1007_s11634-019-00353-y.html
   My bibliography  Save this article

Bayesian shrinkage in mixture-of-experts models: identifying robust determinants of class membership

Author

Listed:
  • Gregor Zens

    (Vienna University of Economics and Business)

Abstract

A method for implicit variable selection in mixture-of-experts frameworks is proposed. We introduce a prior structure where information is taken from a set of independent covariates. Robust class membership predictors are identified using a normal gamma prior. The resulting model setup is used in a finite mixture of Bernoulli distributions to find homogenous clusters of women in Mozambique based on their information sources on HIV. Fully Bayesian inference is carried out via the implementation of a Gibbs sampler.

Suggested Citation

  • Gregor Zens, 2019. "Bayesian shrinkage in mixture-of-experts models: identifying robust determinants of class membership," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 13(4), pages 1019-1051, December.
    • Handle: RePEc:spr:advdac:v:13:y:2019:i:4:d:10.1007_s11634-019-00353-y
    DOI: 10.1007/s11634-019-00353-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11634-019-00353-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11634-019-00353-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Geweke, John, 1989. "Bayesian Inference in Econometric Models Using Monte Carlo Integration," Econometrica, Econometric Society, vol. 57(6), pages 1317-1339, November.
    2. Villani, Mattias & Kohn, Robert & Nott, David J., 2012. "Generalized smooth finite mixtures," Journal of Econometrics, Elsevier, vol. 171(2), pages 121-133.
    3. Salvatore Ingrassia & Antonio Punzo & Giorgio Vittadini & Simona Minotti, 2015. "The Generalized Linear Mixed Cluster-Weighted Model," Journal of Classification, Springer;The Classification Society, vol. 32(1), pages 85-113, April.
    4. Nicholas G. Polson & James G. Scott & Jesse Windle, 2013. "Bayesian Inference for Logistic Models Using Pólya--Gamma Latent Variables," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 108(504), pages 1339-1349, December.
    5. Sylvia Frühwirth‐Schnatter & Christoph Pamminger & Andrea Weber & Rudolf Winter‐Ebmer, 2012. "Labor market entry and earnings dynamics: Bayesian inference using mixtures‐of‐experts Markov chain clustering," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(7), pages 1116-1137, November.
    6. Rajarshi Guhaniyogi & David B. Dunson, 2015. "Bayesian Compressed Regression," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(512), pages 1500-1514, December.
    7. Gupta, Mayetri & Ibrahim, Joseph G., 2007. "Variable Selection in Regression Mixture Modeling for the Discovery of Gene Regulatory Networks," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 867-880, September.
    8. Peter Lenk & Wayne DeSarbo, 2000. "Bayesian inference for finite mixtures of generalized linear models with random effects," Psychometrika, Springer;The Psychometric Society, vol. 65(1), pages 93-119, March.
    9. Peter E. Rossi & Robert E. McCulloch & Greg M. Allenby, 1996. "The Value of Purchase History Data in Target Marketing," Marketing Science, INFORMS, vol. 15(4), pages 321-340.
    10. Ingrassia, Salvatore & Minotti, Simona C. & Punzo, Antonio, 2014. "Model-based clustering via linear cluster-weighted models," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 159-182.
    11. Anderson, Gordon & Farcomeni, Alessio & Pittau, Maria Grazia & Zelli, Roberto, 2016. "A new approach to measuring and studying the characteristics of class membership: Examining poverty, inequality and polarization in urban China," Journal of Econometrics, Elsevier, vol. 191(2), pages 348-359.
    12. Anirban Bhattacharya & Debdeep Pati & Natesh S. Pillai & David B. Dunson, 2015. "Dirichlet--Laplace Priors for Optimal Shrinkage," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(512), pages 1479-1490, December.
    13. Florian Huber & Martin Feldkircher, 2019. "Adaptive Shrinkage in Bayesian Vector Autoregressive Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(1), pages 27-39, January.
    14. Fruhwirth-Schnatter, Sylvia & Kaufmann, Sylvia, 2008. "Model-Based Clustering of Multiple Time Series," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 78-89, January.
    15. Agadjanian, Victor, 2005. "Gender, religious involvement, and HIV/AIDS prevention in Mozambique," Social Science & Medicine, Elsevier, vol. 61(7), pages 1529-1539, October.
    16. Joyee Ghosh & Amy H. Herring & Anna Maria Siega-Riz, 2011. "Bayesian Variable Selection for Latent Class Models," Biometrics, The International Biometric Society, vol. 67(3), pages 917-925, September.
    17. Lubrano, Michel & Ndoye, Abdoul Aziz Junior, 2016. "Income inequality decomposition using a finite mixture of log-normal distributions: A Bayesian approach," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 830-846.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mirfarah, Elham & Naderi, Mehrdad & Chen, Ding-Geng, 2021. "Mixture of linear experts model for censored data: A novel approach with scale-mixture of normal distributions," Computational Statistics & Data Analysis, Elsevier, vol. 158(C).
    2. Uddin, Md Nazir & Gaskins, Jeremy T., 2023. "Shared Bayesian variable shrinkage in multinomial logistic regression," Computational Statistics & Data Analysis, Elsevier, vol. 177(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gregor Zens, 2018. "Bayesian shrinkage in mixture of experts models: Identifying robust determinants of class membership," Papers 1809.04853, arXiv.org, revised Jan 2019.
    2. Florian Huber & Tam'as Krisztin & Michael Pfarrhofer, 2018. "A Bayesian panel VAR model to analyze the impact of climate change on high-income economies," Papers 1804.01554, arXiv.org, revised Feb 2021.
    3. Hou, Chenghan, 2024. "Large Bayesian SVARs with linear restrictions," Journal of Econometrics, Elsevier, vol. 244(1).
    4. Xiaoqiong Fang & Andy W. Chen & Derek S. Young, 2023. "Predictors with measurement error in mixtures of polynomial regressions," Computational Statistics, Springer, vol. 38(1), pages 373-401, March.
    5. Maruotti, Antonello & Punzo, Antonio, 2017. "Model-based time-varying clustering of multivariate longitudinal data with covariates and outliers," Computational Statistics & Data Analysis, Elsevier, vol. 113(C), pages 475-496.
    6. Sylvia Frühwirth-Schnatter, 2011. "Panel data analysis: a survey on model-based clustering of time series," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 5(4), pages 251-280, December.
    7. Ellis Scharfenaker, Markus P.A. Schneider, 2019. "Labor Market Segmentation and the Distribution of Income: New Evidence from Internal Census Bureau Data," Working Paper Series, Department of Economics, University of Utah 2019_08, University of Utah, Department of Economics.
    8. Chan, Joshua C.C., 2021. "Minnesota-type adaptive hierarchical priors for large Bayesian VARs," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1212-1226.
    9. Frühwirth-Schnatter, Sylvia & Pamminger, Christoph & Weber, Andrea & Winter-Ebmer, Rudolf, 2014. "When Is The Best Time To Give Birth?," Economics Series 308, Institute for Advanced Studies.
    10. Gael M. Martin & David T. Frazier & Ruben Loaiza-Maya & Florian Huber & Gary Koop & John Maheu & Didier Nibbering & Anastasios Panagiotelis, 2023. "Bayesian Forecasting in the 21st Century: A Modern Review," Monash Econometrics and Business Statistics Working Papers 1/23, Monash University, Department of Econometrics and Business Statistics.
    11. Joshua C. C. Chan, 2024. "BVARs and stochastic volatility," Chapters, in: Michael P. Clements & Ana Beatriz Galvão (ed.), Handbook of Research Methods and Applications in Macroeconomic Forecasting, chapter 3, pages 43-67, Edward Elgar Publishing.
    12. Hu, Guanyu, 2021. "Spatially varying sparsity in dynamic regression models," Econometrics and Statistics, Elsevier, vol. 17(C), pages 23-34.
    13. Paolo Berta & Salvatore Ingrassia & Antonio Punzo & Giorgio Vittadini, 2016. "Multilevel cluster-weighted models for the evaluation of hospitals," METRON, Springer;Sapienza Università di Roma, vol. 74(3), pages 275-292, December.
    14. Jan Prüser & Florian Huber, 2024. "Nonlinearities in macroeconomic tail risk through the lens of big data quantile regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 39(2), pages 269-291, March.
    15. Michael Pfarrhofer, 2024. "Forecasts with Bayesian vector autoregressions under real time conditions," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(3), pages 771-801, April.
    16. Diani, Cecilia & Galimberti, Giuliano & Soffritti, Gabriele, 2022. "Multivariate cluster-weighted models based on seemingly unrelated linear regression," Computational Statistics & Data Analysis, Elsevier, vol. 171(C).
    17. Lee, Kuo-Jung & Chen, Ray-Bing & Wu, Ying Nian, 2016. "Bayesian variable selection for finite mixture model of linear regressions," Computational Statistics & Data Analysis, Elsevier, vol. 95(C), pages 1-16.
    18. Lynd Bacon & Peter Lenk, 2012. "Augmenting discrete-choice data to identify common preference scales for inter-subject analyses," Quantitative Marketing and Economics (QME), Springer, vol. 10(4), pages 453-474, December.
    19. Salvatore Ingrassia & Antonio Punzo, 2020. "Cluster Validation for Mixtures of Regressions via the Total Sum of Squares Decomposition," Journal of Classification, Springer;The Classification Society, vol. 37(2), pages 526-547, July.
    20. Parfait Munezero, 2022. "Efficient particle smoothing for Bayesian inference in dynamic survival models," Computational Statistics, Springer, vol. 37(2), pages 975-994, April.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:advdac:v:13:y:2019:i:4:d:10.1007_s11634-019-00353-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.