IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1809.04853.html
   My bibliography  Save this paper

Bayesian shrinkage in mixture of experts models: Identifying robust determinants of class membership

Author

Listed:
  • Gregor Zens

Abstract

A method for implicit variable selection in mixture of experts frameworks is proposed. We introduce a prior structure where information is taken from a set of independent covariates. Robust class membership predictors are identified using a normal gamma prior. The resulting model setup is used in a finite mixture of Bernoulli distributions to find homogenous clusters of women in Mozambique based on their information sources on HIV. Fully Bayesian inference is carried out via the implementation of a Gibbs sampler.

Suggested Citation

  • Gregor Zens, 2018. "Bayesian shrinkage in mixture of experts models: Identifying robust determinants of class membership," Papers 1809.04853, arXiv.org, revised Jan 2019.
    • Handle: RePEc:arx:papers:1809.04853
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1809.04853
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Geweke, John, 1989. "Bayesian Inference in Econometric Models Using Monte Carlo Integration," Econometrica, Econometric Society, vol. 57(6), pages 1317-1339, November.
    2. Peter E. Rossi & Robert E. McCulloch & Greg M. Allenby, 1996. "The Value of Purchase History Data in Target Marketing," Marketing Science, INFORMS, vol. 15(4), pages 321-340.
    3. Villani, Mattias & Kohn, Robert & Nott, David J., 2012. "Generalized smooth finite mixtures," Journal of Econometrics, Elsevier, vol. 171(2), pages 121-133.
    4. Kastner, Gregor, 2019. "Sparse Bayesian time-varying covariance estimation in many dimensions," Journal of Econometrics, Elsevier, vol. 210(1), pages 98-115.
    5. Anderson, Gordon & Farcomeni, Alessio & Pittau, Maria Grazia & Zelli, Roberto, 2016. "A new approach to measuring and studying the characteristics of class membership: Examining poverty, inequality and polarization in urban China," Journal of Econometrics, Elsevier, vol. 191(2), pages 348-359.
    6. Nicholas G. Polson & James G. Scott & Jesse Windle, 2013. "Bayesian Inference for Logistic Models Using Pólya--Gamma Latent Variables," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 108(504), pages 1339-1349, December.
    7. Anirban Bhattacharya & Debdeep Pati & Natesh S. Pillai & David B. Dunson, 2015. "Dirichlet--Laplace Priors for Optimal Shrinkage," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(512), pages 1479-1490, December.
    8. Florian Huber & Martin Feldkircher, 2019. "Adaptive Shrinkage in Bayesian Vector Autoregressive Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(1), pages 27-39, January.
    9. Fruhwirth-Schnatter, Sylvia & Kaufmann, Sylvia, 2008. "Model-Based Clustering of Multiple Time Series," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 78-89, January.
    10. Agadjanian, Victor, 2005. "Gender, religious involvement, and HIV/AIDS prevention in Mozambique," Social Science & Medicine, Elsevier, vol. 61(7), pages 1529-1539, October.
    11. Sylvia Frühwirth‐Schnatter & Christoph Pamminger & Andrea Weber & Rudolf Winter‐Ebmer, 2012. "Labor market entry and earnings dynamics: Bayesian inference using mixtures‐of‐experts Markov chain clustering," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(7), pages 1116-1137, November.
    12. Joyee Ghosh & Amy H. Herring & Anna Maria Siega-Riz, 2011. "Bayesian Variable Selection for Latent Class Models," Biometrics, The International Biometric Society, vol. 67(3), pages 917-925, September.
    13. Rajarshi Guhaniyogi & David B. Dunson, 2015. "Bayesian Compressed Regression," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(512), pages 1500-1514, December.
    14. Lubrano, Michel & Ndoye, Abdoul Aziz Junior, 2016. "Income inequality decomposition using a finite mixture of log-normal distributions: A Bayesian approach," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 830-846.
    15. Peter Lenk & Wayne DeSarbo, 2000. "Bayesian inference for finite mixtures of generalized linear models with random effects," Psychometrika, Springer;The Psychometric Society, vol. 65(1), pages 93-119, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gregor Zens, 2019. "Bayesian shrinkage in mixture-of-experts models: identifying robust determinants of class membership," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 13(4), pages 1019-1051, December.
    2. Florian Huber & Tam'as Krisztin & Michael Pfarrhofer, 2018. "A Bayesian panel VAR model to analyze the impact of climate change on high-income economies," Papers 1804.01554, arXiv.org, revised Feb 2021.
    3. Joshua Chan, 2023. "BVARs and Stochastic Volatility," Papers 2310.14438, arXiv.org.
    4. Gregor Kastner & Florian Huber, 2020. "Sparse Bayesian vector autoregressions in huge dimensions," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(7), pages 1142-1165, November.
    5. Luis Gruber & Gregor Kastner, 2022. "Forecasting macroeconomic data with Bayesian VARs: Sparse or dense? It depends!," Papers 2206.04902, arXiv.org, revised Jul 2023.
    6. Michael Pfarrhofer & Philipp Piribauer, 2018. "Flexible shrinkage in high-dimensional Bayesian spatial autoregressive models," Papers 1805.10822, arXiv.org.
    7. Sylvia Frühwirth-Schnatter, 2011. "Panel data analysis: a survey on model-based clustering of time series," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 5(4), pages 251-280, December.
    8. Ellis Scharfenaker, Markus P.A. Schneider, 2019. "Labor Market Segmentation and the Distribution of Income: New Evidence from Internal Census Bureau Data," Working Paper Series, Department of Economics, University of Utah 2019_08, University of Utah, Department of Economics.
    9. Chan, Joshua C.C., 2021. "Minnesota-type adaptive hierarchical priors for large Bayesian VARs," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1212-1226.
    10. Frühwirth-Schnatter, Sylvia & Pamminger, Christoph & Weber, Andrea & Winter-Ebmer, Rudolf, 2014. "When Is The Best Time To Give Birth?," Economics Series 308, Institute for Advanced Studies.
    11. Gael M. Martin & David T. Frazier & Ruben Loaiza-Maya & Florian Huber & Gary Koop & John Maheu & Didier Nibbering & Anastasios Panagiotelis, 2023. "Bayesian Forecasting in the 21st Century: A Modern Review," Monash Econometrics and Business Statistics Working Papers 1/23, Monash University, Department of Econometrics and Business Statistics.
    12. Hu, Guanyu, 2021. "Spatially varying sparsity in dynamic regression models," Econometrics and Statistics, Elsevier, vol. 17(C), pages 23-34.
    13. Michael Pfarrhofer, 2020. "Forecasts with Bayesian vector autoregressions under real time conditions," Papers 2004.04984, arXiv.org.
    14. Lynd Bacon & Peter Lenk, 2012. "Augmenting discrete-choice data to identify common preference scales for inter-subject analyses," Quantitative Marketing and Economics (QME), Springer, vol. 10(4), pages 453-474, December.
    15. Parfait Munezero, 2022. "Efficient particle smoothing for Bayesian inference in dynamic survival models," Computational Statistics, Springer, vol. 37(2), pages 975-994, April.
    16. Max J. Pachali & Peter Kurz & Thomas Otter, 2020. "How to generalize from a hierarchical model?," Quantitative Marketing and Economics (QME), Springer, vol. 18(4), pages 343-380, December.
    17. Florian Huber & Michael Pfarrhofer & Philipp Piribauer, 2020. "A multi‐country dynamic factor model with stochastic volatility for euro area business cycle analysis," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(6), pages 911-926, September.
    18. Winter-Ebmer, Rudolf & Weber, Andrea & Frühwirth-Schnatter, Sylvia & Pamminger, Christoph, 2014. "When Is The Best Time To Give Birth - Career Effects Of Early Birth Decisions," CEPR Discussion Papers 10132, C.E.P.R. Discussion Papers.
    19. Minerva Mukhopadhyay & David B. Dunson, 2020. "Targeted Random Projection for Prediction From High-Dimensional Features," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(532), pages 1998-2010, December.
    20. Peter E. Rossi & Greg M. Allenby, 2003. "Bayesian Statistics and Marketing," Marketing Science, INFORMS, vol. 22(3), pages 304-328, July.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1809.04853. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.