IDEAS home Printed from https://ideas.repec.org/p/tin/wpaper/20200061.html
   My bibliography  Save this paper

Heterogeneous variable selection in nonlinear panel data models: A semiparametric Bayesian approach

Author

Listed:
  • Anoek Castelein

    (Erasmus University Rotterdam)

  • Dennis Fok

    (Erasmus University Rotterdam)

  • Richard Paap

    (Erasmus University Rotterdam)

Abstract

In this paper, we develop a general method for heterogeneous variable selection in Bayesian nonlinear panel data models. Heterogeneous variable selection refers to the possibility that subsets of units are unaffected by certain variables. It may be present in applications as diverse as health treatments, consumer choice-making, macroeconomics, and operations research. Our method additionally allows for other forms of cross-sectional heterogeneity. We consider a two-group approach for the model's unit-specific parameters: each unit-specific parameter is either equal to zero (heterogeneous variable selection) or comes from a Dirichlet process (DP) mixture of multivariate normals (other cross-sectional heterogeneity). We develop our approach for general nonlinear panel data models, encompassing multinomial logit and probit models, poisson and negative binomial count models, exponential models, among many others. For inference, we develop an efficient Bayesian MCMC sampler. In a Monte Carlo study, we find that our approach is able to capture heterogeneous variable selection whereas a ``standard'' DP mixture is not. In an empirical application, we find that accounting for heterogeneous variable selection and non-normality of the continuous heterogeneity leads to an improved in-sample and out-of-sample performance and interesting insights. These findings illustrate the usefulness of our approach.

Suggested Citation

  • Anoek Castelein & Dennis Fok & Richard Paap, 2020. "Heterogeneous variable selection in nonlinear panel data models: A semiparametric Bayesian approach," Tinbergen Institute Discussion Papers 20-061/III, Tinbergen Institute.
  • Handle: RePEc:tin:wpaper:20200061
    as

    Download full text from publisher

    File URL: https://papers.tinbergen.nl/20061.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. John Geweke, 2004. "Getting It Right: Joint Distribution Tests of Posterior Simulators," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 799-804, January.
    2. Collins, Andrew T. & Rose, John M. & Hensher, David A., 2013. "Specification issues in a generalised random parameters attribute nonattendance model," Transportation Research Part B: Methodological, Elsevier, vol. 56(C), pages 234-253.
    3. Hole, Arne Risa, 2011. "A discrete choice model with endogenous attribute attendance," Economics Letters, Elsevier, vol. 110(3), pages 203-205, March.
    4. Nicholas G. Polson & James G. Scott & Jesse Windle, 2013. "Bayesian Inference for Logistic Models Using Pólya--Gamma Latent Variables," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 108(504), pages 1339-1349, December.
    5. Korobilis, Dimitris, 2013. "Bayesian forecasting with highly correlated predictors," Economics Letters, Elsevier, vol. 118(1), pages 148-150.
    6. Yang, Mingan, 2012. "Bayesian variable selection for logistic mixed model with nonparametric random effects," Computational Statistics & Data Analysis, Elsevier, vol. 56(9), pages 2663-2674.
    7. David Hensher & William Greene, 2010. "Non-attendance and dual processing of common-metric attributes in choice analysis: a latent class specification," Empirical Economics, Springer, vol. 39(2), pages 413-426, October.
    8. Danny Campbell & David A. Hensher & Riccardo Scarpa, 2011. "Non-attendance to attributes in environmental choice analysis: a latent class specification," Journal of Environmental Planning and Management, Taylor & Francis Journals, vol. 54(8), pages 1061-1076, December.
    9. Stephane Hess & Amanda Stathopoulos & Danny Campbell & Vikki O’Neill & Sebastian Caussade, 2013. "It’s not that I don’t care, I just don’t care very much: confounding between attribute non-attendance and taste heterogeneity," Transportation, Springer, vol. 40(3), pages 583-607, May.
    10. Hole, Arne Risa & Kolstad, Julie Riise & Gyrd-Hansen, Dorte, 2013. "Inferred vs. stated attribute non-attendance in choice experiments: A study of doctors’ prescription behaviour," Journal of Economic Behavior & Organization, Elsevier, vol. 96(C), pages 21-31.
    11. Peter E. Rossi, 2014. "Bayesian Non- and Semi-parametric Methods and Applications," Economics Books, Princeton University Press, edition 1, number 10259.
    12. Dunson, David B. & Herring, Amy H. & Engel, Stephanie M., 2008. "Bayesian Selection and Clustering of Polymorphisms in Functionally Related Genes," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 534-546, June.
    13. Sinae Kim & Mahlet G. Tadesse & Marina Vannucci, 2006. "Variable selection in clustering via Dirichlet process mixture models," Biometrika, Biometrika Trust, vol. 93(4), pages 877-893, December.
    14. Hale Koç & Hans van Kippersluis, 2017. "Thought for Food: Nutritional Information and Educational Disparities in Diet," Journal of Human Capital, University of Chicago Press, vol. 11(4), pages 508-552.
    15. Riccardo Scarpa & Timothy J. Gilbride & Danny Campbell & David A. Hensher, 2009. "Modelling attribute non-attendance in choice experiments for rural landscape valuation," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 36(2), pages 151-174, June.
    16. David Hensher & Andrew Collins & William Greene, 2013. "Accounting for attribute non-attendance and common-metric aggregation in a probabilistic decision process mixed multinomial logit model: a warning on potential confounding," Transportation, Springer, vol. 40(5), pages 1003-1020, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Weller, Priska & Oehlmann, Malte & Mariel, Petr & Meyerhoff, Jürgen, 2014. "Stated and inferred attribute non-attendance in a design of designs approach," Journal of choice modelling, Elsevier, vol. 11(C), pages 43-56.
    2. Gonçalves, Tânia & Lourenço-Gomes, Lina & Pinto, Lígia M. Costa, 2022. "The role of attribute non-attendance on consumer decision-making: Theoretical insights and empirical evidence," Economic Analysis and Policy, Elsevier, vol. 76(C), pages 788-805.
    3. Espinosa-Goded, María & Rodriguez-Entrena, Macario & Salazar-Ordóñez, Melania, 2021. "A straightforward diagnostic tool to identify attribute non-attendance in discrete choice experiments," Economic Analysis and Policy, Elsevier, vol. 71(C), pages 211-226.
    4. Collins, Andrew T. & Rose, John M. & Hensher, David A., 2013. "Specification issues in a generalised random parameters attribute nonattendance model," Transportation Research Part B: Methodological, Elsevier, vol. 56(C), pages 234-253.
    5. Owusu, V., 2018. "Credit-Constraints and Preferences for Crop Insurance in Ghana: Implications of Attribute Non-Attendance in Discrete Choice Experiments," 2018 Conference, July 28-August 2, 2018, Vancouver, British Columbia 276967, International Association of Agricultural Economists.
    6. Chen, Xuqi & Shen, Meng & Gao, Zhifeng, 2017. "Impact of Intra-respondent Variations in Attribute Attendance on Consumer Preference in Food Choice," 2017 Annual Meeting, July 30-August 1, Chicago, Illinois 258509, Agricultural and Applied Economics Association.
    7. Yegoryan, Narine & Guhl, Daniel & Klapper, Daniel, 2018. "Inferring Attribute Non-Attendance Using Eye Tracking in Choice-Based Conjoint Analysis," Rationality and Competition Discussion Paper Series 111, CRC TRR 190 Rationality and Competition.
    8. Arne Risa Hole & Richard Norman & Rosalie Viney, 2016. "Response Patterns in Health State Valuation Using Endogenous Attribute Attendance and Latent Class Analysis," Health Economics, John Wiley & Sons, Ltd., vol. 25(2), pages 212-224, February.
    9. Hole, Arne Risa & Kolstad, Julie Riise & Gyrd-Hansen, Dorte, 2013. "Inferred vs. stated attribute non-attendance in choice experiments: A study of doctors’ prescription behaviour," Journal of Economic Behavior & Organization, Elsevier, vol. 96(C), pages 21-31.
    10. Yegoryan, Narine & Guhl, Daniel & Klapper, Daniel, 2020. "Inferring attribute non-attendance using eye tracking in choice-based conjoint analysis," Journal of Business Research, Elsevier, vol. 111(C), pages 290-304.
    11. David Hensher, 2014. "Attribute processing as a behavioural strategy in choice making," Chapters, in: Stephane Hess & Andrew Daly (ed.), Handbook of Choice Modelling, chapter 12, pages 268-289, Edward Elgar Publishing.
    12. Díaz, Verónica & Montoya, Ricardo & Maldonado, Sebastián, 2023. "Preference estimation under bounded rationality: Identification of attribute non-attendance in stated-choice data using a support vector machines approach," European Journal of Operational Research, Elsevier, vol. 304(2), pages 797-812.
    13. Gonçalves, Tânia & Lourenço-Gomes, Lina & Pinto, Lígia M. Costa, 2020. "Dealing with ignored attributes through an inferred approach in wine choice experiments," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 87(C).
    14. David Hensher & Andrew Collins & William Greene, 2013. "Accounting for attribute non-attendance and common-metric aggregation in a probabilistic decision process mixed multinomial logit model: a warning on potential confounding," Transportation, Springer, vol. 40(5), pages 1003-1020, September.
    15. Daniel R. Petrolia & Matthew G. Interis & Joonghyun Hwang, 2018. "Single-Choice, Repeated-Choice, and Best-Worst Scaling Elicitation Formats: Do Results Differ and by How Much?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 69(2), pages 365-393, February.
    16. Sandorf, Erlend Dancke & Crastes dit Sourd, Romain & Mahieu, Pierre-Alexandre, 2018. "The effect of attribute-alternative matrix displays on preferences and processing strategies," Journal of choice modelling, Elsevier, vol. 29(C), pages 113-132.
    17. Sebastian Heidenreich & Verity Watson & Mandy Ryan & Euan Phimister, 2018. "Decision heuristic or preference? Attribute non‐attendance in discrete choice problems," Health Economics, John Wiley & Sons, Ltd., vol. 27(1), pages 157-171, January.
    18. Seda Erdem & Danny Campbell & Arne Risa Hole, 2015. "Accounting for Attribute‐Level Non‐Attendance in a Health Choice Experiment: Does it Matter?," Health Economics, John Wiley & Sons, Ltd., vol. 24(7), pages 773-789, July.
    19. Stephane Hess, 2014. "Latent class structures: taste heterogeneity and beyond," Chapters, in: Stephane Hess & Andrew Daly (ed.), Handbook of Choice Modelling, chapter 14, pages 311-330, Edward Elgar Publishing.
    20. Yangui, A. & Akaichi, F. & Gil, J.M., 2018. "Investigating attribute non-attendance effects in conjoint analysis methods performance: Choice experiment, ranking conjoint analysis and best worst scaling," 2018 Conference, July 28-August 2, 2018, Vancouver, British Columbia 275989, International Association of Agricultural Economists.

    More about this item

    Keywords

    Individualized variable selection; Dirichlet process; Stochastic search; Heterogeneity; Attribute non-attendance; Feature selection; Bayesian;
    All these keywords.

    JEL classification:

    • C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models
    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tin:wpaper:20200061. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Tinbergen Office +31 (0)10-4088900 (email available below). General contact details of provider: https://edirc.repec.org/data/tinbenl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.