IDEAS home Printed from https://ideas.repec.org/a/eee/eejocm/v34y2020ics1755534519301058.html
   My bibliography  Save this article

Endogeneity in adaptive choice contexts: Choice-based recommender systems and adaptive stated preferences surveys

Author

Listed:
  • Danaf, Mazen
  • Guevara, Angelo
  • Atasoy, Bilge
  • Ben-Akiva, Moshe

Abstract

Endogeneity arises in discrete choice models due to several factors and results in inconsistent estimates of the model parameters. In adaptive choice contexts such as choice-based recommender systems and adaptive stated preferences (ASP) surveys, endogeneity is expected because the attributes presented to an individual in a specific menu (or choice situation) depend on the previous choices of the same individual (as well as the alternative attributes in the previous menus). Nevertheless, the literature is indecisive on whether the parameter estimates in such cases are consistent or not. In this paper, we discuss cases where the estimates are consistent and those where they are not. We provide a theoretical explanation for this discrepancy and discuss the implications on the design of these systems and on model estimation. We conclude that endogeneity is not a concern when the likelihood function properly accounts for the data generation process. This can be achieved when the system is initialized exogenously and all the data are used in the estimation. In line with previous literature, Monte Carlo results suggest that, even when exogenous initialization is missing, empirical bias decreases with the number of choices per individual. We conclude by discussing the practical implications and extensions of this research.

Suggested Citation

  • Danaf, Mazen & Guevara, Angelo & Atasoy, Bilge & Ben-Akiva, Moshe, 2020. "Endogeneity in adaptive choice contexts: Choice-based recommender systems and adaptive stated preferences surveys," Journal of choice modelling, Elsevier, vol. 34(C).
    • Handle: RePEc:eee:eejocm:v:34:y:2020:i:c:s1755534519301058
    DOI: 10.1016/j.jocm.2019.100200
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1755534519301058
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jocm.2019.100200?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Joel Huber and Kenneth Train., 2000. "On the Similarity of Classical and Bayesian Estimates of Individual Mean Partworths," Economics Working Papers E00-289, University of California at Berkeley.
    2. Jeffrey M. Wooldridge, 2005. "Simple solutions to the initial conditions problem in dynamic, nonlinear panel data models with unobserved heterogeneity," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(1), pages 39-54, January.
    3. Richard W. Blundell & James L. Powell, 2004. "Endogeneity in Semiparametric Binary Response Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 71(3), pages 655-679.
    4. Hess, Stephane & Train, Kenneth, 2017. "Correlation and scale in mixed logit models," Journal of choice modelling, Elsevier, vol. 23(C), pages 1-8.
    5. Hausman, Jerry, 2015. "Specification tests in econometrics," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 38(2), pages 112-134.
    6. Olivier Toubia & Duncan I. Simester & John R. Hauser & Ely Dahan, 2003. "Fast Polyhedral Adaptive Conjoint Estimation," Marketing Science, INFORMS, vol. 22(3), pages 273-303.
    7. Akinc, Deniz & Vandebroek, Martina, 2018. "Bayesian estimation of mixed logit models: Selecting an appropriate prior for the covariance matrix," Journal of choice modelling, Elsevier, vol. 29(C), pages 133-151.
    8. Alpaslan Akay, 2012. "Finite‐sample comparison of alternative methods for estimating dynamic panel data models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(7), pages 1189-1204, November.
    9. Kanninen Barbara J., 1993. "Design of Sequential Experiments for Contingent Valuation Studies," Journal of Environmental Economics and Management, Elsevier, vol. 25(1), pages 1-11, July.
    10. Becker, Felix & Danaf, Mazen & Song, Xiang & Atasoy, Bilge & Ben-Akiva, Moshe, 2018. "Bayesian estimator for Logit Mixtures with inter- and intra-consumer heterogeneity," Transportation Research Part B: Methodological, Elsevier, vol. 117(PA), pages 1-17.
    11. Jordan Louviere & Kenneth Train & Moshe Ben-Akiva & Chandra Bhat & David Brownstone & Trudy Cameron & Richard Carson & J. Deshazo & Denzil Fiebig & William Greene & David Hensher & Donald Waldman, 2005. "Recent Progress on Endogeneity in Choice Modeling," Marketing Letters, Springer, vol. 16(3), pages 255-265, December.
    12. Koop,Gary & Poirier,Dale J. & Tobias,Justin L., 2007. "Bayesian Econometric Methods," Cambridge Books, Cambridge University Press, number 9780521671736, June.
    13. R. K. Blamey & J. W. Bennett & M. D. Morrison, 1999. "Yea-Saying in Contingent Valuation Surveys," Land Economics, University of Wisconsin Press, vol. 75(1), pages 126-141.
    14. Fowkes, Tony, 2007. "The design and interpretation of freight stated preference experiments seeking to elicit behavioural valuations of journey attributes," Transportation Research Part B: Methodological, Elsevier, vol. 41(9), pages 966-980, November.
    15. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521766555.
    16. Joan L. Walker & Yanqiao Wang & Mikkel Thorhauge & Moshe Ben-Akiva, 2018. "D-efficient or deficient? A robustness analysis of stated choice experimental designs," Theory and Decision, Springer, vol. 84(2), pages 215-238, March.
    17. John R. Hauser & Olivier Toubia, 2005. "The Impact of Utility Balance and Endogeneity in Conjoint Analysis," Marketing Science, INFORMS, vol. 24(3), pages 498-507, August.
    18. Chan,Joshua & Koop,Gary & Poirier,Dale J. & Tobias,Justin L., 2019. "Bayesian Econometric Methods," Cambridge Books, Cambridge University Press, number 9781108423380.
    19. Heckman, James J, 1978. "Dummy Endogenous Variables in a Simultaneous Equation System," Econometrica, Econometric Society, vol. 46(4), pages 931-959, July.
    20. Barbara J. Kanninen, 1993. "Optimal Experimental Design for Double-Bounded Dichotomous Choice Contingent Valuation," Land Economics, University of Wisconsin Press, vol. 69(2), pages 138-146.
    21. Hai Jiang & Xin Qi & He Sun, 2014. "Choice-Based Recommender Systems: A Unified Approach to Achieving Relevancy and Diversity," Operations Research, INFORMS, vol. 62(5), pages 973-993, October.
    22. Train, Kenneth & Wilson, Wesley W., 2008. "Estimation on stated-preference experiments constructed from revealed-preference choices," Transportation Research Part B: Methodological, Elsevier, vol. 42(3), pages 191-203, March.
    23. Qing Liu & Thomas Otter & Greg M. Allenby, 2007. "Investigating Endogeneity Bias in Marketing," Marketing Science, INFORMS, vol. 26(5), pages 642-650, 09-10.
    24. Heckman, James, 2013. "Sample selection bias as a specification error," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 31(3), pages 129-137.
    25. Rouwendal, Jan & de Blaeij, Arianne & Rietveld, Piet & Verhoef, Erik, 2010. "The information content of a stated choice experiment: A new method and its application to the value of a statistical life," Transportation Research Part B: Methodological, Elsevier, vol. 44(1), pages 136-151, January.
    26. Ben-Akiva, Moshe & McFadden, Daniel & Train, Kenneth, 2019. "Foundations of Stated Preference Elicitation: Consumer Behavior and Choice-based Conjoint Analysis," Foundations and Trends(R) in Econometrics, now publishers, vol. 10(1-2), pages 1-144, January.
    27. J. Miguel Villas-Boas & Russell S. Winer, 1999. "Endogeneity in Brand Choice Models," Management Science, INFORMS, vol. 45(10), pages 1324-1338, October.
    28. Donkers, A.C.D. & Melenberg, B., 2002. "Testing predictive performance of binary choice models," Econometric Institute Research Papers EI 2002-01, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    29. Guevara, C. Angelo, 2015. "Critical assessment of five methods to correct for endogeneity in discrete-choice models," Transportation Research Part A: Policy and Practice, Elsevier, vol. 82(C), pages 240-254.
    30. Tilahun, Nebiyou Y. & Levinson, David M. & Krizek, Kevin J., 2007. "Trails, lanes, or traffic: Valuing bicycle facilities with an adaptive stated preference survey," Transportation Research Part A: Policy and Practice, Elsevier, vol. 41(4), pages 287-301, May.
    31. Bateman, Ian J. & Burgess, Diane & Hutchinson, W. George & Matthews, David I., 2008. "Learning design contingent valuation (LDCV): NOAA guidelines, preference learning and coherent arbitrariness," Journal of Environmental Economics and Management, Elsevier, vol. 55(2), pages 127-141, March.
    32. Cristian Angelo Guevara & Moshe E. Ben-Akiva, 2012. "Change of Scale and Forecasting with the Control-Function Method in Logit Models," Transportation Science, INFORMS, vol. 46(3), pages 425-437, August.
    33. Thomas P. Holmes & Kevin J. Boyle, 2005. "Dynamic Learning and Context-Dependence in Sequential, Attribute-Based, Stated-Preference Valuation Questions," Land Economics, University of Wisconsin Press, vol. 81(1).
    34. Berry, Steven & Levinsohn, James & Pakes, Ariel, 1995. "Automobile Prices in Market Equilibrium," Econometrica, Econometric Society, vol. 63(4), pages 841-890, July.
    35. Nyquist, Hans, 1992. "Optimal Designs of Discrete Response Experiments in Contingent Valuation Studies," The Review of Economics and Statistics, MIT Press, vol. 74(3), pages 559-563, August.
    36. Natter, Martin & Feurstein, Markus, 2002. "Real world performance of choice-based conjoint models," European Journal of Operational Research, Elsevier, vol. 137(2), pages 448-458, March.
    37. Nebiyou Tilahun & Kevin Krizek & David Levinson, 2007. "Trails, Lanes, or Traffic: Value of Different Bicycle Facilities Using Adaptive Stated-Preference Survey," Working Papers 200701, University of Minnesota: Nexus Research Group.
    38. Guevara, C. Angelo & Hess, Stephane, 2019. "A control-function approach to correct for endogeneity in discrete choice models estimated on SP-off-RP data and contrasts with an earlier FIML approach by Train & Wilson," Transportation Research Part B: Methodological, Elsevier, vol. 123(C), pages 224-239.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Danaf, Mazen & Guevara, C. Angelo & Ben-Akiva, Moshe, 2023. "A control-function correction for endogeneity in random coefficients models: The case of choice-based recommender systems," Journal of choice modelling, Elsevier, vol. 46(C).
    2. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part II. Conceptualisation of external validity, sources and explanations of bias and effectiveness of mitigation methods," Journal of choice modelling, Elsevier, vol. 41(C).
    3. Milad Haghani & Michiel C. J. Bliemer & John M. Rose & Harmen Oppewal & Emily Lancsar, 2021. "Hypothetical bias in stated choice experiments: Part II. Macro-scale analysis of literature and effectiveness of bias mitigation methods," Papers 2102.02945, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Danaf, Mazen & Guevara, C. Angelo & Ben-Akiva, Moshe, 2023. "A control-function correction for endogeneity in random coefficients models: The case of choice-based recommender systems," Journal of choice modelling, Elsevier, vol. 46(C).
    2. Fernández-Antolín, Anna & Guevara, C. Angelo & de Lapparent, Matthieu & Bierlaire, Michel, 2016. "Correcting for endogeneity due to omitted attitudes: Empirical assessment of a modified MIS method using RP mode choice data," Journal of choice modelling, Elsevier, vol. 20(C), pages 1-15.
    3. Milad Haghani & Michiel C. J. Bliemer & John M. Rose & Harmen Oppewal & Emily Lancsar, 2021. "Hypothetical bias in stated choice experiments: Part I. Integrative synthesis of empirical evidence and conceptualisation of external validity," Papers 2102.02940, arXiv.org.
    4. Gopalakrishnan, Raja & Guevara, C. Angelo & Ben-Akiva, Moshe, 2020. "Combining multiple imputation and control function methods to deal with missing data and endogeneity in discrete-choice models," Transportation Research Part B: Methodological, Elsevier, vol. 142(C), pages 45-57.
    5. Guevara, C. Angelo & Tang, Yue & Gao, Song, 2018. "The initial condition problem with complete history dependency in learning models for travel choices," Transportation Research Part B: Methodological, Elsevier, vol. 117(PB), pages 850-861.
    6. Thomas E. Guerrero & C. Angelo Guevara & Elisabetta Cherchi & Juan de Dios Ortúzar, 2021. "Addressing endogeneity in strategic urban mode choice models," Transportation, Springer, vol. 48(4), pages 2081-2102, August.
    7. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    8. Bliemer, Michiel C.J. & Rose, John M., 2011. "Experimental design influences on stated choice outputs: An empirical study in air travel choice," Transportation Research Part A: Policy and Practice, Elsevier, vol. 45(1), pages 63-79, January.
    9. Lurkin, Virginie & Garrow, Laurie A. & Higgins, Matthew J. & Newman, Jeffrey P. & Schyns, Michael, 2017. "Accounting for price endogeneity in airline itinerary choice models: An application to Continental U.S. markets," Transportation Research Part A: Policy and Practice, Elsevier, vol. 100(C), pages 228-246.
    10. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part I. Macro-scale analysis of literature and integrative synthesis of empirical evidence from applied economics, experimental psychology and neuroimag," Journal of choice modelling, Elsevier, vol. 41(C).
    11. Krueger, Rico & Bierlaire, Michel & Daziano, Ricardo A. & Rashidi, Taha H. & Bansal, Prateek, 2021. "Evaluating the predictive abilities of mixed logit models with unobserved inter- and intra-individual heterogeneity," Journal of choice modelling, Elsevier, vol. 41(C).
    12. Guevara, C. Angelo, 2018. "Overidentification tests for the exogeneity of instruments in discrete choice models," Transportation Research Part B: Methodological, Elsevier, vol. 114(C), pages 241-253.
    13. Amil Petrin & Kenneth Train, 2003. "Omitted Product Attributes in Discrete Choice Models," NBER Working Papers 9452, National Bureau of Economic Research, Inc.
    14. Louis Grange & Felipe González & Ignacio Vargas & Rodrigo Troncoso, 2015. "A Logit Model With Endogenous Explanatory Variables and Network Externalities," Networks and Spatial Economics, Springer, vol. 15(1), pages 89-116, March.
    15. Danalet, Antonin & Tinguely, Loïc & Lapparent, Matthieu de & Bierlaire, Michel, 2016. "Location choice with longitudinal WiFi data," Journal of choice modelling, Elsevier, vol. 18(C), pages 1-17.
    16. Walker, Joan L. & Ehlers, Emily & Banerjee, Ipsita & Dugundji, Elenna R., 2011. "Correcting for endogeneity in behavioral choice models with social influence variables," Transportation Research Part A: Policy and Practice, Elsevier, vol. 45(4), pages 362-374, May.
    17. Kassie, Girma T. & Zeleke, Fresenbet & Birhanu, Mulugeta Y. & Scarpa, Riccardo, 2020. "Reminder Nudge, Attribute Nonattendance, and Willingness to Pay in a Discrete Choice Experiment," 2020 Annual Meeting, July 26-28, Kansas City, Missouri 304208, Agricultural and Applied Economics Association.
    18. Guevara, C. Angelo & Hess, Stephane, 2019. "A control-function approach to correct for endogeneity in discrete choice models estimated on SP-off-RP data and contrasts with an earlier FIML approach by Train & Wilson," Transportation Research Part B: Methodological, Elsevier, vol. 123(C), pages 224-239.
    19. Youssef M Aboutaleb & Mazen Danaf & Yifei Xie & Moshe Ben-Akiva, 2020. "Sparse Covariance Estimation in Logit Mixture Models," Papers 2001.05034, arXiv.org.
    20. Watanabe, Hajime & Maruyama, Takuya, 2023. "A Bayesian instrumental variable model for multinomial choice with correlated alternatives," Journal of choice modelling, Elsevier, vol. 46(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:eejocm:v:34:y:2020:i:c:s1755534519301058. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/journal-of-choice-modelling .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.