IDEAS home Printed from https://ideas.repec.org/a/wly/hlthec/v15y2006i8p797-811.html
   My bibliography  Save this article

Deleting ‘irrational’ responses from discrete choice experiments: a case of investigating or imposing preferences?

Author

Listed:
  • Emily Lancsar
  • Jordan Louviere

Abstract

Investigation of the ‘rationality’ of responses to discrete choice experiments (DCEs) has been a theme of research in health economics. Responses have been deleted from DCEs where they have been deemed by researchers to (a) be ‘irrational’, defined by such studies as failing tests for non‐satiation, or (b) represent lexicographic preferences. This paper outlines a number of reasons why deleting responses from DCEs may be inappropriate after first reviewing the theory underpinning rationality, highlighting that the importance placed on rationality depends on the approach to consumer theory to which one ascribes. The aim of this paper is not to suggest that all preferences elicited via DCEs are rational. Instead, it is to suggest a number of reasons why it may not be the case that all preferences labelled as ‘irrational’ are indeed so. Hence, deleting responses may result in the removal of valid preferences; induce sample selection bias; and reduce the statistical efficiency and power of the estimated choice models. Further, evidence suggests random utility theory may be able to cope with such preferences. Finally, we discuss a number of implications for the design, implementation and interpretation of DCEs and recommend caution regarding the deletion of preferences from stated preference experiments. Copyright © 2006 John Wiley & Sons, Ltd.

Suggested Citation

  • Emily Lancsar & Jordan Louviere, 2006. "Deleting ‘irrational’ responses from discrete choice experiments: a case of investigating or imposing preferences?," Health Economics, John Wiley & Sons, Ltd., vol. 15(8), pages 797-811, August.
  • Handle: RePEc:wly:hlthec:v:15:y:2006:i:8:p:797-811
    DOI: 10.1002/hec.1104
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/hec.1104
    Download Restriction: no

    File URL: https://libkey.io/10.1002/hec.1104?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Gideon Yaniv, 2000. "Withholding Information from Cancer Patients as a Physician's Decision under Risk," Medical Decision Making, , vol. 20(2), pages 216-227, April.
    2. Swait, Joffre & Adamowicz, Wiktor, 2001. "The Influence of Task Complexity on Consumer Choice: A Latent Class Model of Decision Strategy Switching," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 28(1), pages 135-148, June.
    3. Alan Shiell & Penelope Hawe & Janelle Seymour, 2000. "Will our understanding of completeness ever be complete?," Health Economics, John Wiley & Sons, Ltd., vol. 9(8), pages 729-731, December.
    4. Sugden, Robert, 1991. "Rational Choice: A Survey of Contributions from Economics and Philosophy," Economic Journal, Royal Economic Society, vol. 101(407), pages 751-785, July.
    5. Fernando San Miguel & Mandy Ryan & Mabelle Amaya‐Amaya, 2005. "‘Irrational’ stated preferences: a quantitative and qualitative investigation," Health Economics, John Wiley & Sons, Ltd., vol. 14(3), pages 307-322, March.
    6. Gregory, Robin & Lichtenstein, Sarah & Slovic, Paul, 1993. "Valuing Environmental Resources: A Constructive Approach," Journal of Risk and Uncertainty, Springer, vol. 7(2), pages 177-197, October.
    7. Starmer, Chris, 1999. "Experimental Economics: Hard Science or Wasteful Tinkering?," Economic Journal, Royal Economic Society, vol. 109(453), pages 5-15, February.
    8. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    9. Mandy Ryan & Fernando San Miguel, 2003. "Revisiting the axiom of completeness in health care," Health Economics, John Wiley & Sons, Ltd., vol. 12(4), pages 295-307, April.
    10. John Cairns & Marjon van der Pol & Andrew Lloyd, 2002. "Decision making heuristics and the elicitation of preferences: being fast and frugal about the future," Health Economics, John Wiley & Sons, Ltd., vol. 11(7), pages 655-658, October.
    11. Peter C. Boxall & Wiktor L. Adamowicz & Theodore Tomasi, 1996. "A Nonparametric Test of the Traditional Travel Cost Model," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 44(2), pages 183-193, July.
    12. Mandy Ryan & Angela Bate, 2001. "Testing the assumptions of rationality, continuity and symmetry when applying discrete choice experiments in health care," Applied Economics Letters, Taylor & Francis Journals, vol. 8(1), pages 59-63.
    13. Paul Dolan & Aki Tsuchiya, 2003. "The person trade‐off method and the transitivity principle: an example from preferences over age weighting," Health Economics, John Wiley & Sons, Ltd., vol. 12(6), pages 505-510, June.
    14. DeShazo, J. R. & Fermo, German, 2002. "Designing Choice Sets for Stated Preference Methods: The Effects of Complexity on Choice Consistency," Journal of Environmental Economics and Management, Elsevier, vol. 44(1), pages 123-143, July.
    15. Boulding, Kenneth E, 1969. "Economics as a Moral Science," American Economic Review, American Economic Association, vol. 59(1), pages 1-12, March.
    16. Alan Shiell & Janelle Seymour & Penelope Hawe & Sue Cameron, 2000. "Are preferences over health states complete?," Health Economics, John Wiley & Sons, Ltd., vol. 9(1), pages 47-55, January.
    17. Mandy Ryan & Jenny Hughes, 1997. "Using Conjoint Analysis to Assess Women's Preferences for Miscarriage Management," Health Economics, John Wiley & Sons, Ltd., vol. 6(3), pages 261-273, May.
    18. Louviere,Jordan J. & Hensher,David A. & Swait,Joffre D., 2000. "Stated Choice Methods," Cambridge Books, Cambridge University Press, number 9780521788304, September.
    19. Emily Lancsar & Cam Donaldson, 2005. "Discrete choice experiments in health economics: Distinguishing between the method and its application," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 6(4), pages 314-316, December.
    20. Swait, Joffre, 2001. "A non-compensatory choice model incorporating attribute cutoffs," Transportation Research Part B: Methodological, Elsevier, vol. 35(10), pages 903-928, November.
    21. Loomes, Graham & Sugden, Robert, 1983. "A Rationale for Preference Reversal," American Economic Review, American Economic Association, vol. 73(3), pages 428-432, June.
    22. de Palma, Andre & Myers, Gordon M & Papageorgiou, Yorgos Y, 1994. "Rational Choice under an Imperfect Ability to Choose," American Economic Review, American Economic Association, vol. 84(3), pages 419-440, June.
    23. Alan Shiell & Lisa Gold, 2003. "If the price is right: vagueness and values clarification in contingent valuation," Health Economics, John Wiley & Sons, Ltd., vol. 12(11), pages 909-919, November.
    24. Alan Shiell & Penelope Hawe & Janelle Seymour, 1997. "Values and preferences are not necessarily the same," Health Economics, John Wiley & Sons, Ltd., vol. 6(5), pages 515-518, September.
    25. McIntosh, E. & Ryan, M., 2002. "Using discrete choice experiments to derive welfare estimates for the provision of elective surgery: Implications of discontinuous preferences," Journal of Economic Psychology, Elsevier, vol. 23(3), pages 367-382, June.
    26. Adamowicz, Wiktor L. & Graham-Tomasi, Theodore, 1991. "Revealed preference tests of nonmarket goods valuation methods," Journal of Environmental Economics and Management, Elsevier, vol. 20(1), pages 29-45, January.
    27. Michaël Schwarzinger & Jean‐Louis Lanoë & Erik Nord & Isabelle Durand‐Zaleski, 2004. "Lack of multiplicative transitivity in person trade‐off responses," Health Economics, John Wiley & Sons, Ltd., vol. 13(2), pages 171-181, February.
    28. Loomes, Graham & Sugden, Robert, 1987. "Testing for Regret and Disappointment in Choice under Uncertainty," Economic Journal, Royal Economic Society, vol. 97(388a), pages 118-129, Supplemen.
    29. Stirling Bryan & Martin Buxton & Robert Sheldon & Alison Grant, 1998. "Magnetic resonance imaging for the investigation of knee injuries: an investigation of preferences," Health Economics, John Wiley & Sons, Ltd., vol. 7(7), pages 595-603, November.
    30. Munro, Alistair & Sugden, Robert, 2003. "On the theory of reference-dependent preferences," Journal of Economic Behavior & Organization, Elsevier, vol. 50(4), pages 407-428, April.
    31. Foster, Vivien & Mourato, Susana, 2002. "Testing for Consistency in Contingent Ranking Experiments," Journal of Environmental Economics and Management, Elsevier, vol. 44(2), pages 309-328, September.
    32. Adam Oliver, 2000. "Complete preferences over health states: a reply to the paper by Shiell et al," Health Economics, John Wiley & Sons, Ltd., vol. 9(8), pages 727-728, December.
    33. Graham Loomes & Robert Sugden, 1986. "Disappointment and Dynamic Consistency in Choice under Uncertainty," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 53(2), pages 271-282.
    34. Hanemann, W., 1996. "Welfare Analysis with Discrete Choice Models," CUDARE Working Papers 198646, University of California, Berkeley, Department of Agricultural and Resource Economics.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mandy Ryan & Mabelle Amaya‐Amaya, 2005. "‘Threats’ to and hopes for estimating benefits," Health Economics, John Wiley & Sons, Ltd., vol. 14(6), pages 609-619, June.
    2. Emily Lancsar & Jordan Louviere, 2008. "Conducting Discrete Choice Experiments to Inform Healthcare Decision Making," PharmacoEconomics, Springer, vol. 26(8), pages 661-677, August.
    3. Fernando San Miguel & Mandy Ryan & Mabelle Amaya‐Amaya, 2005. "‘Irrational’ stated preferences: a quantitative and qualitative investigation," Health Economics, John Wiley & Sons, Ltd., vol. 14(3), pages 307-322, March.
    4. Neuman, Tzahi & Neuman, Einat & Neuman, Shoshana, 2010. "Explorations of the effect of experience on preferences for a health-care service," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 39(3), pages 407-419, June.
    5. Semra Özdemir & Ateesha F. Mohamed & F. Reed Johnson & A. Brett Hauber, 2010. "Who pays attention in stated‐choice surveys?," Health Economics, John Wiley & Sons, Ltd., vol. 19(1), pages 111-118, January.
    6. Alessandro Mengoni & Chiara Seghieri & Sabina Nuti, 2013. "The application of discrete choice experiments in health economics: a systematic review of the literature," Working Papers 201301, Scuola Superiore Sant'Anna of Pisa, Istituto di Management.
    7. Andrew J Lloyd, 2003. "Threats to the estimation of benefit: are preference elicitation methods accurate?," Health Economics, John Wiley & Sons, Ltd., vol. 12(5), pages 393-402, May.
    8. Jens Hougaard & Tue Tjur & Lars Østerdal, 2012. "On the meaningfulness of testing preference axioms in stated preference discrete choice experiments," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 13(4), pages 409-417, August.
    9. Mandy Ryan & Fernando San Miguel, 2003. "Revisiting the axiom of completeness in health care," Health Economics, John Wiley & Sons, Ltd., vol. 12(4), pages 295-307, April.
    10. Haghani, Milad & Bliemer, Michiel C.J. & Hensher, David A., 2021. "The landscape of econometric discrete choice modelling research," Journal of choice modelling, Elsevier, vol. 40(C).
    11. Schwappach, David L.B. & Strasmann, Thomas J., 2006. ""Quick and dirty numbers"?: The reliability of a stated-preference technique for the measurement of preferences for resource allocation," Journal of Health Economics, Elsevier, vol. 25(3), pages 432-448, May.
    12. Kosenius, Anna-Kaisa, 2013. "Preference discontinuity in choice experiment: Determinants and implications," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 45(C), pages 138-145.
    13. Mandy Ryan & Verity Watson & Vikki Entwistle, 2009. "Rationalising the ‘irrational’: a think aloud study of discrete choice experiment responses," Health Economics, John Wiley & Sons, Ltd., vol. 18(3), pages 321-336, March.
    14. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    15. Day, Brett & Bateman, Ian J. & Carson, Richard T. & Dupont, Diane & Louviere, Jordan J. & Morimoto, Sanae & Scarpa, Riccardo & Wang, Paul, 2012. "Ordering effects and choice set awareness in repeat-response stated preference studies," Journal of Environmental Economics and Management, Elsevier, vol. 63(1), pages 73-91.
    16. Campbell, Danny & Hutchinson, W. George & Scarpa, Riccardo, 2006. "Lexicographic Preferences in Discrete Choice Experiments: Consequences on Individual-Specific Willingness to Pay Estimates," Sustainability Indicators and Environmental Valuation Working Papers 12224, Fondazione Eni Enrico Mattei (FEEM).
    17. Rulleau, Bénédicte & Dachary-Bernard, Jeanne, 2012. "Preferences, rational choices and economic valuation: Some empirical tests," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 41(2), pages 198-206.
    18. Mickael Bech & Trine Kjaer & Jørgen Lauridsen, 2011. "Does the number of choice sets matter? Results from a web survey applying a discrete choice experiment," Health Economics, John Wiley & Sons, Ltd., vol. 20(3), pages 273-286, March.
    19. Trine Kjær & Mickael Bech & Dorte Gyrd‐Hansen & Kristian Hart‐Hansen, 2006. "Ordering effect and price sensitivity in discrete choice experiments: need we worry?," Health Economics, John Wiley & Sons, Ltd., vol. 15(11), pages 1217-1228, November.
    20. Nicolas Krucien & Verity Watson & Mandy Ryan, 2017. "Is Best–Worst Scaling Suitable for Health State Valuation? A Comparison with Discrete Choice Experiments," Health Economics, John Wiley & Sons, Ltd., vol. 26(12), pages 1-16, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:hlthec:v:15:y:2006:i:8:p:797-811. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/5749 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.