IDEAS home Printed from https://ideas.repec.org/a/wly/hlthec/v18y2009i3p321-336.html
   My bibliography  Save this article

Rationalising the ‘irrational’: a think aloud study of discrete choice experiment responses

Author

Listed:
  • Mandy Ryan
  • Verity Watson
  • Vikki Entwistle

Abstract

Stated preference methods assume respondents' preferences are consistent with utility theory, but many empirical studies report evidence of preferences that violate utility theory. This evidence is often derived from quantitative tests that occur naturally within, or are added to, stated preference tasks. In this study, we use qualitative methods to explore three axioms of utility theory: completeness, monotonicity, and continuity. We take a novel approach, adopting a ‘think aloud’ technique to identify violations of the axioms of utility theory and to consider how well the quantitative tests incorporated within a discrete choice experiment are able to detect these. Results indicate that quantitative tests classify respondents as being ‘irrational’ when qualitative statements would indicate they are ‘rational’. In particular, ‘non‐monotonic’ responses can often be explained by respondents inferring additional information beyond what is presented in the task, and individuals who appear to adopt non‐compensatory decision‐making strategies do so because they rate particular attributes very highly (they are not attempting to simplify the task). The results also provide evidence of ‘cost‐based responses’: respondents assumed tests with higher costs would be of higher quality. The value of including in‐depth qualitative validation techniques in the development of stated preference tasks is shown. Copyright © 2008 John Wiley & Sons, Ltd.

Suggested Citation

  • Mandy Ryan & Verity Watson & Vikki Entwistle, 2009. "Rationalising the ‘irrational’: a think aloud study of discrete choice experiment responses," Health Economics, John Wiley & Sons, Ltd., vol. 18(3), pages 321-336, March.
  • Handle: RePEc:wly:hlthec:v:18:y:2009:i:3:p:321-336
    DOI: 10.1002/hec.1369
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/hec.1369
    Download Restriction: no

    File URL: https://libkey.io/10.1002/hec.1369?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Ryan, Mandy & Scott, David A. & Donaldson, Cam, 2004. "Valuing health care using willingness to pay: a comparison of the payment card and dichotomous choice methods," Journal of Health Economics, Elsevier, vol. 23(2), pages 237-258, March.
    2. Schkade David A. & Payne John W., 1994. "How People Respond to Contingent Valuation Questions: A Verbal Protocol Analysis of Willingness to Pay for an Environmental Regulation," Journal of Environmental Economics and Management, Elsevier, vol. 26(1), pages 88-109, January.
    3. Cairns, John & van der Pol, Marjon, 2004. "Repeated follow-up as a method for reducing non-trading behaviour in discrete choice experiments," Social Science & Medicine, Elsevier, vol. 58(11), pages 2211-2218, June.
    4. Rachel Baker & Angela Robinson, 2004. "Responses to standard gambles: are preferences ‘well constructed’?," Health Economics, John Wiley & Sons, Ltd., vol. 13(1), pages 37-48, January.
    5. Shiell, Alan & Gold, Lisa, 2002. "Contingent valuation in health care and the persistence of embedding effects without the warm glow," Journal of Economic Psychology, Elsevier, vol. 23(2), pages 251-262, April.
    6. Shiell, Alan & Rush, Bonnie, 2003. "Can willingness to pay capture the value of altruism? An exploration of Sen's notion of commitment," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 32(6), pages 647-660, December.
    7. Joanna Coast, 1999. "The appropriate uses of qualitative methods in health economics," Health Economics, John Wiley & Sons, Ltd., vol. 8(4), pages 345-353, June.
    8. Louviere,Jordan J. & Hensher,David A. & Swait,Joffre D. With contributions by-Name:Adamowicz,Wiktor, 2000. "Stated Choice Methods," Cambridge Books, Cambridge University Press, number 9780521788304.
    9. Payne, John W & Bettman, James R & Schkade, David A, 1999. "Measuring Constructed Preferences: Towards a Building Code," Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 243-270, December.
    10. Ryan, Mandy & San Miguel, Fernando, 2000. "Testing for consistency in willingness to pay experiments," Journal of Economic Psychology, Elsevier, vol. 21(3), pages 305-317, June.
    11. Fernando San Miguel & Mandy Ryan & Mabelle Amaya‐Amaya, 2005. "‘Irrational’ stated preferences: a quantitative and qualitative investigation," Health Economics, John Wiley & Sons, Ltd., vol. 14(3), pages 307-322, March.
    12. Paul McNamee & Sharon Glendinning & Jonathan Shenfine & Nick Steen & S. Griffin & John Bond, 2004. "Chained time trade-off and standard gamble methods," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 5(1), pages 81-86, February.
    13. Matthew Rabin, 1998. "Psychology and Economics," Journal of Economic Literature, American Economic Association, vol. 36(1), pages 11-46, March.
    14. Hall, Jane & Viney, Rosalie & Haas, Marion & Louviere, Jordan, 2004. "Using stated preference discrete choice modeling to evaluate health care programs," Journal of Business Research, Elsevier, vol. 57(9), pages 1026-1032, September.
    15. Colin F. Camerer, 1997. "Progress in Behavioral Game Theory," Journal of Economic Perspectives, American Economic Association, vol. 11(4), pages 167-188, Fall.
    16. Cam Donaldson & Phil Shackley & Mona Abdalla, 1997. "Using Willingness To Pay To Value Close Substitutes: Carrier Screening for Cystic Fibrosis Revisited," Health Economics, John Wiley & Sons, Ltd., vol. 6(2), pages 145-159, March.
    17. McIntosh, E. & Ryan, M., 2002. "Using discrete choice experiments to derive welfare estimates for the provision of elective surgery: Implications of discontinuous preferences," Journal of Economic Psychology, Elsevier, vol. 23(3), pages 367-382, June.
    18. Scott, Anthony & Watson, M. Stuart & Ross, Sue, 2003. "Eliciting preferences of the community for out of hours care provided by general practitioners: a stated preference discrete choice experiment," Social Science & Medicine, Elsevier, vol. 56(4), pages 803-814, February.
    19. Nick Hanley & Robert Wright & Gary Koop, 2002. "Modelling Recreation Demand Using Choice Experiments: Climbing in Scotland," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 22(3), pages 449-466, July.
    20. Mandy Ryan & Fernando San Miguel, 2003. "Revisiting the axiom of completeness in health care," Health Economics, John Wiley & Sons, Ltd., vol. 12(4), pages 295-307, April.
    21. McFadden, Daniel, 1999. "Rationality for Economists?," Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 73-105, December.
    22. Emily Lancsar & Jordan Louviere, 2006. "Deleting ‘irrational’ responses from discrete choice experiments: a case of investigating or imposing preferences?," Health Economics, John Wiley & Sons, Ltd., vol. 15(8), pages 797-811, August.
    23. Dolan, Paul & Kind, Paul, 1996. "Inconsistency and health state valuations," Social Science & Medicine, Elsevier, vol. 42(4), pages 609-615, February.
    24. Dolan, P. & Gudex, C. & Kind, P. & Williams, A., 1996. "Valuing health states: A comparison of methods," Journal of Health Economics, Elsevier, vol. 15(2), pages 209-231, April.
    25. Araña, Jorge E. & León, Carmelo J. & Hanemann, Michael W., 2008. "Emotions and decision rules in discrete choice experiments for valuing health care programmes for the elderly," Journal of Health Economics, Elsevier, vol. 27(3), pages 753-769, May.
    26. Mandy Ryan & Angela Bate, 2001. "Testing the assumptions of rationality, continuity and symmetry when applying discrete choice experiments in health care," Applied Economics Letters, Taylor & Francis Journals, vol. 8(1), pages 59-63.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mandy Ryan & Mabelle Amaya‐Amaya, 2005. "‘Threats’ to and hopes for estimating benefits," Health Economics, John Wiley & Sons, Ltd., vol. 14(6), pages 609-619, June.
    2. Alessandro Mengoni & Chiara Seghieri & Sabina Nuti, 2013. "The application of discrete choice experiments in health economics: a systematic review of the literature," Working Papers 201301, Scuola Superiore Sant'Anna of Pisa, Istituto di Management.
    3. Alan Shiell & Lisa Gold, 2003. "If the price is right: vagueness and values clarification in contingent valuation," Health Economics, John Wiley & Sons, Ltd., vol. 12(11), pages 909-919, November.
    4. Fernando San Miguel & Mandy Ryan & Mabelle Amaya‐Amaya, 2005. "‘Irrational’ stated preferences: a quantitative and qualitative investigation," Health Economics, John Wiley & Sons, Ltd., vol. 14(3), pages 307-322, March.
    5. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    6. Semra Özdemir & Ateesha F. Mohamed & F. Reed Johnson & A. Brett Hauber, 2010. "Who pays attention in stated‐choice surveys?," Health Economics, John Wiley & Sons, Ltd., vol. 19(1), pages 111-118, January.
    7. Rulleau, Bénédicte & Dachary-Bernard, Jeanne, 2012. "Preferences, rational choices and economic valuation: Some empirical tests," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 41(2), pages 198-206.
    8. Jens Hougaard & Tue Tjur & Lars Østerdal, 2012. "On the meaningfulness of testing preference axioms in stated preference discrete choice experiments," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 13(4), pages 409-417, August.
    9. Emily Lancsar & Jordan Louviere, 2006. "Deleting ‘irrational’ responses from discrete choice experiments: a case of investigating or imposing preferences?," Health Economics, John Wiley & Sons, Ltd., vol. 15(8), pages 797-811, August.
    10. Schläpfer, Felix & Schmitt, Marcel & Roschewitz, Anna, 2008. "Competitive politics, simplified heuristics, and preferences for public goods," Ecological Economics, Elsevier, vol. 65(3), pages 574-589, April.
    11. Esther W. de Bekker‐Grob & Mandy Ryan & Karen Gerard, 2012. "Discrete choice experiments in health economics: a review of the literature," Health Economics, John Wiley & Sons, Ltd., vol. 21(2), pages 145-172, February.
    12. Stijn Van Puyvelde & Ralf Caers & Cind Du Bois & Marc Jegers, 2015. "Does organizational ownership matter? Objectives of employees in public, nonprofit and for-profit nursing homes," Applied Economics, Taylor & Francis Journals, vol. 47(24), pages 2500-2513, May.
    13. Nicolas Krucien & Verity Watson & Mandy Ryan, 2017. "Is Best–Worst Scaling Suitable for Health State Valuation? A Comparison with Discrete Choice Experiments," Health Economics, John Wiley & Sons, Ltd., vol. 26(12), pages 1-16, December.
    14. Neuman, Tzahi & Neuman, Einat & Neuman, Shoshana, 2010. "Explorations of the effect of experience on preferences for a health-care service," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 39(3), pages 407-419, June.
    15. Ladenburg, Jacob & Olsen, Søren Bøye, 2014. "Augmenting short Cheap Talk scripts with a repeated Opt-Out Reminder in Choice Experiment surveys," Resource and Energy Economics, Elsevier, vol. 37(C), pages 39-63.
    16. Hoyos, David, 2010. "The state of the art of environmental valuation with discrete choice experiments," Ecological Economics, Elsevier, vol. 69(8), pages 1595-1603, June.
    17. Schlapfer, Felix, 2008. "Contingent valuation: A new perspective," Ecological Economics, Elsevier, vol. 64(4), pages 729-740, February.
    18. Sebastian Heidenreich & Verity Watson & Mandy Ryan & Euan Phimister, 2018. "Decision heuristic or preference? Attribute non‐attendance in discrete choice problems," Health Economics, John Wiley & Sons, Ltd., vol. 27(1), pages 157-171, January.
    19. Chiara Seghieri & Alessandro Mengoni & Sabina Nuti, 2014. "Applying discrete choice modelling in a priority setting: an investigation of public preferences for primary care models," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 15(7), pages 773-785, September.
    20. Schwappach, David L.B. & Strasmann, Thomas J., 2006. ""Quick and dirty numbers"?: The reliability of a stated-preference technique for the measurement of preferences for resource allocation," Journal of Health Economics, Elsevier, vol. 25(3), pages 432-448, May.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:hlthec:v:18:y:2009:i:3:p:321-336. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/5749 .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/5749 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.