IDEAS home Printed from https://ideas.repec.org/a/wly/hlthec/v24y2015i8p951-965.html
   My bibliography  Save this article

Empirical Testing of the External Validity of a Discrete Choice Experiment to Determine Preferred Treatment Option: The Case of Sleep Apnea

Author

Listed:
  • Nicolas Krucien
  • Amiram Gafni
  • Nathalie Pelletier‐Fleury

Abstract

There is an increasing use of the discrete choice experiment (DCE) method in health care to estimate preferences of individuals and the public for different services. Despite this increasing use, there are few studies that investigate the validity of the DCE in health. This study investigates the external validity of DCE by comparing the predicted treatment choices from the DCE to the actual treatment choices made by the same respondents using a decision board (DB) approach. The sample includes 140 patients who came for a sleep apnea routine visit in a hospital setting. Each respondent answered 10 DCE tasks and 1 DB task. The preferences were estimated with a generalized multinomial logit model and the predicted and actual treatment choices were compared both at the sample and individual levels. The results raise questions about the external validity of DCE in health. At the sample level, the comparison showed large but not significant differences between the two methods. This can be explained in part by the aggregation process that obscures variability in the individuals’ preferences. At the individual level, the comparison showed that the two methods led to significantly different patterns of choices. Copyright © 2014 John Wiley & Sons, Ltd.

Suggested Citation

  • Nicolas Krucien & Amiram Gafni & Nathalie Pelletier‐Fleury, 2015. "Empirical Testing of the External Validity of a Discrete Choice Experiment to Determine Preferred Treatment Option: The Case of Sleep Apnea," Health Economics, John Wiley & Sons, Ltd., vol. 24(8), pages 951-965, August.
    • Handle: RePEc:wly:hlthec:v:24:y:2015:i:8:p:951-965
    DOI: 10.1002/hec.3076
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/hec.3076
    Download Restriction: no
    File URL: https://libkey.io/10.1002/hec.3076?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Paul Slovic, 1993. "Perceived Risk, Trust, and Democracy," Risk Analysis, John Wiley & Sons, vol. 13(6), pages 675-682, December.
    2. David Revelt and Kenneth Train., 2000. "Customer-Specific Taste Parameters and Mixed Logit: Households' Choice of Electricity Supplier," Economics Working Papers E00-274, University of California at Berkeley.
    3. Hudson, Darren & Gallardo, Rosa Karina & Hanson, Terrill R., 2012. "A Comparison Of Choice Experiments And Actual Grocery Store Behavior: An Empirical Application To Seafood Products," Journal of Agricultural and Applied Economics, Southern Agricultural Economics Association, vol. 44(1), pages 1-14, February.
    4. Marjon van der Pol & Shiell, Alan & Au, Flora & Johnston, David & Tough, Suzanne, 2008. "Convergent validity between a discrete choice experiment and a direct, open-ended method: Comparison of preferred attribute levels and willingness to pay estimates," Social Science & Medicine, Elsevier, vol. 67(12), pages 2043-2050, December.
    5. Emily Lancsar & Jordan Louviere, 2008. "Conducting Discrete Choice Experiments to Inform Healthcare Decision Making," PharmacoEconomics, Springer, vol. 26(8), pages 661-677, August.
    6. Day, Brett & Pinto Prades, Jose-Luis, 2010. "Ordering anomalies in choice experiments," Journal of Environmental Economics and Management, Elsevier, vol. 59(3), pages 271-285, May.
    7. K. G. Mäler & J. R. Vincent (ed.), 2005. "Handbook of Environmental Economics," Handbook of Environmental Economics, Elsevier, edition 1, volume 3, number 3.
    8. DeShazo, J. R. & Fermo, German, 2002. "Designing Choice Sets for Stated Preference Methods: The Effects of Complexity on Choice Consistency," Journal of Environmental Economics and Management, Elsevier, vol. 44(1), pages 123-143, July.
    9. Denise Bijlenga & Gouke J. Bonsel & Erwin Birnie, 2011. "Eliciting willingness to pay in obstetrics: comparing a direct and an indirect valuation method for complex health outcomes," Health Economics, John Wiley & Sons, Ltd., vol. 20(11), pages 1392-1406, November.
    10. Louviere,Jordan J. & Hensher,David A. & Swait,Joffre D. With contributions by-Name:Adamowicz,Wiktor, 2000. "Stated Choice Methods," Cambridge Books, Cambridge University Press, number 9780521788304, October.
    11. Mandy Ryan & Karen Gerard & Gillian Currie, 2012. "Using Discrete Choice Experiments in Health Economics," Chapters, in: Andrew M. Jones (ed.), The Elgar Companion to Health Economics, Second Edition, chapter 41, Edward Elgar Publishing.
    12. Bettman, James R & Luce, Mary Frances & Payne, John W, 1998. "Constructive Consumer Choice Processes," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 25(3), pages 187-217, December.
    13. Esther W. de Bekker‐Grob & Mandy Ryan & Karen Gerard, 2012. "Discrete choice experiments in health economics: a review of the literature," Health Economics, John Wiley & Sons, Ltd., vol. 21(2), pages 145-172, February.
    14. Mandy Ryan & Verity Watson, 2009. "Comparing welfare estimates from payment card contingent valuation and discrete choice experiments," Health Economics, John Wiley & Sons, Ltd., vol. 18(4), pages 389-401, April.
    15. John Rose & Michiel Bliemer, 2013. "Sample size requirements for stated choice experiments," Transportation, Springer, vol. 40(5), pages 1021-1041, September.
    16. Richard Carson & Theodore Groves, 2007. "Incentive and informational properties of preference questions," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 37(1), pages 181-210, May.
    17. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521747387, October.
    18. Dan Ariely & George Loewenstein & Drazen Prelec, 2003. ""Coherent Arbitrariness": Stable Demand Curves Without Stable Preferences," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(1), pages 73-106.
    19. Stirling Bryan & Paul Dolan, 2004. "Discrete choice experiments in health economics," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 5(3), pages 199-202, September.
    20. Charles, Cathy & Gafni, Amiram & Whelan, Tim, 1997. "Shared decision-making in the medical encounter: What does it mean? (or it takes at least two to tango)," Social Science & Medicine, Elsevier, vol. 44(5), pages 681-692, March.
    21. Andrew J Lloyd, 2003. "Threats to the estimation of benefit: are preference elicitation methods accurate?," Health Economics, John Wiley & Sons, Ltd., vol. 12(5), pages 393-402, May.
    22. Timothy J. Gilbride & Greg M. Allenby, 2004. "A Choice Model with Conjunctive, Disjunctive, and Compensatory Screening Rules," Marketing Science, INFORMS, vol. 23(3), pages 391-406, October.
    23. Vernon L. Smith, 2003. "Constructivist and Ecological Rationality in Economics," American Economic Review, American Economic Association, vol. 93(3), pages 465-508, June.
    24. Day, Brett & Bateman, Ian J. & Carson, Richard T. & Dupont, Diane & Louviere, Jordan J. & Morimoto, Sanae & Scarpa, Riccardo & Wang, Paul, 2012. "Ordering effects and choice set awareness in repeat-response stated preference studies," Journal of Environmental Economics and Management, Elsevier, vol. 63(1), pages 73-91.
    25. Kelvin J. Lancaster, 1966. "A New Approach to Consumer Theory," Journal of Political Economy, University of Chicago Press, vol. 74(2), pages 132-132.
    26. Yuanyuan Gu & Arne Risa Hole & Stephanie Knox, 2013. "Fitting the generalized multinomial logit model in Stata," Stata Journal, StataCorp LP, vol. 13(2), pages 382-397, June.
    27. Trine Kjær & Mickael Bech & Dorte Gyrd‐Hansen & Kristian Hart‐Hansen, 2006. "Ordering effect and price sensitivity in discrete choice experiments: need we worry?," Health Economics, John Wiley & Sons, Ltd., vol. 15(11), pages 1217-1228, November.
    28. Harry Telser & Peter Zweifel, 2007. "Validity of discrete-choice experiments evidence for health risk reduction," Applied Economics, Taylor & Francis Journals, vol. 39(1), pages 69-78.
    29. Araña, Jorge E. & León, Carmelo J. & Hanemann, Michael W., 2008. "Emotions and decision rules in discrete choice experiments for valuing health care programmes for the elderly," Journal of Health Economics, Elsevier, vol. 27(3), pages 753-769, May.
    30. Gregory L. Poe & Kelly L. Giraud & John B. Loomis, 2005. "Computational Methods for Measuring the Difference of Empirical Distributions," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 87(2), pages 353-365.
    31. Stirling Bryan & Lisa Gold & Rob Sheldon & Martin Buxton, 2000. "Preference measurement using conjoint methods: an empirical investigation of reliability," Health Economics, John Wiley & Sons, Ltd., vol. 9(5), pages 385-395, July.
    32. Gafni, Amiram & Birch, Stephen, 1995. "Preferences for outcomes in economic evaluation: An economic approach to addressing economic problems," Social Science & Medicine, Elsevier, vol. 40(6), pages 767-776, March.
    33. Riccarda Moser & Roberta Raffaelli & Sandra Notaro, 2014. "Testing hypothetical bias with a real choice experiment using respondents' own money," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 41(1), pages 25-46, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Marcel F. Jonker & Bas Donkers & Esther de Bekker‐Grob & Elly A. Stolk, 2019. "Attribute level overlap (and color coding) can reduce task complexity, improve choice consistency, and decrease the dropout rate in discrete choice experiments," Health Economics, John Wiley & Sons, Ltd., vol. 28(3), pages 350-363, March.
    2. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part I. Macro-scale analysis of literature and integrative synthesis of empirical evidence from applied economics, experimental psychology and neuroimag," Journal of choice modelling, Elsevier, vol. 41(C).
    3. John C. Whitehead & Daniel K. Lew, 2020. "Estimating recreation benefits through joint estimation of revealed and stated preference discrete choice data," Empirical Economics, Springer, vol. 58(4), pages 2009-2029, April.
    4. Pedersen, Line Bjørnskov & Hess, Stephane & Kjær, Trine, 2016. "Asymmetric information and user orientation in general practice: Exploring the agency relationship in a best–worst scaling study," Journal of Health Economics, Elsevier, vol. 50(C), pages 115-130.
    5. Werbeck, Anna, 2024. "Stated preferences and actual choices in german health insurance," Ruhr Economic Papers 1091, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    6. Sydenham, Rikke Vognbjerg & Jarbøl, Dorte Ejg & Hansen, Malene Plejdrup & Justesen, Ulrik Stenz & Watson, Verity & Pedersen, Line Bjørnskov, 2022. "Prescribing antibiotics: Factors driving decision-making in general practice. A discrete choice experiment," Social Science & Medicine, Elsevier, vol. 305(C).
    7. Vikas Soekhai & Esther W. Bekker-Grob & Alan R. Ellis & Caroline M. Vass, 2019. "Discrete Choice Experiments in Health Economics: Past, Present and Future," PharmacoEconomics, Springer, vol. 37(2), pages 201-226, February.
    8. Matthew Quaife & Fern Terris-Prestholt & Gian Luca Di Tanna & Peter Vickerman, 2018. "How well do discrete choice experiments predict health choices? A systematic review and meta-analysis of external validity," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 19(8), pages 1053-1066, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    2. Alessandro Mengoni & Chiara Seghieri & Sabina Nuti, 2013. "The application of discrete choice experiments in health economics: a systematic review of the literature," Working Papers 201301, Scuola Superiore Sant'Anna of Pisa, Istituto di Management.
    3. Haghani, Milad & Bliemer, Michiel C.J. & Hensher, David A., 2021. "The landscape of econometric discrete choice modelling research," Journal of choice modelling, Elsevier, vol. 40(C).
    4. Emily Lancsar & Peter Burge, 2014. "Choice modelling research in health economics," Chapters, in: Stephane Hess & Andrew Daly (ed.), Handbook of Choice Modelling, chapter 28, pages 675-687, Edward Elgar Publishing.
    5. Sever, Ivan & Verbič, Miroslav & Klarić Sever, Eva, 2019. "Cost attribute in health care DCEs: Just adding another attribute or a trigger of change in the stated preferences?," Journal of choice modelling, Elsevier, vol. 32(C), pages 1-1.
    6. Hoyos, David, 2010. "The state of the art of environmental valuation with discrete choice experiments," Ecological Economics, Elsevier, vol. 69(8), pages 1595-1603, June.
    7. Mandy Ryan & Nicolas Krucien & Frouke Hermens, 2018. "The eyes have it: Using eye tracking to inform information processing strategies in multi‐attributes choices," Health Economics, John Wiley & Sons, Ltd., vol. 27(4), pages 709-721, April.
    8. Pierre-Alexandre Mahieu & Henrik Andersson & Olivier Beaumais & Romain Crastes & François-Charles Wolff, 2014. "Is Choice Experiment Becoming more Popular than Contingent Valuation? A Systematic Review in Agriculture, Environment and Health," Working Papers 2014.12, FAERE - French Association of Environmental and Resource Economists.
    9. Mesfin G. Genie & Nicolas Krucien & Mandy Ryan, 2021. "Weighting or aggregating? Investigating information processing in multi‐attribute choices," Health Economics, John Wiley & Sons, Ltd., vol. 30(6), pages 1291-1305, June.
    10. Axel Mühlbacher & Uwe Junker & Christin Juhnke & Edgar Stemmler & Thomas Kohlmann & Friedhelm Leverkus & Matthias Nübling, 2015. "Chronic pain patients’ treatment preferences: a discrete-choice experiment," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 16(6), pages 613-628, July.
    11. Mesfin G. Genie & Mandy Ryan & Nicolas Krucien, 2023. "Keeping an eye on cost: What can eye tracking tell us about attention to cost information in discrete choice experiments?," Health Economics, John Wiley & Sons, Ltd., vol. 32(5), pages 1101-1119, May.
    12. Genie, Mesfin G. & Ryan, Mandy & Krucien, Nicolas, 2021. "To pay or not to pay? Cost information processing in the valuation of publicly funded healthcare," Social Science & Medicine, Elsevier, vol. 276(C).
    13. Mahieu, Pierre-Alexandre & Andersson, Henrik & Beaumais, Olivier & Crastes dit Sourd, Romain & Hess, François-Charles & Wolff, François-Charles, 2017. "Stated preferences: a unique database composed of 1657 recent published articles in journals related to agriculture, environment, or health," Review of Agricultural, Food and Environmental Studies, Institut National de la Recherche Agronomique (INRA), vol. 98(3), November.
    14. Nguyen, Thanh Cong & Le, Hoa Thu & Nguyen, Hang Dieu & Ngo, Mai Thanh & Nguyen, Hong Quang, 2021. "Examining ordering effects and strategic behaviour in a discrete choice experiment," Economic Analysis and Policy, Elsevier, vol. 70(C), pages 394-413.
    15. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part I. Macro-scale analysis of literature and integrative synthesis of empirical evidence from applied economics, experimental psychology and neuroimag," Journal of choice modelling, Elsevier, vol. 41(C).
    16. Day, Brett & Bateman, Ian J. & Carson, Richard T. & Dupont, Diane & Louviere, Jordan J. & Morimoto, Sanae & Scarpa, Riccardo & Wang, Paul, 2012. "Ordering effects and choice set awareness in repeat-response stated preference studies," Journal of Environmental Economics and Management, Elsevier, vol. 63(1), pages 73-91.
    17. Krucien, Nicolas & Ryan, Mandy & Hermens, Frouke, 2017. "Visual attention in multi-attributes choices: What can eye-tracking tell us?," Journal of Economic Behavior & Organization, Elsevier, vol. 135(C), pages 251-267.
    18. Nicolas Krucien & Verity Watson & Mandy Ryan, 2017. "Is Best–Worst Scaling Suitable for Health State Valuation? A Comparison with Discrete Choice Experiments," Health Economics, John Wiley & Sons, Ltd., vol. 26(12), pages 1-16, December.
    19. Hoyos Ramos, David, 2010. "Using discrete choice experiments for environmental valuation," BILTOKI 1134-8984, Universidad del País Vasco - Departamento de Economía Aplicada III (Econometría y Estadística).
    20. West, Grant H. & Snell, Heather & Kovacs, Kent & Nayga, Rodolfo M., 2020. "Estimation of the preferences for the intertemporal services from groundwater," 2020 Annual Meeting, July 26-28, Kansas City, Missouri 304220, Agricultural and Applied Economics Association.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:hlthec:v:24:y:2015:i:8:p:951-965. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/5749 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.