IDEAS home Printed from https://ideas.repec.org/a/wly/hlthec/v26y2017i6p810-817.html
   My bibliography  Save this article

Discrete Choice Experiment Response Rates: A Meta‐analysis

Author

Listed:
  • Verity Watson
  • Frauke Becker
  • Esther de Bekker‐Grob

Abstract

This paper uses meta‐regression analysis to test how aspects of discrete choice experiment (DCE) study design influence survey response rates. DCEs are a survey‐based method used to elicit preferences for health and health care and are prone to survey errors of coverage, sampling, non‐response and measurement. However, research on DCE response rates is lacking. Our analysis is motivated by a social exchange theory of survey response. We find that DCE response rates are related to the survey's cognitive burden and the relevance to the surveyed population. Copyright © 2016 John Wiley & Sons, Ltd.

Suggested Citation

  • Verity Watson & Frauke Becker & Esther de Bekker‐Grob, 2017. "Discrete Choice Experiment Response Rates: A Meta‐analysis," Health Economics, John Wiley & Sons, Ltd., vol. 26(6), pages 810-817, June.
  • Handle: RePEc:wly:hlthec:v:26:y:2017:i:6:p:810-817
    DOI: 10.1002/hec.3354
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/hec.3354
    Download Restriction: no

    File URL: https://libkey.io/10.1002/hec.3354?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Lancsar, Emily & Louviere, Jordan & Donaldson, Cam & Currie, Gillian & Burgess, Leonie, 2013. "Best worst discrete choice experiments in health: Methods and an application," Social Science & Medicine, Elsevier, vol. 76(C), pages 74-82.
    2. Emily Lancsar & Jordan Louviere, 2008. "Conducting Discrete Choice Experiments to Inform Healthcare Decision Making," PharmacoEconomics, Springer, vol. 26(8), pages 661-677, August.
    3. Nick Hanley & Mandy Ryan & Robert Wright, 2003. "Estimating the monetary value of health care: lessons from environmental economics," Health Economics, John Wiley & Sons, Ltd., vol. 12(1), pages 3-16, January.
    4. DeShazo, J. R. & Fermo, German, 2002. "Designing Choice Sets for Stated Preference Methods: The Effects of Complexity on Choice Consistency," Journal of Environmental Economics and Management, Elsevier, vol. 44(1), pages 123-143, July.
    5. Swait, Joffre & Adamowicz, Wiktor, 2001. "The Influence of Task Complexity on Consumer Choice: A Latent Class Model of Decision Strategy Switching," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 28(1), pages 135-148, June.
    6. repec:ebl:ecbull:v:3:y:2004:i:6:p:1-13 is not listed on IDEAS
    7. Hammitt, James K & Graham, John D, 1999. "Willingness to Pay for Health Protection: Inadequate Sensitivity to Probability?," Journal of Risk and Uncertainty, Springer, vol. 18(1), pages 33-62, April.
    8. Özdemir, Semra & Johnson, F. Reed & Hauber, A. Brett, 2009. "Hypothetical bias, cheap talk, and stated willingness to pay for health care," Journal of Health Economics, Elsevier, vol. 28(4), pages 894-901, July.
    9. Mandy Ryan & Karen Gerard & Gillian Currie, 2012. "Using Discrete Choice Experiments in Health Economics," Chapters, in: Andrew M. Jones (ed.), The Elgar Companion to Health Economics, Second Edition, chapter 41, Edward Elgar Publishing.
    10. Esther W. de Bekker‐Grob & Mandy Ryan & Karen Gerard, 2012. "Discrete choice experiments in health economics: a review of the literature," Health Economics, John Wiley & Sons, Ltd., vol. 21(2), pages 145-172, February.
    11. Barrio, Melina & Loureiro, Maria L., 2010. "A meta-analysis of contingent valuation forest studies," Ecological Economics, Elsevier, vol. 69(5), pages 1023-1030, March.
    12. Francis Asenso‐Boadi & Tim J. Peters & Joanna Coast, 2008. "Exploring differences in empirical time preference rates for health: an application of meta‐regression," Health Economics, John Wiley & Sons, Ltd., vol. 17(2), pages 235-248, February.
    13. Mandy Ryan & Sarah Wordsworth, 2000. "Sensitivity of Willingness to Pay Estimates to the Level of Attributes in Discrete Choice Experiments," Scottish Journal of Political Economy, Scottish Economic Society, vol. 47(5), pages 504-524, November.
    14. Marisa J. Mazzotta & James J. Opaluch, 1995. "Decision Making When Choices Are Complex: A Test of Heiner's Hypothesis," Land Economics, University of Wisconsin Press, vol. 71(4), pages 500-515.
    15. John List & Craig Gallet, 2001. "What Experimental Protocol Influence Disparities Between Actual and Hypothetical Stated Values?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 20(3), pages 241-254, November.
    16. Mark Harrison & Dan Rigby & Caroline Vass & Terry Flynn & Jordan Louviere & Katherine Payne, 2014. "Risk as an Attribute in Discrete Choice Experiments: A Systematic Review of the Literature," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 7(2), pages 151-170, June.
    17. Mickael Bech & Trine Kjaer & Jørgen Lauridsen, 2011. "Does the number of choice sets matter? Results from a web survey applying a discrete choice experiment," Health Economics, John Wiley & Sons, Ltd., vol. 20(3), pages 273-286, March.
    18. Jon Nelson & Peter Kennedy, 2009. "The Use (and Abuse) of Meta-Analysis in Environmental and Natural Resource Economics: An Assessment," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 42(3), pages 345-377, March.
    19. Ryan, Mandy & Wordsworth, Sarah, 2000. "Sensitivity of Willingness to Pay Estimates to the Level of Attributes in Discrete Choice Experiments," Scottish Journal of Political Economy, Scottish Economic Society, vol. 47(5), pages 504-524, November.
    20. Joseph Little & Robert Berrens, 2004. "Explaining Disparities between Actual and Hypothetical Stated Values: Further Investigation Using Meta-Analysis," Economics Bulletin, AccessEcon, vol. 3(6), pages 1-13.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. de Bresser, Jochem & Knoef, Marike & van Ooijen, Raun, 2022. "Preferences for in-kind and in-cash home care insurance," Journal of Health Economics, Elsevier, vol. 84(C).
    2. Caplan, Arthur J. & Akhundjanov, Sherzod B. & Toll, Kristopher, 2021. "Measuring heterogeneous preferences for residential amenities," Regional Science and Urban Economics, Elsevier, vol. 87(C).
    3. Eva Crespo-Cebada & Carlos Díaz-Caro & María Teresa Nevado Gil & Ángel Sabino Mirón Sanguino, 2020. "Does Water Pollution Influence Willingness to Accept the Installation of a Mine Near a City? Case Study of an Open-Pit Lithium Mine," Sustainability, MDPI, vol. 12(24), pages 1-13, December.
    4. Koşar, Gizem & Ransom, Tyler & van der Klaauw, Wilbert, 2022. "Understanding migration aversion using elicited counterfactual choice probabilities," Journal of Econometrics, Elsevier, vol. 231(1), pages 123-147.
    5. Marcel F. Jonker & Bas Donkers & Esther de Bekker‐Grob & Elly A. Stolk, 2019. "Attribute level overlap (and color coding) can reduce task complexity, improve choice consistency, and decrease the dropout rate in discrete choice experiments," Health Economics, John Wiley & Sons, Ltd., vol. 28(3), pages 350-363, March.
    6. Arntz, Melanie & Brüll, Eduard & Lipowski, Cäcilia, 2021. "Do preferences for urban amenities really differ by skill?," ZEW Discussion Papers 21-045, ZEW - Leibniz Centre for European Economic Research.
    7. Jorien Veldwijk & Rachael Lynn DiSantostefano & Ellen Janssen & Gwenda Simons & Matthias Englbrecht & Karin Schölin Bywall & Christine Radawski & Karim Raza & Brett Hauber & Marie Falahee, 2023. "Maximum Acceptable Risk Estimation Based on a Discrete Choice Experiment and a Probabilistic Threshold Technique," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 16(6), pages 641-653, November.
    8. de Bekker-Grob, E.W. & Donkers, B. & Bliemer, M.C.J. & Veldwijk, J. & Swait, J.D., 2020. "Can healthcare choice be predicted using stated preference data?," Social Science & Medicine, Elsevier, vol. 246(C).
    9. Kevin Marsh & Nicolas Krucien, 2022. "Evaluating the Consistency of Patient Preference Estimates: Systematic Variation in Survival—Adverse Event Trade-Offs in Patients with Cancer or Cardiovascular Disease," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 15(1), pages 69-75, January.
    10. Verity Watson & Terry Porteous & Tim Bolt & Mandy Ryan, 2019. "Mode and Frame Matter: Assessing the Impact of Survey Mode and Sample Frame in Choice Experiments," Medical Decision Making, , vol. 39(7), pages 827-841, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mamine, Fateh & Fares, M'hand & Minviel, Jean Joseph, 2020. "Contract Design for Adoption of Agrienvironmental Practices: A Meta-analysis of Discrete Choice Experiments," Ecological Economics, Elsevier, vol. 176(C).
    2. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    3. Buckell, John & Hess, Stephane, 2019. "Stubbing out hypothetical bias: improving tobacco market predictions by combining stated and revealed preference data," Journal of Health Economics, Elsevier, vol. 65(C), pages 93-102.
    4. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part I. Macro-scale analysis of literature and integrative synthesis of empirical evidence from applied economics, experimental psychology and neuroimag," Journal of choice modelling, Elsevier, vol. 41(C).
    5. Alessandro Mengoni & Chiara Seghieri & Sabina Nuti, 2013. "The application of discrete choice experiments in health economics: a systematic review of the literature," Working Papers 201301, Scuola Superiore Sant'Anna of Pisa, Istituto di Management.
    6. Mickael Bech & Trine Kjaer & Jørgen Lauridsen, 2011. "Does the number of choice sets matter? Results from a web survey applying a discrete choice experiment," Health Economics, John Wiley & Sons, Ltd., vol. 20(3), pages 273-286, March.
    7. Matthew Quaife & Fern Terris-Prestholt & Gian Luca Di Tanna & Peter Vickerman, 2018. "How well do discrete choice experiments predict health choices? A systematic review and meta-analysis of external validity," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 19(8), pages 1053-1066, November.
    8. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part II. Conceptualisation of external validity, sources and explanations of bias and effectiveness of mitigation methods," Journal of choice modelling, Elsevier, vol. 41(C).
    9. Nicolas Krucien & Jonathan Sicsic & Mandy Ryan, 2019. "For better or worse? Investigating the validity of best–worst discrete choice experiments in health," Health Economics, John Wiley & Sons, Ltd., vol. 28(4), pages 572-586, April.
    10. Mesfin G. Genie & Mandy Ryan & Nicolas Krucien, 2023. "Keeping an eye on cost: What can eye tracking tell us about attention to cost information in discrete choice experiments?," Health Economics, John Wiley & Sons, Ltd., vol. 32(5), pages 1101-1119, May.
    11. Genie, Mesfin G. & Ryan, Mandy & Krucien, Nicolas, 2021. "To pay or not to pay? Cost information processing in the valuation of publicly funded healthcare," Social Science & Medicine, Elsevier, vol. 276(C).
    12. Sever, Ivan & Verbič, Miroslav & Klarić Sever, Eva, 2019. "Cost attribute in health care DCEs: Just adding another attribute or a trigger of change in the stated preferences?," Journal of choice modelling, Elsevier, vol. 32(C), pages 1-1.
    13. Allen, S. & Goddard, E., 2018. "The Effectiveness of High Sugar Warning Labels on Breakfast Cereals," 2018 Conference, July 28-August 2, 2018, Vancouver, British Columbia 275885, International Association of Agricultural Economists.
    14. Mandy Ryan & Nicolas Krucien & Frouke Hermens, 2018. "The eyes have it: Using eye tracking to inform information processing strategies in multi‐attributes choices," Health Economics, John Wiley & Sons, Ltd., vol. 27(4), pages 709-721, April.
    15. Samare P. I. Huls & Emily Lancsar & Bas Donkers & Jemimah Ride, 2022. "Two for the price of one: If moving beyond traditional single‐best discrete choice experiments, should we use best‐worst, best‐best or ranking for preference elicitation?," Health Economics, John Wiley & Sons, Ltd., vol. 31(12), pages 2630-2647, December.
    16. Haghani, Milad & Bliemer, Michiel C.J. & Hensher, David A., 2021. "The landscape of econometric discrete choice modelling research," Journal of choice modelling, Elsevier, vol. 40(C).
    17. Mandeville, Kate L. & Ulaya, Godwin & Lagarde, Mylène & Muula, Adamson S. & Dzowela, Titha & Hanson, Kara, 2016. "The use of specialty training to retain doctors in Malawi: A discrete choice experiment," Social Science & Medicine, Elsevier, vol. 169(C), pages 109-118.
    18. Nicolas Krucien & Verity Watson & Mandy Ryan, 2017. "Is Best–Worst Scaling Suitable for Health State Valuation? A Comparison with Discrete Choice Experiments," Health Economics, John Wiley & Sons, Ltd., vol. 26(12), pages 1-16, December.
    19. Frauke Becker & Nana Anokye & Esther W de Bekker-Grob & Ailish Higgins & Clare Relton & Mark Strong & Julia Fox-Rushby, 2018. "Women’s preferences for alternative financial incentive schemes for breastfeeding: A discrete choice experiment," PLOS ONE, Public Library of Science, vol. 13(4), pages 1-19, April.
    20. Fifer, Simon & Rose, John M., 2016. "Can you ever be certain? Reducing hypothetical bias in stated choice experiments via respondent reported choice certaintyAuthor-Name: Beck, Matthew J," Transportation Research Part B: Methodological, Elsevier, vol. 89(C), pages 149-167.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:hlthec:v:26:y:2017:i:6:p:810-817. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/5749 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.