IDEAS home Printed from https://ideas.repec.org/a/wly/hlthec/v32y2023i6p1284-1304.html
   My bibliography  Save this article

Comparison of a full and partial choice set design in a labeled discrete choice experiment

Author

Listed:
  • Thao Thai
  • Michiel Bliemer
  • Gang Chen
  • Jean Spinks
  • Sonja de New
  • Emily Lancsar

Abstract

Labeled discrete choice experiments (DCEs) commonly present all alternatives using a full choice set design (FCSD), which could impose a high cognitive burden on respondents. In the setting of employment preferences, this study explored if a partial choice set design (PCSD) reduced cognitive burden whilst maintaining convergent validity compared with a FCSD. Respondents' preferences between the two designs were investigated. In the experimental design, labeled utility functions were rewritten into a single generic utility function using label dummy variables to generate an efficient PCSD with 3 alternatives shown in each choice task (out of 6). The DCE was embedded in a nationwide survey of 790 Australian pharmacy degree holders where respondents were presented with both a block of FCSD and PCSD tasks in random order. The PCSD's impact on error variances was investigated using a heteroscedastic conditional logit model. The convergent validity of PCSD was based on the equality of willingness‐to‐forgo‐expected‐salary estimates from Willingness‐to‐pay‐space mixed logit models. A nested logit model was used combined with respondents' qualitative responses to understand respondents' design preferences. We show a promising future use of PCSD by providing evidence that PCSD can reduce cognitive burden while satisfying convergent validity compared to FCSD.

Suggested Citation

  • Thao Thai & Michiel Bliemer & Gang Chen & Jean Spinks & Sonja de New & Emily Lancsar, 2023. "Comparison of a full and partial choice set design in a labeled discrete choice experiment," Health Economics, John Wiley & Sons, Ltd., vol. 32(6), pages 1284-1304, June.
    • Handle: RePEc:wly:hlthec:v:32:y:2023:i:6:p:1284-1304
    DOI: 10.1002/hec.4666
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/hec.4666
    Download Restriction: no
    File URL: https://libkey.io/10.1002/hec.4666?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Hess, Stephane & Train, Kenneth, 2017. "Correlation and scale in mixed logit models," Journal of choice modelling, Elsevier, vol. 23(C), pages 1-8.
    2. DeShazo, J. R. & Fermo, German, 2002. "Designing Choice Sets for Stated Preference Methods: The Effects of Complexity on Choice Consistency," Journal of Environmental Economics and Management, Elsevier, vol. 44(1), pages 123-143, July.
    3. Blake, Miranda R. & Lancsar, Emily & Peeters, Anna & Backholer, Kathryn, 2019. "Sugar-sweetened beverage price elasticities in a hypothetical convenience store," Social Science & Medicine, Elsevier, vol. 225(C), pages 98-107.
    4. Swait, Joffre & Adamowicz, Wiktor, 2001. "The Influence of Task Complexity on Consumer Choice: A Latent Class Model of Decision Strategy Switching," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 28(1), pages 135-148, June.
    5. Campbell, Danny & Mørkbak, Morten Raun & Olsen, Søren Bøye, 2018. "The link between response time and preference, variance and processing heterogeneity in stated choice experiments," Journal of Environmental Economics and Management, Elsevier, vol. 88(C), pages 18-34.
    6. Hess, Stephane & Stathopoulos, Amanda, 2013. "Linking response quality to survey engagement: A combined random scale and latent variable approach," Journal of choice modelling, Elsevier, vol. 7(C), pages 1-12.
    7. Verelst, Frederik & Willem, Lander & Kessels, Roselinde & Beutels, Philippe, 2018. "Individual decisions to vaccinate one's child or oneself: A discrete choice experiment rejecting free-riding motives," Social Science & Medicine, Elsevier, vol. 207(C), pages 106-116.
    8. Caussade, Sebastián & Ortúzar, Juan de Dios & Rizzi, Luis I. & Hensher, David A., 2005. "Assessing the influence of design dimensions on stated choice experiment estimates," Transportation Research Part B: Methodological, Elsevier, vol. 39(7), pages 621-640, August.
    9. Vikas Soekhai & Esther W. Bekker-Grob & Alan R. Ellis & Caroline M. Vass, 2019. "Discrete Choice Experiments in Health Economics: Past, Present and Future," PharmacoEconomics, Springer, vol. 37(2), pages 201-226, February.
    10. Cristiano Franceschinis & Riccardo Scarpa & Mara Thiene & John Rose & Michele Moretto & Raffaele Cavalli, 2016. "Exploring the Spatial Heterogeneity of Individual Preferences for Ambient Heating Systems," Energies, MDPI, vol. 9(6), pages 1-19, May.
    11. Stephane Hess & John Rose, 2012. "Can scale and coefficient heterogeneity be separated in random coefficients models?," Transportation, Springer, vol. 39(6), pages 1225-1239, November.
    12. Franceschinis, Cristiano & Thiene, Mara & Scarpa, Riccardo & Rose, John & Moretto, Michele & Cavalli, Raffaele, 2017. "Adoption of renewable heating systems: An empirical test of the diffusion of innovation theory," Energy, Elsevier, vol. 125(C), pages 313-326.
    13. Mickael Bech & Trine Kjaer & Jørgen Lauridsen, 2011. "Does the number of choice sets matter? Results from a web survey applying a discrete choice experiment," Health Economics, John Wiley & Sons, Ltd., vol. 20(3), pages 273-286, March.
    14. Richard C. Bishop & Kevin J. Boyle, 2019. "Reliability and Validity in Nonmarket Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 72(2), pages 559-582, February.
    15. Bliemer, Michiel C.J. & Rose, John M., 2013. "Confidence intervals of willingness-to-pay for random coefficient logit models," Transportation Research Part B: Methodological, Elsevier, vol. 58(C), pages 199-214.
    16. Jui-Chen Yang & Shelby D. Reed & Steve Hass & Mark B. Skeen & F. Reed Johnson, 2021. "Is Easier Better Than Harder? An Experiment on Choice Experiments for Benefit-Risk Tradeoff Preferences," Medical Decision Making, , vol. 41(2), pages 222-232, February.
    17. Laura Cornelsen & Matthew Quaife & Mylene Lagarde & Richard D. Smith, 2020. "Framing and signalling effects of taxes on sugary drinks: A discrete choice experiment among households in Great Britain," Health Economics, John Wiley & Sons, Ltd., vol. 29(10), pages 1132-1147, October.
    18. Jordan J. Louviere & Towhidul Islam & Nada Wasi & Deborah Street & Leonie Burgess, 2008. "Designing Discrete Choice Experiments: Do Optimal Designs Come at a Price?," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 35(2), pages 360-375, March.
    19. Marcel F. Jonker & Bas Donkers & Esther de Bekker‐Grob & Elly A. Stolk, 2019. "Attribute level overlap (and color coding) can reduce task complexity, improve choice consistency, and decrease the dropout rate in discrete choice experiments," Health Economics, John Wiley & Sons, Ltd., vol. 28(3), pages 350-363, March.
    20. Cornelsen, Laura & Quaife, Matthew & Lagarde, Mylene & Smith, Richard D., 2020. "Framing and signalling effects of taxes on sugary drinks: a discrete choice experiment among households in Great Britain," LSE Research Online Documents on Economics 105777, London School of Economics and Political Science, LSE Library.
    21. Rosalie Viney & Elizabeth Savage & Jordan Louviere, 2005. "Empirical investigation of experimental design properties of discrete choice experiments in health care," Health Economics, John Wiley & Sons, Ltd., vol. 14(4), pages 349-362, April.
    22. Caroline M. Vass & Marco Boeri, 2021. "Mobilising the Next Generation of Stated-Preference Studies: the Association of Access Device with Choice Behaviour and Data Quality," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 14(1), pages 55-63, January.
    23. Richard R. Batsell & John C. Polking, 1985. "A New Class of Market Share Models," Marketing Science, INFORMS, vol. 4(3), pages 177-198.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marcel F. Jonker & Bas Donkers & Esther de Bekker‐Grob & Elly A. Stolk, 2019. "Attribute level overlap (and color coding) can reduce task complexity, improve choice consistency, and decrease the dropout rate in discrete choice experiments," Health Economics, John Wiley & Sons, Ltd., vol. 28(3), pages 350-363, March.
    2. Elizabeth Kinter & Thomas Prior & Christopher Carswell & John Bridges, 2012. "A Comparison of Two Experimental Design Approaches in Applying Conjoint Analysis in Patient-Centered Outcomes Research," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 5(4), pages 279-294, December.
    3. Tobias Börger & Oliver Frör & Sören Weiß, 2017. "The relationship between perceived difficulty and randomness in discrete choice experiments: Investigating reasons for and consequences of difficulty," Discussion Papers in Environment and Development Economics 2017-03, University of St. Andrews, School of Geography and Sustainable Development.
    4. Weng, Weizhe & Morrison, Mark & Boyle, Kevin J. & Boxall, Peter C., 2017. "The effect of the number of alternatives in choice experiment questions," 2017 Annual Meeting, July 30-August 1, Chicago, Illinois 259179, Agricultural and Applied Economics Association.
    5. Yang, Jui-Chen & Johnson, F. Reed & Kilambi, Vikram & Mohamed, Ateesha F., 2015. "Sample size and utility-difference precision in discrete-choice experiments: A meta-simulation approach," Journal of choice modelling, Elsevier, vol. 16(C), pages 50-57.
    6. Weng, Weizhe & Morrison, Mark D. & Boyle, Kevin J. & Boxall, Peter C. & Rose, John, 2021. "Effects of the number of alternatives in public good discrete choice experiments," Ecological Economics, Elsevier, vol. 182(C).
    7. Sever, Ivan & Verbič, Miroslav & Klarić Sever, Eva, 2019. "Cost attribute in health care DCEs: Just adding another attribute or a trigger of change in the stated preferences?," Journal of choice modelling, Elsevier, vol. 32(C), pages 1-1.
    8. Mamine, Fateh & Fares, M'hand & Minviel, Jean Joseph, 2020. "Contract Design for Adoption of Agrienvironmental Practices: A Meta-analysis of Discrete Choice Experiments," Ecological Economics, Elsevier, vol. 176(C).
    9. Fraser, Iain & Balcombe, Kelvin & Williams, Louis & McSorley, Eugene, 2021. "Preference stability in discrete choice experiments. Some evidence using eye-tracking," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 94(C).
    10. Jürgen Meyerhoff & Malte Oehlmann & Priska Weller, 2015. "The Influence of Design Dimensions on Stated Choices in an Environmental Context," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 61(3), pages 385-407, July.
    11. Regier, Dean A. & Watson, Verity & Burnett, Heather & Ungar, Wendy J., 2014. "Task complexity and response certainty in discrete choice experiments: An application to drug treatments for juvenile idiopathic arthritis," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 50(C), pages 40-49.
    12. Moser, Riccarda & Raffaelli, Roberta, 2014. "Does attribute cut-off elicitation affect choice consistency? Contrasting hypothetical and real-money choice experiments," Journal of choice modelling, Elsevier, vol. 11(C), pages 16-29.
    13. Samare P. I. Huls & Emily Lancsar & Bas Donkers & Jemimah Ride, 2022. "Two for the price of one: If moving beyond traditional single‐best discrete choice experiments, should we use best‐worst, best‐best or ranking for preference elicitation?," Health Economics, John Wiley & Sons, Ltd., vol. 31(12), pages 2630-2647, December.
    14. Enni Ruokamo & Mikołaj Czajkowski & Nick Hanley & Artti Juutinen & Rauli Svento, 2016. "Linking perceived choice complexity with scale heterogeneity in discrete choice experiments: home heating in Finland," Working Papers 2016-30, Faculty of Economic Sciences, University of Warsaw.
    15. Fifer, Simon & Rose, John M., 2016. "Can you ever be certain? Reducing hypothetical bias in stated choice experiments via respondent reported choice certaintyAuthor-Name: Beck, Matthew J," Transportation Research Part B: Methodological, Elsevier, vol. 89(C), pages 149-167.
    16. Marsh, Dan & Phillips, Yvonne, 2012. "Difficult Choices: What Influences the Error Variance in a Choice Experiment," 2012 Conference, August 31, 2012, Nelson, New Zealand 139651, New Zealand Agricultural and Resource Economics Society.
    17. Emily Lancsar & Jordan Louviere, 2008. "Conducting Discrete Choice Experiments to Inform Healthcare Decision Making," PharmacoEconomics, Springer, vol. 26(8), pages 661-677, August.
    18. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    19. Regier, Dean A. & Sicsic, Jonathan & Watson, Verity, 2019. "Choice certainty and deliberative thinking in discrete choice experiments. A theoretical and empirical investigation," Journal of Economic Behavior & Organization, Elsevier, vol. 164(C), pages 235-255.
    20. Ivan Tzintzun & Jonathan Sicsic & Lise Rochaix, 2023. "Into the Far West? Investigating Health Policy-Makers' Willingness to Adopt Decrementally Cost-Effective Innovations Using a DCE Approach," PSE Working Papers halshs-04154933, HAL.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:hlthec:v:32:y:2023:i:6:p:1284-1304. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/5749 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.