IDEAS home Printed from https://ideas.repec.org/a/eee/soceco/v50y2014icp40-49.html
   My bibliography  Save this article

Task complexity and response certainty in discrete choice experiments: An application to drug treatments for juvenile idiopathic arthritis

Author

Listed:
  • Regier, Dean A.
  • Watson, Verity
  • Burnett, Heather
  • Ungar, Wendy J.

Abstract

Responding to a stated preference discrete choice experiment (DCE) is a complex task for respondents to undertake. Task complexity can induce response error, thereby decreasing the statistical precision of the econometric model. This study explores the link between task complexity and statistical precision as moderated by the level of thoughtful deliberation respondents exert when completing choice tasks. To do this, we make novel use of subjects’ certainty of response to DCE tasks as a measure of their deliberation. The distinction between intuitive and deliberate thought (System 1 and System 2, respectively) motivates how task complexity will differentially affect System 1 and System 2 respondents. The principle of utility balance in experimental design theory is used to understand how greater deliberation will increase task complexity, but will also improve statistical precision if respondents are engaging in System 2 processing. Our analyses find that increases in choice task utility balance decreases response certainty, and re-weighting the regression to favor respondents who are more uncertain of their choices increases the statistical precision of the econometric model.

Suggested Citation

  • Regier, Dean A. & Watson, Verity & Burnett, Heather & Ungar, Wendy J., 2014. "Task complexity and response certainty in discrete choice experiments: An application to drug treatments for juvenile idiopathic arthritis," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 50(C), pages 40-49.
    • Handle: RePEc:eee:soceco:v:50:y:2014:i:c:p:40-49
    DOI: 10.1016/j.socec.2014.02.009
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S221480431400038X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.socec.2014.02.009?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Loomis, John & Ekstrand, Earl, 1998. "Alternative approaches for incorporating respondent uncertainty when estimating willingness to pay: the case of the Mexican spotted owl," Ecological Economics, Elsevier, vol. 27(1), pages 29-41, October.
    2. Small, Kenneth A & Rosen, Harvey S, 1981. "Applied Welfare Economics with Discrete Choice Models," Econometrica, Econometric Society, vol. 49(1), pages 105-130, January.
    3. San Miguel, Fernando & Ryan, Mandy & Scott, Anthony, 2002. "Are preferences stable? The case of health care," Journal of Economic Behavior & Organization, Elsevier, vol. 48(1), pages 1-14, May.
    4. Özdemir, Semra & Johnson, F. Reed & Hauber, A. Brett, 2009. "Hypothetical bias, cheap talk, and stated willingness to pay for health care," Journal of Health Economics, Elsevier, vol. 28(4), pages 894-901, July.
    5. Dickie, Mark & Messman, Victoria L., 2004. "Parental altruism and the value of avoiding acute illness: are kids worth more than parents?," Journal of Environmental Economics and Management, Elsevier, vol. 48(3), pages 1146-1174, November.
    6. Karen Blumenschein & Glenn C. Blomquist & Magnus Johannesson & Nancy Horn & Patricia Freeman, 2008. "Eliciting Willingness to Pay Without Bias: Evidence from a Field Experiment," Economic Journal, Royal Economic Society, vol. 118(525), pages 114-137, January.
    7. Andrew J Lloyd, 2003. "Threats to the estimation of benefit: are preference elicitation methods accurate?," Health Economics, John Wiley & Sons, Ltd., vol. 12(5), pages 393-402, May.
    8. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521766555.
    9. Mickael Bech & Trine Kjaer & Jørgen Lauridsen, 2011. "Does the number of choice sets matter? Results from a web survey applying a discrete choice experiment," Health Economics, John Wiley & Sons, Ltd., vol. 20(3), pages 273-286, March.
    10. Kelvin J. Lancaster, 1966. "A New Approach to Consumer Theory," Journal of Political Economy, University of Chicago Press, vol. 74(2), pages 132-132.
    11. Jin‐Tan Liu & James K. Hammitt & Jung‐Der Wang & Jin‐Long Liu, 2000. "Mother's willingness to pay for her own and her child's health: a contingent valuation study in Taiwan," Health Economics, John Wiley & Sons, Ltd., vol. 9(4), pages 319-326, June.
    12. Swait, Joffre & Adamowicz, Wiktor, 2001. "Choice Environment, Market Complexity, and Consumer Behavior: A Theoretical and Empirical Approach for Incorporating Decision Complexity into Models of Consumer Choice," Organizational Behavior and Human Decision Processes, Elsevier, vol. 86(2), pages 141-167, November.
    13. H. I. Brunner & D. Maker & B. Grundland & N. L. Young & V. Blanchette & A-M. Stain & B. M. Feldman, 2003. "Preference-Based Measurement of Health-Related Quality of Life (HRQL) in Children with Chronic Musculoskeletal Disorders (MSKDs)," Medical Decision Making, , vol. 23(4), pages 314-322, July.
    14. DeShazo, J. R. & Fermo, German, 2002. "Designing Choice Sets for Stated Preference Methods: The Effects of Complexity on Choice Consistency," Journal of Environmental Economics and Management, Elsevier, vol. 44(1), pages 123-143, July.
    15. Zsolt Sándor & Michel Wedel, 2002. "Profile Construction in Experimental Choice Designs for Mixed Logit Models," Marketing Science, INFORMS, vol. 21(4), pages 455-475, February.
    16. Li Chuan-Zhong & Mattsson Leif, 1995. "Discrete Choice under Preference Uncertainty: An Improved Structural Model for Contingent Valuation," Journal of Environmental Economics and Management, Elsevier, vol. 28(2), pages 256-269, March.
    17. F. Reed Johnson & Ateesha F. Mohamed & Semra Özdemir & Deborah A. Marshall & Kathryn A. Phillips, 2011. "How does cost matter in health‐care discrete‐choice experiments?," Health Economics, John Wiley & Sons, Ltd., vol. 20(3), pages 323-330, March.
    18. Mandy Ryan & Verity Watson & Vikki Entwistle, 2009. "Rationalising the ‘irrational’: a think aloud study of discrete choice experiment responses," Health Economics, John Wiley & Sons, Ltd., vol. 18(3), pages 321-336, March.
    19. David A. Hensher, 2006. "How do respondents process stated choice experiments? Attribute consideration under varying information load," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(6), pages 861-878.
    20. Jordan J. Louviere & Towhidul Islam & Nada Wasi & Deborah Street & Leonie Burgess, 2008. "Designing Discrete Choice Experiments: Do Optimal Designs Come at a Price?," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 35(2), pages 360-375, March.
    21. Louviere, Jordan J, 2001. "What If Consumer Experiments Impact Variances as Well as Means? Response Variability as a Behavioral Phenomenon," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 28(3), pages 506-511, December.
    22. Rosalie Viney & Elizabeth Savage & Jordan Louviere, 2005. "Empirical investigation of experimental design properties of discrete choice experiments in health care," Health Economics, John Wiley & Sons, Ltd., vol. 14(4), pages 349-362, April.
    23. Søren Olsen & Thomas Lundhede & Jette Jacobsen & Bo Thorsen, 2011. "Tough and Easy Choices: Testing the Influence of Utility Difference on Stated Certainty-in-Choice in Choice Experiments," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 49(4), pages 491-510, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Webb, Edward J.D. & Hess, Stephane, 2021. "Joint modelling of choice and rating data: Theory and examples," Journal of choice modelling, Elsevier, vol. 40(C).
    2. Ladenburg, Jacob & Skotte, Maria, 2022. "Heterogeneity in willingness to pay for the location of offshore wind power development: An application of the willingness to pay space model," Energy, Elsevier, vol. 241(C).
    3. Audrezet, Alice & Parguel, Béatrice, 2018. "Using the Evaluative Space Grid to better capture manifest ambivalence in customer satisfaction surveys," Journal of Retailing and Consumer Services, Elsevier, vol. 43(C), pages 285-295.
    4. Krčál, Ondřej & Peer, Stefanie & Staněk, Rostislav & Karlínová, Bára, 2019. "Real consequences matter: Why hypothetical biases in the valuation of time persist even in controlled lab experiments," Economics of Transportation, Elsevier, vol. 20(C).
    5. Enni Ruokamo & Mikołaj Czajkowski & Nick Hanley & Artti Juutinen & Rauli Svento, 2016. "Linking perceived choice complexity with scale heterogeneity in discrete choice experiments: home heating in Finland," Working Papers 2016-30, Faculty of Economic Sciences, University of Warsaw.
    6. Alice Audrezet & Béatrice Parguel, 2017. "Designing measurement tools to improve fluency and certainty: The case of online customer satisfaction evaluation," Post-Print hal-01821838, HAL.
    7. Wan Norhidayah W Mohamad & Ken Willis & Neil Powe, 2019. "The Status Quo In Discrete Choice Experiments: Is It Relevant?," The Singapore Economic Review (SER), World Scientific Publishing Co. Pte. Ltd., vol. 65(02), pages 507-532, March.
    8. Balcombe, Kelvin & Fraser, Iain, 2024. "A Note on an Alternative Approach to Experimental Design of Lottery Prospects," MPRA Paper 119743, University Library of Munich, Germany.
    9. Lars Hultkrantz & Selen Savsin, 2018. "Is ‘referencing’ a remedy to hypothetical bias in value of time elicitation? Evidence from economic experiments," Transportation, Springer, vol. 45(6), pages 1827-1847, November.
    10. Fraser, Iain & Balcombe, Kelvin & Williams, Louis & McSorley, Eugene, 2021. "Preference stability in discrete choice experiments. Some evidence using eye-tracking," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 94(C).
    11. Regier, Dean A. & Sicsic, Jonathan & Watson, Verity, 2019. "Choice certainty and deliberative thinking in discrete choice experiments. A theoretical and empirical investigation," Journal of Economic Behavior & Organization, Elsevier, vol. 164(C), pages 235-255.
    12. Edward J. D. Webb & John O’Dwyer & David Meads & Paul Kind & Penny Wright, 2020. "Transforming discrete choice experiment latent scale values for EQ-5D-3L using the visual analogue scale," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 21(5), pages 787-800, July.
    13. Nian, Yefan & Gao, Zhifeng, 2020. "Information Treatment, Cognitive Load, and Attribute Attendance in Choice Experiments," 2020 Annual Meeting, July 26-28, Kansas City, Missouri 304315, Agricultural and Applied Economics Association.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    2. Regier, Dean A. & Sicsic, Jonathan & Watson, Verity, 2019. "Choice certainty and deliberative thinking in discrete choice experiments. A theoretical and empirical investigation," Journal of Economic Behavior & Organization, Elsevier, vol. 164(C), pages 235-255.
    3. Emily Lancsar & Jordan Louviere, 2008. "Conducting Discrete Choice Experiments to Inform Healthcare Decision Making," PharmacoEconomics, Springer, vol. 26(8), pages 661-677, August.
    4. Alessandro Mengoni & Chiara Seghieri & Sabina Nuti, 2013. "The application of discrete choice experiments in health economics: a systematic review of the literature," Working Papers 201301, Scuola Superiore Sant'Anna of Pisa, Istituto di Management.
    5. Ladenburg, Jacob & Olsen, Søren Bøye, 2014. "Augmenting short Cheap Talk scripts with a repeated Opt-Out Reminder in Choice Experiment surveys," Resource and Energy Economics, Elsevier, vol. 37(C), pages 39-63.
    6. Genie, Mesfin G. & Ryan, Mandy & Krucien, Nicolas, 2021. "To pay or not to pay? Cost information processing in the valuation of publicly funded healthcare," Social Science & Medicine, Elsevier, vol. 276(C).
    7. Elizabeth Kinter & Thomas Prior & Christopher Carswell & John Bridges, 2012. "A Comparison of Two Experimental Design Approaches in Applying Conjoint Analysis in Patient-Centered Outcomes Research," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 5(4), pages 279-294, December.
    8. Enni Roukamo & Mikolaj Czajkowski & Nick Hanley & A. Juutinen & R. Svento, 2016. "Linking perceived choice complexity with scale heterogeneity in discrete choice experiments: home heating in Finland," Discussion Papers in Environment and Development Economics 2016-16, University of St. Andrews, School of Geography and Sustainable Development.
    9. Fraser, Iain & Balcombe, Kelvin & Williams, Louis & McSorley, Eugene, 2021. "Preference stability in discrete choice experiments. Some evidence using eye-tracking," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 94(C).
    10. Mandy Ryan & Nicolas Krucien & Frouke Hermens, 2018. "The eyes have it: Using eye tracking to inform information processing strategies in multi‐attributes choices," Health Economics, John Wiley & Sons, Ltd., vol. 27(4), pages 709-721, April.
    11. Haghani, Milad & Bliemer, Michiel C.J. & Hensher, David A., 2021. "The landscape of econometric discrete choice modelling research," Journal of choice modelling, Elsevier, vol. 40(C).
    12. Ferrini, Silvia & Scarpa, Riccardo, 2007. "Designs with a priori information for nonmarket valuation with choice experiments: A Monte Carlo study," Journal of Environmental Economics and Management, Elsevier, vol. 53(3), pages 342-363, May.
    13. Mesfin G. Genie & Nicolas Krucien & Mandy Ryan, 2021. "Weighting or aggregating? Investigating information processing in multi‐attribute choices," Health Economics, John Wiley & Sons, Ltd., vol. 30(6), pages 1291-1305, June.
    14. Richard Yao & Riccardo Scarpa & John Rose & James Turner, 2015. "Experimental Design Criteria and Their Behavioural Efficiency: An Evaluation in the Field," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 62(3), pages 433-455, November.
    15. Esther W. de Bekker‐Grob & Mandy Ryan & Karen Gerard, 2012. "Discrete choice experiments in health economics: a review of the literature," Health Economics, John Wiley & Sons, Ltd., vol. 21(2), pages 145-172, February.
    16. Nicolas Krucien & Jonathan Sicsic & Mandy Ryan, 2019. "For better or worse? Investigating the validity of best–worst discrete choice experiments in health," Health Economics, John Wiley & Sons, Ltd., vol. 28(4), pages 572-586, April.
    17. Moser, Riccarda & Raffaelli, Roberta, 2011. "Exploiting cut-off information to incorporate context effect: a discrete choice experiment on small fruits in a Alpine region," 2011 International Congress, August 30-September 2, 2011, Zurich, Switzerland 114646, European Association of Agricultural Economists.
    18. Hoyos, David, 2010. "The state of the art of environmental valuation with discrete choice experiments," Ecological Economics, Elsevier, vol. 69(8), pages 1595-1603, June.
    19. Campbell, Danny & Hutchinson, W. George & Scarpa, Riccardo, 2006. "Lexicographic Preferences in Discrete Choice Experiments: Consequences on Individual-Specific Willingness to Pay Estimates," Sustainability Indicators and Environmental Valuation Working Papers 12224, Fondazione Eni Enrico Mattei (FEEM).
    20. Uggeldahl, Kennet & Jacobsen, Catrine & Lundhede, Thomas Hedemark & Olsen, Søren Bøye, 2016. "Choice certainty in Discrete Choice Experiments: Will eye tracking provide useful measures?," Journal of choice modelling, Elsevier, vol. 20(C), pages 35-48.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:soceco:v:50:y:2014:i:c:p:40-49. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/620175 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.