Not bored yet – Revisiting respondent fatigue in stated choice experiments
Stated choice surveys are used extensively in the study of choice behaviour across many different areas of research, notably in transport. One of their main characteristics in comparison with most types of revealed preference (RP) surveys is the ability to capture behaviour by the same respondent under varying choice scenarios. While this ability to capture multiple choices is generally seen as an advantage, there is a certain amount of unease about survey length. The precise definition about what constitutes a large number of choice tasks however varies across disciplines, and it is not uncommon to see surveys with up to twenty tasks per respondent in some areas. The argument against this practice has always been one of reducing respondent engagement, which could be interpreted as a result of fatigue or boredom, with frequent reference to the findings of Bradley and Daly (1994) who showed a significant drop in utility scale, i.e. an increase in error, as a respondent moved from one choice experiment to the next, an effect they related to respondent fatigue. While the work by Bradley and Daly has become a standard reference in this context, it should be recognised that not only was the fatigue part of the work based on a single dataset, but the state-of-the-art and the state-of-practice in stated choice survey design and implementation has moved on significantly since their study. In this paper, we review other literature and present a more comprehensive study investigating evidence of respondent fatigue across a larger number of different surveys. Using a comprehensive testing framework employing both Logit and mixed Logit structures, we provide strong evidence that the concerns about fatigue in the literature are possibly overstated, with no clear decreasing trend in scale across choice tasks in any of our studies. For the data sets tested, we find that accommodating any scale heterogeneity has little or no impact on substantive model results, that the role of constants generally decreases as the survey progresses, and that there is evidence of significant attribute level (as opposed to scale) heterogeneity across choice tasks.
Volume (Year): 46 (2012)
Issue (Month): 3 ()
|Contact details of provider:|| Web page: http://www.elsevier.com/wps/find/journaldescription.cws_home/547/description#description|
|Order Information:|| Postal: http://www.elsevier.com/wps/find/supportfaq.cws_home/regional|
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Mogens Fosgerau, 2004.
"Investigating the distribution of the value of travel time savings,"
- Fosgerau, Mogens, 2006. "Investigating the distribution of the value of travel time savings," Transportation Research Part B: Methodological, Elsevier, vol. 40(8), pages 688-707, September.
- Mogens Fosgerau, 2004. "Investigating the distribution of the value of travel time savings," Urban/Regional 0410005, EconWPA, revised 25 Nov 2004.
- Bateman, Ian J. & Burgess, Diane & Hutchinson, W. George & Matthews, David I., 2008. "Learning design contingent valuation (LDCV): NOAA guidelines, preference learning and coherent arbitrariness," Journal of Environmental Economics and Management, Elsevier, vol. 55(2), pages 127-141, March.
- Scott J. Savage & Donald M. Waldman, 2008. "Learning and fatigue during choice experiments: a comparison of online and mail survey modes," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(3), pages 351-371.
- Arne Risa Hole, 2003.
"Forecasting the demand for an employee Park and Ride service using commuters’ stated choices,"
0312002, EconWPA, revised 12 Apr 2004.
- Risa Hole, Arne, 2004. "Forecasting the demand for an employee Park and Ride service using commuters' stated choices," Transport Policy, Elsevier, vol. 11(4), pages 355-362, October.
- Thomas P. Holmes & Kevin J. Boyle, 2005. "Dynamic Learning and Context-Dependence in Sequential, Attribute-Based, Stated-Preference Valuation Questions," Land Economics, University of Wisconsin Press, vol. 81(1).
- Caussade, Sebastián & Ortúzar, Juan de Dios & Rizzi, Luis I. & Hensher, David A., 2005. "Assessing the influence of design dimensions on stated choice experiment estimates," Transportation Research Part B: Methodological, Elsevier, vol. 39(7), pages 621-640, August.
- Nick Hanley & Robert Wright & Gary Koop, 2002. "Modelling Recreation Demand Using Choice Experiments: Climbing in Scotland," Environmental & Resource Economics, European Association of Environmental and Resource Economists, vol. 22(3), pages 449-466, July.
- Wiktor Adamowicz & Peter Boxall & Michael Williams & Jordan Louviere, 1998. "Stated Preference Approaches for Measuring Passive Use Values: Choice Experiments and Contingent Valuation," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 80(1), pages 64-75.
- Roy Brouwer & Thijs Dekker & John Rolfe & Jill Windle, 2010. "Choice Certainty and Consistency in Repeated Choice Experiments," Environmental & Resource Economics, European Association of Environmental and Resource Economists, vol. 46(1), pages 93-109, May.
- Guilkey, David K. & Murphy, James L., 1993. "Estimation and testing in the random effects probit model," Journal of Econometrics, Elsevier, vol. 59(3), pages 301-317, October.
- Mickael Bech & Trine Kjaer & Jørgen Lauridsen, 2011. "Does the number of choice sets matter? Results from a web survey applying a discrete choice experiment," Health Economics, John Wiley & Sons, Ltd., vol. 20(3), pages 273-286, March.
- Hu, Wuyang, 2006. "Effects of Endogenous Task Complexity and the Endowed Bundle on Stated Choice," 2006 Annual meeting, July 23-26, Long Beach, CA 21437, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
- Ladenburg, Jacob & Olsen, Søren Bøye, 2008. "Gender-specific starting point bias in choice experiments: Evidence from an empirical study," Journal of Environmental Economics and Management, Elsevier, vol. 56(3), pages 275-285, November.
When requesting a correction, please mention this item's handle: RePEc:eee:transa:v:46:y:2012:i:3:p:626-644. See general information about how to correct material in RePEc.
If references are entirely missing, you can add them using this form.