The first time is the hardest: A test of ordering effects in choice experiments
AbstractThis paper addresses the issue of ordering effects in choice experiments, and in particular how learning processes potentially affect respondents’ stated preferences in a sequence of choice sets. In a case study concerning food quality attributes of chicken breast filets, we find evidence of ordering effects in a sequence of 16 choice sets, where the last 8 choice sets are identical to the first 8. The overall preference structure is found to differ significantly between the two identical sequences of choice sets, and significant increases in marginal WTP are found for two out of four attributes. We find a reduction in the error variance for the last 8 choice sets relative to the first 8 choice sets. In particular, this difference is ascribed to the first choice set obtaining a significantly higher error variance than all succeeding choice sets, suggesting institutional learning rather than preference learning effects underlying the observed ordering effect. This is further supported by the fact that the differences in WTP become insignificant when removing the first choice set from the analysis. We find no evidence of fatigue, and we argue that our findings cannot be explained by starting point or strategic behavior effects.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by University of Gothenburg, Department of Economics in its series Working Papers in Economics with number 470.
Length: 21 pages
Date of creation: 11 Oct 2010
Date of revision:
Contact details of provider:
Postal: Department of Economics, School of Business, Economics and Law, University of Gothenburg, Box 640, SE 405 30 GÖTEBORG, Sweden
Phone: 031-773 10 00
Web page: http://www.handels.gu.se/econ/
More information through EDIRC
Choice Experiments; Fatigue; Learning; Ordering Effects; WTP;
Find related papers by JEL classification:
- C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior
This paper has been announced in the following NEP Reports:
- NEP-ALL-2010-10-23 (All new papers)
- NEP-DCM-2010-10-23 (Discrete Choice Models)
- NEP-EXP-2010-10-23 (Experimental Economics)
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Dan Ariely & George Loewenstein & Drazen Prelec, 2003. ""Coherent Arbitrariness": Stable Demand Curves Without Stable Preferences," The Quarterly Journal of Economics, MIT Press, vol. 118(1), pages 73-105, February.
- Day, Brett & Pinto Prades, Jose-Luis, 2010. "Ordering anomalies in choice experiments," Journal of Environmental Economics and Management, Elsevier, vol. 59(3), pages 271-285, May.
- Kenneth Train, 2003.
"Discrete Choice Methods with Simulation,"
Online economics textbooks,
SUNY-Oswego, Department of Economics, number emetr2.
- Carson, Richard T & Groves, Theodore, 2010.
"Incentive and Information Properties of Preference Questions,"
University of California at San Diego, Economics Working Paper Series
qt88d8644g, Department of Economics, UC San Diego.
- Richard Carson & Theodore Groves, 2007. "Incentive and informational properties of preference questions," Environmental & Resource Economics, European Association of Environmental and Resource Economists, vol. 37(1), pages 181-210, May.
- Ladenburg, Jacob & Olsen, Søren Bøye, 2008. "Gender-specific starting point bias in choice experiments: Evidence from an empirical study," Journal of Environmental Economics and Management, Elsevier, vol. 56(3), pages 275-285, November.
- Swait, Joffre & Adamowicz, Wiktor, 2001. " The Influence of Task Complexity on Consumer Choice: A Latent Class Model of Decision Strategy Switching," Journal of Consumer Research, University of Chicago Press, vol. 28(1), pages 135-48, June.
- Scott J. Savage & Donald M. Waldman, 2008. "Learning and fatigue during choice experiments: a comparison of online and mail survey modes," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(3), pages 351-371.
- Roy Brouwer & Thijs Dekker & John Rolfe & Jill Windle, 2010. "Choice Certainty and Consistency in Repeated Choice Experiments," Environmental & Resource Economics, European Association of Environmental and Resource Economists, vol. 46(1), pages 93-109, May.
- Dekker, T. & Koster, P.R. & Brouwer, R., 2012.
"Changing with the tide: Semi-parametric estimation of preference dynamics,"
Serie Research Memoranda
0005, VU University Amsterdam, Faculty of Economics, Business Administration and Econometrics.
- Thijs Dekker & Paul Koster & Roy Brouwer, 2013. "Changing with the Tide: Semi-Parametric Estimation of Preference Dynamics," Tinbergen Institute Discussion Papers 13-074/VIII, Tinbergen Institute.
- Mikołaj Czajkowski & Marek Giergiczny & William H. Greene, 2012. "Learning and Fatigue Effects Revisited. The Impact of Accounting for Unobservable Preference and Scale Heterogeneity on Perceived Ordering Effects in Multiple Choice Task Discrete Choice Experiments," Working Papers 2012-08, Faculty of Economic Sciences, University of Warsaw.
- Jacob L. Orquin & Martin P. Bagger & Simone Mueller Loose, 2013. "Learning affects top down and bottom up modulation of eye movements in decision making," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 8(6), pages 700-716, November.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Marie Andersson).
If references are entirely missing, you can add them using this form.