The Impact of Utility Balance and Endogeneity in Conjoint Analysis
AbstractAdaptive metric utility balance is at the heart of one of the most widely used and studied methods for conjoint analysis. We use formal models, simulations, and empirical data to suggest that adaptive metric utility balance leads to partworth estimates that are relatively biased—smaller partworths are upwardly biased relative to larger partworths. Such relative biases could lead to erroneous managerial decisions. Metric utility-balanced questions are also more likely to be inefficient and, in one empirical example, contrary to popular wisdom, lead to response errors that are at least as large as nonadaptive orthogonal questions. We demonstrate that this bias is because of endogeneity caused by a “winner’s curse.” Shrinkage estimates do not mitigate these biases. Combined with adaptive metric utility balance, shrinkage estimates of heterogeneous partworths are biased downward relative to homogeneous partworths. Although biases can affect managerial decisions, our data suggest that, empirically, biases and inefficiencies are of the order of response errors. We examine viable alternatives to metric utility balance that researchers can use without biases or inefficiencies to retain the desired properties of (1) individual-level adaptation and (2) challenging questions.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoArticle provided by INFORMS in its journal Marketing Science.
Volume (Year): 24 (2005)
Issue (Month): 3 (August)
conjoint analysis; efficient question design; adaptive question design; Internet market research; e-commerce; product development;
You can help add them by filling out this form.
CitEc Project, subscribe to its RSS feed for this item.
- Campbell, Danny & Doherty, Edel & Gibson, Vikki, 2011. "Choosing ‘buy none’ in food choice analysis: the role of utility balance," 85th Annual Conference, April 18-20, 2011, Warwick University, Coventry, UK 108951, Agricultural Economics Society.
- Srinivasan, V. "Seenu" & Netzer, Oded, 2007. "Adaptive Self-Explication of Multi-attribute Preferences," Research Papers 1979, Stanford University, Graduate School of Business.
- Gensler, Sonja & Hinz, Oliver & Skiera, Bernd & Theysohn, Sven, 2012. "Willingness-to-pay estimation with choice-based conjoint analysis: Addressing extreme response behavior with individually adapted designs," European Journal of Operational Research, Elsevier, vol. 219(2), pages 368-378.
- David Hensher & Sean Puckett & John Rose, 2007. "Extending stated choice analysis to recognise agent-specific attribute endogeneity in bilateral group negotiation and choice: a think piece," Transportation, Springer, vol. 34(6), pages 667-679, November.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Mirko Janc).
If references are entirely missing, you can add them using this form.