Hierarchical Bayes Conjoint Analysis: Recovery of Partworth Heterogeneity from Reduced Experimental Designs
AbstractThe drive to satisfy customers in narrowly defined market segments has led firms to offer wider arrays of products and services. Delivering products and services with the appropriate mix of features for these highly fragmented market segments requires understanding the value that customers place on these features. Conjoint analysis endeavors to unravel the value or partworths, that customers place on the product or service's attributes from experimental subjects' evaluation of profiles based on hypothetical products or services. When the goal is to estimate the heterogeneity in the customers' partworths, traditional estimation methods, such as least squares, require each subject to respond to more profiles than product attributes, resulting in lengthy questionnaires for complex, multiattributed products or services. Long questionnaires pose practical and theoretical problems. Response rates tend to decrease with increasing questionnaire length, and more importantly, academic evidence indicates that long questionnaires may induce response biases. The problems associated with long questionnaires call for experimental designs and estimation methods that recover the heterogeneity in the partworths with shorter questionnaires. Unlike more popular estimation methods, Hierarchical Bayes (HB) random effects models do not require that individual-level design matrices be of full rank, which leads to the possibility of using fewer profiles per subject than currently used. Can this theoretical possibility be practically implemented? This paper tests this conjecture with empirical studies and mathematical analysis. The random effects model in the paper describes the heterogeneity in subject-level partworths or regression coefficients with a linear model that can include subject-level covariates. In addition, the error variances are specific to the subjects, thus allowing for the differential use of the measurement scale by different subjects. In the empirical study, subjects' responses to a full profile design are randomly deleted to test the performance of HB methods with declining sample sizes. These simple experiments indicate that HB methods can recover heterogeneity and estimate individual-level partworths, even when individual-level least squares estimators do not exist due to insufficient degrees of freedom. Motivated by these empirical studies, the paper analytically investigates the trade-off between the number of profiles per subject and the number of subjects on the statistical accuracy of the estimators that describe the partworth heterogeneity. The paper considers two experimental designs: each subject receives the same set of profiles, and subjects receive different blocks of a fractional factorial design. In the first case, the optimal design, subject to a budget constraint, uses more subjects and fewer profiles per subject when the ratio of unexplained, partworth heterogeneity to unexplained response variance is large. In the second case, one can maintain a given level of estimation accuracy as the number of profiles per subject decreases by increasing the number of subjects assigned to each block. These results provide marketing researchers the option of using shorter questionnaires for complex products or services. The analysis assumes that response quality is independent of questionnaire length and does not address the impact of design factors on response quality. If response quality and questionnaire length were, in fact, unrelated, then marketing researchers would still find the paper's results useful in improving the efficiency of their conjoint designs. However, if response quality were to decline with questionnaire length, as the preponderance of academic research indicates, then the option to use shorter questionnaires would become even more valuable.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoArticle provided by INFORMS in its journal Marketing Science.
Volume (Year): 15 (1996)
Issue (Month): 2 ()
consumer preferences; multi-attributed models; consumer research;
You can help add them by filling out this form.
CitEc Project, subscribe to its RSS feed for this item.
- Crabbe, M. & Vandebroek, M., 2012. "Improving the efficiency of individualized designs for the mixed logit choice model by including covariates," Computational Statistics & Data Analysis, Elsevier, vol. 56(6), pages 2059-2072.
- Terry Elrod & Gerald Häubl & Steven Tipps, 2012. "Parsimonious Structural Equation Models for Repeated Measures Data, with Application to the Study of Consumer Preferences," Psychometrika, Springer, vol. 77(2), pages 358-387, April.
- Allenby, Greg M. & Rossi, Peter E., 1998. "Marketing models of consumer heterogeneity," Journal of Econometrics, Elsevier, vol. 89(1-2), pages 57-78, November.
- KESSELS, Roselinde & JONES, Bradley & GOOS, Peter, 2013. "An argument for preferring Firth bias-adjusted estimates in aggregate and individual-level discrete choice modeling," Working Papers 2013013, University of Antwerp, Faculty of Applied Economics.
- Oded Netzer & Olivier Toubia & Eric Bradlow & Ely Dahan & Theodoros Evgeniou & Fred Feinberg & Eleanor Feit & Sam Hui & Joseph Johnson & John Liechty & James Orlin & Vithala Rao, 2008. "Beyond conjoint analysis: Advances in preference measurement," Marketing Letters, Springer, vol. 19(3), pages 337-354, December.
- John Liechty & Duncan Fong & Eelko Huizingh & Arnaud Bruyn, 2008. "Hierarchical Bayesian conjoint models incorporating measurement uncertainty," Marketing Letters, Springer, vol. 19(2), pages 141-155, June.
- Lüthi, Sonja & Prässler, Thomas, 2011. "Analyzing policy support instruments and regulatory risk factors for wind energy deployment--A developers' perspective," Energy Policy, Elsevier, vol. 39(9), pages 4876-4892, September.
- Lüthi, Sonja & Wüstenhagen, Rolf, 2012. "The price of policy risk — Empirical insights from choice experiments with European photovoltaic project developers," Energy Economics, Elsevier, vol. 34(4), pages 1001-1011.
- Huber, Joel & Train, Kenneth, 2000.
"On the Similarity of Classical and Bayesian Estimates of Individual Mean Partworths,"
Department of Economics, Working Paper Series
qt7zm4f51b, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
- Joel Huber & Kenneth Train, 2001. "On the Similarity of Classical and Bayesian Estimates of Individual Mean Partworths," Econometrics 0012003, EconWPA.
- Joel Huber and Kenneth Train., 2000. "On the Similarity of Classical and Bayesian Estimates of Individual Mean Partworths," Economics Working Papers E00-289, University of California at Berkeley.
- Natter, Martin & Feurstein, Markus, 2002. "Real world performance of choice-based conjoint models," European Journal of Operational Research, Elsevier, vol. 137(2), pages 448-458, March.
- Qing Liu & Angela Dean & David Bakken & Greg Allenby, 2009. "Studying the level-effect in conjoint analysis: An application of efficient experimental designs for hyper-parameter estimation," Quantitative Marketing and Economics, Springer, vol. 7(1), pages 69-93, March.
- DeSarbo, Wayne S. & Kim, Youngchan & Wedel, Michel & Fong, Duncan K. H., 1998. "A Bayesian approach to the spatial representation of market structure from consumer choice data," European Journal of Operational Research, Elsevier, vol. 111(2), pages 285-305, December.
- Halme, Merja & Kallio, Markku, 2011. "Estimation methods for choice-based conjoint analysis of consumer preferences," European Journal of Operational Research, Elsevier, vol. 214(1), pages 160-167, October.
- B. P. S. Murthi & Sumit Sarkar, 2003. "The Role of the Mangement Sciences in Research on Personalization," Review of Marketing Science Working Papers 2-2-1025, Berkeley Electronic Press.
- Robert Zeithammer & Peter Lenk, 2006. "Bayesian estimation of multivariate-normal models when dimensions are absent," Quantitative Marketing and Economics, Springer, vol. 4(3), pages 241-265, September.
- Park, Chan Su, 2004. "The robustness of hierarchical Bayes conjoint analysis under alternative measurement scales," Journal of Business Research, Elsevier, vol. 57(10), pages 1092-1097, October.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Mirko Janc).
If references are entirely missing, you can add them using this form.