A comparison of partial profile designs for discrete choice experiments with an application in software development
In a discrete choice experiment, each respondent chooses the best product or service sequentially from many groups or choice sets of alternative goods. The alternatives, called profiles, are described by level combinations from a set of predefined attributes. Respondents sometimes make their choices on the basis of only one dominant attribute rather than making trade-offs among all the attributes. For example, in studies involving price as an attribute, respondents may always choose the profile with the lowest price. Also, a choice task including many attributes may encourage respondent decisions that are not fully compensatory. To thwart these behaviors, the investigator can hold the levels of some of the attributes constant in every choice set. The resulting designs are called partial profile designs. In this paper, we construct D-optimal partial profile designs for estimating main-effects models. We use a Bayesian design algorithm that integrates the D-optimality criterion over a prior distribution of likely parameter values. To determine the constant attributes in each choice set, we provide three alternative generalizations of an approach that makes use of balanced incomplete block designs. Each of our three generalizations constructs partial profile designs accommodating attributes with any number of levels and allowing flexibility in the numbers of choice sets and constant attributes. We show results from an actual experiment in software development performed using one of these algorithms. Finally, we compare the algorithms with respect to their statistical efficiency and ability to avoid failures due to the presence of a dominant attribute.
|Date of creation:||Feb 2012|
|Date of revision:|
|Contact details of provider:|| Postal: Prinsstraat 13, B-2000 Antwerpen|
Web page: https://www.uantwerp.be/en/faculties/applied-economic-sciences/
More information through EDIRC
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Zsolt Sándor & Michel Wedel, 2002. "Profile Construction in Experimental Choice Designs for Mixed Logit Models," Marketing Science, INFORMS, vol. 21(4), pages 455-475, February.
- Jie Yu & Peter Goos & Martina Vandebroek, 2009. "Efficient Conjoint Choice Designs in the Presence of Respondent Heterogeneity," Marketing Science, INFORMS, vol. 28(1), pages 122-135, 01-02.
- Scott, Anthony, 2002. "Identifying and analysing dominant preferences in discrete choice experiments: An application in health care," Journal of Economic Psychology, Elsevier, vol. 23(3), pages 383-398, June.
- Kessels, Roselinde & Goos, Peter & Vandebroek, Martina, 2008. "Optimal designs for conjoint experiments," Computational Statistics & Data Analysis, Elsevier, vol. 52(5), pages 2369-2387, January.
- DeShazo, J. R. & Fermo, German, 2002. "Designing Choice Sets for Stated Preference Methods: The Effects of Complexity on Choice Consistency," Journal of Environmental Economics and Management, Elsevier, vol. 44(1), pages 123-143, July.
- Swait, Joffre & Adamowicz, Wiktor, 2001.
"Choice Environment, Market Complexity, and Consumer Behavior: A Theoretical and Empirical Approach for Incorporating Decision Complexity into Models of Consumer Choice,"
Organizational Behavior and Human Decision Processes,
Elsevier, vol. 86(2), pages 141-167, November.
- Swait, Joffre & Adamowicz, Wiktor L., 1999. "Choice Environment, Market Complexity and Consumer Behavior: A Theoretical and Empirical Approach for Incorporating Decision Complexity into Models of Consumer Choice," Staff Paper Series 24093, University of Alberta, Department of Resource Economics and Environmental Sociology.
- Hensher, David A. & Rose, John M., 2009. "Simplifying choice through attribute preservation or non-attendance: Implications for willingness to pay," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 45(4), pages 583-590, July.
- Bliemer, Michiel C.J. & Rose, John M., 2010. "Construction of experimental designs for mixed logit models allowing for correlation across choice observations," Transportation Research Part B: Methodological, Elsevier, vol. 44(6), pages 720-734, July.
- Yu, Jie & Goos, Peter & Vandebroek, Martina, 2010. "Comparing different sampling schemes for approximating the integrals involved in the efficient design of stated choice experiments," Transportation Research Part B: Methodological, Elsevier, vol. 44(10), pages 1268-1289, December.
- Kessels, Roselinde & Jones, Bradley & Goos, Peter & Vandebroek, Martina, 2009. "An Efficient Algorithm for Constructing Bayesian Optimal Choice Designs," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(2), pages 279-291.
- Ferrini, Silvia & Scarpa, Riccardo, 2007. "Designs with a priori information for nonmarket valuation with choice experiments: A Monte Carlo study," Journal of Environmental Economics and Management, Elsevier, vol. 53(3), pages 342-363, May.
When requesting a correction, please mention this item's handle: RePEc:ant:wpaper:2012004. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Joeri Nys)
If references are entirely missing, you can add them using this form.