IDEAS home Printed from https://ideas.repec.org/p/feb/framed/00139.html
   My bibliography  Save this paper

Incentive-aligned conjoint analysis

Author

Listed:
  • Min Ding
  • Rajdeep Grewal
  • John Liechty

Abstract

Because most conjoint studies are conducted in hypothetical situations with no consumption consequences for the participants, the extent to which the studies are able to uncover "true" consumer preference structures is questionable. Experimental economics literature, with its emphasis on incentive alignment and hypothetical bias, suggests that more realistic incentive aligned studies will result in stronger out-of-sample predictive performance of actual purchase behaviors and provide better estimates of consumer preference structures than hypothetical studies. To test this hypothesis, the authors design an experiment with conventional (hypothetical) conditions and their parallel incentive-aligned counterparts. Using Chinese dinner specials as the context, the authors conducted a field experiment in a Chinese restaurant during dinnertime. The results provide strong evidence in favor of incentive-aligned choice conjoint analysis, in that incentive-aligned choice conjoint outperforms hypothetical choice conjoint in out-of-sample predictions (59% versus 26% for incentive-aligned choice conjoint and hypothetical choice conjoint, respectively for the top two choices). As expected, subjects in the incentive-aligned choice condition exhibit preference structures that are systematically different from the preference structures of subjects in the hypothetical condition. Most notably, the subjects in the incentive-aligned choice condition are more price sensitive and exhibit different heterogeneity patterns. To determine the robustness of these results, the authors conducted a second study that used snacks as the context and only considered the choice treatments. This study confirmed the results by again providing strong evidence in favor of incentive-aligned choice analysis in out-of-sample predictions (36% versus 16% for incentive-aligned choice conjoint and hypothetical choice conjoint, respectively for the top two choices). The results provide a strong motivation for conjoint practitioners to consider conducting their studies in realistic settings using incentive structures that require participants to live with their decisions.

Suggested Citation

  • Min Ding & Rajdeep Grewal & John Liechty, 2005. "Incentive-aligned conjoint analysis," Framed Field Experiments 00139, The Field Experiments Website.
  • Handle: RePEc:feb:framed:00139
    as

    Download full text from publisher

    File URL: http://s3.amazonaws.com/fieldexperiments-papers2/papers/00139.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Smith, Vernon L & Walker, James M, 1993. "Monetary Rewards and Decision Cost in Experimental Economics," Economic Inquiry, Western Economic Association International, vol. 31(2), pages 245-261, April.
    2. Camerer, Colin F & Hogarth, Robin M, 1999. "The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework," Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 7-42, December.
    3. Green, Paul E & Srinivasan, V, 1978. "Conjoint Analysis in Consumer Research: Issues and Outlook," Journal of Consumer Research, Oxford University Press, vol. 5(2), pages 103-123, Se.
    4. List, John A & Shogren, Jason F, 1998. "The Deadweight Loss of Christmas: Comment," American Economic Review, American Economic Association, vol. 88(5), pages 1350-1355, December.
    5. Peter A. Diamond & Jerry A. Hausman, 1994. "Contingent Valuation: Is Some Number Better than No Number?," Journal of Economic Perspectives, American Economic Association, vol. 8(4), pages 45-64, Fall.
    6. Starmer, Chris & Sugden, Robert, 1991. "Does the Random-Lottery Incentive System Elicit True Preferences? An Experimental Investigation," American Economic Review, American Economic Association, vol. 81(4), pages 971-978, September.
    7. Paul E. Green & Abba M. Krieger & Yoram Wind, 2001. "Thirty Years of Conjoint Analysis: Reflections and Prospects," Interfaces, INFORMS, vol. 31(3_supplem), pages 56-73, June.
    8. Peter J. Lenk & Wayne S. DeSarbo & Paul E. Green & Martin R. Young, 1996. "Hierarchical Bayes Conjoint Analysis: Recovery of Partworth Heterogeneity from Reduced Experimental Designs," Marketing Science, INFORMS, vol. 15(2), pages 173-191.
    9. John A. List, 2001. "Do Explicit Warnings Eliminate the Hypothetical Bias in Elicitation Procedures? Evidence from Field Auctions for Sportscards," American Economic Review, American Economic Association, vol. 91(5), pages 1498-1507, December.
    10. Smith, Vernon L, 1976. "Experimental Economics: Induced Value Theory," American Economic Review, American Economic Association, vol. 66(2), pages 274-279, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Anna Bassi & Kenneth C. Williams, 2014. "Examining Monotonicity and Saliency Using Level- k Reasoning in a Voting Game," Games, MDPI, vol. 5(1), pages 1-27, February.
    2. Chavez, Daniel E. & Palma, Marco A. & Nayga, Rodolfo M. & Mjelde, James W., 2020. "Product availability in discrete choice experiments with private goods," Journal of choice modelling, Elsevier, vol. 36(C).
    3. James C. Cox & Vjollca Sadiraj, 2018. "Incentives," Experimental Economics Center Working Paper Series 2018-01, Experimental Economics Center, Andrew Young School of Policy Studies, Georgia State University.
    4. Fiore, Annamaria, 2009. "Experimental Economics: Some Methodological Notes," MPRA Paper 12498, University Library of Munich, Germany.
    5. Jinkwon Lee, 2007. "Repetition And Financial Incentives In Economics Experiments," Journal of Economic Surveys, Wiley Blackwell, vol. 21(3), pages 628-681, July.
    6. Ferdinand Vieider, 2011. "Separating real incentives and accountability," Experimental Economics, Springer;Economic Science Association, vol. 14(4), pages 507-518, November.
    7. John Liechty & Duncan Fong & Eelko Huizingh & Arnaud Bruyn, 2008. "Hierarchical Bayesian conjoint models incorporating measurement uncertainty," Marketing Letters, Springer, vol. 19(2), pages 141-155, June.
    8. Bodo Sturm & Joachim Weimann, 2006. "Experiments in Environmental Economics and Some Close Relatives," Journal of Economic Surveys, Wiley Blackwell, vol. 20(3), pages 419-457, July.
    9. Olivier Toubia & Duncan I. Simester & John R. Hauser & Ely Dahan, 2003. "Fast Polyhedral Adaptive Conjoint Estimation," Marketing Science, INFORMS, vol. 22(3), pages 273-303.
    10. Nathalie Etchart-Vincent & Olivier l’Haridon, 2011. "Monetary incentives in the loss domain and behavior toward risk: An experimental comparison of three reward schemes including real losses," Journal of Risk and Uncertainty, Springer, vol. 42(1), pages 61-83, February.
    11. Sven Grüner & Mira Lehberger & Norbert Hirschauer & Oliver Mußhoff, 2022. "How (un)informative are experiments with students for other social groups? A study of agricultural students and farmers," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 66(3), pages 471-504, July.
    12. John A. List & David Lucking-Reiley, 2002. "Bidding Behavior and Decision Costs in Field Experiments," Economic Inquiry, Western Economic Association International, vol. 40(4), pages 611-619, October.
    13. John A. List, 2003. "Does Market Experience Eliminate Market Anomalies?," The Quarterly Journal of Economics, Oxford University Press, vol. 118(1), pages 41-71.
    14. Barrafrem, Kinga & Hausfeld, Jan, 2020. "Tracing risky decisions for oneself and others: The role of intuition and deliberation," Journal of Economic Psychology, Elsevier, vol. 77(C).
    15. Ding, Shuze & Lugovskyy, Volodymyr & Puzzello, Daniela & Tucker, Steven & Williams, Arlington, 2018. "Cash versus extra-credit incentives in experimental asset markets," Journal of Economic Behavior & Organization, Elsevier, vol. 150(C), pages 19-27.
    16. Ulrich Schmidt & Christian Seidl, 2014. "Reconsidering the common ratio effect: the roles of compound independence, reduction, and coalescing," Theory and Decision, Springer, vol. 77(3), pages 323-339, October.
    17. Andreas Ortmann, 2009. ""The Way in which an Experiment is Conducted is Unbelievably Important": On the Experimentation Practices of Economists and Psychologists," CESifo Working Paper Series 2887, CESifo.
    18. Murphy, James J. & Stevens, Thomas H., 2004. "Contingent Valuation, Hypothetical Bias, and Experimental Economics," Agricultural and Resource Economics Review, Cambridge University Press, vol. 33(2), pages 182-192, October.
    19. Karen Blumenschein & GlennC. Blomquist & Magnus Johannesson & Nancy Horn & Patricia Freeman, 2008. "Eliciting Willingness to Pay Without Bias: Evidence from a Field Experiment," Economic Journal, Royal Economic Society, vol. 118(525), pages 114-137, January.
    20. Rydval, Ondrej & Ortmann, Andreas, 2004. "How financial incentives and cognitive abilities affect task performance in laboratory settings: an illustration," Economics Letters, Elsevier, vol. 85(3), pages 315-320, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:feb:framed:00139. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: David Franks (email available below). General contact details of provider: http://www.fieldexperiments.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.