IDEAS home Printed from https://ideas.repec.org/a/kap/mktlet/v36y2025i1d10.1007_s11002-023-09714-2.html
   My bibliography  Save this article

Incentive alignment in anchored MaxDiff yields superior predictive validity

Author

Listed:
  • Joshua Benjamin Schramm

    (Chemnitz University of Technology
    Otto von Guericke University Magdeburg)

  • Marcel Lichters

    (Otto von Guericke University Magdeburg)

Abstract

Maximum Difference Scaling (MaxDiff) is an essential method in marketing concerning forecasting consumer purchase decisions and general product demand. However, the usefulness of traditional MaxDiff studies suffers from two limitations. First, it measures relative preferences, which prevents predicting how many consumers would actually buy a product and impedes comparing results across respondents. Second, market researchers apply MaxDiff in hypothetical settings that might not reveal valid preferences due to hypothetical bias. The first limitation has been addressed by implementing anchored MaxDiff variants. In contrast, the latter limitation has only been targeted in other preference measurement procedures such as conjoint analysis by applying incentive alignment. By integrating anchored MaxDiff (i.e., direct vs. indirect anchoring) with incentive alignment (present vs. absent) in a 2 × 2 between-subjects preregistered online experiment (n = 448), the current study is the first to address both threats. The results show that incentive-aligning MaxDiff increases the predictive validity regarding consequential product choices—importantly—independently of the anchoring method. In contrast, hypothetical MaxDiff variants overestimate general product demand. The article concludes by showcasing how the managerial implications drawn from anchored MaxDiff differ depending on the four tested variants. In addition, we provide the first incentive-aligned MaxDiff benchmark dataset in the field.

Suggested Citation

  • Joshua Benjamin Schramm & Marcel Lichters, 2025. "Incentive alignment in anchored MaxDiff yields superior predictive validity," Marketing Letters, Springer, vol. 36(1), pages 1-16, March.
  • Handle: RePEc:kap:mktlet:v:36:y:2025:i:1:d:10.1007_s11002-023-09714-2
    DOI: 10.1007/s11002-023-09714-2
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11002-023-09714-2
    File Function: Abstract
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1007/s11002-023-09714-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hofstetter, Reto & Miller, Klaus M. & Krohmer, Harley & Zhang, Z. John, 2021. "A de-biased direct question approach to measuring consumers' willingness to pay," International Journal of Research in Marketing, Elsevier, vol. 38(1), pages 70-84.
    2. Verena Sablotny-Wackershauser & Marcel Lichters & Daniel Guhl & Paul Bengart & Bodo Vogt, 2024. "Crossing incentive alignment and adaptive designs in choice-based conjoint: A fruitful endeavor," Journal of the Academy of Marketing Science, Springer, vol. 52(3), pages 610-633, May.
    3. Deacue Fields & Walt Prevatt, 2008. "An Incentive Compatible Conjoint Ranking Mechanism," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 90(2), pages 487-498.
    4. Marcel Lichters & Marko Sarstedt & Bodo Vogt, 2015. "On the practical relevance of the attraction effect: A cautionary note and guidelines for context effect experiments," AMS Review, Springer;Academy of Marketing Science, vol. 5(1), pages 1-19, June.
    5. Louviere, Jordan & Lings, Ian & Islam, Towhidul & Gudergan, Siegfried & Flynn, Terry, 2013. "An introduction to the application of (case 1) best–worst scaling in marketing research," International Journal of Research in Marketing, Elsevier, vol. 30(3), pages 292-303.
    6. Min Ding & Rajdeep Grewal & John Liechty, 2005. "Incentive-aligned conjoint analysis," Framed Field Experiments 00139, The Field Experiments Website.
    7. Dong, Songting & Ding, Min & Huber, Joel, 2010. "A simple mechanism to incentive-align conjoint experiments," International Journal of Research in Marketing, Elsevier, vol. 27(1), pages 25-32.
    8. Chrzan, Keith & Peitz, Megan, 2019. "Best-Worst Scaling with many items," Journal of choice modelling, Elsevier, vol. 30(C), pages 61-72.
    9. Rausch, Theresa Maria & Baier, Daniel & Wening, Stefanie, 2021. "Does sustainability really matter to consumers? Assessing the importance of online shop and apparel product attributes," Journal of Retailing and Consumer Services, Elsevier, vol. 63(C).
    10. Marcel Lichters & Marko Sarstedt & Bodo Vogt, 2015. "On the practical relevance of the attraction effect: A cautionary note and guidelines for context effect experiments," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 5(1), pages 1-19, June.
    11. Axel C. Mühlbacher & Anika Kaczynski & Peter Zweifel & F. Reed Johnson, 2016. "Experimental measurement of preferences in health and healthcare using best-worst scaling: an overview," Health Economics Review, Springer, vol. 6(1), pages 1-14, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lichters, Marcel & Wackershauser, Verena & Han, Shixing & Vogt, Bodo, 2019. "On the applicability of the BDM mechanism in product evaluation," Journal of Retailing and Consumer Services, Elsevier, vol. 51(C), pages 1-7.
    2. Verena Sablotny-Wackershauser & Marcel Lichters & Daniel Guhl & Paul Bengart & Bodo Vogt, 2024. "Crossing incentive alignment and adaptive designs in choice-based conjoint: A fruitful endeavor," Journal of the Academy of Marketing Science, Springer, vol. 52(3), pages 610-633, May.
    3. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part II. Conceptualisation of external validity, sources and explanations of bias and effectiveness of mitigation methods," Journal of choice modelling, Elsevier, vol. 41(C).
    4. Lichters, Marcel & Müller, Holger & Sarstedt, Marko & Vogt, Bodo, 2016. "How durable are compromise effects?," Journal of Business Research, Elsevier, vol. 69(10), pages 4056-4064.
    5. Chavez, Daniel E. & Palma, Marco A. & Nayga, Rodolfo M. & Mjelde, James W., 2020. "Product availability in discrete choice experiments with private goods," Journal of choice modelling, Elsevier, vol. 36(C).
    6. James Agarwal & Wayne DeSarbo & Naresh K. Malhotra & Vithala Rao, 2015. "An Interdisciplinary Review of Research in Conjoint Analysis: Recent Developments and Directions for Future Research," Customer Needs and Solutions, Springer;Institute for Sustainable Innovation and Growth (iSIG), vol. 2(1), pages 19-40, March.
    7. Dongling Huang & Lan Luo, 2016. "Consumer Preference Elicitation of Complex Products Using Fuzzy Support Vector Machine Active Learning," Marketing Science, INFORMS, vol. 35(3), pages 445-464, May.
    8. Huls, Samare P.I. & de Bekker-Grob, Esther W., 2022. "Can healthcare choice be predicted using stated preference data? The role of model complexity in a discrete choice experiment about colorectal cancer screening," Social Science & Medicine, Elsevier, vol. 315(C).
    9. Castillo, Geoffrey, 2020. "The attraction effect and its explanations," Games and Economic Behavior, Elsevier, vol. 119(C), pages 123-147.
    10. Fabio Galeotti & Maria Montero & Anders Poulsen, 2022. "The Attraction and Compromise Effects in Bargaining: Experimental Evidence," Management Science, INFORMS, vol. 68(4), pages 2987-3007, April.
    11. Michael Canty & Felix Josua Lang & Susanne Jana Adler & Marcel Lichters & Marko Sarstedt, 2024. "Caffeine’s complex influence on the attraction effect: a mixed bag of outcomes," Marketing Letters, Springer, vol. 35(3), pages 451-476, September.
    12. Chavez, Daniel E. & Palma, Marco A. & Nayga Jr., Rodolfo M., 2017. "When does real become consequential in non-hypothetical choice experiments?," 2018 Annual Meeting, February 2-6, 2018, Jacksonville, Florida 266327, Southern Agricultural Economics Association.
    13. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part I. Macro-scale analysis of literature and integrative synthesis of empirical evidence from applied economics, experimental psychology and neuroimag," Journal of choice modelling, Elsevier, vol. 41(C).
    14. Takashi Tsuzuki & Yuji Takeda & Itsuki Chiba, 2021. "Influence of divided attention on the attraction effect in multialternative choice," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 16(3), pages 729-742, May.
    15. Alexander Dilger & Thomas Gehrig & Marko Sarstedt, 2019. "(Ir)Rationality of decisions in business research and practice: introduction to the special issue," Business Research, Springer;German Academic Association for Business Research, vol. 12(1), pages 1-7, April.
    16. Zuschke, Nick, 2020. "The impact of task complexity and task motivation on in-store marketing effectiveness: An eye tracking analysis," Journal of Business Research, Elsevier, vol. 116(C), pages 337-350.
    17. James C. Cox & Eike B. Kroll & Marcel Lichters & Vjollca Sadiraj & Bodo Vogt, 2019. "The St. Petersburg paradox despite risk-seeking preferences: an experimental study," Business Research, Springer;German Academic Association for Business Research, vol. 12(1), pages 27-44, April.
    18. Hofstetter, Reto & Miller, Klaus M. & Krohmer, Harley & Zhang, Z. John, 2021. "A de-biased direct question approach to measuring consumers' willingness to pay," International Journal of Research in Marketing, Elsevier, vol. 38(1), pages 70-84.
    19. Braun, Alexander & Schmeiser, Hato & Schreiber, Florian, 2016. "On consumer preferences and the willingness to pay for term life insurance," European Journal of Operational Research, Elsevier, vol. 253(3), pages 761-776.
    20. Wolfgang Breuer & Jannis Bischof & Christian Hofmann & Jochen Hundsdoerfer & Hans-Ulrich Küpper & Marko Sarstedt & Philipp Schreck & Tim Weitzel & Peter Witt, 2023. "Recent developments in Business Economics," Journal of Business Economics, Springer, vol. 93(6), pages 989-1013, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:mktlet:v:36:y:2025:i:1:d:10.1007_s11002-023-09714-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.