IDEAS home Printed from https://ideas.repec.org/a/eee/eejocm/v56y2025ics1755534525000247.html

Mitigating hypothetical bias in choice Experiments: An in-depth review on the use of cheap talk

Author

Listed:
  • Xhakollari, Vilma
  • Asioli, Daniele
  • Nayga, Rodolfo M.

Abstract

Cheap Talk is one of the most popular techniques used to mitigate hypothetical bias in choice experiments, but there is uncertainty about how it is used by researchers, and its effectiveness. We reviewed and explored in-depth how cheap talk is used and how effective it is in mitigating hypothetical bias by examining 172 articles in the literature using a systematic review. The results show that cheap talk is largely used in choice experiment studies, but only a minority of articles make the cheap talk scripts available to the readers. Furthermore, we found that there is a large heterogeneity on how the cheap talk script is used by researchers in terms of length, words used, structure, and its effectiveness. This review provides useful insights about the implementation of cheap talk in choice experiments as well as outline several future research avenues that could be useful in improving the validity and reliability of data collected using hypothetical choice experiments.

Suggested Citation

  • Xhakollari, Vilma & Asioli, Daniele & Nayga, Rodolfo M., 2025. "Mitigating hypothetical bias in choice Experiments: An in-depth review on the use of cheap talk," Journal of choice modelling, Elsevier, vol. 56(C).
    • Handle: RePEc:eee:eejocm:v:56:y:2025:i:c:s1755534525000247
    DOI: 10.1016/j.jocm.2025.100561
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1755534525000247
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jocm.2025.100561?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Adelina Gschwandtner & Michael Burton, 2020. "Comparing treatments to reduce hypothetical bias in choice experiments regarding organic food," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 47(3), pages 1302-1337.
    2. Keiko Aoki & Kenju Akai, 2022. "Testing hypothetical bias in a choice experiment: An application to the value of the carbon footprint of mandarin oranges," PLOS ONE, Public Library of Science, vol. 17(1), pages 1-26, January.
    3. Craig D. Broadbent, 2014. "Evaluating mitigation and calibration techniques for hypothetical bias in choice experiments," Journal of Environmental Planning and Management, Taylor & Francis Journals, vol. 57(12), pages 1831-1848, December.
    4. Glynn T. Tonsor & Robert S. Shupp, 2011. "Cheap Talk Scripts and Online Choice Experiments: "Looking Beyond the Mean"," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 93(4), pages 1015-1031.
    5. Joseph A. Herriges & Catherine L. Kling & Christopher D. Azevedo, 1999. "Linking Revealed and Stated Preferences to Test External Validity," Center for Agricultural and Rural Development (CARD) Publications 99-wp222, Center for Agricultural and Rural Development (CARD) at Iowa State University.
    6. Jacquemet, Nicolas & Joule, Robert-Vincent & Luchini, Stéphane & Shogren, Jason F., 2013. "Preference elicitation under oath," Journal of Environmental Economics and Management, Elsevier, vol. 65(1), pages 110-132.
    7. Özdemir, Semra & Johnson, F. Reed & Hauber, A. Brett, 2009. "Hypothetical bias, cheap talk, and stated willingness to pay for health care," Journal of Health Economics, Elsevier, vol. 28(4), pages 894-901, July.
    8. repec:hal:pseose:halshs-00731244 is not listed on IDEAS
    9. Brown, Thomas C. & Ajzen, Icek & Hrubes, Daniel, 2003. "Further tests of entreaties to avoid hypothetical bias in referendum contingent valuation," Journal of Environmental Economics and Management, Elsevier, vol. 46(2), pages 353-361, September.
    10. List John A., 2007. "Field Experiments: A Bridge between Lab and Naturally Occurring Data," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 6(2), pages 1-47, April.
    11. Ryan Feuz & F. Bailey Norwood & Ranjith Ramanathan, 2020. "Do consumers have an appetite for discolored beef?," Agribusiness, John Wiley & Sons, Ltd., vol. 36(4), pages 631-652, October.
    12. Bulte, Erwin & Gerking, Shelby & List, John A. & de Zeeuw, Aart, 2005. "The effect of varying the causes of environmental problems on stated WTP values: evidence from a field study," Journal of Environmental Economics and Management, Elsevier, vol. 49(2), pages 330-342, March.
    13. David Wuepper & Philipp Wree & Goezde Ardali, 2019. "Does information change German consumers’ attitudes about genetically modified food?," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 46(1), pages 53-78.
    14. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521766555, Enero-Abr.
    15. Champ, Patricia A. & Bishop, Richard C. & Brown, Thomas C. & McCollum, Daniel W., 1997. "Using Donation Mechanisms to Value Nonuse Benefits from Public Goods," Journal of Environmental Economics and Management, Elsevier, vol. 33(2), pages 151-162, June.
    16. Herriges, Joseph & Kling, Catherine & Liu, Chih-Chen & Tobias, Justin, 2010. "What are the consequences of consequentiality?," Journal of Environmental Economics and Management, Elsevier, vol. 59(1), pages 67-81, January.
    17. Richard C. Ready & Patricia A. Champ & Jennifer L. Lawton, 2010. "Using Respondent Uncertainty to Mitigate Hypothetical Bias in a Stated Choice Experiment," Land Economics, University of Wisconsin Press, vol. 86(2), pages 363-381.
    18. Mark A. Andor & Manuel Frondel & Colin Vance, 2017. "Mitigating Hypothetical Bias: Evidence on the Effects of Correctives from a Large Field Study," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 68(3), pages 777-796, November.
    19. Tiziana de-Magistris & Azucena Gracia & Rodolfo M. Nayga, 2013. "On the Use of Honesty Priming Tasks to Mitigate Hypothetical Bias in Choice Experiments," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 95(5), pages 1136-1154.
    20. David Aadland & Arthur J. Caplan, 2003. "Willingness to Pay for Curbside Recycling with Detection and Mitigation of Hypothetical Bias," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 85(2), pages 492-502.
    21. Whittington, Dale & Smith, V. Kerry & Okorafor, Apia & Okore, Augustine & Liu, Jin Long & McPhail, Alexander, 1992. "Giving respondents time to think in contingent valuation studies: A developing country application," Journal of Environmental Economics and Management, Elsevier, vol. 22(3), pages 205-225, May.
    22. John A. List, 2001. "Do Explicit Warnings Eliminate the Hypothetical Bias in Elicitation Procedures? Evidence from Field Auctions for Sportscards," American Economic Review, American Economic Association, vol. 91(5), pages 1498-1507, December.
    23. Wuepper, David & Clemm, Alexandra & Wree, Philipp, 2019. "The preference for sustainable coffee and a new approach for dealing with hypothetical bias," Journal of Economic Behavior & Organization, Elsevier, vol. 158(C), pages 475-486.
    24. Menapace, Luisa & Raffaelli, Roberta, 2020. "Unraveling hypothetical bias in discrete choice experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 176(C), pages 416-430.
    25. Laura O. Taylor & Ronald G. Cummings, 1999. "Unbiased Value Estimates for Environmental Goods: A Cheap Talk Design for the Contingent Valuation Method," American Economic Review, American Economic Association, vol. 89(3), pages 649-665, June.
    26. Carlsson, Fredrik & Frykblom, Peter & Johan Lagerkvist, Carl, 2005. "Using cheap talk as a test of validity in choice experiments," Economics Letters, Elsevier, vol. 89(2), pages 147-152, November.
    27. Rose, John M. & Bliemer, Michiel C.J. & Hensher, David A. & Collins, Andrew T., 2008. "Designing efficient stated choice experiments in the presence of reference alternatives," Transportation Research Part B: Methodological, Elsevier, vol. 42(4), pages 395-406, May.
    28. James Murphy & Thomas Stevens & Darryl Weatherhead, 2005. "Is Cheap Talk Effective at Eliminating Hypothetical Bias in a Provision Point Mechanism?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 30(3), pages 327-343, March.
    29. Mohammed H Alemu & Søren B Olsen, 2018. "Can a Repeated Opt-Out Reminder mitigate hypothetical bias in discrete choice experiments? An application to consumer valuation of novel food products," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 45(5), pages 749-782.
    30. Andres Silva & Rodolfo Nayga & Benjamin Campbell & John Park, 2012. "Can perceived task complexity influence cheap talk's effectiveness in reducing hypothetical bias in stated choice studies?," Applied Economics Letters, Taylor & Francis Journals, vol. 19(17), pages 1711-1714.
    31. Vincenzina Caputo & Ellen J. Van Loo & Riccardo Scarpa & Rodolfo M. Nayga & Wim Verbeke, 2018. "Comparing Serial, and Choice Task Stated and Inferred Attribute Non†Attendance Methods in Food Choice Experiments," Journal of Agricultural Economics, Wiley Blackwell, vol. 69(1), pages 35-57, February.
    32. Shijun GaoMorrison & Carola Grebitus & Karen DeLong, 2023. "Consumer preferences for beef quality grades on imported and domestic beef," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 50(3), pages 1064-1102.
    33. Caputo, Vincenzina & Nayga, Rodolfo M. Jr. & Scarpa, Riccardo, 2013. "Food miles or carbon emissions? Exploring labelling preference for food transport footprint with a stated choice study," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 57(4), pages 1-18.
    34. Hensher,David A. & Rose,John M. & Greene,William H., 2015. "Applied Choice Analysis," Cambridge Books, Cambridge University Press, number 9781107465923, Enero-Abr.
    35. Bateman, Ian J. & Day, Brett H. & Jones, Andrew P. & Jude, Simon, 2009. "Reducing gain-loss asymmetry: A virtual reality choice experiment valuing land use change," Journal of Environmental Economics and Management, Elsevier, vol. 58(1), pages 106-118, July.
    36. Aadland, David & Caplan, Arthur J., 2006. "Cheap talk reconsidered: New evidence from CVM," Journal of Economic Behavior & Organization, Elsevier, vol. 60(4), pages 562-578, August.
    37. Jayson L. Lusk, 2003. "Effects of Cheap Talk on Consumer Willingness-to-Pay for Golden Rice," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 85(4), pages 840-856.
    38. Sergio Colombo & Wiktor Budziński & Mikołaj Czajkowski & Klaus Glenk, 2022. "The relative performance of ex‐ante and ex‐post measures to mitigate hypothetical and strategic bias in a stated preference study," Journal of Agricultural Economics, Wiley Blackwell, vol. 73(3), pages 845-873, September.
    39. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part II. Conceptualisation of external validity, sources and explanations of bias and effectiveness of mitigation methods," Journal of choice modelling, Elsevier, vol. 41(C).
    40. Daniele Asioli & Claudia Bazzani & Rodolfo M. Nayga, 2022. "Are consumers willing to pay for in‐vitro meat? An investigation of naming effects," Journal of Agricultural Economics, Wiley Blackwell, vol. 73(2), pages 356-375, June.
    41. Gregory Howard & Brian E. Roe & Erik C. Nisbet & Jay F. Martin, 2017. "Hypothetical Bias Mitigation Techniques in Choice Experiments: Do Cheap Talk and Honesty Priming Effects Fade with Repeated Choices?," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 543-573.
    42. Frode Alfnes & Chengyan Yue & Helen H. Jensen, 2010. "Cognitive dissonance as a means of reducing hypothetical bias," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 37(2), pages 147-163, June.
    43. Andreas C. Drichoutis & Achilleas Vassilopoulos & Jayson L. Lusk & Rodolfo M. NaygaJr., 2017. "Consumer preferences for fair labour certification," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 44(3), pages 455-474.
    44. Di Fang & Rodolfo M. Nayga & Grant H. West & Claudia Bazzani & Wei Yang & Benjamin C. Lok & Charles E. Levy & Heather A. Snell, 2021. "On the Use of Virtual Reality in Mitigating Hypothetical Bias in Choice Experiments," American Journal of Agricultural Economics, John Wiley & Sons, vol. 103(1), pages 142-161, January.
    45. Penn, Jerrod & Hu, Wuyang, 2019. "Cheap talk efficacy under potential and actual Hypothetical Bias: A meta-analysis," Journal of Environmental Economics and Management, Elsevier, vol. 96(C), pages 22-35.
    46. Vincenzina Caputo & Riccardo Scarpa, 2022. "Methodological Advances in Food Choice Experiments and Modeling: Current Practices, Challenges, and Future Research Directions," Annual Review of Resource Economics, Annual Reviews, vol. 14(1), pages 63-90, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part II. Conceptualisation of external validity, sources and explanations of bias and effectiveness of mitigation methods," Journal of choice modelling, Elsevier, vol. 41(C).
    2. Milad Haghani & Michiel C. J. Bliemer & John M. Rose & Harmen Oppewal & Emily Lancsar, 2021. "Hypothetical bias in stated choice experiments: Part II. Macro-scale analysis of literature and effectiveness of bias mitigation methods," Papers 2102.02945, arXiv.org.
    3. Ladenburg, Jacob & Olsen, Søren Bøye, 2014. "Augmenting short Cheap Talk scripts with a repeated Opt-Out Reminder in Choice Experiment surveys," Resource and Energy Economics, Elsevier, vol. 37(C), pages 39-63.
    4. Penn, Jerrod & Hu, Wuyang, 2016. "Making the Most of Cheap Talk in an Online Survey," 2016 Annual Meeting, July 31-August 2, Boston, Massachusetts 236171, Agricultural and Applied Economics Association.
    5. Mohammed H. Alemu & Søren B. Olsen, 2017. "Can a Repeated Opt-Out Reminder remove hypothetical bias in discrete choice experiments? An application to consumer valuation of novel food products," IFRO Working Paper 2017/05, University of Copenhagen, Department of Food and Resource Economics.
    6. Jiang, Qi & Penn, Jerrod & Hu, Wuyang, 2022. "Real payment priming to reduce potential hypothetical bias," Journal of choice modelling, Elsevier, vol. 45(C).
    7. Sergio Colombo & Wiktor Budziński & Mikołaj Czajkowski & Klaus Glenk, 2022. "The relative performance of ex‐ante and ex‐post measures to mitigate hypothetical and strategic bias in a stated preference study," Journal of Agricultural Economics, Wiley Blackwell, vol. 73(3), pages 845-873, September.
    8. Penn, Jerrod & Hu, Wuyang, 2019. "Cheap talk efficacy under potential and actual Hypothetical Bias: A meta-analysis," Journal of Environmental Economics and Management, Elsevier, vol. 96(C), pages 22-35.
    9. Fifer, Simon & Rose, John M., 2016. "Can you ever be certain? Reducing hypothetical bias in stated choice experiments via respondent reported choice certaintyAuthor-Name: Beck, Matthew J," Transportation Research Part B: Methodological, Elsevier, vol. 89(C), pages 149-167.
    10. Stavroula Tsigou & Stathis Klonaris, 2018. "Factors affecting farmers’ WTP for innovative fertilizer against soil salinity," Working Papers 2018-3, Agricultural University of Athens, Department Of Agricultural Economics.
    11. Dominique Ami & Frédéric Aprahamian & Olivier Chanel & Stéphane Luchini, 2011. "A Test of Cheap Talk in Different Hypothetical Contexts: The Case of Air Pollution," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 50(1), pages 111-130, September.
    12. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    13. Craig D. Broadbent, 2014. "Evaluating mitigation and calibration techniques for hypothetical bias in choice experiments," Journal of Environmental Planning and Management, Taylor & Francis Journals, vol. 57(12), pages 1831-1848, December.
    14. Kar Ho Lim & Wuyang Hu, 2023. "Contextual reference price in choice experiments," American Journal of Agricultural Economics, John Wiley & Sons, vol. 105(4), pages 1288-1306, August.
    15. Wuepper, David & Clemm, Alexandra & Wree, Philipp, 2019. "The preference for sustainable coffee and a new approach for dealing with hypothetical bias," Journal of Economic Behavior & Organization, Elsevier, vol. 158(C), pages 475-486.
    16. Giles Atkinson & Sian Morse-Jones & Susana Mourato & Allan Provins, 2012. "‘When to Take “No” for an Answer’? Using Entreaties to Reduce Protests in Contingent Valuation Studies," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 51(4), pages 497-523, April.
    17. Quainoo, Ruth & Petrolia, Daniel, "undated". "Mitigating Hypothetical Bias: An Application to WTP for Beach Conditions Information," 2018 Annual Meeting, February 2-6, 2018, Jacksonville, Florida 266715, Southern Agricultural Economics Association.
    18. Penn, Jerrod & Hu, Wuyang & Ye, Tao, 2024. "Efficacy of hypothetical bias mitigation techniques: A cross-country comparison," Journal of Environmental Economics and Management, Elsevier, vol. 125(C).
    19. John K. Horowitz & Kenneth E. McConnell & James J. Murphy, 2013. "Behavioral foundations of environmental economics and valuation," Chapters, in: John A. List & Michael K. Price (ed.), Handbook on Experimental Economics and the Environment, chapter 4, pages 115-156, Edward Elgar Publishing.
    20. Penn, Jerrod & Hu, Wuyang & Ye, Tao, "undated". "Cheap Talk, Consequentiality, and Certainty Follow-up as Hypothetical Bias Mitigation Techniques: A Cross Country Comparison," 2018 Annual Meeting, August 5-7, Washington, D.C. 274018, Agricultural and Applied Economics Association.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:eejocm:v:56:y:2025:i:c:s1755534525000247. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/journal-of-choice-modelling .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.