IDEAS home Printed from https://ideas.repec.org/a/eee/jeeman/v96y2019icp22-35.html
   My bibliography  Save this article

Cheap talk efficacy under potential and actual Hypothetical Bias: A meta-analysis

Author

Listed:
  • Penn, Jerrod
  • Hu, Wuyang

Abstract

Cheap Talk (CT) is a common technique employed in stated preference methods of nonmarket valuation to reduce Hypothetical Bias (HB). However, multiple studies have documented its mixed usefulness. Using meta-analysis of 67 studies identified after reviewing over 400 articles, we first show the efficacy of CT while controlling for publication bias. We then investigate when CT is likely to be effective. Our results indicate that on average CT is significant in reducing estimated economic values by about 20% compared to the baseline treatment without implementing CT. Further analysis demonstrates that using CT in the context of public goods, using a budget/substitute reminder, and using CT in conjunction with other HB mitigation strategies improves its efficacy. In addition, we show that CT works better when the actual HB is larger thus one potential reason for previous studies failing to identify positive reduction in potential HB through CT may be because actual HB is small instead of CT being ineffective.

Suggested Citation

  • Penn, Jerrod & Hu, Wuyang, 2019. "Cheap talk efficacy under potential and actual Hypothetical Bias: A meta-analysis," Journal of Environmental Economics and Management, Elsevier, vol. 96(C), pages 22-35.
  • Handle: RePEc:eee:jeeman:v:96:y:2019:i:c:p:22-35
    DOI: 10.1016/j.jeem.2019.02.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0095069618300111
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jeem.2019.02.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Raymond J. G. M. Florax & Chiara M. Travisi & Peter Nijkamp, 2005. "A meta-analysis of the willingness to pay for reductions in pesticide risk exposure," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 32(4), pages 441-467, December.
    2. John Loomis & Armando Gonzalez-Caban & Robin Gregory, 1994. "Do Reminders of Substitutes and Budget Constraints Influence Contingent Valuation Estimates?," Land Economics, University of Wisconsin Press, vol. 70(4), pages 499-506.
    3. Jacquemet, Nicolas & Joule, Robert-Vincent & Luchini, Stéphane & Shogren, Jason F., 2013. "Preference elicitation under oath," Journal of Environmental Economics and Management, Elsevier, vol. 65(1), pages 110-132.
    4. Card, David & Krueger, Alan B, 1995. "Time-Series Minimum-Wage Studies: A Meta-analysis," American Economic Review, American Economic Association, vol. 85(2), pages 238-243, May.
    5. Glynn T. Tonsor & Robert S. Shupp, 2011. "Cheap Talk Scripts and Online Choice Experiments: "Looking Beyond the Mean"," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 93(4), pages 1015-1031.
    6. James Murphy & P. Allen & Thomas Stevens & Darryl Weatherhead, 2005. "A Meta-analysis of Hypothetical Bias in Stated Preference Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 30(3), pages 313-325, March.
    7. Tunçel, Tuba & Hammitt, James K., 2014. "A new meta-analysis on the WTP/WTA disparity," Journal of Environmental Economics and Management, Elsevier, vol. 68(1), pages 175-187.
    8. Drichoutis, Andreas C. & Vassilopoulos, Achilleas & Lusk, Jayson L. & Nayga, Rodolfo M. Jr., 2015. "Reference dependence, consequentiality and social desirability in value elicitation: A study of fair labor labeling," 143rd Joint EAAE/AAEA Seminar, March 25-27, 2015, Naples, Italy 202705, European Association of Agricultural Economists.
    9. Laura O. Taylor & Ronald G. Cummings, 1999. "Unbiased Value Estimates for Environmental Goods: A Cheap Talk Design for the Contingent Valuation Method," American Economic Review, American Economic Association, vol. 89(3), pages 649-665, June.
    10. Jerrod M Penn & Wuyang Hu, 2018. "Understanding Hypothetical Bias: An Enhanced Meta-Analysis," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 100(4), pages 1186-1206.
    11. John A. Fox & Jason F. Shogren & Dermot J. Hayes & James B. Kliebenstein, 1998. "CVM-X: Calibrating Contingent Values with Experimental Auction Markets," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 80(3), pages 455-465.
    12. Bohara, Alok K. & Caplan, Arthur J. & Grijalva, Therese, 2007. "The effect of experience and quantity-based pricing on the valuation of a curbside recycling program," Ecological Economics, Elsevier, vol. 64(2), pages 433-443, December.
    13. Maria Loureiro & John Loomis & Maria Vázquez, 2009. "Economic Valuation of Environmental Damages due to the Prestige Oil Spill in Spain," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 44(4), pages 537-553, December.
    14. Aadland, David & Caplan, Arthur J., 2006. "Cheap talk reconsidered: New evidence from CVM," Journal of Economic Behavior & Organization, Elsevier, vol. 60(4), pages 562-578, August.
    15. Herriges, Joseph & Kling, Catherine & Liu, Chih-Chen & Tobias, Justin, 2010. "What are the consequences of consequentiality?," Journal of Environmental Economics and Management, Elsevier, vol. 59(1), pages 67-81, January.
    16. Whitehead, John C. & Cherry, Todd L., 2007. "Willingness to pay for a Green Energy program: A comparison of ex-ante and ex-post hypothetical bias mitigation approaches," Resource and Energy Economics, Elsevier, vol. 29(4), pages 247-261, November.
    17. James Murphy & Thomas Stevens & Darryl Weatherhead, 2005. "Is Cheap Talk Effective at Eliminating Hypothetical Bias in a Provision Point Mechanism?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 30(3), pages 327-343, March.
    18. Loomis, John B., 2014. "2013 WAEA Keynote Address: Strategies for Overcoming Hypothetical Bias in Stated Preference Surveys," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 39(1), pages 1-13, April.
    19. Little, Joseph & Broadbent, Craig D. & Berrens, Robert P., 2012. "Meta-Analysis of the Probability of Disparity between Actual and Hypothetical Valuation Responses: Extension and Preliminary New Results," Western Economics Forum, Western Agricultural Economics Association, vol. 11(1), pages 1-12.
    20. Menegaki, Angeliki, N. & Olsen, Søren Bøye & Tsagarakis, Konstantinos P., 2016. "Towards a common standard – A reporting checklist for web-based stated preference valuation surveys and a critique for mode surveys," Journal of choice modelling, Elsevier, vol. 18(C), pages 18-50.
    21. Nelson, Jon P., 2014. "Estimating the price elasticity of beer: Meta-analysis of data with heterogeneity, dependence, and publication bias," Journal of Health Economics, Elsevier, vol. 33(C), pages 180-187.
    22. Shrestha, Ram K. & Loomis, John B., 2001. "Testing a meta-analysis model for benefit transfer in international outdoor recreation," Ecological Economics, Elsevier, vol. 39(1), pages 67-83, October.
    23. Brown, Thomas C. & Ajzen, Icek & Hrubes, Daniel, 2003. "Further tests of entreaties to avoid hypothetical bias in referendum contingent valuation," Journal of Environmental Economics and Management, Elsevier, vol. 46(2), pages 353-361, September.
    24. Lindhjem, Henrik & Navrud, Ståle, 2008. "How reliable are meta-analyses for international benefit transfers?," Ecological Economics, Elsevier, vol. 66(2-3), pages 425-435, June.
    25. Maria Loureiro & Melina Barrio, 2011. "Do entreaties reduce the WTA-WTP disparity when valuing public goods?," Applied Economics Letters, Taylor & Francis Journals, vol. 18(6), pages 581-584.
    26. Dominique Ami & Frédéric Aprahamian & Olivier Chanel & Stéphane Luchini, 2011. "A Test of Cheap Talk in Different Hypothetical Contexts: The Case of Air Pollution," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 50(1), pages 111-130, September.
    27. John A. List, 2001. "Do Explicit Warnings Eliminate the Hypothetical Bias in Elicitation Procedures? Evidence from Field Auctions for Sportscards," American Economic Review, American Economic Association, vol. 91(5), pages 1498-1507, December.
    28. Karen Blumenschein & Glenn C. Blomquist & Magnus Johannesson & Nancy Horn & Patricia Freeman, 2008. "Eliciting Willingness to Pay Without Bias: Evidence from a Field Experiment," Economic Journal, Royal Economic Society, vol. 118(525), pages 114-137, January.
    29. Robert G. Ethier & Gregory L. Poe & William D. Schulze & Jeremy Clark, 2000. "Comparison of Hypothetical Phone and Mail Contingent Valuation Responses for Green-Pricing Electricity Programs," Land Economics, University of Wisconsin Press, vol. 76(1), pages 54-67.
    30. T.D. Stanley & Hristos Doucouliagos & Margaret Giles & Jost Heckemeyer & Robert Johnston & Patrice Laroche & Jon Nelson & Martin Paldam & Jacques Poot & Geoff Pugh & Randall Rosenberger & Katja Rost, 2013. "Meta-analysis of economics research reporting guidelines," Post-Print hal-02137661, HAL.
    31. Ladenburg, Jacob & Olsen, Søren Bøye, 2014. "Augmenting short Cheap Talk scripts with a repeated Opt-Out Reminder in Choice Experiment surveys," Resource and Energy Economics, Elsevier, vol. 37(C), pages 39-63.
    32. Jayson L. Lusk, 2003. "Effects of Cheap Talk on Consumer Willingness-to-Pay for Golden Rice," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 85(4), pages 840-856.
    33. Bosworth Ryan & Taylor Laura O., 2012. "Hypothetical Bias in Choice Experiments: Is Cheap Talk Effective at Eliminating Bias on the Intensive and Extensive Margins of Choice?," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 12(1), pages 1-28, December.
    34. Barrage, Lint & Lee, Min Sok, 2010. "A penny for your thoughts: Inducing truth-telling in stated preference elicitation," Economics Letters, Elsevier, vol. 106(2), pages 140-142, February.
    35. Carlsson, Fredrik & Martinsson, Peter & Akay, Alpaslan, 2011. "The effect of power outages and cheap talk on willingness to pay to reduce outages," Energy Economics, Elsevier, vol. 33(5), pages 790-798, September.
    36. James Fogarty, 2010. "The Demand For Beer, Wine And Spirits: A Survey Of The Literature," Journal of Economic Surveys, Wiley Blackwell, vol. 24(3), pages 428-478, July.
    37. LaRiviere, Jacob & Czajkowski, Mikołaj & Hanley, Nick & Aanesen, Margrethe & Falk-Petersen, Jannike & Tinch, Dugald, 2014. "The value of familiarity: Effects of knowledge and objective signals on willingness to pay for a public good," Journal of Environmental Economics and Management, Elsevier, vol. 68(2), pages 376-389.
    38. John List & Craig Gallet, 2001. "What Experimental Protocol Influence Disparities Between Actual and Hypothetical Stated Values?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 20(3), pages 241-254, November.
    39. Gregory Poe & Jeremy Clark & Daniel Rondeau & William Schulze, 2002. "Provision Point Mechanisms and Field Validity Tests of Contingent Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 23(1), pages 105-131, September.
    40. Champ, Patricia A. & Bishop, Richard C. & Brown, Thomas C. & McCollum, Daniel W., 1997. "Using Donation Mechanisms to Value Nonuse Benefits from Public Goods," Journal of Environmental Economics and Management, Elsevier, vol. 33(2), pages 151-162, June.
    41. LaRiviere, Jacob & Czajkowski, Mikolaj & Hanley, Nick & Aanesen, Margrethe & Falk-Peterson, Jannike & Tinch, Dugald, 2014. "Effects of Experience, Knowledge and Signals on Willingness to Pay for a Public Good," SIRE Discussion Papers 2014-008, Scottish Institute for Research in Economics (SIRE).
    42. Cameron, Trudy Ann & Poe, Gregory L. & Ethier, Robert G. & Schulze, William D., 2002. "Alternative Non-market Value-Elicitation Methods: Are the Underlying Preferences the Same?," Journal of Environmental Economics and Management, Elsevier, vol. 44(3), pages 391-425, November.
    43. Schulze, William D. & McClelland, Gary H. & Lazo, Jeffrey K. & Rowe, Robert D., 1998. "Embedding and calibration in measuring non-use values," Resource and Energy Economics, Elsevier, vol. 20(2), pages 163-178, June.
    44. Silva, Andres & Nayga, Rodolfo M., Jr. & Campbell, Benjamin L. & Park, John L., 2011. "Revisiting Cheap Talk with New Evidence from a Field Experiment," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 36(2), pages 1-12, August.
    45. Varela, Elsa & Mahieu, Pierre-Alexandre & Giergiczny, Marek & Riera, Pere & Soliño, Mario, 2014. "Testing the single opt-out reminder in choice experiments: An application to fuel break management in Spain," Journal of Forest Economics, Elsevier, vol. 20(3), pages 212-222.
    46. T.D. Stanley & Hristos Doucouliagos & Margaret Giles & Jost H. Heckemeyer & Robert J. Johnston & Patrice Laroche & Jon P. Nelson & Martin Paldam & Jacques Poot & Geoff Pugh & Randall S. Rosenberger & , 2013. "Meta-Analysis Of Economics Research Reporting Guidelines," Journal of Economic Surveys, Wiley Blackwell, vol. 27(2), pages 390-394, April.
    47. Pierre-Alexandre Mahieu, 2010. "Does gender matter when using cheap talk in contingent valuation studies?," Economics Bulletin, AccessEcon, vol. 30(4), pages 2955-2961.
    48. Tiziana de-Magistris & Azucena Gracia & Rodolfo M. Nayga, 2013. "On the Use of Honesty Priming Tasks to Mitigate Hypothetical Bias in Choice Experiments," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 95(5), pages 1136-1154.
    49. David Aadland & Arthur J. Caplan, 2003. "Willingness to Pay for Curbside Recycling with Detection and Mitigation of Hypothetical Bias," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 85(2), pages 492-502.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part II. Conceptualisation of external validity, sources and explanations of bias and effectiveness of mitigation methods," Journal of choice modelling, Elsevier, vol. 41(C).
    2. Milad Haghani & Michiel C. J. Bliemer & John M. Rose & Harmen Oppewal & Emily Lancsar, 2021. "Hypothetical bias in stated choice experiments: Part II. Macro-scale analysis of literature and effectiveness of bias mitigation methods," Papers 2102.02945, arXiv.org.
    3. Mohammed H. Alemu & Søren B. Olsen, 2017. "Can a Repeated Opt-Out Reminder remove hypothetical bias in discrete choice experiments? An application to consumer valuation of novel food products," IFRO Working Paper 2017/05, University of Copenhagen, Department of Food and Resource Economics.
    4. Ladenburg, Jacob & Olsen, Søren Bøye, 2014. "Augmenting short Cheap Talk scripts with a repeated Opt-Out Reminder in Choice Experiment surveys," Resource and Energy Economics, Elsevier, vol. 37(C), pages 39-63.
    5. Penn, Jerrod & Hu, Wuyang, 2016. "Making the Most of Cheap Talk in an Online Survey," 2016 Annual Meeting, July 31-August 2, Boston, Massachusetts 236171, Agricultural and Applied Economics Association.
    6. Sergio Colombo & Wiktor Budziński & Mikołaj Czajkowski & Klaus Glenk, 2022. "The relative performance of ex‐ante and ex‐post measures to mitigate hypothetical and strategic bias in a stated preference study," Journal of Agricultural Economics, Wiley Blackwell, vol. 73(3), pages 845-873, September.
    7. Nicolas Jacquemet & Alexander James & Stéphane Luchini & Jason Shogren, 2011. "Social Psychology and Environmental Economics: A New Look at ex ante Corrections of Biased Preference Evaluation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 48(3), pages 413-433, March.
    8. Dominique Ami & Frédéric Aprahamian & Olivier Chanel & Stéphane Luchini, 2011. "A Test of Cheap Talk in Different Hypothetical Contexts: The Case of Air Pollution," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 50(1), pages 111-130, September.
    9. Sergio Colombo & Wiktor Budziński & Mikołaj Czajkowski & Klaus Glenk, 2020. "Ex-ante and ex-post measures to mitigate hypothetical bias. Are they alternative or complementary tools to increase the reliability and validity of DCE estimates?," Working Papers 2020-20, Faculty of Economic Sciences, University of Warsaw.
    10. Fifer, Simon & Rose, John M., 2016. "Can you ever be certain? Reducing hypothetical bias in stated choice experiments via respondent reported choice certaintyAuthor-Name: Beck, Matthew J," Transportation Research Part B: Methodological, Elsevier, vol. 89(C), pages 149-167.
    11. John K. Horowitz & Kenneth E. McConnell & James J. Murphy, 2013. "Behavioral foundations of environmental economics and valuation," Chapters, in: John A. List & Michael K. Price (ed.), Handbook on Experimental Economics and the Environment, chapter 4, pages 115-156, Edward Elgar Publishing.
    12. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    13. Crastes dit Sourd, Romain & Zawojska, Ewa & Mahieu, Pierre-Alexandre & Louviere, Jordan, 2018. "Mitigating strategic misrepresentation of values in open-ended stated preference surveys by using negative reinforcement," Journal of choice modelling, Elsevier, vol. 28(C), pages 153-166.
    14. Quainoo, Ruth & Petrolia, Daniel, 2018. "Mitigating Hypothetical Bias: An Application to WTP for Beach Conditions Information," 2018 Annual Meeting, February 2-6, 2018, Jacksonville, Florida 266715, Southern Agricultural Economics Association.
    15. Jinkwon Lee & Uk Hwang, 2016. "Hypothetical Bias in Risk Preferences as a Driver of Hypothetical Bias in Willingness to Pay: Experimental Evidence," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 65(4), pages 789-811, December.
    16. Murphy, James J. & Stevens, Thomas H. & Weatherhead, Darryl, 2004. "Is Cheap Talk Effective At Eliminating Hypothetical Bias In A Provision," Working Paper Series 14510, University of Massachusetts, Amherst, Department of Resource Economics.
    17. Maurice Doyon & Laure Saulais & Bernard Ruffieux & Denise Bweli, 2015. "Hypothetical bias for private goods: does cheap talk make a difference?," Post-Print hal-01254936, HAL.
    18. Stephane Bergeron & Maurice Doyon & Laurent Muller, 2019. "Strategic response: A key to understand how cheap talk works," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 67(1), pages 75-83, March.
    19. Loomis, John B., 2014. "2013 WAEA Keynote Address: Strategies for Overcoming Hypothetical Bias in Stated Preference Surveys," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 39(1), pages 1-13, April.
    20. Ana Bedate & Luis Herrero & José Sanz, 2009. "Economic valuation of a contemporary art museum: correction of hypothetical bias using a certainty question," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 33(3), pages 185-199, August.

    More about this item

    Keywords

    Cheap Talk; Hypothetical Bias; Meta-analysis;
    All these keywords.

    JEL classification:

    • Q51 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Environmental Economics - - - Valuation of Environmental Effects
    • Q10 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Agriculture - - - General
    • D90 - Microeconomics - - Micro-Based Behavioral Economics - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jeeman:v:96:y:2019:i:c:p:22-35. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/622870 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.