IDEAS home Printed from https://ideas.repec.org/a/ecj/econjl/v118y2008i525p114-137.html
   My bibliography  Save this article

Eliciting Willingness to Pay Without Bias: Evidence from a Field Experiment

Author

Listed:
  • Karen Blumenschein
  • GlennC. Blomquist
  • Magnus Johannesson
  • Nancy Horn
  • Patricia Freeman

Abstract

Concern exists that hypothetical willingness to pay questions overestimate real willingness to pay. In a field experiment, we compare two methods of removing hypothetical bias, a cheap talk approach and a certainty approach, with real purchases. We find evidence of hypothetical bias for unadulterated contingent valuation. Contingent valuation with certainty statements removes the hypothetical bias, but the cheap talk approach has no significant impact. Our findings suggest that willingness to pay can be accurately estimated by adding a simple follow-up question about the certainty of responses and that cheap talk is not a generally effective approach. Copyright 2008 The Author(s). Journal compilation Royal Economic Society 2008.

Suggested Citation

  • Karen Blumenschein & GlennC. Blomquist & Magnus Johannesson & Nancy Horn & Patricia Freeman, 2008. "Eliciting Willingness to Pay Without Bias: Evidence from a Field Experiment," Economic Journal, Royal Economic Society, vol. 118(525), pages 114-137, January.
    • Handle: RePEc:ecj:econjl:v:118:y:2008:i:525:p:114-137
    as

    Download full text from publisher

    To our knowledge, this item is not available for download. To find whether it is available, there are three options:
    1. Check below whether another version of this item is available online.
    2. Check on the provider's web page whether it is in fact available.
    3. Perform a search for a similarly titled item that would be available.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Christian A. Vossler & Robert G. Ethier & Gregory L. Poe & Michael P. Welsh, 2003. "Payment Certainty in Discrete Choice Contingent Valuation Responses: Results from a Field Validity Test," Southern Economic Journal, John Wiley & Sons, vol. 69(4), pages 886-902, April.
    2. Magnus Tambour & Niklas Zethraeus, 1998. "Nonparametric Willingness-to-pay Measures and Confidence Statements," Medical Decision Making, , vol. 18(3), pages 330-336, August.
    3. Dan Ariely & George Loewenstein & Drazen Prelec, 2003. ""Coherent Arbitrariness": Stable Demand Curves Without Stable Preferences," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(1), pages 73-106.
    4. Johansson,Per-Olov, 1995. "Evaluating Health Risks," Cambridge Books, Cambridge University Press, number 9780521478786, September.
    5. Karen Blumenschein & Magnus Johannesson & Glenn C. Blomquist & Bengt Liljas & Richard M. O’Conor, 1998. "Experimental Results on Expressed Certainty and Hypothetical Bias in Contingent Valuation," Southern Economic Journal, John Wiley & Sons, vol. 65(1), pages 169-177, July.
    6. Johannesson, Magnus & Johansson, Per-Olov & Kristrom, Bengt & Gerdtham, Ulf-G., 1993. "Willingness to pay for antihypertensive therapy -- further results," Journal of Health Economics, Elsevier, vol. 12(1), pages 95-108, April.
    7. Bengt Kristrom, 1990. "A Non-Parametric Approach to the Estimation of Welfare Measures in Discrete Response Valuation Studies," Land Economics, University of Wisconsin Press, vol. 66(2), pages 135-139.
    8. Aadland, David & Caplan, Arthur J., 2006. "Cheap talk reconsidered: New evidence from CVM," Journal of Economic Behavior & Organization, Elsevier, vol. 60(4), pages 562-578, August.
    9. Camerer, Colin F & Hogarth, Robin M, 1999. "The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework," Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 7-42, December.
    10. Timothy C. Haab & Ju-Chin Huang & John C. Whitehead, 1999. "Are Hypothetical Referenda Incentive Compatible? A Comment," Journal of Political Economy, University of Chicago Press, vol. 107(1), pages 186-196, February.
    11. Laura O. Taylor & Ronald G. Cummings, 1999. "Unbiased Value Estimates for Environmental Goods: A Cheap Talk Design for the Contingent Valuation Method," American Economic Review, American Economic Association, vol. 89(3), pages 649-665, June.
    12. Budescu, David V, 1999. "Commentary on "The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework."," Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 43-45, December.
    13. Magnus Johannesson & Bengt Liljas & Per-Olov Johansson, 1998. "An experimental comparison of dichotomous choice contingent valuation questions and real purchase decisions," Applied Economics, Taylor & Francis Journals, vol. 30(5), pages 643-647.
    14. John List & Craig Gallet, 2001. "What Experimental Protocol Influence Disparities Between Actual and Hypothetical Stated Values?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 20(3), pages 241-254, November.
    15. Alberini, Anna & Boyle, Kevin & Welsh, Michael, 2003. "Analysis of contingent valuation data with multiple bids and response options allowing respondents to express uncertainty," Journal of Environmental Economics and Management, Elsevier, vol. 45(1), pages 40-62, January.
    16. Richard Carson & Nicholas Flores & Norman Meade, 2001. "Contingent Valuation: Controversies and Evidence," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 19(2), pages 173-210, June.
    17. Bishop, Richard C. & Heberlein, Thomas A., 1979. "Measuring Values Of Extramarket Goods: Are Indirect Measures Biased?," 1979 Annual Meeting, July 29-August 1, Pullman, Washington 277818, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    18. Eckel, Catherine, 1999. "Commentary on "The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework."," Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 47-48, December.
    19. Richard T. Carson & Nicholas E. Flores & Kerry M. Martin & Jennifer L. Wright, 1996. "Contingent Valuation and Revealed Preference Methodologies: Comparing the Estimates for Quasi-Public Goods," Land Economics, University of Wisconsin Press, vol. 72(1), pages 80-99.
    20. Cummings, Ronald G & Elliott, Steven & Harrison, Glenn W & Murphy, James, 1997. "Are Hypothetical Referenda Incentive Compatible?," Journal of Political Economy, University of Chicago Press, vol. 105(3), pages 609-621, June.
    21. Gregory Poe & Jeremy Clark & Daniel Rondeau & William Schulze, 2002. "Provision Point Mechanisms and Field Validity Tests of Contingent Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 23(1), pages 105-131, September.
    22. Peter A. Diamond & Jerry A. Hausman, 1994. "Contingent Valuation: Is Some Number Better than No Number?," Journal of Economic Perspectives, American Economic Association, vol. 8(4), pages 45-64, Fall.
    23. John A. List & Robert P. Berrens & Alok K. Bohara & Joe Kerkvliet, 2004. "Examining the Role of Social Isolation on Stated Preferences," American Economic Review, American Economic Association, vol. 94(3), pages 741-752, June.
    24. Vossler, Christian A. & Poe, Gregory L., 2005. "Analysis of contingent valuation data with multiple bids and response options allowing respondents to express uncertainty: a comment," Journal of Environmental Economics and Management, Elsevier, vol. 49(1), pages 197-200, January.
    25. Ajzen, Icek, 1991. "The theory of planned behavior," Organizational Behavior and Human Decision Processes, Elsevier, vol. 50(2), pages 179-211, December.
    26. Champ, Patricia A. & Bishop, Richard C. & Brown, Thomas C. & McCollum, Daniel W., 1997. "Using Donation Mechanisms to Value Nonuse Benefits from Public Goods," Journal of Environmental Economics and Management, Elsevier, vol. 33(2), pages 151-162, June.
    27. Glenn Harrison, 2006. "Experimental Evidence on Alternative Environmental Valuation Methods," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 34(1), pages 125-162, May.
    28. James Murphy & Thomas Stevens & Darryl Weatherhead, 2005. "Is Cheap Talk Effective at Eliminating Hypothetical Bias in a Provision Point Mechanism?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 30(3), pages 327-343, March.
    29. Carson, Richard T & Flores, Nicholas A, 2000. "Contingent Valuation: Controversies and Evidence," University of California at San Diego, Economics Working Paper Series qt75k752s7, Department of Economics, UC San Diego.
    30. Viscusi, W Kip & Evans, William N, 1990. "Utility Functions That Depend on Health Status: Estimates and Economic Implications," American Economic Review, American Economic Association, vol. 80(3), pages 353-374, June.
    31. Brown, Thomas C. & Ajzen, Icek & Hrubes, Daniel, 2003. "Further tests of entreaties to avoid hypothetical bias in referendum contingent valuation," Journal of Environmental Economics and Management, Elsevier, vol. 46(2), pages 353-361, September.
    32. Ready Richard C. & Whitehead John C. & Blomquist Glenn C., 1995. "Contingent Valuation When Respondents Are Ambivalent," Journal of Environmental Economics and Management, Elsevier, vol. 29(2), pages 181-196, September.
    33. Blumenschein, Karen & Johannesson, Magnus & Yokoyama, Krista K. & Freeman, Patricia R., 2001. "Hypothetical versus real willingness to pay in the health care sector: results from a field experiment," Journal of Health Economics, Elsevier, vol. 20(3), pages 441-457, May.
    34. Paul R. Portney, 1994. "The Contingent Valuation Debate: Why Economists Should Care," Journal of Economic Perspectives, American Economic Association, vol. 8(4), pages 3-17, Fall.
    35. Cummings, Ronald G & Harrison, Glenn W & Rutstrom, E Elisabet, 1995. "Homegrown Values and Hypothetical Surveys: Is the Dichotomous Choice Approach Incentive-Compatible?," American Economic Review, American Economic Association, vol. 85(1), pages 260-266, March.
    36. Mary F. Evans & Nicholas E. Flores & Kevin J. Boyle, 2003. "Multiple-Bounded Uncertainty Choice Data as Probabilistic Intentions," Land Economics, University of Wisconsin Press, vol. 79(4), pages 549-560.
    37. Richard C. Ready & Ståle Navrud & RW. Richard Dubourg, 2001. "How Do Respondents with Uncertain Willingness to Pay Answer Contingent Valuation Questions?," Land Economics, University of Wisconsin Press, vol. 77(3), pages 315-326.
    38. Aadland, David & Caplan, Arthur J., 2003. "Cheap Talk Revisited: New Evidence From Cvm," 2003 Annual meeting, July 27-30, Montreal, Canada 22112, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    39. Christian A. Vossler & Robert G. Ethier & Gregory L. Poe & Michael P. Welsh, 2003. "Payment Certainty in Discrete Choice Contingent Valuation Responses: Results from a Field Validity Test," Southern Economic Journal, John Wiley & Sons, vol. 69(4), pages 886-902, April.
    40. Robert G. Ethier & Gregory L. Poe & William D. Schulze & Jeremy Clark, 2000. "Comparison of Hypothetical Phone and Mail Contingent Valuation Responses for Green-Pricing Electricity Programs," Land Economics, University of Wisconsin Press, vol. 76(1), pages 54-67.
    41. Patricia Champ & Richard Bishop, 2001. "Donation Payment Mechanisms and Contingent Valuation: An Empirical Study of Hypothetical Bias," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 19(4), pages 383-402, August.
    42. John A. List, 2001. "Do Explicit Warnings Eliminate the Hypothetical Bias in Elicitation Procedures? Evidence from Field Auctions for Sportscards," American Economic Review, American Economic Association, vol. 91(5), pages 1498-1507, December.
    43. Fujii, Satoshi & Gärling, Tommy, 2003. "Application of attitude theory for improved predictive accuracy of stated preference methods in travel demand analysis," Transportation Research Part A: Policy and Practice, Elsevier, vol. 37(4), pages 389-402, May.
    44. Johansson,Per-Olov, 1995. "Evaluating Health Risks," Cambridge Books, Cambridge University Press, number 9780521472852, September.
    45. Richard C. Bishop & Thomas A. Heberlein, 1979. "Measuring Values of Extramarket Goods: Are Indirect Measures Biased?," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 61(5), pages 926-930.
    46. Johannesson, Magnus & Blomquist, Glenn C. & Blumenschein, Karen & Johansson, Per-olov & Liljas, Bengt & O'Conor, Richard M., 1999. "Calibrating Hypothetical Willingness to Pay Responses," Journal of Risk and Uncertainty, Springer, vol. 18(1), pages 21-32, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Murphy, James J. & Stevens, Thomas H., 2004. "Contingent Valuation, Hypothetical Bias, and Experimental Economics," Agricultural and Resource Economics Review, Cambridge University Press, vol. 33(2), pages 182-192, October.
    2. John K. Horowitz & Kenneth E. McConnell & James J. Murphy, 2013. "Behavioral foundations of environmental economics and valuation," Chapters, in: John A. List & Michael K. Price (ed.), Handbook on Experimental Economics and the Environment, chapter 4, pages 115-156, Edward Elgar Publishing.
    3. Ana Bedate & Luis Herrero & José Sanz, 2009. "Economic valuation of a contemporary art museum: correction of hypothetical bias using a certainty question," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 33(3), pages 185-199, August.
    4. Lars Hultkrantz & Gunnar Lindberg & Camilla Andersson, 2006. "The value of improved road safety," Journal of Risk and Uncertainty, Springer, vol. 32(2), pages 151-170, March.
    5. Sund, Björn, 2009. "Certainty calibration in contingent valuation - exploring the within-difference between dichotomous choice and open-ended answers as a certainty measure," Working Papers 2009:1, Örebro University, School of Business.
    6. Richard T. Carson, 2011. "Contingent Valuation," Books, Edward Elgar Publishing, number 2489.
    7. Svensson, Mikael, 2006. "The Value of a Statistical Life in Sweden Estimates from Two Studies using the "Certainty Approach" Calibration," Working Papers 2006:6, Örebro University, School of Business, revised 12 May 2009.
    8. Whitehead, John C. & Cherry, Todd L., 2007. "Willingness to pay for a Green Energy program: A comparison of ex-ante and ex-post hypothetical bias mitigation approaches," Resource and Energy Economics, Elsevier, vol. 29(4), pages 247-261, November.
    9. Veisten, Knut, 2007. "Contingent valuation controversies: Philosophic debates about economic theory," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 36(2), pages 204-232, April.
    10. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part II. Conceptualisation of external validity, sources and explanations of bias and effectiveness of mitigation methods," Journal of choice modelling, Elsevier, vol. 41(C).
    11. Hensher, David A., 2010. "Hypothetical bias, choice experiments and willingness to pay," Transportation Research Part B: Methodological, Elsevier, vol. 44(6), pages 735-752, July.
    12. Milad Haghani & Michiel C. J. Bliemer & John M. Rose & Harmen Oppewal & Emily Lancsar, 2021. "Hypothetical bias in stated choice experiments: Part II. Macro-scale analysis of literature and effectiveness of bias mitigation methods," Papers 2102.02945, arXiv.org.
    13. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    14. Blumenschein, Karen & Johannesson, Magnus & Yokoyama, Krista K. & Freeman, Patricia R., 2001. "Hypothetical versus real willingness to pay in the health care sector: results from a field experiment," Journal of Health Economics, Elsevier, vol. 20(3), pages 441-457, May.
    15. Mark A. Andor & Manuel Frondel & Colin Vance, 2017. "Mitigating Hypothetical Bias: Evidence on the Effects of Correctives from a Large Field Study," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 68(3), pages 777-796, November.
    16. Jinkwon Lee & Uk Hwang, 2016. "Hypothetical Bias in Risk Preferences as a Driver of Hypothetical Bias in Willingness to Pay: Experimental Evidence," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 65(4), pages 789-811, December.
    17. Glenn Blomquist & Karen Blumenschein & Magnus Johannesson, 2009. "Eliciting Willingness to Pay without Bias using Follow-up Certainty Statements: Comparisons between Probably/Definitely and a 10-point Certainty Scale," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 43(4), pages 473-502, August.
    18. Shogren, Jason F., 2006. "Experimental Methods and Valuation," Handbook of Environmental Economics, in: K. G. Mäler & J. R. Vincent (ed.), Handbook of Environmental Economics, edition 1, volume 2, chapter 19, pages 969-1027, Elsevier.
    19. Gregory Poe & Jeremy Clark & Daniel Rondeau & William Schulze, 2002. "Provision Point Mechanisms and Field Validity Tests of Contingent Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 23(1), pages 105-131, September.
    20. Mark Morrison & Thomas Brown, 2009. "Testing the Effectiveness of Certainty Scales, Cheap Talk, and Dissonance-Minimization in Reducing Hypothetical Bias in Contingent Valuation Studies," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 44(3), pages 307-326, November.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ecj:econjl:v:118:y:2008:i:525:p:114-137. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley-Blackwell Digital Licensing or Christopher F. Baum (email available below). General contact details of provider: https://edirc.repec.org/data/resssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.