IDEAS home Printed from https://ideas.repec.org/a/ags/jlaare/168258.html
   My bibliography  Save this article

2013 WAEA Keynote Address: Strategies for Overcoming Hypothetical Bias in Stated Preference Surveys

Author

Listed:
  • Loomis, John B.

Abstract

In some, but not all, contexts, respondents to stated preference valuation studies state a willingness to pay (WTP) higher than what lab or field experiments indicate is the actual amount they would pay. However, several ex ante survey design strategies and ex post calibration techniques can be used to minimize or eliminate hypothetical bias. This article reviews and presents evidence on the effectiveness of these ex ante and ex post approaches. The ex ante approaches lead to recommendations to modify survey designs to minimize the bias up front. If the analyst desires, ex post calibration of WTP using certainty scales can be used to reduce stated WTP to the point at which it will match actual cash contributions.

Suggested Citation

  • Loomis, John B., 2014. "2013 WAEA Keynote Address: Strategies for Overcoming Hypothetical Bias in Stated Preference Surveys," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 39(1), pages 1-13, April.
    • Handle: RePEc:ags:jlaare:168258
    DOI: 10.22004/ag.econ.168258
    as

    Download full text from publisher

    File URL: https://ageconsearch.umn.edu/record/168258/files/JARE_Apr2014__3_Loomis_pp34-46.pdf
    Download Restriction: no
    File URL: https://libkey.io/10.22004/ag.econ.168258?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Whitehead, John C. & Cherry, Todd L., 2007. "Willingness to pay for a Green Energy program: A comparison of ex-ante and ex-post hypothetical bias mitigation approaches," Resource and Energy Economics, Elsevier, vol. 29(4), pages 247-261, November.
    2. Louviere,Jordan J. & Hensher,David A. & Swait,Joffre D. With contributions by-Name:Adamowicz,Wiktor, 2000. "Stated Choice Methods," Cambridge Books, Cambridge University Press, number 9780521788304.
    3. Craig E. Landry & John A. List, 2007. "Using Ex Ante Approaches to Obtain Credible Signals for Value in Contingent Markets: Evidence from the Field," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 89(2), pages 420-429.
    4. Bohm, Peter, 1972. "Estimating demand for public goods: An experiment," European Economic Review, Elsevier, vol. 3(2), pages 111-130.
    5. Catherine L. Kling & Daniel J. Phaneuf & Jinhua Zhao, 2012. "From Exxon to BP: Has Some Number Become Better Than No Number?," Journal of Economic Perspectives, American Economic Association, vol. 26(4), pages 3-26, Fall.
    6. Christian A. Vossler & Maurice Doyon & Daniel Rondeau, 2012. "Truth in Consequentiality: Theory and Field Evidence on Discrete Choice Experiments," American Economic Journal: Microeconomics, American Economic Association, vol. 4(4), pages 145-171, November.
    7. Jayson L. Lusk & F. Bailey Norwood, 2011. "Animal Welfare Economics," Applied Economic Perspectives and Policy, Agricultural and Applied Economics Association, vol. 33(4), pages 463-483.
    8. John Loomis & Thomas Brown & Beatrice Lucero & George Peterson, 1996. "Improving Validity Experiments of Contingent Valuation Methods: Results of Efforts to Reduce the Disparity of Hypothetical and Actual Willingness to Pay," Land Economics, University of Wisconsin Press, vol. 72(4), pages 450-461.
    9. Karen Blumenschein & GlennC. Blomquist & Magnus Johannesson & Nancy Horn & Patricia Freeman, 2008. "Eliciting Willingness to Pay Without Bias: Evidence from a Field Experiment," Economic Journal, Royal Economic Society, vol. 118(525), pages 114-137, January.
    10. Richard T. Carson & Nicholas E. Flores & Kerry M. Martin & Jennifer L. Wright, 1996. "Contingent Valuation and Revealed Preference Methodologies: Comparing the Estimates for Quasi-Public Goods," Land Economics, University of Wisconsin Press, vol. 72(1), pages 80-99.
    11. Johnston, Robert J., 2006. "Is hypothetical bias universal? Validating contingent valuation responses using a binding public referendum," Journal of Environmental Economics and Management, Elsevier, vol. 52(1), pages 469-481, July.
    12. Thomas C. Brown & Patricia A. Champ & Richard C. Bishop & Daniel W. McCollum, 1996. "Which Response Format Reveals the Truth about Donations to a Public Good?," Land Economics, University of Wisconsin Press, vol. 72(2), pages 152-166.
    13. Jacquemet, Nicolas & Joule, Robert-Vincent & Luchini, Stéphane & Shogren, Jason F., 2013. "Preference elicitation under oath," Journal of Environmental Economics and Management, Elsevier, vol. 65(1), pages 110-132.
    14. John A. Fox & Jason F. Shogren & Dermot J. Hayes & James B. Kliebenstein, 1998. "CVM-X: Calibrating Contingent Values with Experimental Auction Markets," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 80(3), pages 455-465.
    15. Jerry Hausman, 2012. "Contingent Valuation: From Dubious to Hopeless," Journal of Economic Perspectives, American Economic Association, vol. 26(4), pages 43-56, Fall.
    16. James Murphy & P. Allen & Thomas Stevens & Darryl Weatherhead, 2005. "A Meta-analysis of Hypothetical Bias in Stated Preference Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 30(3), pages 313-325, March.
    17. Rebecca Moore & Richard C. Bishop & Bill Provencher & Patricia A. Champ, 2010. "Accounting for Respondent Uncertainty to Improve Willingness‐to‐Pay Estimates," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 58(3), pages 381-401, September.
    18. Brown, Thomas C. & Ajzen, Icek & Hrubes, Daniel, 2003. "Further tests of entreaties to avoid hypothetical bias in referendum contingent valuation," Journal of Environmental Economics and Management, Elsevier, vol. 46(2), pages 353-361, September.
    19. Jayson L. Lusk & F. Bailey Norwood, 2009. "An Inferred Valuation Method," Land Economics, University of Wisconsin Press, vol. 85(3), pages 500-514.
    20. Glenn W. Harrison & Ronald M. Harstad & E. Elisabet Rutstr–m, 2004. "Experimental Methods and Elicitation of Values," Experimental Economics, Springer;Economic Science Association, vol. 7(2), pages 123-140, June.
    21. Timothy C. Haab & Kenneth E. McConnell, 2002. "Valuing Environmental and Natural Resources," Books, Edward Elgar Publishing, number 2427.
    22. Davies, Stephen & Loomis, John, 2010. "An Improved Method for Calibrating Purchase Intentions in Stated Preference Demand Models," Journal of Agricultural and Applied Economics, Cambridge University Press, vol. 42(4), pages 679-693, November.
    23. John Loomis & Cynthia Pierce & Mike Manfredo, 2000. "Using the demand for hunting licences to evaluate contingent valuation estimates of willingness to pay," Applied Economics Letters, Taylor & Francis Journals, vol. 7(7), pages 435-438.
    24. Laura O. Taylor & Ronald G. Cummings, 1999. "Unbiased Value Estimates for Environmental Goods: A Cheap Talk Design for the Contingent Valuation Method," American Economic Review, American Economic Association, vol. 89(3), pages 649-665, June.
    25. Champ, Patricia A. & Moore, Rebecca & Bishop, Richard C., 2009. "A Comparison of Approaches to Mitigate Hypothetical Bias," Agricultural and Resource Economics Review, Cambridge University Press, vol. 38(2), pages 166-180, October.
    26. John List & Craig Gallet, 2001. "What Experimental Protocol Influence Disparities Between Actual and Hypothetical Stated Values?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 20(3), pages 241-254, November.
    27. repec:feb:framed:0073 is not listed on IDEAS
    28. Sonia Akter & Jeff Bennett, 2012. "Valuing Climate Change Mitigation," Books, Edward Elgar Publishing, number 14829.
    29. Vossler, Christian A. & Watson, Sharon B., 2013. "Understanding the consequences of consequentiality: Testing the validity of stated preferences in the field," Journal of Economic Behavior & Organization, Elsevier, vol. 86(C), pages 137-147.
    30. Vossler, Christian A. & Kerkvliet, Joe, 2003. "A criterion validity test of the contingent valuation method: comparing hypothetical and actual voting behavior for a public referendum," Journal of Environmental Economics and Management, Elsevier, vol. 45(3), pages 631-649, May.
    31. Peter Bohm, 1972. "Estimating the demand for public goods: An experiment," Framed Field Experiments 00126, The Field Experiments Website.
    32. repec:ebl:ecbull:v:3:y:2004:i:6:p:1-13 is not listed on IDEAS
    33. Vossler, Christian A. & Evans, Mary F., 2009. "Bridging the gap between the field and the lab: Environmental goods, policy maker input, and consequentiality," Journal of Environmental Economics and Management, Elsevier, vol. 58(3), pages 338-345, November.
    34. Norwood, F. Bailey & Lusk, Jayson L., 2011. "A calibrated auction-conjoint valuation method: Valuing pork and eggs produced under differing animal welfare conditions," Journal of Environmental Economics and Management, Elsevier, vol. 62(1), pages 80-94, July.
    35. Peter A. Diamond & Jerry A. Hausman, 1994. "Contingent Valuation: Is Some Number Better than No Number?," Journal of Economic Perspectives, American Economic Association, vol. 8(4), pages 45-64, Fall.
    36. Jayson L. Lusk & Ted C. Schroeder, 2004. "Are Choice Experiments Incentive Compatible? A Test with Quality Differentiated Beef Steaks," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 86(2), pages 467-482.
    37. John A. List, 2001. "Do Explicit Warnings Eliminate the Hypothetical Bias in Elicitation Procedures? Evidence from Field Auctions for Sportscards," American Economic Review, American Economic Association, vol. 91(5), pages 1498-1507, December.
    38. David Aadland & Arthur J. Caplan, 2003. "Willingness to Pay for Curbside Recycling with Detection and Mitigation of Hypothetical Bias," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 85(2), pages 492-502.
    39. Champ, Patricia A. & Bishop, Richard C. & Brown, Thomas C. & McCollum, Daniel W., 1997. "Using Donation Mechanisms to Value Nonuse Benefits from Public Goods," Journal of Environmental Economics and Management, Elsevier, vol. 33(2), pages 151-162, June.
    40. Champ, Patricia A. & Moore, Rebecca & Bishop, Richard C., 2009. "A Comparison of Approaches to Mitigate Hypothetical Bias," Agricultural and Resource Economics Review, Northeastern Agricultural and Resource Economics Association, vol. 38(2), pages 1-15, October.
    41. Joseph Little & Robert Berrens, 2004. "Explaining Disparities between Actual and Hypothetical Stated Values: Further Investigation Using Meta-Analysis," Economics Bulletin, AccessEcon, vol. 3(6), pages 1-13.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fifer, Simon & Rose, John M., 2016. "Can you ever be certain? Reducing hypothetical bias in stated choice experiments via respondent reported choice certaintyAuthor-Name: Beck, Matthew J," Transportation Research Part B: Methodological, Elsevier, vol. 89(C), pages 149-167.
    2. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    3. John K. Horowitz & Kenneth E. McConnell & James J. Murphy, 2013. "Behavioral foundations of environmental economics and valuation," Chapters, in: John A. List & Michael K. Price (ed.), Handbook on Experimental Economics and the Environment, chapter 4, pages 115-156, Edward Elgar Publishing.
    4. Catherine L. Kling & Daniel J. Phaneuf & Jinhua Zhao, 2012. "From Exxon to BP: Has Some Number Become Better Than No Number?," Journal of Economic Perspectives, American Economic Association, vol. 26(4), pages 3-26, Fall.
    5. Helga Fehr-Duda & Robin Schimmelpfennig, 2018. "Wider die Zahlengläubigkeit: Sind Befragungsergebnisse eine gute Grundlage für wirtschaftspolitische Entscheidungen?," ECON - Working Papers 297, Department of Economics - University of Zurich, revised Dec 2018.
    6. Nicolas Jacquemet & Alexander James & Stéphane Luchini & Jason Shogren, 2011. "Social Psychology and Environmental Economics: A New Look at ex ante Corrections of Biased Preference Evaluation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 48(3), pages 413-433, March.
    7. Jie He & Jérôme Dupras & Thomas G. Poder, 2018. "Payment and Provision Consequentiality in Voluntary Contribution Mechanism: Single or Double “Knife-Edge” Evidence?," Cahiers de recherche 18-02, Departement d'économique de l'École de gestion à l'Université de Sherbrooke.
    8. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part II. Conceptualisation of external validity, sources and explanations of bias and effectiveness of mitigation methods," Journal of choice modelling, Elsevier, vol. 41(C).
    9. Fifer, Simon & Rose, John & Greaves, Stephen, 2014. "Hypothetical bias in Stated Choice Experiments: Is it a problem? And if so, how do we deal with it?," Transportation Research Part A: Policy and Practice, Elsevier, vol. 61(C), pages 164-177.
    10. Jinkwon Lee & Uk Hwang, 2016. "Hypothetical Bias in Risk Preferences as a Driver of Hypothetical Bias in Willingness to Pay: Experimental Evidence," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 65(4), pages 789-811, December.
    11. Atozou, Baoubadi & Tamini, Lota D. & Bergeronm, Stephane & Doyon, Maurice, 2020. "Factors Explaining the Hypothetical Bias: How to Improve Models for Meta-Analyses," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 45(2), March.
    12. Kanya, Lucy & Saghera, Sabina & Lewin, Alex & Fox-Rushby, Julia, 2019. "The criterion validity of willingness to pay methods: a systematic review and meta-analysis of the evidence," LSE Research Online Documents on Economics 100741, London School of Economics and Political Science, LSE Library.
    13. Daniel A. Brent & Lata Gangadharan & Anke Leroux & Paul A. Raschky, 2014. "Putting One's Money Where One's Mouth is: Increasing Saliency in the Field," Monash Economics Working Papers 43-14, Monash University, Department of Economics.
    14. Sawe, Nik, 2017. "Using neuroeconomics to understand environmental valuation," Ecological Economics, Elsevier, vol. 135(C), pages 1-9.
    15. Daniel A. Brent & Lata Gangadharan & Anke Leroux & Paul A. Raschky, 2016. "Putting Your Money Where Your Mouth Is," Monash Economics Working Papers 42-16, Monash University, Department of Economics.
    16. Quainoo, Ruth & Petrolia, Daniel, 2018. "Mitigating Hypothetical Bias: An Application to WTP for Beach Conditions Information," 2018 Annual Meeting, February 2-6, 2018, Jacksonville, Florida 266715, Southern Agricultural Economics Association.
    17. Mohammed H. Alemu & Søren B. Olsen, 2017. "Can a Repeated Opt-Out Reminder remove hypothetical bias in discrete choice experiments? An application to consumer valuation of novel food products," IFRO Working Paper 2017/05, University of Copenhagen, Department of Food and Resource Economics.
    18. Kanya, Lucy & Sanghera, Sabina & Lewin, Alex & Fox-Rushby, Julia, 2019. "The criterion validity of willingness to pay methods: A systematic review and meta-analysis of the evidence," Social Science & Medicine, Elsevier, vol. 232(C), pages 238-261.
    19. Murphy, James J. & Stevens, Thomas H., 2004. "Contingent Valuation, Hypothetical Bias, and Experimental Economics," Agricultural and Resource Economics Review, Northeastern Agricultural and Resource Economics Association, vol. 33(2), pages 1-11, October.
    20. Crastes dit Sourd, Romain & Zawojska, Ewa & Mahieu, Pierre-Alexandre & Louviere, Jordan, 2018. "Mitigating strategic misrepresentation of values in open-ended stated preference surveys by using negative reinforcement," Journal of choice modelling, Elsevier, vol. 28(C), pages 153-166.

    More about this item

    Keywords

    Research Methods/ Statistical Methods;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ags:jlaare:168258. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: AgEcon Search (email available below). General contact details of provider: https://edirc.repec.org/data/waeaaea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.