IDEAS home Printed from https://ideas.repec.org/a/eee/ecolec/v189y2021ics0921800921002020.html
   My bibliography  Save this article

Contingent valuation estimates for environmental goods: Validity and reliability

Author

Listed:
  • Perni, Ángel
  • Barreiro-Hurlé, Jesús
  • Martínez-Paz, José Miguel

Abstract

The contingent valuation method (CV) has become a recognised tool for estimating monetary non-market values. Despite the pragmatic acceptance of CV in policy evaluation, the application of CV-based estimates in decision-making remains controversial, as critics argue that CV suffers of hypothetical bias and question its accuracy to reflect non-market values via willingness to pay (WTP) estimates. In this paper we approach the assessment of CV accuracy from a double perspective. First, we assess validity and reliability by comparing CV-based WTP estimates and real monetary contributions to a crowdfunding initiative. Second, we assess construct validity identifying whether changing individual preferences are driven by strictly rational economic behaviour or by other factors that are not consistent with it. For this purpose, we conduct regression analysis using a synthetic panel dataset constructed from two contingent valuation surveys using the Propensity Score Matching method. Our findings suggest that WTP estimates are suitable to infer the economic value of environmental assets. This evidence points towards non-market valuation methods being capable of eliciting rational behaviour from individuals that is free of hypothetical bias. However, hypothetical bias might be lurking in a less researched area, that of market participation, which calls for a rigorous treatment of protest behaviour.

Suggested Citation

  • Perni, Ángel & Barreiro-Hurlé, Jesús & Martínez-Paz, José Miguel, 2021. "Contingent valuation estimates for environmental goods: Validity and reliability," Ecological Economics, Elsevier, vol. 189(C).
  • Handle: RePEc:eee:ecolec:v:189:y:2021:i:c:s0921800921002020
    DOI: 10.1016/j.ecolecon.2021.107144
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0921800921002020
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ecolecon.2021.107144?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ando, Amy W. & Cadavid, Catalina Londoño & Netusil, Noelwah R. & Parthum, Bryan, 2020. "Willingness-to-volunteer and stability of preferences between cities: Estimating the benefits of stormwater management," Journal of Environmental Economics and Management, Elsevier, vol. 99(C).
    2. Harry Foster & James Burrows, 2017. "Hypothetical bias: a new meta-analysis," Chapters, in: Daniel McFadden & Kenneth Train (ed.), Contingent Valuation of Environmental Goods, chapter 10, pages 270-291, Edward Elgar Publishing.
    3. K. McConnell* & I. Strand & Sebastián Valdés, 1998. "Testing Temporal Reliability and Carry-over Effect: The Role of Correlated Responses in Test-retest Reliability Studies," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 12(3), pages 357-374, October.
    4. Bateman, Ian J. & Day, Brett H. & Georgiou, Stavros & Lake, Iain, 2006. "The aggregation of environmental benefit values: Welfare measures, distance decay and total WTP," Ecological Economics, Elsevier, vol. 60(2), pages 450-460, December.
    5. Vossler, Christian A. & Kerkvliet, Joe & Polasky, Stephen & Gainutdinova, Olesya, 2003. "Externally validating contingent valuation: an open-space survey and referendum in Corvallis, Oregon," Journal of Economic Behavior & Organization, Elsevier, vol. 51(2), pages 261-277, June.
    6. Vossler, Christian A. & Kerkvliet, Joe, 2003. "A criterion validity test of the contingent valuation method: comparing hypothetical and actual voting behavior for a public referendum," Journal of Environmental Economics and Management, Elsevier, vol. 45(3), pages 631-649, May.
    7. repec:ebl:ecbull:v:3:y:2004:i:6:p:1-13 is not listed on IDEAS
    8. Boyle, Kevin J. & Welsh, Michael P. & Bishop, Richard C. & Baumgartner, Robert M., 1995. "Validating Contingent Valuation With Surveys Of Experts," Agricultural and Resource Economics Review, Northeastern Agricultural and Resource Economics Association, vol. 24(2), pages 1-8, October.
    9. Bateman, Ian J. & Burgess, Diane & Hutchinson, W. George & Matthews, David I., 2008. "Learning design contingent valuation (LDCV): NOAA guidelines, preference learning and coherent arbitrariness," Journal of Environmental Economics and Management, Elsevier, vol. 55(2), pages 127-141, March.
    10. Nick Hanley & Mikołaj Czajkowski, 2019. "The Role of Stated Preference Valuation Methods in Understanding Choices and Informing Policy," Review of Environmental Economics and Policy, Association of Environmental and Resource Economists, vol. 13(2), pages 248-266.
    11. Loureiro, Maria L. & Loomis, John, 2017. "How Sensitive Are Environmental Valuations To Economic Downturns?," Ecological Economics, Elsevier, vol. 140(C), pages 235-240.
    12. Martin-Ortega, Julia & Perni, Angel & Jackson-Blake, Leah & Balana, Bedru B. & Mckee, Annie & Dunn, Sarah & Helliwell, Rachel & Psaltopoulos, Demetris & Skuras, Dimitris & Cooksley, Susan & Slee, Bill, 2015. "A transdisciplinary approach to the economic analysis of the European Water Framework Directive," Ecological Economics, Elsevier, vol. 116(C), pages 34-45.
    13. Richard T. Carson & W. Michael Hanemann, & Raymond J. Kopp & Jon A. Krosnick & Robert C. Mitchell & Stanley Presser & Paul A. Rudd & V. Kerry Smith & Michael Conaway & Kerry Martin, 1997. "Temporal Reliability of Estimates from Contingent Valuation," Land Economics, University of Wisconsin Press, vol. 73(2), pages 151-163.
    14. Johnston, Robert J., 2006. "Is hypothetical bias universal? Validating contingent valuation responses using a binding public referendum," Journal of Environmental Economics and Management, Elsevier, vol. 52(1), pages 469-481, July.
    15. Perni, Ángel & Barreiro-Hurlé, Jesús & Martínez-Paz, José Miguel, 2020. "When policy implementation failures affect public preferences for environmental goods: Implications for economic analysis in the European water policy," Ecological Economics, Elsevier, vol. 169(C).
    16. Barreiro-Hurle, Jesus & Espinosa-Goded, Maria & Martinez-Paz, Jose Miguel & Perni, Angel, 2018. "Choosing not to choose: A meta-analysis of status quo effects in environmental valuations using choice experiments," Economia Agraria y Recursos Naturales, Spanish Association of Agricultural Economists, vol. 18(01), June.
    17. Stephen D. Reiling & Kevin J. Boyle & Marcia L. Phillips & Mark W. Anderson, 1990. "Temporal Reliability of Contingent Values," Land Economics, University of Wisconsin Press, vol. 66(2), pages 128-134.
    18. Meyerhoff, Jürgen & Liebe, Ulf, 2010. "Determinants of protest responses in environmental valuation: A meta-study," Ecological Economics, Elsevier, vol. 70(2), pages 366-374, December.
    19. Loomis, John B., 1990. "Comparative reliability of the dichotomous choice and open-ended contingent valuation techniques," Journal of Environmental Economics and Management, Elsevier, vol. 18(1), pages 78-85, January.
    20. Oerlemans, Leon A.G. & Chan, Kai-Ying & Volschenk, Jako, 2016. "Willingness to pay for green electricity: A review of the contingent valuation literature and its sources of error," Renewable and Sustainable Energy Reviews, Elsevier, vol. 66(C), pages 875-885.
    21. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    22. John List & Craig Gallet, 2001. "What Experimental Protocol Influence Disparities Between Actual and Hypothetical Stated Values?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 20(3), pages 241-254, November.
    23. Robert Tinch & Nicola Beaumont & Tim Sunderland & Ece Ozdemiroglu & David Barton & Colm Bowe & Tobias Börger & Paul Burgess & Canon Nigel Cooper & Michela Faccioli & Pierre Failler & Ioanna Gkolemi & , 2019. "Economic valuation of ecosystem goods and services: a review for decision makers," Journal of Environmental Economics and Policy, Taylor & Francis Journals, vol. 8(4), pages 359-378, October.
    24. Richard C. Bishop & Kevin J. Boyle, 2019. "Reliability and Validity in Nonmarket Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 72(2), pages 559-582, February.
    25. Lopez-Becerra, E.I. & Alcon, F., 2021. "Social desirability bias in the environmental economic valuation: An inferred valuation approach," Ecological Economics, Elsevier, vol. 184(C).
    26. Alcon, Francisco & de-Miguel, María Dolores & Martínez-Paz, José Miguel, 2021. "Assessment of real and perceived cost-effectiveness to inform agricultural diffuse pollution mitigation policies," Land Use Policy, Elsevier, vol. 107(C).
    27. Wang, Hua & He, Jie & Huang, Desheng, 2020. "Public distrust and valuation biases: Identification and calibration with contingent valuation studies of two air quality improvement programs in China," China Economic Review, Elsevier, vol. 61(C).
    28. Jerry Hausman, 2012. "Contingent Valuation: From Dubious to Hopeless," Journal of Economic Perspectives, American Economic Association, vol. 26(4), pages 43-56, Fall.
    29. Zein Kallas & José A. Gómez‐Limón & Jesús Barreiro Hurlé, 2007. "Decomposing the Value of Agricultural Multifunctionality: Combining Contingent Valuation and the Analytical Hierarchy Process," Journal of Agricultural Economics, Wiley Blackwell, vol. 58(2), pages 218-241, June.
    30. Brouwer, Roy & van Beukering, Pieter & Sultanian, Elena, 2008. "The impact of the bird flu on public willingness to pay for the protection of migratory birds," Ecological Economics, Elsevier, vol. 64(3), pages 575-585, January.
    31. Joseph Little & Robert Berrens, 2004. "Explaining Disparities between Actual and Hypothetical Stated Values: Further Investigation Using Meta-Analysis," Economics Bulletin, AccessEcon, vol. 3(6), pages 1-13.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yu, Ying & Yamaguchi, Kensuke & Thuy, Truong Dang & Kittner, Noah, 2022. "Will the public in emerging economies support renewable energy? Evidence from Ho Chi Minh City, Vietnam," Renewable and Sustainable Energy Reviews, Elsevier, vol. 169(C).
    2. Tan, Yang & Fukuda, Hiroatsu & Li, Zhang & Wang, Shuai & Gao, Weijun & Liu, Zhonghui, 2022. "Does the public support the construction of battery swapping station for battery electric vehicles? - Data from Hangzhou, China," Energy Policy, Elsevier, vol. 163(C).
    3. Koo, A Mi & Kim, Ju-Hee & Yoo, Seung-Hoon, 2022. "Household willingness to pay for a smart water metering and monitoring system: The case of South Korea," Utilities Policy, Elsevier, vol. 79(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Richard C. Bishop & Kevin J. Boyle, 2019. "Reliability and Validity in Nonmarket Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 72(2), pages 559-582, February.
    2. Perni, Ángel & Barreiro-Hurlé, Jesús & Martínez-Paz, José Miguel, 2020. "When policy implementation failures affect public preferences for environmental goods: Implications for economic analysis in the European water policy," Ecological Economics, Elsevier, vol. 169(C).
    3. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    4. Martínez-Paz, José M. & Albaladejo-García, José A. & Barreiro-Hurle, Jesús & Pleite, Federico Martínez-Carrasco & Perni, Ángel, 2021. "Spatial effects in the socioeconomic valuation of peri-urban ecosystems restoration," Land Use Policy, Elsevier, vol. 105(C).
    5. Richard T. Carson, 2011. "Contingent Valuation," Books, Edward Elgar Publishing, number 2489.
    6. Loureiro, Maria L. & Loomis, John, 2017. "How Sensitive Are Environmental Valuations To Economic Downturns?," Ecological Economics, Elsevier, vol. 140(C), pages 235-240.
    7. Catherine L. Kling & Daniel J. Phaneuf & Jinhua Zhao, 2012. "From Exxon to BP: Has Some Number Become Better Than No Number?," Journal of Economic Perspectives, American Economic Association, vol. 26(4), pages 3-26, Fall.
    8. Kanya, Lucy & Saghera, Sabina & Lewin, Alex & Fox-Rushby, Julia, 2019. "The criterion validity of willingness to pay methods: a systematic review and meta-analysis of the evidence," LSE Research Online Documents on Economics 100741, London School of Economics and Political Science, LSE Library.
    9. Loomis, John B., 2014. "2013 WAEA Keynote Address: Strategies for Overcoming Hypothetical Bias in Stated Preference Surveys," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 39(1), pages 1-13, April.
    10. Simora, Michael & Frondel, Manuel & Vance, Colin, 2020. "Do financial incentives increase the acceptance of power lines? Evidence from Germany," Regional Science and Urban Economics, Elsevier, vol. 85(C).
    11. Sawe, Nik, 2017. "Using neuroeconomics to understand environmental valuation," Ecological Economics, Elsevier, vol. 135(C), pages 1-9.
    12. Jie He & Bing Zhang, 2021. "Current Air Pollution and Willingness to Pay for Better Air Quality: Revisiting the Temporal Reliability of the Contingent Valuation Method," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 79(1), pages 135-168, May.
    13. Robert J. Johnston & Kevin J. Boyle & Maria L. Loureiro & Ståle Navrud & John Rolfe, 2021. "Guidance to Enhance the Validity and Credibility of Environmental Benefit Transfers," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 79(3), pages 575-624, July.
    14. Vossler, Christian A. & Watson, Sharon B., 2013. "Understanding the consequences of consequentiality: Testing the validity of stated preferences in the field," Journal of Economic Behavior & Organization, Elsevier, vol. 86(C), pages 137-147.
    15. Koo, A Mi & Kim, Ju-Hee & Yoo, Seung-Hoon, 2022. "Household willingness to pay for a smart water metering and monitoring system: The case of South Korea," Utilities Policy, Elsevier, vol. 79(C).
    16. Johnston, Robert J., 2006. "Is hypothetical bias universal? Validating contingent valuation responses using a binding public referendum," Journal of Environmental Economics and Management, Elsevier, vol. 52(1), pages 469-481, July.
    17. Vossler, Christian A. & Evans, Mary F., 2009. "Bridging the gap between the field and the lab: Environmental goods, policy maker input, and consequentiality," Journal of Environmental Economics and Management, Elsevier, vol. 58(3), pages 338-345, November.
    18. Jorgensen, Bradley S. & Syme, Geoffrey J. & Smith, Leigh M. & Bishop, Brian J., 2004. "Random error in willingness to pay measurement: A multiple indicators, latent variable approach to the reliability of contingent values," Journal of Economic Psychology, Elsevier, vol. 25(1), pages 41-59, February.
    19. Simora, Michael, 2017. "The effect of financial compensation on the acceptance of power lines: Evidence from a randomized discrete choice experiment in Germany," Ruhr Economic Papers 729, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    20. Brent, Daniel A. & Gangadharan, Lata & Leroux, Anke & Raschky, Paul, 2016. "Putting Your Money Where Your Month Is," 2016 Conference (60th), February 2-5, 2016, Canberra, Australia 235377, Australian Agricultural and Resource Economics Society.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecolec:v:189:y:2021:i:c:s0921800921002020. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ecolecon .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.