IDEAS home Printed from https://ideas.repec.org/a/eee/jeeman/v104y2020ics0095069620301029.html
   My bibliography  Save this article

Valuing non-market valuation studies using meta-analysis: A demonstration using estimates of willingness-to-pay for water quality improvements

Author

Listed:
  • Newbold, Stephen C.
  • Johnston, Robert J.

Abstract

A common refrain in the environmental economics literature is the need for additional estimates of environmental and natural resource values. Yet economists have paid little formal attention to the value of information (VOI) provided by non-market valuation studies, and whether this value justifies the cost. We develop a novel VOI model to quantify the benefit of non-market valuation studies conducted to expand the body of value estimates in the literature, and hence available for use in policy analyses. The approach is designed to capitalize on information available through preexisting valuation meta-data, and can be applied to any valuation meta-regression that is suitable to inform policy decisions. We illustrate the approach for a prototype nationwide water-quality improvement policy in the United States, assuming that policy benefits are evaluated using benefit transfer based on a meta-regression model of willingness-to-pay. Our results suggest that, when evaluating nationwide water quality regulations with uncertain net benefits, the VOI from a typical water quality valuation study will almost certainly exceed the cost. We also examine how VOI varies with study design features and information gaps in the literature, thereby illustrating how the approach can inform research priorities.

Suggested Citation

  • Newbold, Stephen C. & Johnston, Robert J., 2020. "Valuing non-market valuation studies using meta-analysis: A demonstration using estimates of willingness-to-pay for water quality improvements," Journal of Environmental Economics and Management, Elsevier, vol. 104(C).
  • Handle: RePEc:eee:jeeman:v:104:y:2020:i:c:s0095069620301029
    DOI: 10.1016/j.jeem.2020.102379
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0095069620301029
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jeem.2020.102379?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. H. Spencer Banzhaf & V. Kerry Smith, 2007. "Meta-analysis in model implementation: choice sets and the valuation of air quality improvements," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 22(6), pages 1013-1031.
    2. Stephen C. Newbold & Patrick J. Walsh & D. Matthew Massey & Julie Hewitt, 2018. "Using structural restrictions to achieve theoretical consistency in benefit transfers," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 69(3), pages 529-553, March.
    3. Walsh, Patrick J. & Wheeler, William J., 2013. "Water quality indices and benefit-cost analysis," Journal of Benefit-Cost Analysis, Cambridge University Press, vol. 4(1), pages 81-105, March.
    4. Ryan Stapler & Robert Johnston, 2009. "Meta-Analysis, Benefit Transfer, and Methodological Covariates: Implications for Transfer Error," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 42(2), pages 227-246, February.
    5. Randall S. Rosenberger & Robert J. Johnston, 2009. "Selection Effects in Meta-Analysis and Benefit Transfer: Avoiding Unintended Consequences," Land Economics, University of Wisconsin Press, vol. 85(3), pages 410-428.
    6. Janusz R. Mrozek & Laura O. Taylor, 2002. "What determines the value of life? a meta-analysis," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 21(2), pages 253-270.
    7. Hermine Vedogbeton & Robert J. Johnston, 2020. "Correction to: Commodity Consistent Meta-Analysis of Wetland Values: An Illustration for Coastal Marsh Habitat," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 77(4), pages 869-878, December.
    8. Bergstrom, John C. & Taylor, Laura O., 2006. "Using meta-analysis for benefits transfer: Theory and practice," Ecological Economics, Elsevier, vol. 60(2), pages 351-360, December.
    9. Moeltner, Klaus, 2019. "Bayesian nonlinear meta regression for benefit transfer," Journal of Environmental Economics and Management, Elsevier, vol. 93(C), pages 44-62.
    10. Luke Brander & Ingo Bräuer & Holger Gerdes & Andrea Ghermandi & Onno Kuik & Anil Markandya & Ståle Navrud & Paulo Nunes & Marije Schaafsma & Hans Vos & Alfred Wagtendonk, 2012. "Using Meta-Analysis and GIS for Value Transfer and Scaling Up: Valuing Climate Change Induced Losses of European Wetlands," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 52(3), pages 395-413, July.
    11. Edward Wilson, 2015. "A Practical Guide to Value of Information Analysis," PharmacoEconomics, Springer, vol. 33(2), pages 105-121, February.
    12. Zandersen, Marianne & Tol, Richard S.J., 2009. "A meta-analysis of forest recreation values in Europe," Journal of Forest Economics, Elsevier, vol. 15(1-2), pages 109-130, January.
    13. Auffhammer, Maximilian & Carson, Richard T., 2008. "Forecasting the path of China's CO2 emissions using province-level information," Journal of Environmental Economics and Management, Elsevier, vol. 55(3), pages 229-247, May.
    14. Robert J. Johnston & Randall S. Rosenberger, 2010. "Methods, Trends And Controversies In Contemporary Benefit Transfer," Journal of Economic Surveys, Wiley Blackwell, vol. 24(3), pages 479-510, July.
    15. Catherine L. Kling & Daniel J. Phaneuf, 2018. "How are Scope and Adding up Relevant for Benefits Transfer?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 69(3), pages 483-502, March.
    16. Van Houtven, George & Mansfield, Carol & Phaneuf, Daniel J. & von Haefen, Roger & Milstead, Bryan & Kenney, Melissa A. & Reckhow, Kenneth H., 2014. "Combining expert elicitation and stated preference methods to value ecosystem services from improved lake water quality," Ecological Economics, Elsevier, vol. 99(C), pages 40-52.
    17. Pindyck, Robert S., 2002. "Optimal timing problems in environmental economics," Journal of Economic Dynamics and Control, Elsevier, vol. 26(9-10), pages 1677-1697, August.
    18. Barrio, Melina & Loureiro, Maria L., 2010. "A meta-analysis of contingent valuation forest studies," Ecological Economics, Elsevier, vol. 69(5), pages 1023-1030, March.
    19. Bryon P. Allen & John B. Loomis, 2008. "The Decision To Use Benefit Transfer Or Conduct Original Valuation Research For Benefit‐Cost And Policy Analysis," Contemporary Economic Policy, Western Economic Association International, vol. 26(1), pages 1-12, January.
    20. Robert J. Johnston & Elena Y. Besedin & Ryan Stapler, 2017. "Enhanced Geospatial Validity for Meta-analysis and Environmental Benefit Transfer: An Application to Water Quality Improvements," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 68(2), pages 343-375, October.
    21. Diamond, Peter, 1996. "Testing the Internal Consistency of Contingent Valuation Surveys," Journal of Environmental Economics and Management, Elsevier, vol. 30(3), pages 337-347, May.
    22. Kevin Boyle & Christopher Parmeter & Brent Boehlert & Robert Paterson, 2013. "Due Diligence in Meta-analyses to Support Benefit Transfers," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 55(3), pages 357-386, July.
    23. Roger Cooke & Bruce A. Wielicki & David F. Young & Martin G. Mlynczak, 2014. "Value of information for climate observing systems," Environment Systems and Decisions, Springer, vol. 34(1), pages 98-109, March.
    24. Wilson, Matthew A. & Hoehn, John P., 2006. "Valuing environmental goods and services using benefit transfer: The state-of-the art and science," Ecological Economics, Elsevier, vol. 60(2), pages 335-342, December.
    25. Brander, Luke M. & Van Beukering, Pieter & Cesar, Herman S.J., 2007. "The recreational value of coral reefs: A meta-analysis," Ecological Economics, Elsevier, vol. 63(1), pages 209-218, June.
    26. Nicky J. Welton & Howard H. Z. Thom, 2015. "Value of Information," Medical Decision Making, , vol. 35(5), pages 564-566, July.
    27. Klaus Moeltner & Richard Woodward, 2009. "Meta-Functional Benefit Transfer for Wetland Valuation: Making the Most of Small Samples," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 42(1), pages 89-108, January.
    28. Johnston, Robert J. & Rolfe, John & Zawojska, Ewa, 2018. "Benefit Transfer of Environmental and Resource Values: Progress, Prospects and Challenges," International Review of Environmental and Resource Economics, now publishers, vol. 12(2-3), pages 177-266, November.
    29. Newbold, Stephen C. & Marten, Alex L., 2014. "The value of information for integrated assessment models of climate change," Journal of Environmental Economics and Management, Elsevier, vol. 68(1), pages 111-123.
    30. Hanemann, W. Michael, 1989. "Information and the concept of option value," Journal of Environmental Economics and Management, Elsevier, vol. 16(1), pages 23-37, January.
    31. McComb, Greg & Lantz, Van & Nash, Katrina & Rittmaster, Robyn, 2006. "International valuation databases: Overview, methods and operational issues," Ecological Economics, Elsevier, vol. 60(2), pages 461-472, December.
    32. Robert J. Johnston & Elena Y. Besedin & Richard Iovanna & Christopher J. Miller & Ryan F. Wardwell & Matthew H. Ranson, 2005. "Systematic Variation in Willingness to Pay for Aquatic Resource Improvements and Implications for Benefit Transfer: A Meta‐Analysis," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 53(2‐3), pages 221-248, June.
    33. I. Bateman & R. Brouwer & S. Ferrini & M. Schaafsma & D. Barton & A. Dubgaard & B. Hasler & S. Hime & I. Liekens & S. Navrud & L. De Nocker & R. Ščeponavičiūtė & D. Semėnienė, 2011. "Making Benefit Transfers Work: Deriving and Testing Principles for Value Transfers for Similar and Dissimilar Sites Using a Case Study of the Non-Market Benefits of Water Quality Improvements Across E," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 50(3), pages 365-387, November.
    34. Fisher, Brendan & Turner, R. Kerry & Morling, Paul, 2009. "Defining and classifying ecosystem services for decision making," Ecological Economics, Elsevier, vol. 68(3), pages 643-653, January.
    35. Kevin J. Boyle & Nicolai V. Kuminoff & Christopher F. Parmeter & Jaren C. Pope, 2009. "Necessary Conditions for Valid Benefit Transfers," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 91(5), pages 1328-1334.
    36. V. Smith & Subhrendu Pattanayak, 2002. "Is Meta-Analysis a Noah's Ark for Non-Market Valuation?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 22(1), pages 271-296, June.
    37. Cosetta Minelli & Gianluca Baio, 2015. "Value of Information: A Tool to Improve Research Prioritization and Reduce Waste," PLOS Medicine, Public Library of Science, vol. 12(9), pages 1-5, September.
    38. Spash, Clive L. & Vatn, Arild, 2006. "Transferring environmental value estimates: Issues and alternatives," Ecological Economics, Elsevier, vol. 60(2), pages 379-388, December.
    39. Jon Nelson & Peter Kennedy, 2009. "The Use (and Abuse) of Meta-Analysis in Environmental and Natural Resource Economics: An Assessment," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 42(3), pages 345-377, March.
    40. Jon M. Conrad, 1980. "Quasi-Option Value and the Expected Value of Information," The Quarterly Journal of Economics, Oxford University Press, vol. 94(4), pages 813-820.
    41. Fumie Yokota & Kimberly M. Thompson, 2004. "Value of Information Analysis in Environmental Health Risk Management Decisions: Past, Present, and Future," Risk Analysis, John Wiley & Sons, vol. 24(3), pages 635-650, June.
    42. Krinsky, Itzhak & Robb, A Leslie, 1986. "On Approximating the Statistical Properties of Elasticities," The Review of Economics and Statistics, MIT Press, vol. 68(4), pages 715-719, November.
    43. Van Houtven, George & Powers, John & Pattanayak, Subhrendu K., 2007. "Valuing water quality improvements in the United States using meta-analysis: Is the glass half-full or half-empty for national policy analysis?," Resource and Energy Economics, Elsevier, vol. 29(3), pages 206-228, September.
    44. Loomis, John B. & Rosenberger, Randall S., 2006. "Reducing barriers in future benefit transfers: Needed improvements in primary study design and reporting," Ecological Economics, Elsevier, vol. 60(2), pages 343-350, December.
    45. Kevin J. Boyle & Jeffrey M. Wooldridge, 2018. "Understanding Error Structures and Exploiting Panel Data in Meta-analytic Benefit Transfers," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 69(3), pages 609-635, March.
    46. Londoño, Luz M. & Johnston, Robert J., 2012. "Enhancing the reliability of benefit transfer over heterogeneous sites: A meta-analysis of international coral reef values," Ecological Economics, Elsevier, vol. 78(C), pages 80-89.
    47. Hermine Vedogbeton & Robert J. Johnston, 2020. "Commodity Consistent Meta-Analysis of Wetland Values: An Illustration for Coastal Marsh Habitat," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 75(4), pages 835-865, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Dietrich, Stephan & Nichols, Stafford, 2023. "More than a feeling," MERIT Working Papers 2023-005, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).
    2. Robert J. Johnston & Kevin J. Boyle & Maria L. Loureiro & Ståle Navrud & John Rolfe, 2021. "Guidance to Enhance the Validity and Credibility of Environmental Benefit Transfers," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 79(3), pages 575-624, July.
    3. Grammatikopoulou, Ioanna & VaÄ kářová, Davina, 2021. "The value of forest ecosystem services: A meta-analysis at the European scale and application to national ecosystem accounting," Ecosystem Services, Elsevier, vol. 48(C).
    4. Francesco Jacopo Pintus, 2023. "Valuing drinking water quality after a PFAS contamination event: results from a meta-analysis benefit transfer," "Marco Fanno" Working Papers 0308, Dipartimento di Scienze Economiche "Marco Fanno".

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Robert J. Johnston & Kevin J. Boyle & Maria L. Loureiro & Ståle Navrud & John Rolfe, 2021. "Guidance to Enhance the Validity and Credibility of Environmental Benefit Transfers," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 79(3), pages 575-624, July.
    2. Hermine Vedogbeton & Robert J. Johnston, 2020. "Commodity Consistent Meta-Analysis of Wetland Values: An Illustration for Coastal Marsh Habitat," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 75(4), pages 835-865, April.
    3. Robert J. Johnston & Elena Y. Besedin & Benedict M. Holland, 2019. "Modeling Distance Decay Within Valuation Meta-Analysis," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 72(3), pages 657-690, March.
    4. Robert J. Johnston & Elena Y. Besedin & Ryan Stapler, 2017. "Enhanced Geospatial Validity for Meta-analysis and Environmental Benefit Transfer: An Application to Water Quality Improvements," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 68(2), pages 343-375, October.
    5. Richardson, Leslie & Loomis, John & Kroeger, Timm & Casey, Frank, 2015. "The role of benefit transfer in ecosystem service valuation," Ecological Economics, Elsevier, vol. 115(C), pages 51-58.
    6. Londoño, Luz M. & Johnston, Robert J., 2012. "Enhancing the reliability of benefit transfer over heterogeneous sites: A meta-analysis of international coral reef values," Ecological Economics, Elsevier, vol. 78(C), pages 80-89.
    7. Heather Klemick & Charles Griffiths & Dennis Guignet & Patrick Walsh, 2018. "Improving Water Quality in an Iconic Estuary: An Internal Meta-analysis of Property Value Impacts Around the Chesapeake Bay," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 69(2), pages 265-292, February.
    8. Abbie A. Rogers & Fiona L. Dempster & Jacob I. Hawkins & Robert J. Johnston & Peter C. Boxall & John Rolfe & Marit E. Kragt & Michael P. Burton & David J. Pannell, 2019. "Valuing non-market economic impacts from natural hazards," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 99(2), pages 1131-1161, November.
    9. Dennis Guignet & Matthew T. Heberling & Michael Papenfus & Olivia Griot, 2022. "Property Values, Water Quality, and Benefit Transfer: A Nationwide Meta-analysis," Land Economics, University of Wisconsin Press, vol. 98(2), pages 191-218.
    10. Chaikumbung, Mayula & Doucouliagos, Hristos & Scarborough, Helen, 2016. "The economic value of wetlands in developing countries: A meta-regression analysis," Ecological Economics, Elsevier, vol. 124(C), pages 164-174.
    11. Fitzpatrick, Luke & Parmeter, Christopher F. & Agar, Juan, 2019. "Approaches for visualizing uncertainty in benefit transfer from metaregression," Ecological Economics, Elsevier, vol. 164(C), pages 1-1.
    12. Heather Klemick & Charles Griffiths & Dennis Guignet & Patrick Walsh, 2015. "Explaining Variation in the Value of Chesapeake Bay Water Quality Using Internal Meta-analysis," NCEE Working Paper Series 201504, National Center for Environmental Economics, U.S. Environmental Protection Agency, revised Nov 2015.
    13. Fitzpatrick, Luke & Parmeter, Christopher F. & Agar, Juan, 2017. "Threshold Effects in Meta-Analyses With Application to Benefit Transfer for Coral Reef Valuation," Ecological Economics, Elsevier, vol. 133(C), pages 74-85.
    14. Henrik Lindhjem & Tran Tuan, 2012. "Valuation of species and nature conservation in Asia and Oceania: a meta-analysis," Environmental Economics and Policy Studies, Springer;Society for Environmental Economics and Policy Studies - SEEPS, vol. 14(1), pages 1-22, January.
    15. Kevin Boyle & Christopher Parmeter & Brent Boehlert & Robert Paterson, 2013. "Due Diligence in Meta-analyses to Support Benefit Transfers," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 55(3), pages 357-386, July.
    16. Stephen Newbold & R. David Simpson & D. Matthew Massey & Matthew T. Heberling & William Wheeler & Joel Corona & Julie Hewitt, 2018. "Benefit Transfer Challenges: Perspectives from U.S. Practitioners," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 69(3), pages 467-481, March.
    17. Moeltner, Klaus, 2019. "Bayesian nonlinear meta regression for benefit transfer," Journal of Environmental Economics and Management, Elsevier, vol. 93(C), pages 44-62.
    18. de Groot, Rudolf & Brander, Luke & van der Ploeg, Sander & Costanza, Robert & Bernard, Florence & Braat, Leon & Christie, Mike & Crossman, Neville & Ghermandi, Andrea & Hein, Lars & Hussain, Salman & , 2012. "Global estimates of the value of ecosystems and their services in monetary units," Ecosystem Services, Elsevier, vol. 1(1), pages 50-61.
    19. Robert Johnston & Klaus Moeltner, 2014. "Meta-Modeling and Benefit Transfer: The Empirical Relevance of Source-Consistency in Welfare Measures," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 59(3), pages 337-361, November.
    20. Moeltner, Klaus & Puri, Roshan & Johnston, Robert J. & Besedin, Elena & Balukas, Jessica & Le, Alyssa, 2022. "Locally Weighted Meta-Regression and Benefit Transfer," 2022 Annual Meeting, July 31-August 2, Anaheim, California 322359, Agricultural and Applied Economics Association.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jeeman:v:104:y:2020:i:c:s0095069620301029. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/622870 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.