IDEAS home Printed from https://ideas.repec.org/a/eee/ecolec/v66y2008i2-3p425-435.html
   My bibliography  Save this article

How reliable are meta-analyses for international benefit transfers?

Author

Listed:
  • Lindhjem, Henrik
  • Navrud, Ståle

Abstract

Meta-analysis has increasingly been used to synthesise the environmental valuation literature, but only a few test the use of these analyses for benefit transfer. These are typically based on national studies only. However, meta-analyses of valuation studies across countries are a potentially powerful tool for benefit transfer, especially for environmental goods where the domestic literature is scarce. We test the reliability of such international meta-analytic transfers, and find that even under conditions of homogeneity in valuation methods, cultural and institutional conditions across countries, and a meta-analysis with large explanatory power, the transfer errors could still be large. Further, international meta-analytic transfers do not on average perform better than simple value transfers averaging over domestic studies. Thus, we question whether the use of meta-analysis for practical benefit transfer achieves reliability gains justifying the increased effort. However, more meta-analytic benefit transfer tests should be performed for other environmental goods and other countries before discarding international meta-analysis as a tool for benefit transfer.

Suggested Citation

  • Lindhjem, Henrik & Navrud, Ståle, 2008. "How reliable are meta-analyses for international benefit transfers?," Ecological Economics, Elsevier, vol. 66(2-3), pages 425-435, June.
  • Handle: RePEc:eee:ecolec:v:66:y:2008:i:2-3:p:425-435
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0921-8009(07)00506-X
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Bengt Kristrom, 1990. "A Non-Parametric Approach to the Estimation of Welfare Measures in Discrete Response Valuation Studies," Land Economics, University of Wisconsin Press, vol. 66(2), pages 135-139.
    2. Heberlein, Thomas A. & Wilson, Matthew A. & Bishop, Richard C. & Schaeffer, Nora Cate, 2005. "Rethinking the scope test as a criterion for validity in contingent valuation," Journal of Environmental Economics and Management, Elsevier, vol. 50(1), pages 1-22, July.
    3. Bergstrom, John C. & Taylor, Laura O., 2006. "Using meta-analysis for benefits transfer: Theory and practice," Ecological Economics, Elsevier, vol. 60(2), pages 351-360, December.
    4. Luke Brander & Raymond Florax & Jan Vermaat, 2006. "The Empirics of Wetland Valuation: A Comprehensive Summary and a Meta-Analysis of the Literature," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 33(2), pages 223-250, February.
    5. Siikamaki, Juha & Layton, David F., 2007. "Discrete choice survey experiments: A comparison using flexible methods," Journal of Environmental Economics and Management, Elsevier, vol. 53(1), pages 122-139, January.
    6. Ian J. Bateman & Andrew P. Jones, 2003. "Contrasting Conventional with Multi-Level Modeling Approaches to Meta-Analysis: Expectation Consistency in U.K. Woodland Recreation Values," Land Economics, University of Wisconsin Press, vol. 79(2), pages 235-258.
    7. Smith, V. Kerry & Osborne, Laura L., 1996. "Do Contingent Valuation Estimates Pass a "Scope" Test? A Meta-analysis," Journal of Environmental Economics and Management, Elsevier, vol. 31(3), pages 287-301, November.
    8. Rosenberger, Randall S. & Loomis, John B., 2000. "Panel Stratification in Meta-Analysis of Economic Studies: An Investigation of Its Effects in the Recreation Valuation Literature," Journal of Agricultural and Applied Economics, Cambridge University Press, vol. 32(3), pages 459-470, December.
    9. Dadi Kristofersson & Ståle Navrud, 2005. "Validity Tests of Benefit Transfer – Are We Performing the Wrong Tests?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 30(3), pages 279-286, March.
    10. Loomis, John B. & White, Douglas S., 1996. "Economic benefits of rare and endangered species: summary and meta-analysis," Ecological Economics, Elsevier, vol. 18(3), pages 197-206, September.
    11. Shrestha, Ram K. & Loomis, John B., 2001. "Testing a meta-analysis model for benefit transfer in international outdoor recreation," Ecological Economics, Elsevier, vol. 39(1), pages 67-83, October.
    12. Brander, Luke M. & Van Beukering, Pieter & Cesar, Herman S.J., 2007. "The recreational value of coral reefs: A meta-analysis," Ecological Economics, Elsevier, vol. 63(1), pages 209-218, June.
    13. Lindhjem, Henrik, 2007. "20 years of stated preference valuation of non-timber benefits from Fennoscandian forests: A meta-analysis," Journal of Forest Economics, Elsevier, vol. 12(4), pages 251-277, February.
    14. Ram Shrestha & John Loomis, 2003. "Meta-Analytic Benefit Transfer of Outdoor Recreation Economic Values: Testing Out-of-Sample Convergent Validity," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 25(1), pages 79-100, May.
    15. Robert J. Johnston & Elena Y. Besedin & Richard Iovanna & Christopher J. Miller & Ryan F. Wardwell & Matthew H. Ranson, 2005. "Systematic Variation in Willingness to Pay for Aquatic Resource Improvements and Implications for Benefit Transfer: A Meta‐Analysis," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 53(2‐3), pages 221-248, June.
    16. Hoehn, John P., 2006. "Methods to address selection effects in the meta regression and transfer of ecosystem values," Ecological Economics, Elsevier, vol. 60(2), pages 389-398, December.
    17. Rosenberger, Randall S. & Loomis, John B., 2000. "Panel Stratification In Meta-Analysis Of Economic Studies: An Investigation Of Its Effects In The Recreation Valuation Literature," Journal of Agricultural and Applied Economics, Southern Agricultural Economics Association, vol. 32(3), pages 1-12, December.
    18. Johnston, Robert J. & Besedin, Elena Y. & Ranson, Matthew H., 2006. "Characterizing the effects of valuation methodology in function-based benefits transfer," Ecological Economics, Elsevier, vol. 60(2), pages 407-419, December.
    19. Pouta, Eija, 2005. "Sensitivity to scope of environmental regulation in contingent valuation of forest cutting practices in Finland," Forest Policy and Economics, Elsevier, vol. 7(4), pages 539-550, May.
    20. Pouta, Eija, 2004. "Attitude and belief questions as a source of context effect in a contingent valuation survey," Journal of Economic Psychology, Elsevier, vol. 25(2), pages 229-242, April.
    21. V. Smith & Subhrendu Pattanayak, 2002. "Is Meta-Analysis a Noah's Ark for Non-Market Valuation?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 22(1), pages 271-296, June.
    22. Bateman, Ian J. & Cole, Matthew & Cooper, Philip & Georgiou, Stavros & Hadley, David & Poe, Gregory L., 2004. "On visible choice sets and scope sensitivity," Journal of Environmental Economics and Management, Elsevier, vol. 47(1), pages 71-93, January.
    23. Rekola, Mika & Pouta, Eija, 2005. "Public preferences for uncertain regeneration cuttings: a contingent valuation experiment involving Finnish private forests," Forest Policy and Economics, Elsevier, vol. 7(4), pages 635-649, May.
    24. Knut Veisten & Hans Hoen & Jon Strand, 2004. "Sequencing and the Adding-up Property in Contingent Valuation of Endangered Species: Are Contingent Non-Use Values Economic Values?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 29(4), pages 419-433, December.
    25. Pouta, Eija & Rekola, Mika & Kuuluvainen, Jari & Li, Chuan-Zhong & Tahvonen, Olli, 2002. "Willingness to pay in different policy-planning methods: insights into respondents' decision-making processes," Ecological Economics, Elsevier, vol. 40(2), pages 295-311, February.
    26. Woodward, Richard T. & Wui, Yong-Suhk, 2001. "The economic value of wetland services: a meta-analysis," Ecological Economics, Elsevier, vol. 37(2), pages 257-270, May.
    27. V. Kerry Smith & Yoshiaki Kaoru, 1990. "Signals or Noise? Explaining the Variation in Recreation Benefit Estimates," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 72(2), pages 419-433.
    28. Brouwer, Roy, 2000. "Environmental value transfer: state of the art and future prospects," Ecological Economics, Elsevier, vol. 32(1), pages 137-152, January.
    29. Moeltner, Klaus & Boyle, Kevin J. & Paterson, Robert W., 2007. "Meta-analysis and benefit transfer for resource valuation-addressing classical challenges with Bayesian modeling," Journal of Environmental Economics and Management, Elsevier, vol. 53(2), pages 250-269, March.
    30. Van Houtven, George & Powers, John & Pattanayak, Subhrendu K., 2007. "Valuing water quality improvements in the United States using meta-analysis: Is the glass half-full or half-empty for national policy analysis?," Resource and Energy Economics, Elsevier, vol. 29(3), pages 206-228, September.
    31. Jose M.L. Santos, 1998. "The Economic Valuation of Landscape Change," Books, Edward Elgar Publishing, number 1469.
    32. Knut Veisten & Ståle Navrud, 2006. "Contingent valuation and actual payment for voluntarily provided passive-use values: Assessing the effect of an induced truth-telling mechanism and elicitation formats," Applied Economics, Taylor & Francis Journals, vol. 38(7), pages 735-756.
    33. Ready, Richard & Navrud, Stale, 2006. "International benefit transfer: Methods and validity tests," Ecological Economics, Elsevier, vol. 60(2), pages 429-434, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lindhjem, Henrik, 2007. "20 years of stated preference valuation of non-timber benefits from Fennoscandian forests: A meta-analysis," Journal of Forest Economics, Elsevier, vol. 12(4), pages 251-277, February.
    2. Tuan, Tran Hu & Lindhjem, Henrik, 2008. "Meta-analysis of nature conservation values in Asia & Oceania: Data heterogeneity and benefit transfer issues," MPRA Paper 11470, University Library of Munich, Germany.
    3. Shuang Liu & David I Stern, 2008. "A Meta-Analysis of Contingent Valuation Studies in Coastal and Near-Shore Marine Ecosystems," Socio-Economics and the Environment in Discussion (SEED) Working Paper Series 2008-15, CSIRO Sustainable Ecosystems.
    4. Londoño, Luz M. & Johnston, Robert J., 2012. "Enhancing the reliability of benefit transfer over heterogeneous sites: A meta-analysis of international coral reef values," Ecological Economics, Elsevier, vol. 78(C), pages 80-89.
    5. Barrio, Melina & Loureiro, Maria L., 2010. "A meta-analysis of contingent valuation forest studies," Ecological Economics, Elsevier, vol. 69(5), pages 1023-1030, March.
    6. Henrik Lindhjem & Tran Tuan, 2012. "Valuation of species and nature conservation in Asia and Oceania: a meta-analysis," Environmental Economics and Policy Studies, Springer;Society for Environmental Economics and Policy Studies - SEEPS, vol. 14(1), pages 1-22, January.
    7. Hjerpe, Evan & Hussain, Anwar & Phillips, Spencer, 2015. "Valuing type and scope of ecosystem conservation: A meta-analysis," Journal of Forest Economics, Elsevier, vol. 21(1), pages 32-50.
    8. Jette Jacobsen & Nick Hanley, 2009. "Are There Income Effects on Global Willingness to Pay for Biodiversity Conservation?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 43(2), pages 137-160, June.
    9. Richardson, Leslie & Loomis, John & Kroeger, Timm & Casey, Frank, 2015. "The role of benefit transfer in ecosystem service valuation," Ecological Economics, Elsevier, vol. 115(C), pages 51-58.
    10. Hynes, Stephen & Ghermandi, Andrea & Norton, Daniel & Williams, Heidi, 2018. "Marine recreational ecosystem service value estimation: A meta-analysis with cultural considerations," Ecosystem Services, Elsevier, vol. 31(PC), pages 410-419.
    11. Kevin Boyle & Christopher Parmeter & Brent Boehlert & Robert Paterson, 2013. "Due Diligence in Meta-analyses to Support Benefit Transfers," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 55(3), pages 357-386, July.
    12. Robert J. Johnston & Kevin J. Boyle & Maria L. Loureiro & Ståle Navrud & John Rolfe, 2021. "Guidance to Enhance the Validity and Credibility of Environmental Benefit Transfers," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 79(3), pages 575-624, July.
    13. Bergstrom, John C. & Taylor, Laura O., 2006. "Using meta-analysis for benefits transfer: Theory and practice," Ecological Economics, Elsevier, vol. 60(2), pages 351-360, December.
    14. Zandersen, Marianne & Tol, Richard S.J., 2009. "A meta-analysis of forest recreation values in Europe," Journal of Forest Economics, Elsevier, vol. 15(1-2), pages 109-130, January.
    15. Hynes, S. & Ghermandi, A. & Norton, D. & Williams, H., 2017. "Marine Recreational Ecosystem Service Value Meta-Analysis," Working Papers 266404, National University of Ireland, Galway, Socio-Economic Marine Research Unit.
    16. Fitzpatrick, Luke & Parmeter, Christopher F. & Agar, Juan, 2017. "Threshold Effects in Meta-Analyses With Application to Benefit Transfer for Coral Reef Valuation," Ecological Economics, Elsevier, vol. 133(C), pages 74-85.
    17. Ojea, Elena & Loureiro, Maria L., 2011. "Identifying the scope effect on a meta-analysis of biodiversity valuation studies," Resource and Energy Economics, Elsevier, vol. 33(3), pages 706-724, September.
    18. Chaikumbung, Mayula & Doucouliagos, Hristos & Scarborough, Helen, 2016. "The economic value of wetlands in developing countries: A meta-regression analysis," Ecological Economics, Elsevier, vol. 124(C), pages 164-174.
    19. Kukielka, Jessica B. & Johnston, Robert J. & Duke, Joshua M., 2008. "Systematic Variation in Willingness to Pay for Agricultural Land Preservation and Implications for Benefit Transfer: A Meta-Analysis," 2008 Annual Meeting, July 27-29, 2008, Orlando, Florida 6121, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    20. Ojea, Elena & Loureiro, Maria L. & Alló, Maria & Barrio, Melina, 2016. "Ecosystem Services and REDD: Estimating the Benefits of Non-Carbon Services in Worldwide Forests," World Development, Elsevier, vol. 78(C), pages 246-261.

    More about this item

    JEL classification:

    • H41 - Public Economics - - Publicly Provided Goods - - - Public Goods
    • Q51 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Environmental Economics - - - Valuation of Environmental Effects

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecolec:v:66:y:2008:i:2-3:p:425-435. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ecolecon .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.