IDEAS home Printed from https://ideas.repec.org/p/exc/wpaper/2006-12.html
   My bibliography  Save this paper

Using Meta Analysis for Benefits Transfer: Theory and Practice

Author

Listed:
  • John C. Bergstrom
  • Laura O. Taylor

Abstract

Meta-analysis, or the "study of studies", attempts to statistically measure systematic relationships between reported valuation estimates for an environmental good or service and attributes of the study that generated the estimates including valuation methods, human population and sample characteristics, and characteristics of the good or service itself. In this paper, we discuss the general theory behind and practice of the emerging use of meta-analysis for benefits transfer. If carefully conducted following systematic protocols for model development, data collection, and data analysis and interpretation, we believe that meta-analysis may prove to be a useful tool for benefits transfer in particular applications. However, before widespread application of this method, more convergent validity tests are needed. One of the greatest strengths of using meta-analysis for benefits transfer is the ability to combine and summarize large amounts of information from previous studies. This strength can also lead to one of the greatest weaknesses of this method which is the loss of important valuation details across time and space in the aggregation process. Thus, application of this method to policy questions and issues should always proceed with caution.

Suggested Citation

  • John C. Bergstrom & Laura O. Taylor, 2006. "Using Meta Analysis for Benefits Transfer: Theory and Practice," Experimental Economics Center Working Paper Series 2006-12, Experimental Economics Center, Andrew Young School of Policy Studies, Georgia State University, revised Jul 2007.
    • Handle: RePEc:exc:wpaper:2006-12
    as

    Download full text from publisher

    File URL: http://excen.gsu.edu/workingpapers/GSU_EXCEN_WP_2006-12.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Amos Tversky & Daniel Kahneman, 1991. "Loss Aversion in Riskless Choice: A Reference-Dependent Model," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 106(4), pages 1039-1061.
    2. Smith, V. Kerry & Osborne, Laura L., 1996. "Do Contingent Valuation Estimates Pass a "Scope" Test? A Meta-analysis," Journal of Environmental Economics and Management, Elsevier, vol. 31(3), pages 287-301, November.
    3. T. D. Stanley, 2005. "Beyond Publication Bias," Journal of Economic Surveys, Wiley Blackwell, vol. 19(3), pages 309-345, July.
    4. John C. Bergstrom & Kevin J. Boyle & Gregory L. Poe (ed.), 2001. "The Economic Value of Water Quality," Books, Edward Elgar Publishing, number 1723.
    5. V. Smith & Subhrendu Pattanayak, 2002. "Is Meta-Analysis a Noah's Ark for Non-Market Valuation?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 22(1), pages 271-296, June.
    6. W. Michael Hanemann, 1984. "Welfare Evaluations in Contingent Valuation Experiments with Discrete Responses," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 66(3), pages 332-341.
    7. Martin Van Bueren & Jeff Bennett, 2004. "Towards the development of a transferable set of value estimates for environmental attributes," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 48(1), pages 1-32, March.
    8. Raymond J.G.M. Florax & Peter Nijkamp & Kenneth G. Willis (ed.), 2002. "Comparative Environmental Economic Assessment," Books, Edward Elgar Publishing, number 1945.
    9. Smith, V Kerry & Huang, Ju-Chin, 1995. "Can Markets Value Air Quality? A Meta-analysis of Hedonic Property Value Models," Journal of Political Economy, University of Chicago Press, vol. 103(1), pages 209-227, February.
    10. Orley Ashenfelter & Michael Greenstone, 2004. "Estimating the Value of a Statistical Life: The Importance of Omitted Variables and Publication Bias," American Economic Review, American Economic Association, vol. 94(2), pages 454-460, May.
    11. Janusz R. Mrozek & Laura O. Taylor, 2002. "What determines the value of life? a meta-analysis," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 21(2), pages 253-270.
    12. Randall, Alan & Stoll, John R, 1980. "Consumer's Surplus in Commodity Space," American Economic Review, American Economic Association, vol. 70(3), pages 449-455, June.
    13. Kevin J. Boyle & Gregory L. Poe & John C. Bergstrom, 1994. "What Do We Know About Groundwater Values? Preliminary Implications from a Meta Analysis of Contingent-Valuation Studies," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 76(5), pages 1055-1061.
    14. John C. Bergstrom & Paul Civita, 1999. "Status of Benefits Transfer in the United States and Canada: A Review," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 47(1), pages 79-87, March.
    15. V. Kerry Smith & Yoshiaki Kaoru, 1990. "Signals or Noise? Explaining the Variation in Recreation Benefit Estimates," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 72(2), pages 419-433.
    16. David S. Brookshire & Alan Randall & John R. Stoll, 1980. "Valuing Increments and Decrements in Natural Resource Service Flows," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 62(3), pages 478-488.
    17. Rosenberger, Randall S. & Loomis, John B., 2000. "Panel Stratification in Meta-Analysis of Economic Studies: An Investigation of Its Effects in the Recreation Valuation Literature," Journal of Agricultural and Applied Economics, Cambridge University Press, vol. 32(3), pages 459-470, December.
    18. Cameron, Trudy Ann, 1988. "A new paradigm for valuing non-market goods using referendum data: Maximum likelihood estimation by censored logistic regression," Journal of Environmental Economics and Management, Elsevier, vol. 15(3), pages 355-379, September.
    19. Ram Shrestha & John Loomis, 2003. "Meta-Analytic Benefit Transfer of Outdoor Recreation Economic Values: Testing Out-of-Sample Convergent Validity," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 25(1), pages 79-100, May.
    20. Richard T. Carson & Nicholas E. Flores & Kerry M. Martin & Jennifer L. Wright, 1996. "Contingent Valuation and Revealed Preference Methodologies: Comparing the Estimates for Quasi-Public Goods," Land Economics, University of Wisconsin Press, vol. 72(1), pages 80-99.
    21. Kelvin J. Lancaster, 1966. "A New Approach to Consumer Theory," Journal of Political Economy, University of Chicago Press, vol. 74(2), pages 132-132.
    22. V. Kerry Smith & George Van Houtven & Subhrendu K. Pattanayak, 2002. "Benefit Transfer via Preference Calibration: "Prudential Algebra" for Policy," Land Economics, University of Wisconsin Press, vol. 78(1), pages 132-152.
    23. Orley Ashenfelter & Michael Greenstone, 2004. "Estimating the Value of a Statistical Life: The Importance of Omitted Variables and Publication Bias," American Economic Review, American Economic Association, vol. 94(2), pages 454-460, May.
    24. Woodward, Richard T. & Wui, Yong-Suhk, 2001. "The economic value of wetland services: a meta-analysis," Ecological Economics, Elsevier, vol. 37(2), pages 257-270, May.
    25. Beron, Kurt & Murdoch, James & Thayer, Mark, 2001. "The Benefits of Visibility Improvement: New Evidence from the Los Angeles Metropolitan Area," The Journal of Real Estate Finance and Economics, Springer, vol. 22(2-3), pages 319-337, March-May.
    26. Ikuho Kochi & Bryan Hubbell & Randall Kramer, 2006. "An Empirical Bayes Approach to Combining and Comparing Estimates of the Value of a Statistical Life for Environmental Policy Analysis," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 34(3), pages 385-406, July.
    27. Willig, Robert D, 1976. "Consumer's Surplus without Apology," American Economic Review, American Economic Association, vol. 66(4), pages 589-597, September.
    28. Loomis, John B. & White, Douglas S., 1996. "Economic benefits of rare and endangered species: summary and meta-analysis," Ecological Economics, Elsevier, vol. 18(3), pages 197-206, September.
    29. Rosenberger, Randall S. & Loomis, John B., 2000. "Panel Stratification In Meta-Analysis Of Economic Studies: An Investigation Of Its Effects In The Recreation Valuation Literature," Journal of Agricultural and Applied Economics, Southern Agricultural Economics Association, vol. 32(3), pages 1-12, December.
    30. Orley Ashenfelter & Michael Greenstone, 2004. "Estimating the Value of a Statistical Life: The Importance of Omitted Variables and Publication Bias," Working Papers 858, Princeton University, Department of Economics, Industrial Relations Section..
    31. Moeltner, Klaus & Boyle, Kevin J. & Paterson, Robert W., 2007. "Meta-analysis and benefit transfer for resource valuation-addressing classical challenges with Bayesian modeling," Journal of Environmental Economics and Management, Elsevier, vol. 53(2), pages 250-269, March.
    32. T. D. Stanley, 2001. "Wheat from Chaff: Meta-analysis as Quantitative Literature Review," Journal of Economic Perspectives, American Economic Association, vol. 15(3), pages 131-150, Summer.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. V. Smith & Subhrendu Pattanayak, 2002. "Is Meta-Analysis a Noah's Ark for Non-Market Valuation?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 22(1), pages 271-296, June.
    2. Ram Shrestha & John Loomis, 2003. "Meta-Analytic Benefit Transfer of Outdoor Recreation Economic Values: Testing Out-of-Sample Convergent Validity," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 25(1), pages 79-100, May.
    3. Lindhjem, Henrik, 2007. "20 years of stated preference valuation of non-timber benefits from Fennoscandian forests: A meta-analysis," Journal of Forest Economics, Elsevier, vol. 12(4), pages 251-277, February.
    4. Shuang Liu & David I Stern, 2008. "A Meta-Analysis of Contingent Valuation Studies in Coastal and Near-Shore Marine Ecosystems," Socio-Economics and the Environment in Discussion (SEED) Working Paper Series 2008-15, CSIRO Sustainable Ecosystems.
    5. Lindhjem, Henrik & Navrud, Ståle, 2008. "How reliable are meta-analyses for international benefit transfers?," Ecological Economics, Elsevier, vol. 66(2-3), pages 425-435, June.
    6. Rosenberger, Randall S. & Stanley, Tom D., 2006. "Measurement, generalization, and publication: Sources of error in benefit transfers and their management," Ecological Economics, Elsevier, vol. 60(2), pages 372-378, December.
    7. Chris Dumas & Pete Schuhmann & John C. Whitehead, 2004. "Measuring the Economic Benefits of Water Quality Improvement with the Benefit Transfer Method: An Introduction for Non-Economists," Working Papers 04-12, Department of Economics, Appalachian State University.
    8. Richard T. Carson, 2011. "Contingent Valuation," Books, Edward Elgar Publishing, number 2489.
    9. Van Houtven, George & Powers, John & Pattanayak, Subhrendu K., 2007. "Valuing water quality improvements in the United States using meta-analysis: Is the glass half-full or half-empty for national policy analysis?," Resource and Energy Economics, Elsevier, vol. 29(3), pages 206-228, September.
    10. Richardson, Leslie & Loomis, John & Kroeger, Timm & Casey, Frank, 2015. "The role of benefit transfer in ecosystem service valuation," Ecological Economics, Elsevier, vol. 115(C), pages 51-58.
    11. Fan, Yubing & Wang, Chenggang & Nan, Zhibiao, 2018. "Determining water use efficiency of wheat and cotton: A meta-regression analysis," Agricultural Water Management, Elsevier, vol. 199(C), pages 48-60.
    12. Moeltner, Klaus & Boyle, Kevin J. & Paterson, Robert W., 2007. "Meta-analysis and benefit transfer for resource valuation-addressing classical challenges with Bayesian modeling," Journal of Environmental Economics and Management, Elsevier, vol. 53(2), pages 250-269, March.
    13. Zandersen, Marianne & Tol, Richard S.J., 2009. "A meta-analysis of forest recreation values in Europe," Journal of Forest Economics, Elsevier, vol. 15(1-2), pages 109-130, January.
    14. Brander, Luke M. & Ghermandi, Andrea & Kuik, Onno & Markandya, Anil & Nunes, Paulo A.L.D. & Schaafsma, Marije & Wagtendonk, Alfred, 2010. "Scaling up Ecosystem Services Values: Methodology, Applicability and a Case Study," Sustainable Development Papers 60689, Fondazione Eni Enrico Mattei (FEEM).
    15. Jon Nelson & Peter Kennedy, 2009. "The Use (and Abuse) of Meta-Analysis in Environmental and Natural Resource Economics: An Assessment," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 42(3), pages 345-377, March.
    16. Londoño, Luz M. & Johnston, Robert J., 2012. "Enhancing the reliability of benefit transfer over heterogeneous sites: A meta-analysis of international coral reef values," Ecological Economics, Elsevier, vol. 78(C), pages 80-89.
    17. Raymond J.G.M. Florax & Henri L.F. de Groot & Ruud A. de Mooij, 2002. "Meta-analysis: A Tool for Upgrading Inputs of Macroeconomic Policy Models," Tinbergen Institute Discussion Papers 02-041/3, Tinbergen Institute.
    18. Barrio, Melina & Loureiro, Maria L., 2010. "A meta-analysis of contingent valuation forest studies," Ecological Economics, Elsevier, vol. 69(5), pages 1023-1030, March.
    19. Kevin J. Boyle & Jeffrey M. Wooldridge, 2018. "Understanding Error Structures and Exploiting Panel Data in Meta-analytic Benefit Transfers," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 69(3), pages 609-635, March.
    20. De Salvo, Maria & Signorello, Giovanni, 2015. "Non-market valuation of recreational services in Italy: A meta-analysis," Ecosystem Services, Elsevier, vol. 16(C), pages 47-62.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:exc:wpaper:2006-12. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: J. Todd Swarthout (email available below). General contact details of provider: https://edirc.repec.org/data/exgsuus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.