IDEAS home Printed from https://ideas.repec.org/a/eee/jeeman/v66y2013i1p90-104.html
   My bibliography  Save this article

What can we learn from benefit transfer errors? Evidence from 20 years of research on convergent validity

Author

Listed:
  • Kaul, Sapna
  • Boyle, Kevin J.
  • Kuminoff, Nicolai V.
  • Parmeter, Christopher F.
  • Pope, Jaren C.

Abstract

We develop a nonparametric approach to meta-analysis and use it to identify modeling decisions that affect benefit transfer errors. The meta-data describe the results from 31 empirical studies testing the convergent validity of benefit transfers. They evaluated numerous methodological procedures, collectively reporting 1071 transfer errors. Our meta-regressions identify several important findings, including: (1) the median absolute error is 39%; (2) function transfers outperform value transfers; (3) transfers describing environmental quantity generate lower transfer errors than transfers describing quality changes; (4) geographic site similarity is important for value transfers; (5) contingent valuation generates lower transfer errors than other valuation methods; and (6) combining data from multiple studies tends to reduce transfer errors.

Suggested Citation

  • Kaul, Sapna & Boyle, Kevin J. & Kuminoff, Nicolai V. & Parmeter, Christopher F. & Pope, Jaren C., 2013. "What can we learn from benefit transfer errors? Evidence from 20 years of research on convergent validity," Journal of Environmental Economics and Management, Elsevier, vol. 66(1), pages 90-104.
  • Handle: RePEc:eee:jeeman:v:66:y:2013:i:1:p:90-104
    DOI: 10.1016/j.jeem.2013.03.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0095069613000168
    Download Restriction: Full text for ScienceDirect subscribers only

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kirchhoff, Stefanie & Colby, Bonnie G. & LaFrance, Jeffrey T., 1997. "Evaluating the Performance of Benefit Transfer: An Empirical Inquiry," Journal of Environmental Economics and Management, Elsevier, vol. 33(1), pages 75-93, May.
    2. Valentina Hartarska & ChristopherF. Parmeter & Denis Nadolnyak & Beibei Zhu, 2010. "Economies Of Scope For Microfinance: Differences Across Output Measures," Pacific Economic Review, Wiley Blackwell, vol. 15(4), pages 464-481, October.
    3. A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2008. "Bootstrap-Based Improvements for Inference with Clustered Errors," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 414-427, August.
    4. Kevin J. Boyle & Nicolai V. Kuminoff & Christopher F. Parmeter & Jaren C. Pope, 2009. "Necessary Conditions for Valid Benefit Transfers," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 91(5), pages 1328-1334.
    5. Henderson, Daniel J. & Kumbhakar, Subal C. & Parmeter, Christopher F., 2012. "A simple method to visualize results in nonlinear regression models," Economics Letters, Elsevier, vol. 117(3), pages 578-581.
    6. Peter Hall & Qi Li & Jeffrey S. Racine, 2007. "Nonparametric Estimation of Regression Functions in the Presence of Irrelevant Regressors," The Review of Economics and Statistics, MIT Press, vol. 89(4), pages 784-789, November.
    7. Roy Brouwer & Frank Spaninks, 1999. "The Validity of Environmental Benefits Transfer: Further Empirical Testing," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 14(1), pages 95-117, July.
    8. Bergstrom, John C. & Taylor, Laura O., 2006. "Using meta-analysis for benefits transfer: Theory and practice," Ecological Economics, Elsevier, vol. 60(2), pages 351-360, December.
    9. Savchuk, Olga Y. & Hart, Jeffrey D. & Sheather, Simon J., 2010. "Indirect Cross-Validation for Density Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 105(489), pages 415-423.
    10. H. Spencer Banzhaf & V. Kerry Smith, 2007. "Meta-analysis in model implementation: choice sets and the valuation of air quality improvements," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 22(6), pages 1013-1031.
    11. Tzipi Eshet & Mira Baron & Mordechai Shechter, 2007. "Exploring Benefit Transfer: Disamenities of Waste Transfer Stations," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 37(3), pages 521-547, July.
    12. Jon Nelson & Peter Kennedy, 2009. "The Use (and Abuse) of Meta-Analysis in Environmental and Natural Resource Economics: An Assessment," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 42(3), pages 345-377, March.
    13. Rosenberger, Randall S. & Stanley, Tom D., 2006. "Measurement, generalization, and publication: Sources of error in benefit transfers and their management," Ecological Economics, Elsevier, vol. 60(2), pages 372-378, December.
    14. Ouyang, Desheng & Li, Qi & Racine, Jeffrey S., 2009. "Nonparametric Estimation Of Regression Functions With Discrete Regressors," Econometric Theory, Cambridge University Press, vol. 25(01), pages 1-42, February.
    15. V. Kerry Smith & George Van Houtven & Subhrendu K. Pattanayak, 2002. "Benefit Transfer via Preference Calibration: "Prudential Algebra" for Policy," Land Economics, University of Wisconsin Press, vol. 78(1), pages 132-152.
    16. Robert J. Johnston & Randall S. Rosenberger, 2010. "Methods, Trends And Controversies In Contemporary Benefit Transfer," Journal of Economic Surveys, Wiley Blackwell, vol. 24(3), pages 479-510, July.
    17. Smith, V. Kerry & Osborne, Laura L., 1996. "Do Contingent Valuation Estimates Pass a "Scope" Test? A Meta-analysis," Journal of Environmental Economics and Management, Elsevier, vol. 31(3), pages 287-301, November.
    18. V. Kerry Smith & Yoshiaki Kaoru, 1990. "Signals or Noise? Explaining the Variation in Recreation Benefit Estimates," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 72(2), pages 419-433.
    19. Walsh, Richard G. & Johnson, Donn M. & McKean, John R., 1989. "Issues In Nonmarket Valuation And Policy Application: A Retrospective Glance," Western Journal of Agricultural Economics, Western Agricultural Economics Association, vol. 14(01), July.
    20. James Murphy & P. Allen & Thomas Stevens & Darryl Weatherhead, 2005. "A Meta-analysis of Hypothetical Bias in Stated Preference Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 30(3), pages 313-325, March.
    21. Sudip Chattopadhyay, 2003. "A Repeated Sampling Technique in Assessing the Validity of Benefit Transfer in Valuing Non-Market Goods," Land Economics, University of Wisconsin Press, vol. 79(4), pages 576-596.
    22. Kevin J. Boyle & Nicolai V. Kuminoff & Christopher F. Parmeter & Jaren C. Pope, 2010. "The Benefit-Transfer Challenges," Annual Review of Resource Economics, Annual Reviews, vol. 2(1), pages 161-182, October.
    23. Mark Morrison & Jeff Bennett & Russell Blamey & Jordan Louviere, 2002. "Choice Modeling and Tests of Benefit Transfer," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 84(1), pages 161-170.
    24. Hsiao, Cheng & Li, Qi & Racine, Jeffrey S., 2007. "A consistent model specification test with mixed discrete and continuous data," Journal of Econometrics, Elsevier, vol. 140(2), pages 802-826, October.
    25. Jeffery Racine & Jeffrey Hart & Qi Li, 2006. "Testing the Significance of Categorical Predictor Variables in Nonparametric Regression Models," Econometric Reviews, Taylor & Francis Journals, vol. 25(4), pages 523-544.
    26. Daniel J. Henderson & Chris Papageorgiou & Christopher F. Parmeter, 2012. "Growth Empirics without Parameters," Economic Journal, Royal Economic Society, vol. 122(559), pages 125-154, March.
    27. Schwertman, Neil C. & Owens, Margaret Ann & Adnan, Robiah, 2004. "A simple more general boxplot method for identifying outliers," Computational Statistics & Data Analysis, Elsevier, vol. 47(1), pages 165-174, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Duke, Joshua M. & Dundas, Steven J. & Johnston, Robert J. & Messer, Kent D., 2014. "Prioritizing payment for environmental services: Using nonmarket benefits and costs for optimal selection," Ecological Economics, Elsevier, vol. 105(C), pages 319-329.
    2. Y Mehmet Kutluay & Richard S. J. Tol, 2015. "Valuing malaria morbidity: Results from a global metaanalysis," Working Paper Series 7615, Department of Economics, University of Sussex.
    3. Fitzpatrick, Luke & Parmeter, Christopher F. & Agar, Juan, 2017. "Threshold Effects in Meta-Analyses With Application to Benefit Transfer for Coral Reef Valuation," Ecological Economics, Elsevier, vol. 133(C), pages 74-85.
    4. Börger, Tobias & Beaumont, Nicola J. & Pendleton, Linwood & Boyle, Kevin J. & Cooper, Philip & Fletcher, Stephen & Haab, Tim & Hanemann, Michael & Hooper, Tara L. & Hussain, S. Salman & Portela, Rosim, 2014. "Incorporating ecosystem services in marine planning: The role of valuation," Marine Policy, Elsevier, vol. 46(C), pages 161-170.
    5. repec:eee:ecoser:v:24:y:2017:i:c:p:1-15 is not listed on IDEAS
    6. Kevin Boyle & Christopher Parmeter & Brent Boehlert & Robert Paterson, 2013. "Due Diligence in Meta-analyses to Support Benefit Transfers," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 55(3), pages 357-386, July.
    7. Czajkowski, Mikołaj & Ahtiainen, Heini & Artell, Janne & Meyerhoff, Jürgen, 2017. "Choosing a Functional Form for an International Benefit Transfer: Evidence from a Nine-country Valuation Experiment," Ecological Economics, Elsevier, vol. 134(C), pages 104-113.
    8. Chaikumbung, Mayula & Doucouliagos, Hristos & Scarborough, Helen, 2016. "The economic value of wetlands in developing countries: A meta-regression analysis," Ecological Economics, Elsevier, vol. 124(C), pages 164-174.
    9. Meya, Jasper N. & Drupp, Moritz A. & Hanley, Nick, 2017. "Income inequality and the international transfer of environmental values," Economics Working Papers 2017-03, Christian-Albrechts-University of Kiel, Department of Economics.
    10. Ankamah-Yeboah, Isaac & Rehdanz, Katrin, 2014. "Explaining the variation in the value of building energy efficiency certificates: A quantitative meta-analysis," Kiel Working Papers 1949, Kiel Institute for the World Economy (IfW).
    11. Robert Johnston & Klaus Moeltner, 2014. "Meta-Modeling and Benefit Transfer: The Empirical Relevance of Source-Consistency in Welfare Measures," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 59(3), pages 337-361, November.
    12. Patrizia Schwegler, 2015. "Economic valuation of environmental costs of soil erosion and the loss of biodiversity and ecosystem services caused by food wastage," Journal of Socio-Economics in Agriculture (Until 2015: Yearbook of Socioeconomics in Agriculture), Swiss Society for Agricultural Economics and Rural Sociology, vol. 8(2).
    13. Baumgärtner, Stefan & Drupp, Moritz A. & Meya, Jasper N. & Munz, Jan M. & Quaas, Martin F., 2016. "Income inequality and willingness to pay for public environmental goods," Economics Working Papers 2016-04, Christian-Albrechts-University of Kiel, Department of Economics.
    14. Christof Gubler, 2014. "Potential des Anbaus und Absatzmo glichkeiten der Walnuss in der Schweiz," Journal of Socio-Economics in Agriculture (Until 2015: Yearbook of Socioeconomics in Agriculture), Swiss Society for Agricultural Economics and Rural Sociology, vol. 7(1).
    15. Gibson, Matthew & Carnovale, Maria, 2015. "The effects of road pricing on driver behavior and air pollution," Journal of Urban Economics, Elsevier, vol. 89(C), pages 62-73.
    16. Zhang, Fan & Fogarty, James, 2015. "Nonmarket Valuation of Water Sensitive Cities: Current Knowledge and Issues," Working Papers 207694, University of Western Australia, School of Agricultural and Resource Economics.
    17. Kevin J. Boyle & Christopher F. Parmeter, 2017. "Benefit Transfer for Ecosystem Services," Working Papers 2017-07, University of Miami, Department of Economics.
    18. repec:eee:jeeman:v:85:y:2017:i:c:p:35-61 is not listed on IDEAS
    19. Wright, William C.C. & Eppink, Florian V., 2016. "Drivers of heritage value: A meta-analysis of monetary valuation studies of cultural heritage," Ecological Economics, Elsevier, vol. 130(C), pages 277-284.
    20. Ewa Zawojska & Zbigniew Szkop & Mikołaj Czajkowski & Tomasz Żylicz, 2016. "Economic valuation of ecosystem services provided by the Wilanów Park: A benefit transfer study," Working Papers 2016-31, Faculty of Economic Sciences, University of Warsaw.
    21. Gebeyehu Fetene & Søren Olsen & Ole Bonnichsen, 2014. "Disentangling the Pure Time Effect From Site and Preference Heterogeneity Effects in Benefit Transfer: An Empirical Investigation of Transferability," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 59(4), pages 583-611, December.
    22. Klaus Glenk & Julia Martin-Ortega & Manuel Pulido-Velazquez & Jacqueline Potts, 2015. "Inferring Attribute Non-attendance from Discrete Choice Experiments: Implications for Benefit Transfer," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 60(4), pages 497-520, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jeeman:v:66:y:2013:i:1:p:90-104. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Dana Niculescu). General contact details of provider: http://www.elsevier.com/locate/inca/622870 .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.