IDEAS home Printed from https://ideas.repec.org/a/uwp/landec/v85y2009i3p410-428.html
   My bibliography  Save this article

Selection Effects in Meta-Analysis and Benefit Transfer: Avoiding Unintended Consequences

Author

Listed:
  • Randall S. Rosenberger
  • Robert J. Johnston

Abstract

Selection effects include seemingly independent influences on, and choices in, conducting and reporting primary research that may bias a stock of knowledge. Such effects may arise from sociopolitical influences (research priority selection), researcher choices (methodology selection), peer review influences (publication selection), and meta-analyst choices (metadata sample selection). This paper discusses the impact, detection, and amelioration of selection effects within benefit transfer. Also discussed is evidence of selection effects in the literature and their implications for primary research. Evidence suggests that metaregression analysis may be the best tool for detecting and generating corrective measures for selection biases within benefit transfers.

Suggested Citation

  • Randall S. Rosenberger & Robert J. Johnston, 2009. "Selection Effects in Meta-Analysis and Benefit Transfer: Avoiding Unintended Consequences," Land Economics, University of Wisconsin Press, vol. 85(3), pages 410-428.
    • Handle: RePEc:uwp:landec:v:85:y:2009:i:3:p:410-428
    as

    Download full text from publisher

    File URL: http://le.uwpress.org/cgi/reprint/85/3/410
    Download Restriction: A subscripton is required to access pdf files. Pay per article is available.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ryan Stapler & Robert Johnston, 2009. "Meta-Analysis, Benefit Transfer, and Methodological Covariates: Implications for Transfer Error," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 42(2), pages 227-246, February.
    2. Yong Jiang & Stephen Swallow & Michael Mcgonagle, 2005. "Context-Sensitive Benefit Transfer Using Stated Choice Models: Specification and Convergent Validity for Policy Analysis," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 31(4), pages 477-499, August.
    3. van Kooten, G. Cornelis & Eagle, Alison J. & Manley, James G. & Smolak, Tara M., 2004. "How Costly Are Carbon Offsets? A Meta-Analysis Of Carbon Forest Sinks," Working Papers 18166, University of Victoria, Resource Economics and Policy.
    4. V. Smith & Ju Huang, 1993. "Hedonic models and air pollution: Twenty-five years and counting," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 3(4), pages 381-394, August.
    5. Iovanna, Richard & Griffiths, Charles, 2006. "Clean water, ecological benefits, and benefits transfer: A work in progress at the U.S. EPA," Ecological Economics, Elsevier, vol. 60(2), pages 473-482, December.
    6. Rosenberger, Randall S. & Stanley, Tom D., 2006. "Measurement, generalization, and publication: Sources of error in benefit transfers and their management," Ecological Economics, Elsevier, vol. 60(2), pages 372-378, December.
    7. Ian J. Bateman & Alistair Munro & Gregory L. Poe, 2008. "Decoy Effects in Choice Experiments and Contingent Valuation: Asymmetric Dominance," Land Economics, University of Wisconsin Press, vol. 84(1), pages 115-127.
    8. John C. Bergstrom & Kevin J. Boyle & Gregory L. Poe (ed.), 2001. "The Economic Value of Water Quality," Books, Edward Elgar Publishing, number 1723.
    9. Robert J. Johnston & Elena Y. Besedin & Richard Iovanna & Christopher J. Miller & Ryan F. Wardwell & Matthew H. Ranson, 2005. "Systematic Variation in Willingness to Pay for Aquatic Resource Improvements and Implications for Benefit Transfer: A Meta‐Analysis," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 53(2‐3), pages 221-248, June.
    10. Hoehn, John P., 2006. "Methods to address selection effects in the meta regression and transfer of ecosystem values," Ecological Economics, Elsevier, vol. 60(2), pages 389-398, December.
    11. Johnston, Robert J. & Besedin, Elena Y. & Ranson, Matthew H., 2006. "Characterizing the effects of valuation methodology in function-based benefits transfer," Ecological Economics, Elsevier, vol. 60(2), pages 407-419, December.
    12. Raymond J.G.M. Florax & Peter Nijkamp & Kenneth G. Willis (ed.), 2002. "Comparative Environmental Economic Assessment," Books, Edward Elgar Publishing, number 1945.
    13. Guy Garrod & Kenneth G. Willis, 1999. "Economic Valuation of the Environment," Books, Edward Elgar Publishing, number 1368.
    14. G. Cornelis van Kooten & Alison Eagle & James Manley & Tara Smolak, 2004. "How Costly are Carbon Offsets? A Meta-Analysis of Forest Carbon Sinks," Working Papers 2004-01, University of Victoria, Department of Economics, Resource Economics and Policy Analysis Research Group.
    15. Loomis, John B. & Rosenberger, Randall S., 2006. "Reducing barriers in future benefit transfers: Needed improvements in primary study design and reporting," Ecological Economics, Elsevier, vol. 60(2), pages 343-350, December.
    16. Ian J. Bateman & Andrew P. Jones, 2003. "Contrasting Conventional with Multi-Level Modeling Approaches to Meta-Analysis: Expectation Consistency in U.K. Woodland Recreation Values," Land Economics, University of Wisconsin Press, vol. 79(2), pages 235-258.
    17. Morrison, Mark & Bergland, Olvar, 2006. "Prospects for the use of choice modelling for benefit transfer," Ecological Economics, Elsevier, vol. 60(2), pages 420-428, December.
    18. Mark J. Koetse & Raymond J.G.M. Florax & Henri L.F. de Groot, 2005. "Correcting for Primary Study Misspecifications in Meta-Analysis," Tinbergen Institute Discussion Papers 05-029/3, Tinbergen Institute, revised 31 Jan 2013.
    19. Jacinto Braga & Chris Starmer, 2005. "Preference Anomalies, Preference Elicitation and the Discovered Preference Hypothesis," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 32(1), pages 55-89, September.
    20. Loomis, John B. & White, Douglas S., 1996. "Economic benefits of rare and endangered species: summary and meta-analysis," Ecological Economics, Elsevier, vol. 18(3), pages 197-206, September.
    21. Smith, V. Kerry & Kaoru, Yoshiaki, 1990. "What have we learned since hotelling's letter? : A meta-analysis," Economics Letters, Elsevier, vol. 32(3), pages 277-281, March.
    22. Robert Johnston, 2007. "Choice experiments, site similarity and benefits transfer," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 38(3), pages 331-351, November.
    23. Gregory Poe & Jeremy Clark & Daniel Rondeau & William Schulze, 2002. "Provision Point Mechanisms and Field Validity Tests of Contingent Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 23(1), pages 105-131, September.
    24. V. Kerry Smith & Yoshiaki Kaoru, 1990. "Signals or Noise? Explaining the Variation in Recreation Benefit Estimates," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 72(2), pages 419-433.
    25. Robert J. Johnston & James J. Opaluch & Thomas A. Grigalunas & Marisa J. Mazzotta, 2001. "Estimating Amenity Benefits of Coastal Farmland," Growth and Change, Wiley Blackwell, vol. 32(3), pages 305-325.
    26. Moeltner, Klaus & Boyle, Kevin J. & Paterson, Robert W., 2007. "Meta-analysis and benefit transfer for resource valuation-addressing classical challenges with Bayesian modeling," Journal of Environmental Economics and Management, Elsevier, vol. 53(2), pages 250-269, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Robert J. Johnston & Kevin J. Boyle & Maria L. Loureiro & Ståle Navrud & John Rolfe, 2021. "Guidance to Enhance the Validity and Credibility of Environmental Benefit Transfers," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 79(3), pages 575-624, July.
    2. Robert J. Johnston & Randall S. Rosenberger, 2010. "Methods, Trends And Controversies In Contemporary Benefit Transfer," Journal of Economic Surveys, Wiley Blackwell, vol. 24(3), pages 479-510, July.
    3. Richardson, Leslie & Loomis, John & Kroeger, Timm & Casey, Frank, 2015. "The role of benefit transfer in ecosystem service valuation," Ecological Economics, Elsevier, vol. 115(C), pages 51-58.
    4. Kukielka, Jessica B. & Johnston, Robert J. & Duke, Joshua M., 2008. "Systematic Variation in Willingness to Pay for Agricultural Land Preservation and Implications for Benefit Transfer: A Meta-Analysis," 2008 Annual Meeting, July 27-29, 2008, Orlando, Florida 6121, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    5. Rosenberger, Randall S. & Stanley, Tom D., 2006. "Measurement, generalization, and publication: Sources of error in benefit transfers and their management," Ecological Economics, Elsevier, vol. 60(2), pages 372-378, December.
    6. Shuang Liu & David I Stern, 2008. "A Meta-Analysis of Contingent Valuation Studies in Coastal and Near-Shore Marine Ecosystems," Socio-Economics and the Environment in Discussion (SEED) Working Paper Series 2008-15, CSIRO Sustainable Ecosystems.
    7. Kevin Boyle & Christopher Parmeter & Brent Boehlert & Robert Paterson, 2013. "Due Diligence in Meta-analyses to Support Benefit Transfers," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 55(3), pages 357-386, July.
    8. Zandersen, Marianne & Tol, Richard S.J., 2009. "A meta-analysis of forest recreation values in Europe," Journal of Forest Economics, Elsevier, vol. 15(1-2), pages 109-130, January.
    9. Brander, Luke M. & Ghermandi, Andrea & Kuik, Onno & Markandya, Anil & Nunes, Paulo A.L.D. & Schaafsma, Marije & Wagtendonk, Alfred, 2010. "Scaling up Ecosystem Services Values: Methodology, Applicability and a Case Study," Sustainable Development Papers 60689, Fondazione Eni Enrico Mattei (FEEM).
    10. Jon Nelson & Peter Kennedy, 2009. "The Use (and Abuse) of Meta-Analysis in Environmental and Natural Resource Economics: An Assessment," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 42(3), pages 345-377, March.
    11. Tuan, Tran Hu & Lindhjem, Henrik, 2008. "Meta-analysis of nature conservation values in Asia & Oceania: Data heterogeneity and benefit transfer issues," MPRA Paper 11470, University Library of Munich, Germany.
    12. Lindhjem, Henrik & Navrud, Ståle, 2008. "How reliable are meta-analyses for international benefit transfers?," Ecological Economics, Elsevier, vol. 66(2-3), pages 425-435, June.
    13. Ryan Stapler & Robert Johnston, 2009. "Meta-Analysis, Benefit Transfer, and Methodological Covariates: Implications for Transfer Error," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 42(2), pages 227-246, February.
    14. Henrik Lindhjem & Tran Tuan, 2012. "Valuation of species and nature conservation in Asia and Oceania: a meta-analysis," Environmental Economics and Policy Studies, Springer;Society for Environmental Economics and Policy Studies - SEEPS, vol. 14(1), pages 1-22, January.
    15. Ghermandi, Andrea & Nunes, Paulo A.L.D., 2013. "A global map of coastal recreation values: Results from a spatially explicit meta-analysis," Ecological Economics, Elsevier, vol. 86(C), pages 1-15.
    16. Londoño, Luz M. & Johnston, Robert J., 2012. "Enhancing the reliability of benefit transfer over heterogeneous sites: A meta-analysis of international coral reef values," Ecological Economics, Elsevier, vol. 78(C), pages 80-89.
    17. Johnston, Robert J. & Duke, Joshua M. & Kukielka, Jessica B., 2008. "Optimizing Farmland Preservation Choices Across Communities and Jurisdictional Scales: To What Extent are Amenity Values and Selection Criteria Transferable?," 2008 Annual Meeting, July 27-29, 2008, Orlando, Florida 6243, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    18. Kevin J. Boyle & Jeffrey M. Wooldridge, 2018. "Understanding Error Structures and Exploiting Panel Data in Meta-analytic Benefit Transfers," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 69(3), pages 609-635, March.
    19. Robert J. Johnston & Elena Y. Besedin & Ryan Stapler, 2017. "Enhanced Geospatial Validity for Meta-analysis and Environmental Benefit Transfer: An Application to Water Quality Improvements," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 68(2), pages 343-375, October.
    20. Robert J. Johnston & Joshua M. Duke, 2009. "Willingness to Pay for Land Preservation across States and Jurisdictional Scale: Implications for Benefit Transfer," Land Economics, University of Wisconsin Press, vol. 85(2), pages 217-237.

    More about this item

    JEL classification:

    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
    • Q51 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Environmental Economics - - - Valuation of Environmental Effects

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:uwp:landec:v:85:y:2009:i:3:p:410-428. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: http://le.uwpress.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.