IDEAS home Printed from https://ideas.repec.org/a/uwp/landec/v85y2009i3p410-428.html
   My bibliography  Save this article

Selection Effects in Meta-Analysis and Benefit Transfer: Avoiding Unintended Consequences

Author

Listed:
  • Randall S. Rosenberger
  • Robert J. Johnston

Abstract

Selection effects include seemingly independent influences on, and choices in, conducting and reporting primary research that may bias a stock of knowledge. Such effects may arise from sociopolitical influences (research priority selection), researcher choices (methodology selection), peer review influences (publication selection), and meta-analyst choices (metadata sample selection). This paper discusses the impact, detection, and amelioration of selection effects within benefit transfer. Also discussed is evidence of selection effects in the literature and their implications for primary research. Evidence suggests that metaregression analysis may be the best tool for detecting and generating corrective measures for selection biases within benefit transfers.

Suggested Citation

  • Randall S. Rosenberger & Robert J. Johnston, 2009. "Selection Effects in Meta-Analysis and Benefit Transfer: Avoiding Unintended Consequences," Land Economics, University of Wisconsin Press, vol. 85(3), pages 410-428.
  • Handle: RePEc:uwp:landec:v:85:y:2009:i:3:p:410-428
    as

    Download full text from publisher

    File URL: http://le.uwpress.org/cgi/reprint/85/3/410
    Download Restriction: A subscripton is required to access pdf files. Pay per article is available.

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ryan Stapler & Robert Johnston, 2009. "Meta-Analysis, Benefit Transfer, and Methodological Covariates: Implications for Transfer Error," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 42(2), pages 227-246, February.
    2. Yong Jiang & Stephen Swallow & Michael Mcgonagle, 2005. "Context-Sensitive Benefit Transfer Using Stated Choice Models: Specification and Convergent Validity for Policy Analysis," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 31(4), pages 477-499, August.
    3. Ian J. Bateman & Andrew P. Jones, 2003. "Contrasting Conventional with Multi-Level Modeling Approaches to Meta-Analysis: Expectation Consistency in U.K. Woodland Recreation Values," Land Economics, University of Wisconsin Press, vol. 79(2), pages 235-258.
    4. Morrison, Mark & Bergland, Olvar, 2006. "Prospects for the use of choice modelling for benefit transfer," Ecological Economics, Elsevier, vol. 60(2), pages 420-428, December.
    5. Mark J. Koetse & Raymond J.G.M. Florax & Henri L.F. de Groot, 2005. "Correcting for Primary Study Misspecifications in Meta-Analysis," Tinbergen Institute Discussion Papers 05-029/3, Tinbergen Institute, revised 31 Jan 2013.
    6. Ian J. Bateman & Alistair Munro & Gregory L. Poe, 2008. "Decoy Effects in Choice Experiments and Contingent Valuation: Asymmetric Dominance," Land Economics, University of Wisconsin Press, vol. 84(1), pages 115-127.
    7. Smith, V. Kerry & Kaoru, Yoshiaki, 1990. "What have we learned since hotelling's letter? : A meta-analysis," Economics Letters, Elsevier, vol. 32(3), pages 277-281, March.
    8. Robert J. Johnston & Elena Y. Besedin & Richard Iovanna & Christopher J. Miller & Ryan F. Wardwell & Matthew H. Ranson, 2005. "Systematic Variation in Willingness to Pay for Aquatic Resource Improvements and Implications for Benefit Transfer: A Meta-Analysis," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 53(2-3), pages 221-248, June.
    9. Johnston, Robert J. & Besedin, Elena Y. & Ranson, Matthew H., 2006. "Characterizing the effects of valuation methodology in function-based benefits transfer," Ecological Economics, Elsevier, vol. 60(2), pages 407-419, December.
    10. Robert Johnston, 2007. "Choice experiments, site similarity and benefits transfer," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 38(3), pages 331-351, November.
    11. Gregory Poe & Jeremy Clark & Daniel Rondeau & William Schulze, 2002. "Provision Point Mechanisms and Field Validity Tests of Contingent Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 23(1), pages 105-131, September.
    12. V. Kerry Smith & Yoshiaki Kaoru, 1990. "Signals or Noise? Explaining the Variation in Recreation Benefit Estimates," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 72(2), pages 419-433.
    13. Robert J. Johnston, 2001. "Estimating Amenity Benefits of Coastal Farmland," Growth and Change, Wiley Blackwell, vol. 32(3), pages 305-325.
    14. Moeltner, Klaus & Boyle, Kevin J. & Paterson, Robert W., 2007. "Meta-analysis and benefit transfer for resource valuation-addressing classical challenges with Bayesian modeling," Journal of Environmental Economics and Management, Elsevier, vol. 53(2), pages 250-269, March.
    15. G. Cornelis van Kooten & Alison Eagle & James Manley & Tara Smolak, 2004. "How Costly are Carbon Offsets? A Meta-Analysis of Forest Carbon Sinks," Working Papers 2004-01, University of Victoria, Department of Economics, Resource Economics and Policy Analysis Research Group.
    16. Klaus Moeltner & Randall S. Rosenberger, 2007. "Meta-Regression and Benefit Transfer: Data Space, Model Space, and the Quest for ‘Optimal Scope’," Working Papers 07-011, University of Nevada, Reno, Department of Economics;University of Nevada, Reno , Department of Resource Economics.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Robert J. Johnston & Randall S. Rosenberger, 2010. "Methods, Trends And Controversies In Contemporary Benefit Transfer," Journal of Economic Surveys, Wiley Blackwell, vol. 24(3), pages 479-510, July.
    2. Patton, Douglas & Bergstrom, John C. & Moore, Rebecca & Covich, Alan, 2013. "Correspondence And Efficiency In Forecasts Of Ecosystem Service Benefits," 2013 Annual Meeting, August 4-6, 2013, Washington, D.C. 150559, Agricultural and Applied Economics Association.
    3. Luke Brander & Ingo Bräuer & Holger Gerdes & Andrea Ghermandi & Onno Kuik & Anil Markandya & Ståle Navrud & Paulo Nunes & Marije Schaafsma & Hans Vos & Alfred Wagtendonk, 2012. "Using Meta-Analysis and GIS for Value Transfer and Scaling Up: Valuing Climate Change Induced Losses of European Wetlands," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 52(3), pages 395-413, July.
    4. Vista, Arvin B. & Rosenberger, Randall S., 2013. "Addressing dependency in the sportfishing valuation literature: Implications for meta-regression analysis and benefit transfer," Ecological Economics, Elsevier, vol. 96(C), pages 181-189.
    5. Richardson, Leslie & Loomis, John & Kroeger, Timm & Casey, Frank, 2015. "The role of benefit transfer in ecosystem service valuation," Ecological Economics, Elsevier, vol. 115(C), pages 51-58.
    6. World Bank, 2013. "India : Diagnostic Assessment of Select Environmental Challenges, Volume 3. Valuation of Biodiversity and Ecosystem Services in India," World Bank Other Operational Studies 16029, The World Bank.
    7. Londoño, Luz M. & Johnston, Robert J., 2012. "Enhancing the reliability of benefit transfer over heterogeneous sites: A meta-analysis of international coral reef values," Ecological Economics, Elsevier, vol. 78(C), pages 80-89.
    8. Ghermandi, Andrea & Nunes, Paulo A.L.D., 2013. "A global map of coastal recreation values: Results from a spatially explicit meta-analysis," Ecological Economics, Elsevier, vol. 86(C), pages 1-15.
    9. Jürgen Meyerhoff & Morten Mørkbak & Søren Olsen, 2014. "A Meta-study Investigating the Sources of Protest Behaviour in Stated Preference Surveys," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 58(1), pages 35-57, May.
    10. repec:eee:ecoser:v:4:y:2013:i:c:p:33-46 is not listed on IDEAS
    11. Chaikumbung, Mayula & Doucouliagos, Hristos & Scarborough, Helen, 2016. "The economic value of wetlands in developing countries: A meta-regression analysis," Ecological Economics, Elsevier, vol. 124(C), pages 164-174.
    12. repec:eee:ecoser:v:26:y:2017:i:pa:p:170-182 is not listed on IDEAS
    13. repec:kap:enreec:v:68:y:2017:i:2:d:10.1007_s10640-016-0021-7 is not listed on IDEAS
    14. Jan Philipp Schägner & Luke Brander & Joachim Maes & Volkmar Hartje, 2012. "Mapping Ecosystem Services’ Values: Current Practice and Future Prospects," Working Papers 2012.59, Fondazione Eni Enrico Mattei.
    15. Johnston, Robert J. & Duke, Joshua M., 2010. "Socioeconomic adjustments and choice experiment benefit function transfer: Evaluating the common wisdom," Resource and Energy Economics, Elsevier, vol. 32(3), pages 421-438, August.
    16. Henrik Lindhjem & Tran Tuan, 2012. "Valuation of species and nature conservation in Asia and Oceania: a meta-analysis," Environmental Economics and Policy Studies, Springer;Society for Environmental Economics and Policy Studies - SEEPS, vol. 14(1), pages 1-22, January.

    More about this item

    JEL classification:

    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
    • Q51 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Environmental Economics - - - Valuation of Environmental Effects

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:uwp:landec:v:85:y:2009:i:3:p:410-428. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (). General contact details of provider: http://le.uwpress.org/ .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.