IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0149374.html
   My bibliography  Save this article

Evaluating Payments for Environmental Services: Methodological Challenges

Author

Listed:
  • Gwenolé Le Velly
  • Céline Dutilly

Abstract

Over the last fifteen years, Payments for Environmental Services (PES) schemes have become very popular environmental policy instruments, but the academic literature has begun to question their additionality. The literature attempts to estimate the causal effect of these programs by applying impact evaluation (IE) techniques. However, PES programs are complex instruments and IE methods cannot be directly applied without adjustments. Based on a systematic review of the literature, this article proposes a framework for the methodological process of designing an IE for PES schemes. It revises and discusses the methodological choices at each step of the process and proposes guidelines for practitioners.

Suggested Citation

  • Gwenolé Le Velly & Céline Dutilly, 2016. "Evaluating Payments for Environmental Services: Methodological Challenges," PLOS ONE, Public Library of Science, vol. 11(2), pages 1-20, February.
  • Handle: RePEc:plo:pone00:0149374
    DOI: 10.1371/journal.pone.0149374
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0149374
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0149374&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0149374?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Wunder, Sven, 2015. "Revisiting the concept of payments for environmental services," Ecological Economics, Elsevier, vol. 117(C), pages 234-243.
    2. Bauch, Simone C. & Sills, Erin O. & Pattanayak, Subhrendu K., 2014. "Have We Managed to Integrate Conservation and Development? ICDP Impacts in the Brazilian Amazon," World Development, Elsevier, vol. 64(S1), pages 135-148.
    3. Ferraro, Paul J. & Miranda, Juan José, 2013. "Heterogeneous treatment effects and mechanisms in information-based environmental policies: Evidence from a large-scale field experiment," Resource and Energy Economics, Elsevier, vol. 35(3), pages 356-379.
    4. Angus Deaton, 2009. "Instruments of development: Randomization in the tropics, and the search for the elusive keys to economic development," Working Papers 1128, Princeton University, Woodrow Wilson School of Public and International Affairs, Center for Health and Wellbeing..
    5. Louise Aukland & Pedro Moura Costa & Sandra Brown, 2003. "A conceptual framework and its application for addressing leakage: the case of avoided deforestation," Climate Policy, Taylor & Francis Journals, vol. 3(2), pages 123-136, June.
    6. JunJie Wu, 2000. "Slippage Effects of the Conservation Reserve Program," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 82(4), pages 979-992.
    7. Gwenolé Le Velly & Alexandre Sauquet & Sergio Cortina-Villar, 2017. "PES Impact and Leakages over Several Cohorts: The Case of the PSA-H in Yucatan, Mexico," Land Economics, University of Wisconsin Press, vol. 93(2), pages 230-257.
    8. Allen Blackman, 2012. "Ex-post Evaluation of Forest Conservation Policies Using Remote Sensing Data: An Introduction and Practical Guide," SPD Working Papers 1201, Inter-American Development Bank, Office of Strategic Planning and Development Effectiveness (SPD).
    9. Ashenfelter, Orley C, 1978. "Estimating the Effect of Training Programs on Earnings," The Review of Economics and Statistics, MIT Press, vol. 60(1), pages 47-57, February.
    10. Clements, Tom & Suon, Seng & Wilkie, David S. & Milner-Gulland, E.J., 2014. "Impacts of Protected Areas on Local Livelihoods in Cambodia," World Development, Elsevier, vol. 64(S1), pages 125-134.
    11. Jennifer Alix-Garcia & Craig McIntosh & Katharine R. E. Sims & Jarrod R. Welch, 2013. "The Ecological Footprint of Poverty Alleviation: Evidence from Mexico's Oportunidades Program," The Review of Economics and Statistics, MIT Press, vol. 95(2), pages 417-435, May.
    12. Chabé-Ferret, Sylvain & Subervie, Julie, 2013. "How much green for the buck? Estimating additional and windfall effects of French agro-environmental schemes by DID-matching," Journal of Environmental Economics and Management, Elsevier, vol. 65(1), pages 12-27.
    13. Sébastien Costedoat & Esteve Corbera & Driss Ezzine-de-Blas & Jordi Honey-Rosés & Kathy Baylis & Miguel Angel Castillo-Santiago, 2015. "How Effective Are Biodiversity Conservation Payments in Mexico?," PLOS ONE, Public Library of Science, vol. 10(3), pages 1-20, March.
    14. Cuenca, Pablo & Arriagada, Rodrigo & Echeverría, Cristian, 2016. "How much deforestation do protected areas avoid in tropical Andean landscapes?," Environmental Science & Policy, Elsevier, vol. 56(C), pages 56-66.
    15. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    16. Seema Jayachandran, 2013. "Liquidity Constraints and Deforestation: The Limitations of Payments for Ecosystem Services," American Economic Review, American Economic Association, vol. 103(3), pages 309-313, May.
    17. Daniela A. Miteva & Subhrendu K. Pattanayak & Paul J. Ferraro, 2012. "Evaluation of biodiversity policy instruments: what works and what doesn’t?," Oxford Review of Economic Policy, Oxford University Press, vol. 28(1), pages 69-92, Spring.
    18. Juan Robalino & Alexander Pfaff, 2013. "Ecopayments and Deforestation in Costa Rica: A Nationwide Analysis of PSA’s Initial Years," Land Economics, University of Wisconsin Press, vol. 89(3), pages 432-448.
    19. Jennifer M. Alix-Garcia & Elizabeth N. Shapiro & Katharine R. E. Sims, 2012. "Forest Conservation and Slippage: Evidence from Mexico’s National Payments for Ecosystem Services Program," Land Economics, University of Wisconsin Press, vol. 88(4), pages 613-638.
    20. Pagiola, Stefano & Arcenas, Agustin & Platais, Gunars, 2005. "Can Payments for Environmental Services Help Reduce Poverty? An Exploration of the Issues and the Evidence to Date from Latin America," World Development, Elsevier, vol. 33(2), pages 237-253, February.
    21. Katharine Sims, 2014. "Do Protected Areas Reduce Forest Fragmentation? A Microlandscapes Approach," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 58(2), pages 303-333, June.
    22. Gani Aldashev & Georg Kirchsteiger & Alexander Sebald, 2017. "Assignment Procedure Biases in Randomised Policy Experiments," Economic Journal, Royal Economic Society, vol. 127(602), pages 873-895, June.
    23. Pfaff Alexander & Robalino Juan & Sanchez-Azofeifa G. Arturo & Andam Kwaw S & Ferraro Paul J, 2009. "Park Location Affects Forest Protection: Land Characteristics Cause Differences in Park Impacts across Costa Rica," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 9(2), pages 1-26, July.
    24. Miteva, Daniela A. & Murray, Brian C. & Pattanayak, Subhrendu K., 2015. "Do protected areas reduce blue carbon emissions? A quasi-experimental evaluation of mangroves in Indonesia," Ecological Economics, Elsevier, vol. 119(C), pages 127-135.
    25. Ferraro, Paul J., 2008. "Asymmetric information and contract design for payments for environmental services," Ecological Economics, Elsevier, vol. 65(4), pages 810-821, May.
    26. Takahashi, Ryo & Todo, Yasuyuki, 2011. "Impact of Community Management on Forest Protection:Evidence from an Aid-Funded Project in Ethiopia," Working Papers 31, JICA Research Institute.
    27. repec:pri:cheawb:deaton%20instruments%20of%20development%20keynes%20lecture%202009 is not listed on IDEAS
    28. Martin Persson, U. & Alpízar, Francisco, 2013. "Conditional Cash Transfers and Payments for Environmental Services—A Conceptual Framework for Explaining and Judging Differences in Outcomes," World Development, Elsevier, vol. 43(C), pages 124-137.
    29. Gabriela Simonet & Julie Subervie & Driss Ezzine-de-Blas & Marina Cromberg & Amy Duchelle, 2015. "Paying smallholders not to cut down the Amazon forest: Impact evaluation of a REDD+ pilot project," Working Papers 15-14, LAMETA, Universtiy of Montpellier, revised Oct 2015.
    30. Shahidur R. Khandker & Gayatri B. Koolwal & Hussain A. Samad, . "Handbook on Impact Evaluation : Quantitative Methods and Practices," World Bank Publications, The World Bank, number 2693, July.
    31. Angelsen, Arild & Kaimowitz, David, 1999. "Rethinking the Causes of Deforestation: Lessons from Economic Models," World Bank Research Observer, World Bank Group, vol. 14(1), pages 73-98, February.
    32. Bishnu Prasad Sharma & Subhrendu Pattanayak & Mani Nepal & Priya Shyamsundar & Bhaskar S. Karky, "undated". "REDD+ Impacts: Evidence from Nepal," Working papers 98, The South Asian Network for Development and Environmental Economics.
    33. repec:pri:cheawb:deaton%20instruments%20of%20development%20keynes%20lecture%202009.pdf is not listed on IDEAS
    34. Sébastien Desbureaux & Laura Brimon, 2015. "Between economic loss and social identity: Themulti-dimensional cost of avoiding deforestation in Eastern Madagascar," Post-Print halshs-01189016, HAL.
    35. Schmook, Birgit & Vance, Colin, 2009. "Agricultural Policy, Market Barriers, and Deforestation: The Case of Mexico's Southern Yucatn," World Development, Elsevier, vol. 37(5), pages 1015-1025, May.
    36. Rodrigo A. Arriagada, & Paul J. Ferraro & Erin O. Sills & Subhrendu K. Pattanayak & Silvia Cordero-Sancho, 2012. "Do Payments for Environmental Services Affect Forest Cover? A Farm-Level Evaluation from Costa Rica," Land Economics, University of Wisconsin Press, vol. 88(2), pages 382-399.
    37. Kelly J. Wendland & Matthias Baumann & David J. Lewis & Anika Sieber & Volker C. Radeloff, 2015. "Protected Area Effectiveness in European Russia: A Postmatching Panel Data Analysis," Land Economics, University of Wisconsin Press, vol. 91(1), pages 149-168.
    38. Juan Robalino & Catalina Sandoval & David N Barton & Adriana Chacon & Alexander Pfaff, 2015. "Evaluating Interactions of Forest Conservation Policies on Avoided Deforestation," PLOS ONE, Public Library of Science, vol. 10(4), pages 1-16, April.
    39. Jack, B. Kelsey, 2009. "Upstream-downstream transactions and watershed externalities: Experimental evidence from Kenya," Ecological Economics, Elsevier, vol. 68(6), pages 1813-1824, April.
    40. Desbureaux, Sébastien & Brimont, Laura, 2015. "Between economic loss and social identity: The multi-dimensional cost of avoiding deforestation in Eastern Madagascar," Ecological Economics, Elsevier, vol. 118(C), pages 10-20.
    41. Corbera, Esteve & Soberanis, Carmen González & Brown, Katrina, 2009. "Institutional dimensions of Payments for Ecosystem Services: An analysis of Mexico's carbon forestry programme," Ecological Economics, Elsevier, vol. 68(3), pages 743-761, January.
    42. Ho, Daniel E. & Imai, Kosuke & King, Gary & Stuart, Elizabeth A., 2007. "Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference," Political Analysis, Cambridge University Press, vol. 15(3), pages 199-236, July.
    43. Erin O Sills & Diego Herrera & A Justin Kirkpatrick & Amintas Brandão Jr. & Rebecca Dickson & Simon Hall & Subhrendu Pattanayak & David Shoch & Mariana Vedoveto & Luisa Young & Alexander Pfaff, 2015. "Estimating the Impacts of Local Policy Innovation: The Synthetic Control Method Applied to Tropical Deforestation," PLOS ONE, Public Library of Science, vol. 10(7), pages 1-15, July.
    44. repec:idb:brikps:65398 is not listed on IDEAS
    45. Zhong Zhao, 2004. "Using Matching to Estimate Treatment Effects: Data Requirements, Matching Metrics, and Monte Carlo Evidence," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 91-107, February.
    46. Paul J. Gertler & Sebastian Martinez & Patrick Premand & Laura B. Rawlings & Christel M. J. Vermeersch, . "Impact Evaluation in Practice, First Edition [La evaluación de impacto en la práctica]," World Bank Publications, The World Bank, number 2550, July.
    47. repec:pri:rpdevs:instruments_of_development.pdf is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tritsch, Isabelle & Le Velly, Gwenolé & Mertens, Benoit & Meyfroidt, Patrick & Sannier, Christophe & Makak, Jean-Sylvestre & Houngbedji, Kenneth, 2020. "Do forest-management plans and FSC certification help avoid deforestation in the Congo Basin?," Ecological Economics, Elsevier, vol. 175(C).
    2. Blundo-Canto, Genowefa & Bax, Vincent & Quintero, Marcela & Cruz-Garcia, Gisella S. & Groeneveld, Rolf A. & Perez-Marulanda, Lisset, 2018. "The Different Dimensions of Livelihood Impacts of Payments for Environmental Services (PES) Schemes: A Systematic Review," Ecological Economics, Elsevier, vol. 149(C), pages 160-183.
    3. Jan Börner & Kathy Baylis & Esteve Corbera & Driss Ezzine-de-Blas & Paul J Ferraro & Jordi Honey-Rosés & Renaud Lapeyre & U Martin Persson & Sven Wunder, 2016. "Emerging Evidence on the Effectiveness of Tropical Forest Conservation," PLOS ONE, Public Library of Science, vol. 11(11), pages 1-11, November.
    4. Wollni, M. & Lanza, G. & Ibanez, M., 2018. "Social capital and conservation under collective and individual incentive schemes: a framed field experiment in Indonesia," 2018 Conference, July 28-August 2, 2018, Vancouver, British Columbia 275968, International Association of Agricultural Economists.
    5. Pierre Mokondoko & Robert H Manson & Taylor H Ricketts & Daniel Geissert, 2018. "Spatial analysis of ecosystem service relationships to improve targeting of payments for hydrological services," PLOS ONE, Public Library of Science, vol. 13(2), pages 1-27, February.
    6. Campanhão, Ligia Maria Barrios & Ranieri, Victor Eduardo Lima, 2019. "Guideline framework for effective targeting of payments for watershed services," Forest Policy and Economics, Elsevier, vol. 104(C), pages 93-109.
    7. Ruggiero, Patricia G.C. & Metzger, Jean Paul & Reverberi Tambosi, Leandro & Nichols, Elizabeth, 2019. "Payment for ecosystem services programs in the Brazilian Atlantic Forest: Effective but not enough," Land Use Policy, Elsevier, vol. 82(C), pages 283-291.
    8. Von Thaden, Juan & Manson, Robert H. & Congalton, Russell G. & López-Barrera, Fabiola & Jones, Kelly W., 2021. "Evaluating the environmental effectiveness of payments for hydrological services in Veracruz, México: A landscape approach," Land Use Policy, Elsevier, vol. 100(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gwenolé Le Velly & Alexandre Sauquet & Sergio Cortina-Villar, 2017. "PES Impact and Leakages over Several Cohorts: The Case of the PSA-H in Yucatan, Mexico," Land Economics, University of Wisconsin Press, vol. 93(2), pages 230-257.
    2. Sims, Katharine R.E. & Alix-Garcia, Jennifer M., 2017. "Parks versus PES: Evaluating direct and incentive-based land conservation in Mexico," Journal of Environmental Economics and Management, Elsevier, vol. 86(C), pages 8-28.
    3. Pablo Cuenca & Juan Robalino & Rodrigo Arriagada & Cristian Echeverría, 2018. "Are government incentives effective for avoided deforestation in the tropical Andean forest?," PLOS ONE, Public Library of Science, vol. 13(9), pages 1-14, September.
    4. Jones, Kelly W. & Muñoz Brenes, Carlos L. & Shinbrot, Xoco A. & López-Báez, Walter & Rivera-Castañeda, Andrómeda, 2018. "The influence of cash and technical assistance on household-level outcomes in payments for hydrological services programs in Chiapas, Mexico," Ecosystem Services, Elsevier, vol. 31(PA), pages 208-218.
    5. Philippe Delacote & Gwenolé Le Velly & Gabriela Simonet, 2018. "A tale of REDD+ projects. How do location and certification impact additionality?," Working Papers 1808, Chaire Economie du climat.
    6. Oliveira Fiorini, Ana Carolina & Mullally, Conner & Swisher, Marilyn & Putz, Francis E., 2020. "Forest cover effects of payments for ecosystem services: Evidence from an impact evaluation in Brazil," Ecological Economics, Elsevier, vol. 169(C).
    7. Ito, Junichi & Feuer, Hart N. & Kitano, Shinichi & Asahi, Haruka, 2019. "Assessing the effectiveness of Japan's community-based direct payment scheme for hilly and mountainous areas," Ecological Economics, Elsevier, vol. 160(C), pages 62-75.
    8. Börner, Jan & Baylis, Kathy & Corbera, Esteve & Ezzine-de-Blas, Driss & Honey-Rosés, Jordi & Persson, U. Martin & Wunder, Sven, 2017. "The Effectiveness of Payments for Environmental Services," World Development, Elsevier, vol. 96(C), pages 359-374.
    9. Jones, Kelly W. & Mayer, Alex & Von Thaden, Juan & Berry, Z. Carter & López-Ramírez, Sergio & Salcone, Jacob & Manson, Robert H. & Asbjornsen, Heidi, 2020. "Measuring the net benefits of payments for hydrological services programs in Mexico," Ecological Economics, Elsevier, vol. 175(C).
    10. Philippe Delacote & Gwenolé Le Velly & Gabriela Simonet, 2020. "Distinguishing potential and effective additionality to revisit the location bias of REDD+ project," Working Papers hal-01954923, HAL.
    11. Mohebalian, Phillip M. & Aguilar, Francisco X., 2018. "Beneath the Canopy: Tropical Forests Enrolled in Conservation Payments Reveal Evidence of Less Degradation," Ecological Economics, Elsevier, vol. 143(C), pages 64-73.
    12. Mohebalian, Phillip M. & Aguilar, Francisco X., 2016. "Additionality and design of forest conservation programs: Insights from Ecuador's Socio Bosque Program," Forest Policy and Economics, Elsevier, vol. 71(C), pages 103-114.
    13. Rosa da Conceição, Hugo & Börner, Jan & Wunder, Sven, 2015. "Why were upscaled incentive programs for forest conservation adopted? Comparing policy choices in Brazil, Ecuador, and Peru," Ecosystem Services, Elsevier, vol. 16(C), pages 243-252.
    14. Alexander Pfaff & Juan Robalino, 2017. "Spillovers from Conservation Programs," Annual Review of Economics, Annual Reviews, vol. 9(1), pages 299-315, October.
    15. Alix-Garcia, Jennifer & Wolff, Hendrik, 2014. "Payment for Ecosystem Services from Forests," IZA Discussion Papers 8179, Institute of Labor Economics (IZA).
    16. Jennifer M. Alix-Garcia & Elizabeth N. Shapiro & Katharine R. E. Sims, 2012. "Forest Conservation and Slippage: Evidence from Mexico’s National Payments for Ecosystem Services Program," Land Economics, University of Wisconsin Press, vol. 88(4), pages 613-638.
    17. Sébastien Desbureaux & Eric Nazindigouba Kere & Pascale Combes Motel, 2016. "Impact Evaluation in a Landscape: Protected Natural Forests, Anthropized Forested Lands and Deforestation Leakages in Madagascar's Rainforests," Working Papers halshs-01342182, HAL.
    18. Arriagada, Rodrigo & Villaseñor, Adrián & Rubiano, Eliana & Cotacachi, David & Morrison, Judith, 2018. "Analysing the impacts of PES programmes beyond economic rationale: Perceptions of ecosystem services provision associated to the Mexican case," Ecosystem Services, Elsevier, vol. 29(PA), pages 116-127.
    19. Sébastien Costedoat & Esteve Corbera & Driss Ezzine-de-Blas & Jordi Honey-Rosés & Kathy Baylis & Miguel Angel Castillo-Santiago, 2015. "How Effective Are Biodiversity Conservation Payments in Mexico?," PLOS ONE, Public Library of Science, vol. 10(3), pages 1-20, March.
    20. Jan Börner & Kathy Baylis & Esteve Corbera & Driss Ezzine-de-Blas & Paul J Ferraro & Jordi Honey-Rosés & Renaud Lapeyre & U Martin Persson & Sven Wunder, 2016. "Emerging Evidence on the Effectiveness of Tropical Forest Conservation," PLOS ONE, Public Library of Science, vol. 11(11), pages 1-11, November.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0149374. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://journals.plos.org/plosone/ .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.