IDEAS home Printed from https://ideas.repec.org/a/kap/enreec/v84y2023i3d10.1007_s10640-021-00644-z.html
   My bibliography  Save this article

Inferring Economic Impacts from a Program’s Physical Outcomes: An Application to Forest Protection in Thailand

Author

Listed:
  • Wumeng He

    (Wuhan University)

  • Orapan Nabangchang

    (Sukhothai Thammathirat Open University)

  • Krista Erdman

    (South Dakota Department of Agriculture)

  • Alex C. A. Vanko

    (Wildlands Network)

  • Prapti Poudel

    (College of Natural Resources, North Carolina State University)

  • Chandra Giri

    (U.S. Environmental Protection Agency)

  • Jeffrey R. Vincent

    (Duke University)

Abstract

Economists typically estimate the average treatment effect on the treated (ATT) when evaluating government programs. The economic interpretation of the ATT can be ambiguous when program outcomes are measured in purely physical terms, as they often are in evaluations of environmental programs (e.g., avoided deforestation). This paper presents an approach for inferring economic impacts from physical outcomes when the ATT is estimated using propensity-score matching. For the case of forest protection, we show that a protection program’s ex post economic impact, as perceived by the government agency responsible for protection decisions, can be proxied by a weighted ATT, with the weights derived from the propensity of being treated (i.e., protected). We apply this new metric to mangrove protection in Thailand during 1987–2000. We find that the government’s protection program avoided the loss of 12.8% of the economic value associated with the protected mangrove area. This estimate is about a quarter smaller than the conventional ATT for avoided deforestation, 17.3 percentage points. The difference between the two measures indicates that the program tended to be less effective at reducing deforestation in locations where the government perceived the net benefits of protection as being greater, which is the opposite of the relationship that would characterize a maximally effective program.

Suggested Citation

  • Wumeng He & Orapan Nabangchang & Krista Erdman & Alex C. A. Vanko & Prapti Poudel & Chandra Giri & Jeffrey R. Vincent, 2023. "Inferring Economic Impacts from a Program’s Physical Outcomes: An Application to Forest Protection in Thailand," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 84(3), pages 845-876, March.
  • Handle: RePEc:kap:enreec:v:84:y:2023:i:3:d:10.1007_s10640-021-00644-z
    DOI: 10.1007/s10640-021-00644-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10640-021-00644-z
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10640-021-00644-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Diego Herrera & Alexander Pfaff & Juan Robalino, 2019. "Impacts of protected areas vary with the level of government: Comparing avoided deforestation across agencies in the Brazilian Amazon," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 116(30), pages 14916-14925, July.
    2. Jeffrey R. Vincent, 2016. "Impact Evaluation of Forest Conservation Programs: Benefit-Cost Analysis, Without the Economics," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 63(2), pages 395-408, February.
    3. Pattanayak, Subhrendu K. & Kramer, Randall A., 2001. "Worth of watersheds: a producer surplus approach for valuing drought mitigation in Eastern Indonesia," Environment and Development Economics, Cambridge University Press, vol. 6(1), pages 123-146, February.
    4. Miteva, Daniela A. & Murray, Brian C. & Pattanayak, Subhrendu K., 2015. "Do protected areas reduce blue carbon emissions? A quasi-experimental evaluation of mangroves in Indonesia," Ecological Economics, Elsevier, vol. 119(C), pages 127-135.
    5. Suthawan Sathirathai, 1998. "Economic Valuation of Mangroves and the Roles of Local Communities in the Conservation of Natural Resources: Case Study of Surat Thani, South of Thailand," EEPSEA Research Report rr1998061, Economy and Environment Program for Southeast Asia (EEPSEA), revised Jun 1998.
    6. Susan Athey & Guido W. Imbens, 2017. "The State of Applied Econometrics: Causality and Policy Evaluation," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 3-32, Spring.
    7. Luke Gibson & Tien Ming Lee & Lian Pin Koh & Barry W. Brook & Toby A. Gardner & Jos Barlow & Carlos A. Peres & Corey J. A. Bradshaw & William F. Laurance & Thomas E. Lovejoy & Navjot S. Sodhi, 2011. "Primary forests are irreplaceable for sustaining tropical biodiversity," Nature, Nature, vol. 478(7369), pages 378-381, October.
    8. James J. Heckman, 2010. "Building Bridges between Structural and Program Evaluation Approaches to Evaluating Policy," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 356-398, June.
    9. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    10. A. D. Roy, 1951. "Some Thoughts On The Distribution Of Earnings," Oxford Economic Papers, Oxford University Press, vol. 3(2), pages 135-146.
    11. Juan Robalino & Alexander Pfaff & Laura Villalobos, 2017. "Heterogeneous Local Spillovers from Protected Areas in Costa Rica," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(3), pages 795-820.
    12. Ho, Daniel E. & Imai, Kosuke & King, Gary & Stuart, Elizabeth A., 2007. "Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference," Political Analysis, Cambridge University Press, vol. 15(3), pages 199-236, July.
    13. Alberto Abadie & Guido W. Imbens, 2008. "On the Failure of the Bootstrap for Matching Estimators," Econometrica, Econometric Society, vol. 76(6), pages 1537-1557, November.
    14. Barbier, Edward B., 2008. "In the wake of tsunami: Lessons learned from the household decision to replant mangroves in Thailand," Resource and Energy Economics, Elsevier, vol. 30(2), pages 229-249, May.
    15. Pfaff Alexander & Robalino Juan & Sanchez-Azofeifa G. Arturo & Andam Kwaw S & Ferraro Paul J, 2009. "Park Location Affects Forest Protection: Land Characteristics Cause Differences in Park Impacts across Costa Rica," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 9(2), pages 1-26, July.
    16. Paul J. Ferraro & Kathleen Lawlor & Katrina L. Mullan & Subhrendu K. Pattanayak, 2012. "Forest Figures: Ecosystem Services Valuation and Policy Evaluation in Developing Countries," Review of Environmental Economics and Policy, Association of Environmental and Resource Economists, vol. 6(1), pages 20-44.
    17. Maxx Dilley & Robert S. Chen & Uwe Deichmann & Arthur L. Lerner-Lam & Margaret Arnold, 2005. "Natural Disaster Hotspots: A Global Risk Analysis," World Bank Publications - Books, The World Bank Group, number 7376, December.
    18. Blackman, Allen, 2013. "Evaluating forest conservation policies in developing countries using remote sensing data: An introduction and practical guide," Forest Policy and Economics, Elsevier, vol. 34(C), pages 1-16.
    19. Kosuke Imai & Gary King & Elizabeth A. Stuart, 2008. "Misunderstandings between experimentalists and observationalists about causal inference," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 171(2), pages 481-502, April.
    20. Edward B. Barbier, 2007. "Valuing ecosystem services as productive inputs [‘Valuing groundwater recharge through agricultural production in the Hadejia-Jama’are wetlands in northern Nigeria’]," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 22(49), pages 178-229.
    21. Jeffrey R. Vincent, 2016. "Erratum to: Impact Evaluation of Forest Conservation Programs: Benefit-Cost Analysis, Without the Economics," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 63(2), pages 409-409, February.
    22. Alberto Abadie & Guido W. Imbens, 2006. "Large Sample Properties of Matching Estimators for Average Treatment Effects," Econometrica, Econometric Society, vol. 74(1), pages 235-267, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jeffrey R. Vincent, 2016. "Impact Evaluation of Forest Conservation Programs: Benefit-Cost Analysis, Without the Economics," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 63(2), pages 395-408, February.
    2. Blackman, Allen, 2015. "Strict versus mixed-use protected areas: Guatemala's Maya Biosphere Reserve," Ecological Economics, Elsevier, vol. 112(C), pages 14-24.
    3. Jasjeet Singh Sekhon & Richard D. Grieve, 2012. "A matching method for improving covariate balance in cost‐effectiveness analyses," Health Economics, John Wiley & Sons, Ltd., vol. 21(6), pages 695-714, June.
    4. Jones A.M & Rice N, 2009. "Econometric Evaluation of Health Policies," Health, Econometrics and Data Group (HEDG) Working Papers 09/09, HEDG, c/o Department of Economics, University of York.
    5. Miteva, Daniela A. & Pattanayak, Subhrendu K., 2021. "The effectiveness of protected areas in the context of decentralization," World Development, Elsevier, vol. 142(C).
    6. Canavire-Bacarreza, Gustavo & Diaz-Gutierrez, Julian Eduardo & Hanauer, Merlin M., 2018. "Unintended consequences of conservation: Estimating the impact of protected areas on violence in Colombia," Journal of Environmental Economics and Management, Elsevier, vol. 89(C), pages 46-70.
    7. Blackman, Allen & Goff, Leonard & Rivera Planter, Marisol, 2018. "Does eco-certification stem tropical deforestation? Forest Stewardship Council certification in Mexico," Journal of Environmental Economics and Management, Elsevier, vol. 89(C), pages 306-333.
    8. Jeffrey Smith & Arthur Sweetman, 2016. "Viewpoint: Estimating the causal effects of policies and programs," Canadian Journal of Economics, Canadian Economics Association, vol. 49(3), pages 871-905, August.
    9. Miranda, Juan Jose & Corral, Leonardo & Blackman, Allen & Asner, Gregory & Lima, Eirivelthon, 2014. "Effects of Protected Areas on Forest Cover Change and Local Communities," RFF Working Paper Series dp-14-14, Resources for the Future.
    10. Canavire-Bacarreza, Gustavo & Hanauer, Merlin M., 2013. "Estimating the Impacts of Bolivia’s Protected Areas on Poverty," World Development, Elsevier, vol. 41(C), pages 265-285.
    11. Martin Huber & Michael Lechner & Andreas Steinmayr, 2015. "Radius matching on the propensity score with bias adjustment: tuning parameters and finite sample behaviour," Empirical Economics, Springer, vol. 49(1), pages 1-31, August.
    12. Miranda, Juan José & Corral, Leonardo & Blackman, Allen & Asner, Gregory & Lima, Eirivelthon, 2016. "Effects of Protected Areas on Forest Cover Change and Local Communities: Evidence from the Peruvian Amazon," World Development, Elsevier, vol. 78(C), pages 288-307.
    13. Paul Ferraro & Merlin Hanauer, 2011. "Protecting Ecosystems and Alleviating Poverty with Parks and Reserves: ‘Win-Win’ or Tradeoffs?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 48(2), pages 269-286, February.
    14. Ulf Rinne & Arne Uhlendorff & Zhong Zhao, 2013. "Vouchers and caseworkers in training programs for the unemployed," Empirical Economics, Springer, vol. 45(3), pages 1089-1127, December.
    15. Estifanos, Tafesse Kefyalew & Polyakov, Maksym & Pandit, Ram & Hailu, Atakelty & Burton, Michael, 2020. "The impact of protected areas on the rural households’ incomes in Ethiopia," Land Use Policy, Elsevier, vol. 91(C).
    16. Blackman, Allen & Veit, Peter, 2018. "Titled Amazon Indigenous Communities Cut Forest Carbon Emissions," Ecological Economics, Elsevier, vol. 153(C), pages 56-67.
    17. Huber, Martin, 2019. "An introduction to flexible methods for policy evaluation," FSES Working Papers 504, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    18. Sébastien Costedoat & Esteve Corbera & Driss Ezzine-de-Blas & Jordi Honey-Rosés & Kathy Baylis & Miguel Angel Castillo-Santiago, 2015. "How Effective Are Biodiversity Conservation Payments in Mexico?," PLOS ONE, Public Library of Science, vol. 10(3), pages 1-20, March.
    19. Chervier, Colas & Costedoat, Sébastien, 2017. "Heterogeneous Impact of a Collective Payment for Environmental Services Scheme on Reducing Deforestation in Cambodia," World Development, Elsevier, vol. 98(C), pages 148-159.
    20. Huber, Martin & Lechner, Michael & Wunsch, Conny, 2013. "The performance of estimators based on the propensity score," Journal of Econometrics, Elsevier, vol. 175(1), pages 1-21.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:enreec:v:84:y:2023:i:3:d:10.1007_s10640-021-00644-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.