IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0132590.html
   My bibliography  Save this article

Estimating the Impacts of Local Policy Innovation: The Synthetic Control Method Applied to Tropical Deforestation

Author

Listed:
  • Erin O Sills
  • Diego Herrera
  • A Justin Kirkpatrick
  • Amintas Brandão Jr.
  • Rebecca Dickson
  • Simon Hall
  • Subhrendu Pattanayak
  • David Shoch
  • Mariana Vedoveto
  • Luisa Young
  • Alexander Pfaff

Abstract

Quasi-experimental methods increasingly are used to evaluate the impacts of conservation interventions by generating credible estimates of counterfactual baselines. These methods generally require large samples for statistical comparisons, presenting a challenge for evaluating innovative policies implemented within a few pioneering jurisdictions. Single jurisdictions often are studied using comparative methods, which rely on analysts’ selection of best case comparisons. The synthetic control method (SCM) offers one systematic and transparent way to select cases for comparison, from a sizeable pool, by focusing upon similarity in outcomes before the intervention. We explain SCM, then apply it to one local initiative to limit deforestation in the Brazilian Amazon. The municipality of Paragominas launched a multi-pronged local initiative in 2008 to maintain low deforestation while restoring economic production. This was a response to having been placed, due to high deforestation, on a federal “blacklist” that increased enforcement of forest regulations and restricted access to credit and output markets. The local initiative included mapping and monitoring of rural land plus promotion of economic alternatives compatible with low deforestation. The key motivation for the program may have been to reduce the costs of blacklisting. However its stated purpose was to limit deforestation, and thus we apply SCM to estimate what deforestation would have been in a (counterfactual) scenario of no local initiative. We obtain a plausible estimate, in that deforestation patterns before the intervention were similar in Paragominas and the synthetic control, which suggests that after several years, the initiative did lower deforestation (significantly below the synthetic control in 2012). This demonstrates that SCM can yield helpful land-use counterfactuals for single units, with opportunities to integrate local and expert knowledge and to test innovations and permutations on policies that are implemented in just a few locations.

Suggested Citation

  • Erin O Sills & Diego Herrera & A Justin Kirkpatrick & Amintas Brandão Jr. & Rebecca Dickson & Simon Hall & Subhrendu Pattanayak & David Shoch & Mariana Vedoveto & Luisa Young & Alexander Pfaff, 2015. "Estimating the Impacts of Local Policy Innovation: The Synthetic Control Method Applied to Tropical Deforestation," PLOS ONE, Public Library of Science, vol. 10(7), pages 1-15, July.
  • Handle: RePEc:plo:pone00:0132590
    DOI: 10.1371/journal.pone.0132590
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0132590
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0132590&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0132590?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Kirkpatrick, A. Justin & Bennear, Lori S., 2014. "Promoting clean energy investment: An empirical analysis of property assessed clean energy," Journal of Environmental Economics and Management, Elsevier, vol. 68(2), pages 357-375.
    2. Coffman, Makena & Noy, Ilan, 2012. "Hurricane Iniki: measuring the long-term economic impact of a natural disaster using synthetic control," Environment and Development Economics, Cambridge University Press, vol. 17(2), pages 187-205, April.
    3. Sarah Bohn & Magnus Lofstrom & Steven Raphael, 2014. "Did the 2007 Legal Arizona Workers Act Reduce the State's Unauthorized Immigrant Population?," The Review of Economics and Statistics, MIT Press, vol. 96(2), pages 258-269, May.
    4. Alberto Abadie & Javier Gardeazabal, 2003. "The Economic Costs of Conflict: A Case Study of the Basque Country," American Economic Review, American Economic Association, vol. 93(1), pages 113-132, March.
    5. Mircea Trandafir, 2014. "Reply to Comment on “The Effect of Same-Sex Marriage Laws on Different-Sex Marriage: Evidence From the Netherlands”," Demography, Springer;Population Association of America (PAA), vol. 51(6), pages 2349-2350, December.
    6. Campos, Nauro F. & Coricelli, Fabrizio & Moretti, Luigi, 2014. "Economic Growth and Political Integration: Estimating the Benefits from Membership in the European Union Using the Synthetic Counterfactuals Method," IZA Discussion Papers 8162, Institute of Labor Economics (IZA).
    7. Andreas Billmeier & Tommaso Nannicini, 2013. "Assessing Economic Liberalization Episodes: A Synthetic Control Approach," The Review of Economics and Statistics, MIT Press, vol. 95(3), pages 983-1001, July.
    8. Bradley Heim & Ithai Lurie, 2014. "Does health reform affect self-employment? Evidence from Massachusetts," Small Business Economics, Springer, vol. 43(4), pages 917-930, December.
    9. Marcos Sanso‐Navarro, 2011. "The Effects on American Foreign Direct Investment in the United Kingdom from Not Adopting the Euro," Journal of Common Market Studies, Wiley Blackwell, vol. 49(2), pages 463-483, March.
    10. Abadie, Alberto & Diamond, Alexis & Hainmueller, Jens, 2011. "Synth: An R Package for Synthetic Control Methods in Comparative Case Studies," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 42(i13).
    11. Eduardo Cavallo & Sebastian Galiani & Ilan Noy & Juan Pantano, 2013. "Catastrophic Natural Disasters and Economic Growth," The Review of Economics and Statistics, MIT Press, vol. 95(5), pages 1549-1561, December.
    12. Lijphart, Arend, 1971. "Comparative Politics and the Comparative Method," American Political Science Review, Cambridge University Press, vol. 65(3), pages 682-693, September.
    13. Mircea Trandafir, 2014. "The Effect of Same-Sex Marriage Laws on Different-Sex Marriage: Evidence From the Netherlands," Demography, Springer;Population Association of America (PAA), vol. 51(1), pages 317-340, February.
    14. Dorsett, Richard, 2013. "The effect of the Troubles on GDP in Northern Ireland," European Journal of Political Economy, Elsevier, vol. 29(C), pages 119-133.
    15. Coricelli, Fabrizio & Campos, Nauro & Moretti, Luigi, 2014. "Economic Growth and Political Integration: Estimating the Benefits from Membership in the European Union Using the Synthetic Co," CEPR Discussion Papers 9968, C.E.P.R. Discussion Papers.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bruno Ferman & Cristine Pinto & Vitor Possebom, 2020. "Cherry Picking with Synthetic Controls," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(2), pages 510-532, March.
    2. Cappelli, Federica & Caravaggio, Nicola & Vaquero-Piñeiro, Cristina, 2022. "Buen Vivir and forest conservation in Bolivia: False promises or effective change?," Forest Policy and Economics, Elsevier, vol. 137(C).
    3. Corral, Leonardo R. & Schling, Maja, 2017. "The impact of shoreline stabilization on economic growth in small island developing states," Journal of Environmental Economics and Management, Elsevier, vol. 86(C), pages 210-228.
    4. Ferman, Bruno & Pinto, Cristine, 2016. "Revisiting the Synthetic Control Estimator," MPRA Paper 73982, University Library of Munich, Germany.
    5. Cisneros, Elías & Kis-Katos, Krisztina & Nuryartono, Nunung, 2021. "Palm oil and the politics of deforestation in Indonesia," Journal of Environmental Economics and Management, Elsevier, vol. 108(C).
    6. Sills, Erin & Pfaff, Alexander & Andrade, Luiza & Kirkpatrick, Justin & Dickson, Rebecca, 2020. "Investing in local capacity to respond to a federal environmental mandate: Forest & economic impacts of the Green Municipality Program in the Brazilian Amazon," World Development, Elsevier, vol. 129(C).
    7. Bueno, Matheus & Valente, Marica, 2019. "The effects of pricing waste generation: A synthetic control approach," Journal of Environmental Economics and Management, Elsevier, vol. 96(C), pages 274-285.
    8. Pellegrini, Lorenzo & Tasciotti, Luca & Spartaco, Andrea, 2021. "A regional resource curse? A synthetic-control approach to oil extraction in Basilicata, Italy," Ecological Economics, Elsevier, vol. 185(C).
    9. Ibrahim Alnafrah & Sulaiman Mouselli, 2020. "Constructing the Reconstruction Process: a Smooth Transition Towards Knowledge Society and Economy in Post-Conflict Syria," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 11(3), pages 931-948, September.
    10. Yinger Zheng & Haixia Zheng & Xinyue Ye, 2016. "Using Machine Learning in Environmental Tax Reform Assessment for Sustainable Development: A Case Study of Hubei Province, China," Sustainability, MDPI, vol. 8(11), pages 1-20, November.
    11. dos Santos Massoca, Paulo Eduardo & Brondízio, Eduardo Sonnewend, 2022. "National policies encounter municipal realities: A critical analysis of the outcomes of the List of Priority Municipalities in curbing deforestation in the Brazilian Amazon," World Development, Elsevier, vol. 158(C).
    12. Bragança, Arthur & Dahis, Ricardo, 2022. "Cutting special interests by the roots: Evidence from the Brazilian Amazon," Journal of Public Economics, Elsevier, vol. 215(C).
    13. Jan Börner & Kathy Baylis & Esteve Corbera & Driss Ezzine-de-Blas & Paul J Ferraro & Jordi Honey-Rosés & Renaud Lapeyre & U Martin Persson & Sven Wunder, 2016. "Emerging Evidence on the Effectiveness of Tropical Forest Conservation," PLOS ONE, Public Library of Science, vol. 11(11), pages 1-11, November.
    14. Reed, James & Ickowitz, Amy & Chervier, Colas & Djoudi, Houria & Moombe, Kaala & Ros-Tonen, Mirjam & Yanou, Malaika & Yuliani, Linda & Sunderland, Terry, 2020. "Integrated landscape approaches in the tropics: A brief stock-take," Land Use Policy, Elsevier, vol. 99(C).
    15. Firpo Sergio & Possebom Vitor, 2018. "Synthetic Control Method: Inference, Sensitivity Analysis and Confidence Sets," Journal of Causal Inference, De Gruyter, vol. 6(2), pages 1-26, September.
    16. Alice Lépissier & Matto Mildenberger, 2021. "Unilateral climate policies can substantially reduce national carbon pollution," Climatic Change, Springer, vol. 166(3), pages 1-21, June.
    17. Gwenolé Le Velly & Céline Dutilly, 2016. "Evaluating Payments for Environmental Services: Methodological Challenges," PLOS ONE, Public Library of Science, vol. 11(2), pages 1-20, February.
    18. Assunção, Juliano & Rocha, Romero, 2019. "Getting greener by going black: the effect of blacklisting municipalities on Amazon deforestation," Environment and Development Economics, Cambridge University Press, vol. 24(2), pages 115-137, April.
    19. Correa, Juliano & Cisneros, Elías & Börner, Jan & Pfaff, Alexander & Costa, Marcelo & Rajão, Raoni, 2020. "Evaluating REDD+ at subnational level: Amazon fund impacts in Alta Floresta, Brazil," Forest Policy and Economics, Elsevier, vol. 116(C).
    20. Brito, Brenda, 2020. "The pioneer market for forest law compliance in Paragominas, Eastern Brazilian Amazon," Land Use Policy, Elsevier, vol. 94(C).
    21. Petar Soric, 2024. "The euro and inflation in Croatia: much ado about nothing?," Public Sector Economics, Institute of Public Finance, vol. 48(1), pages 1-37.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bruno Ferman & Cristine Pinto & Vitor Possebom, 2020. "Cherry Picking with Synthetic Controls," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(2), pages 510-532, March.
    2. Giulio Grossi & Marco Mariani & Alessandra Mattei & Patrizia Lattarulo & Ozge Oner, 2020. "Direct and spillover effects of a new tramway line on the commercial vitality of peripheral streets. A synthetic-control approach," Papers 2004.05027, arXiv.org, revised Nov 2023.
    3. David Gilchrist & Thomas Emery & Nuno Garoupa & Rok Spruk, 2023. "Synthetic Control Method: A tool for comparative case studies in economic history," Journal of Economic Surveys, Wiley Blackwell, vol. 37(2), pages 409-445, April.
    4. Kaul, Ashok & Klößner, Stefan & Pfeifer, Gregor & Schieler, Manuel, 2015. "Synthetic Control Methods: Never Use All Pre-Intervention Outcomes Together With Covariates," MPRA Paper 83790, University Library of Munich, Germany.
    5. Robert Bifulco & Ross Rubenstein & Hosung Sohn, 2017. "Using Synthetic Controls to Evaluate the Effect of Unique Interventions: The Case of Say Yes to Education," Evaluation Review, , vol. 41(6), pages 593-619, December.
    6. Kleis, Mischa & Moessinger, Marc-Daniel, 2016. "The long-run effect of fiscal consolidation on economic growth: Evidence from quantitative case studies," ZEW Discussion Papers 16-047, ZEW - Leibniz Centre for European Economic Research, revised 2016.
    7. Katarzyna Metelska-Szaniawska, 2016. "Reassessing the Economic Effects of Post-Socialist Constitutions Using the Synthetic Control Method," Working Papers 2016-18, Faculty of Economic Sciences, University of Warsaw.
    8. Ferman, Bruno & Pinto, Cristine, 2016. "Revisiting the Synthetic Control Estimator," MPRA Paper 73982, University Library of Munich, Germany.
    9. Bibek Adhikari & Romain Duval & Bingjie Hu & Prakash Loungani, 2018. "Can Reform Waves Turn the Tide? Some Case Studies using the Synthetic Control Method," Open Economies Review, Springer, vol. 29(4), pages 879-910, September.
    10. Dennis Essers & Stefaan Ide, 2017. "The IMF and precautionary lending : An empirical evaluation of the selectivity and effectiveness of the flexible credit line," Working Paper Research 323, National Bank of Belgium.
    11. Makram El-Shagi & Axel Lindner & Gregor von Schweinitz, 2016. "Real Effective Exchange Rate Misalignment in the Euro Area: A Counterfactual Analysis," Review of International Economics, Wiley Blackwell, vol. 24(1), pages 37-66, February.
    12. Bibek Adhikari & James Alm, 2016. "Evaluating the Economic Effects of Flat Tax Reforms Using Synthetic Control Methods," Southern Economic Journal, John Wiley & Sons, vol. 83(2), pages 437-463, October.
    13. Daniel Albalate & Germà Bel & Ferran A. Mazaira-Font, 2021. "Decoupling synthetic control methods to ensure stability, accuracy and meaningfulness," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 12(4), pages 549-584, December.
    14. Essers, Dennis & Ide, Stefaan, 2019. "The IMF and precautionary lending: An empirical evaluation of the selectivity and effectiveness of the Flexible Credit Line," Journal of International Money and Finance, Elsevier, vol. 92(C), pages 25-61.
    15. Alena Bachleitner, 2017. "Abolishing the Wealth Tax. A Case Study for Germany," WIFO Working Papers 545, WIFO.
    16. Hope, David, 2016. "Estimating the effect of the EMU on current account balances: A synthetic control approach," European Journal of Political Economy, Elsevier, vol. 44(C), pages 20-40.
    17. Björn Falkenhall & Jonas Månsson & Sofia Tano, 2020. "Impact of VAT Reform on Swedish Restaurants: A Synthetic Control Group Approach," Scandinavian Journal of Economics, Wiley Blackwell, vol. 122(2), pages 824-850, April.
    18. Matej Opatrny, 2021. "The impact of the Brexit vote on UK financial markets: a synthetic control method approach," Empirica, Springer;Austrian Institute for Economic Research;Austrian Economic Association, vol. 48(2), pages 559-587, May.
    19. Emery, Thomas & Mélon, Lela & Spruk, Rok, 2023. "Does e-procurement matter for economic growth? Subnational evidence from Australia," The Quarterly Review of Economics and Finance, Elsevier, vol. 89(C), pages 318-334.
    20. Daniel Albalate & Germà Bel & Ferran A. Mazaira-Font, 2020. "Ensuring Stability, Accuracy and Meaningfulness in Synthetic Control Methods: The Regularized SHAP-Distance Method," IREA Working Papers 202005, University of Barcelona, Research Institute of Applied Economics, revised Apr 2020.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0132590. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.