IDEAS home Printed from https://ideas.repec.org/a/oup/erevae/v49y2022i4p723-759..html
   My bibliography  Save this article

Using Machine Learning to Identify Heterogeneous Impacts of Agri-Environment Schemes in the EU: A Case Study

Author

Listed:
  • Christian Stetter
  • Philipp Mennig
  • Johannes Sauer

Abstract

Legislators in the European Union have long been concerned with the environmental impact of farming activities and introduced so-called agri-environment schemes (AES) to mitigate adverse environmental effects and foster desirable ecosystem services in agriculture. This study combines economic theory with a novel machine learning method to identify the environmental effectiveness of AES at the farm level. We develop a set of more than 130 contextual predictors to assess the individual impact of participating in AES. Results from our empirical application for Southeast Germany suggest the existence of heterogeneous, but limited effects of agri-environment measures in several environmental dimensions such as climate change mitigation, clean water and soil health. By making use of Shapley values, we demonstrate the importance of considering the individual farming context in agricultural policy evaluation and provide important insights into the improved targeting of AES along several domains.

Suggested Citation

  • Christian Stetter & Philipp Mennig & Johannes Sauer, 2022. "Using Machine Learning to Identify Heterogeneous Impacts of Agri-Environment Schemes in the EU: A Case Study," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 49(4), pages 723-759.
  • Handle: RePEc:oup:erevae:v:49:y:2022:i:4:p:723-759.
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1093/erae/jbab057
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Victor Chernozhukov & Denis Chetverikov & Mert Demirer & Esther Duflo & Christian Hansen & Whitney Newey & James Robins, 2018. "Double/debiased machine learning for treatment and structural parameters," Econometrics Journal, Royal Economic Society, vol. 21(1), pages 1-68, February.
    2. Andrea Pufahl & Christoph R. Weiss, 2009. "Evaluating the effects of farm programmes: results from propensity score matching," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 36(1), pages 79-101, March.
    3. Carter, Michael R. & Tjernström, Emilia & Toledo, Patricia, 2019. "Heterogeneous impact dynamics of a rural business development program in Nicaragua," Journal of Development Economics, Elsevier, vol. 138(C), pages 77-98.
    4. Efthymios G. Tsionas, 2002. "Stochastic frontier models with random coefficients," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 17(2), pages 127-147.
    5. Wuepper, David & Wimmer, Stefan & Sauer, Johannes, 2020. "Is small family farming more environmentally sustainable? Evidence from a spatial regression discontinuity design in Germany," Land Use Policy, Elsevier, vol. 90(C).
    6. Wossink, Ada & Swinton, Scott M., 2007. "Jointness in production and farmers' willingness to supply non-marketed ecosystem services," Ecological Economics, Elsevier, vol. 64(2), pages 297-304, December.
    7. Yann Desjeux & Pierre Dupraz & Tom Kuhlman & Maria Luisa Paracchini & Rolf Michels & Élise Maigné & Stijn Reinhard, 2015. "Evaluating the impact of rural development measures on nature value indicators at different spatial levels: Application to France and The Netherlands," Post-Print hal-02638882, HAL.
    8. Mario Herrero & Benjamin Henderson & Petr Havlík & Philip K. Thornton & Richard T. Conant & Pete Smith & Stefan Wirsenius & Alexander N. Hristov & Pierre Gerber & Margaret Gill & Klaus Butterbach-Bahl, 2016. "Greenhouse gas mitigation potentials in the livestock sector," Nature Climate Change, Nature, vol. 6(5), pages 452-461, May.
    9. Wooldridge, Jeffrey M., 2005. "Violating Ignorability Of Treatment By Controlling For Too Many Factors," Econometric Theory, Cambridge University Press, vol. 21(5), pages 1026-1028, October.
    10. Uwe Latacz-Lohmann & Gunnar Breustedt, 2019. "Using choice experiments to improve the design of agri-environmental schemes," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 46(3), pages 495-528.
    11. Yixin Wang & David M. Blei, 2019. "The Blessings of Multiple Causes: Rejoinder," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(528), pages 1616-1619, October.
    12. Calvi, Gianpiero & Campedelli, Tommaso & Tellini Florenzano, Guido & Rossi, Patrizia, 2018. "Evaluating the benefits of agri-environment schemes on farmland bird communities through a common species monitoring programme. A case study in northern Italy," Agricultural Systems, Elsevier, vol. 160(C), pages 60-69.
    13. Chabé-Ferret, Sylvain & Subervie, Julie, 2013. "How much green for the buck? Estimating additional and windfall effects of French agro-environmental schemes by DID-matching," Journal of Environmental Economics and Management, Elsevier, vol. 65(1), pages 12-27.
    14. Kuhfuss, Laure & Subervie, Julie, 2018. "Do European Agri-environment Measures Help Reduce Herbicide Use? Evidence From Viticulture in France," Ecological Economics, Elsevier, vol. 149(C), pages 202-211.
    15. Baldoni, Edoardo & Coderoni, Silvia & Esposti, Roberto, 2017. "The productivity and environment nexus with farm-level data. The Case of Carbon Footprint in Lombardy FADN farms," Bio-based and Applied Economics Journal, Italian Association of Agricultural and Applied Economics (AIEAA), vol. 6(2), September.
    16. Fabio Landini & Alessandro Arrighetti & Eleonora Bartoloni, 2020. "The sources of heterogeneity in firm performance: lessons from Italy1," Cambridge Journal of Economics, Cambridge Political Economy Society, vol. 44(3), pages 527-558.
    17. Uehleke, Reinhard & Petrick, Martin & Hüttel, Silke, 2022. "Evaluations of agri-environmental schemes based on observational farm data: The importance of covariate selection," Land Use Policy, Elsevier, vol. 114(C).
    18. Robinson, Peter M, 1988. "Root- N-Consistent Semiparametric Regression," Econometrica, Econometric Society, vol. 56(4), pages 931-954, July.
    19. Doove, L.L. & Van Buuren, S. & Dusseldorp, E., 2014. "Recursive partitioning for missing data imputation in the presence of interaction effects," Computational Statistics & Data Analysis, Elsevier, vol. 72(C), pages 92-104.
    20. Uwe Latacz-Lohmann & Carel Van der Hamsvoort, 1997. "Auctioning Conservation Contracts: A Theoretical Analysis and an Application," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 79(2), pages 407-418.
    21. Allen M. Featherstone & Barry K. Goodwin, 1993. "Factors Influencing a Farmer's Decision to Invest in Long-Term Conservation Improvements," Land Economics, University of Wisconsin Press, vol. 69(1), pages 67-81.
    22. Sexton, Joseph & Laake, Petter, 2009. "Standard errors for bagged and random forest estimators," Computational Statistics & Data Analysis, Elsevier, vol. 53(3), pages 801-811, January.
    23. Westerink, Judith & Jongeneel, Roel & Polman, Nico & Prager, Katrin & Franks, Jeremy & Dupraz, Pierre & Mettepenningen, Evy, 2017. "Collaborative governance arrangements to deliver spatially coordinated agri-environmental management," Land Use Policy, Elsevier, vol. 69(C), pages 176-192.
    24. Joseph Hotz, V. & Imbens, Guido W. & Mortimer, Julie H., 2005. "Predicting the efficacy of future training programs using past experiences at other locations," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 241-270.
    25. Stefan Wager & Susan Athey, 2018. "Estimation and Inference of Heterogeneous Treatment Effects using Random Forests," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(523), pages 1228-1242, July.
    26. Früh-Müller, Andrea & Bach, Martin & Breuer, Lutz & Hotes, Stefan & Koellner, Thomas & Krippes, Christian & Wolters, Volkmar, 2019. "The use of agri-environmental measures to address environmental pressures in Germany: Spatial mismatches and options for improvement," Land Use Policy, Elsevier, vol. 84(C), pages 347-362.
    27. Susan Athey & Guido Imbens & Thai Pham & Stefan Wager, 2017. "Estimating Average Treatment Effects: Supplementary Analyses and Remaining Challenges," American Economic Review, American Economic Association, vol. 107(5), pages 278-281, May.
    28. Eric Ruto & Guy Garrod, 2009. "Investigating farmers' preferences for the design of agri-environment schemes: a choice experiment approach," Journal of Environmental Planning and Management, Taylor & Francis Journals, vol. 52(5), pages 631-647.
    29. Jacob M. Montgomery & Brendan Nyhan & Michelle Torres, 2018. "How Conditioning on Posttreatment Variables Can Ruin Your Experiment and What to Do about It," American Journal of Political Science, John Wiley & Sons, vol. 62(3), pages 760-775, July.
    30. Schomers, Sarah & Matzdorf, Bettina, 2013. "Payments for ecosystem services: A review and comparison of developing and industrialized countries," Ecosystem Services, Elsevier, vol. 6(C), pages 16-30.
    31. Pierre Dupraz & Hervé Guyomard, 2019. "Environment and Climate in the Common Agricultural Policy," EuroChoices, The Agricultural Economics Society, vol. 18(1), pages 18-25, April.
    32. King, Gary & Zeng, Langche, 2006. "The Dangers of Extreme Counterfactuals," Political Analysis, Cambridge University Press, vol. 14(2), pages 131-159, April.
    33. Johannes Sauer & Catherine J. Morrison Paul, 2013. "The empirical identification of heterogeneous technologies and technical change," Applied Economics, Taylor & Francis Journals, vol. 45(11), pages 1461-1479, April.
    34. José A. Gómez‐Limón & Carlos Gutiérrez‐Martín & Anastasio J. Villanueva, 2019. "Optimal Design of Agri‐environmental Schemes under Asymmetric Information for Improving Farmland Biodiversity," Journal of Agricultural Economics, Wiley Blackwell, vol. 70(1), pages 153-177, February.
    35. R. Färe & S. Grosskopf & G. Whittaker, 2013. "Directional output distance functions: endogenous directions based on exogenous normalization constraints," Journal of Productivity Analysis, Springer, vol. 40(3), pages 267-269, December.
    36. DiPrete, Thomas A. & Gangl, Markus, 2004. "Assessing bias in the estimation of causal effects: Rosenbaum bounds on matching estimators and instrumental variables estimation with imperfect instruments," Discussion Papers, Research Unit: Labor Market Policy and Employment SP I 2004-101, WZB Berlin Social Science Center.
    37. Yixin Wang & David M. Blei, 2019. "The Blessings of Multiple Causes," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(528), pages 1574-1596, October.
    38. Chambers,Robert G., 1988. "Applied Production Analysis," Cambridge Books, Cambridge University Press, number 9780521314275, September.
    39. Linda Arata & Paolo Sckokai, 2016. "The Impact of Agri-environmental Schemes on Farm Performance in Five E.U. Member States: A DID-Matching Approach," Land Economics, University of Wisconsin Press, vol. 92(1), pages 167-186.
    40. Silvia Coderoni & Roberto Esposti, 2014. "Is There a Long-Term Relationship Between Agricultural GHG Emissions and Productivity Growth? A Dynamic Panel Data Approach," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 58(2), pages 273-302, June.
    41. Laure Kuhfuss & Raphaële Préget & Sophie Thoyer & Nick Hanley, 2016. "Nudging farmers to enrol land into agri-environmental schemes: the role of a collective bonus," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 43(4), pages 609-636.
    42. Bertoni, Danilo & Curzi, Daniele & Aletti, Giacomo & Olper, Alessandro, 2020. "Estimating the effects of agri-environmental measures using difference-in-difference coarsened exact matching," Food Policy, Elsevier, vol. 90(C).
    43. Mullally, Conner & Chakravarty, Shourish, 2018. "Are matching funds for smallholder irrigation money well spent?," Food Policy, Elsevier, vol. 76(C), pages 70-80.
    44. Christian Langpap & Ivan Hascic & JunJie Wu, 2008. "Protecting Watershed Ecosystems through Targeted Local Land Use Policies," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 90(3), pages 684-700.
    45. Miller, Steve, 2020. "Causal forest estimation of heterogeneous and time-varying environmental policy effects," Journal of Environmental Economics and Management, Elsevier, vol. 103(C).
    46. Frank Wätzold & Martin Drechsler & Karin Johst & Melanie Mewes & Astrid Sturm, 2016. "A Novel, Spatiotemporally Explicit Ecological-economic Modeling Procedure for the Design of Cost-effective Agri-environment Schemes to Conserve Biodiversity," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 98(2), pages 489-512.
    47. Ferraro, Paul J., 2008. "Asymmetric information and contract design for payments for environmental services," Ecological Economics, Elsevier, vol. 65(4), pages 810-821, May.
    48. Mr. Andrew J Tiffin, 2019. "Machine Learning and Causality: The Impact of Financial Crises on Growth," IMF Working Papers 2019/228, International Monetary Fund.
    49. François J Dessart & Jesús Barreiro-Hurlé & René van Bavel, 2019. "Behavioural factors affecting the adoption of sustainable farming practices: a policy-oriented review," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 46(3), pages 417-471.
    50. Baldoni, Edoardo & Coderoni, Silvia & Esposti, Roberto, 2017. "The Productivity-environment Nexus At The Farm Level. The Case Of Carbon Footprint Of Lombardy FADN Farms," 2017 International Congress, August 28-September 1, 2017, Parma, Italy 260895, European Association of Agricultural Economists.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Barnes, Andrew P. & Bevan, Kev & Moxey, Andrew & Grierson, Sascha & Toma, Luiza, 2023. "Identifying best practice in Less Favoured Area mixed livestock systems," Agricultural Systems, Elsevier, vol. 208(C).
    2. Ait Sidhoum, Amer & Mennig, Philipp & Frick, Fabian, 2024. "Assessing the impact of agri-environmental payments on green productivity in Germany," Ecological Economics, Elsevier, vol. 219(C).
    3. Hecker, Lutz Philip & Sturm, Astrid & Querhammer, Lisa & Wätzold, Frank, 2024. "Cost-effectiveness of state-dependent versus state-independent agri-environment schemes for biodiversity conservation," Ecological Economics, Elsevier, vol. 217(C).
    4. Paul Clarke & Annalivia Polselli, 2023. "Double Machine Learning for Static Panel Models with Fixed Effects," Papers 2312.08174, arXiv.org, revised Sep 2024.
    5. Sylvia Klosin & Max Vilgalys, 2022. "Estimating Continuous Treatment Effects in Panel Data using Machine Learning with a Climate Application," Papers 2207.08789, arXiv.org, revised Sep 2023.
    6. Kelvin Mulungu & Zewdu Ayalew Abro & Wambui Beatrice Muriithi & Menale Kassie & Miachael Kidoido & Subramanian Sevgan & Samira Mohamed & Chrysantus Tanga & Fathiya Khamis, 2024. "One size does not fit all: Heterogeneous economic impact of integrated pest management practices for mango fruit flies in Kenya—a machine learning approach," Journal of Agricultural Economics, Wiley Blackwell, vol. 75(1), pages 261-279, February.
    7. Tsakiridis, Andreas & O’Donoghue, Cathal & Ryan, Mary & Cullen, Paula & Ó hUallacháin, Daire & Sheridan, Helen & Stout, Jane, 2022. "Examining the relationship between farmer participation in an agri-environment scheme and the quantity and quality of semi-natural habitats on Irish farms," Land Use Policy, Elsevier, vol. 120(C).
    8. Max Vilgalys, 2023. "A Machine Learning Approach to Measuring Climate Adaptation," Papers 2302.01236, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Uehleke, Reinhard & Petrick, Martin & Hüttel, Silke, 2022. "Evaluations of agri-environmental schemes based on observational farm data: The importance of covariate selection," Land Use Policy, Elsevier, vol. 114(C).
    2. Philippe Coent, 2023. "Payment for environmental services related to aquifers: a review of specific issues and existing programmes," Review of Agricultural, Food and Environmental Studies, Springer, vol. 104(3), pages 273-310, December.
    3. Bartolini, Fabio & Vergamini, Daniele & Longhitano, Davide & Povellato, Andrea, 2021. "Do differential payments for agri-environment schemes affect the environmental benefits? A case study in the North-Eastern Italy," Land Use Policy, Elsevier, vol. 107(C).
    4. Brown, Calum & Kovács, Eszter & Herzon, Irina & Villamayor-Tomas, Sergio & Albizua, Amaia & Galanaki, Antonia & Grammatikopoulou, Ioanna & McCracken, Davy & Olsson, Johanna Alkan & Zinngrebe, Yves, 2021. "Simplistic understandings of farmer motivations could undermine the environmental potential of the common agricultural policy," Land Use Policy, Elsevier, vol. 101(C).
    5. Newham, Melissa & Valente, Marica, 2024. "The cost of influence: How gifts to physicians shape prescriptions and drug costs," Journal of Health Economics, Elsevier, vol. 95(C).
    6. Blazy, J.-M. & Subervie, J. & Paul, J. & Causeret, F. & Guindé, L. & Moulla, S. & Thomas, A. & Sierra, J., 2021. "Ex-ante assessment of the cost-effectiveness of public policies to sequester carbon in soils," Ecological Economics, Elsevier, vol. 190(C).
    7. Valente, Marica, 2023. "Policy evaluation of waste pricing programs using heterogeneous causal effect estimation," Journal of Environmental Economics and Management, Elsevier, vol. 117(C).
    8. Michalek, Jerzy, 2022. "Environmental and farm impacts of the EU RDP agri-environmental measures: Evidence from Slovak regions," Land Use Policy, Elsevier, vol. 113(C).
    9. Meike Weltin & Silke Hüttel, 2023. "Sustainable Intensification Farming as an Enabler for Farm Eco-Efficiency?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 84(1), pages 315-342, January.
    10. Jean-Marc Blazy & Julie Subervie & Jacky Paul & François Causeret & Loic Guinde & Sarah Moulla & Alban Thomas & Jorge Sierra, 2020. "Ex ante assessment of the cost-effectiveness of Agri-Environmental Schemes promoting compost use to sequester carbon in soils in Guadeloupe," CEE-M Working Papers hal-02748634, CEE-M, Universtiy of Montpellier, CNRS, INRA, Montpellier SupAgro.
    11. Lapierre, Margaux & Le Velly, Gwenolé & Bougherara, Douadia & Préget, Raphaële & Sauquet, Alexandre, 2023. "Designing agri-environmental schemes to cope with uncertainty," Ecological Economics, Elsevier, vol. 203(C).
    12. Christoph Schulze & Katarzyna Zagórska & Kati Häfner & Olimpia Markiewicz & Mikołaj Czajkowski & Bettina Matzdorf, 2024. "Using farmers' ex ante preferences to design agri‐environmental contracts: A systematic review," Journal of Agricultural Economics, Wiley Blackwell, vol. 75(1), pages 44-83, February.
    13. Philippe Le Coent & Coralie Calvet, 2016. "Challenges of achieving biodiversity offsetting through agri-environmental schemes: evidence from an empirical study," Working Papers 16-10, LAMETA, Universtiy of Montpellier.
    14. Luc Behaghel & Karen Macours & Julie Subervie, 2019. "How can randomised controlled trials help improve the design of the common agricultural policy?," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 46(3), pages 473-493.
    15. Chabé-Ferret, Sylvain & Voia, Anca, 2019. "Are Grassland Conservation Programs a Cost-Effective Way to Fight Climate Change? Evidence from France," SocArXiv cx8j6, Center for Open Science.
    16. Ito, Junichi & Feuer, Hart N. & Kitano, Shinichi & Asahi, Haruka, 2019. "Assessing the effectiveness of Japan's community-based direct payment scheme for hilly and mountainous areas," Ecological Economics, Elsevier, vol. 160(C), pages 62-75.
    17. Reinhard Uehleke & Heidi Leonhardt & Silke Hüttel, 2024. "Counterfactual evaluation of two Austrian agri‐environmental schemes in 2014–2018," Agricultural Economics, International Association of Agricultural Economists, vol. 55(1), pages 27-40, January.
    18. Amer Ait Sidhoum & Carolin Canessa & Johannes Sauer, 2023. "Effects of agri‐environment schemes on farm‐level eco‐efficiency measures: Empirical evidence from EU countries," Journal of Agricultural Economics, Wiley Blackwell, vol. 74(2), pages 551-569, June.
    19. Bertoni, Danilo & Curzi, Daniele & Aletti, Giacomo & Olper, Alessandro, 2020. "Estimating the effects of agri-environmental measures using difference-in-difference coarsened exact matching," Food Policy, Elsevier, vol. 90(C).
    20. Tsakiridis, Andreas & O’Donoghue, Cathal & Ryan, Mary & Cullen, Paula & Ó hUallacháin, Daire & Sheridan, Helen & Stout, Jane, 2022. "Examining the relationship between farmer participation in an agri-environment scheme and the quantity and quality of semi-natural habitats on Irish farms," Land Use Policy, Elsevier, vol. 120(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:oup:erevae:v:49:y:2022:i:4:p:723-759.. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Oxford University Press (email available below). General contact details of provider: https://edirc.repec.org/data/eaaeeea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.