IDEAS home Printed from https://ideas.repec.org/p/hal/journl/hal-02112625.html
   My bibliography  Save this paper

Can RCTs help improve the design of CAP

Author

Listed:
  • Luc Behaghel

    (PSE - Paris School of Economics - UP1 - Université Paris 1 Panthéon-Sorbonne - ENS-PSL - École normale supérieure - Paris - PSL - Université Paris Sciences et Lettres - EHESS - École des hautes études en sciences sociales - ENPC - École des Ponts ParisTech - CNRS - Centre National de la Recherche Scientifique - INRAE - Institut National de Recherche pour l’Agriculture, l’Alimentation et l’Environnement)

  • Karen Macours

    (PSE - Paris School of Economics - UP1 - Université Paris 1 Panthéon-Sorbonne - ENS-PSL - École normale supérieure - Paris - PSL - Université Paris Sciences et Lettres - EHESS - École des hautes études en sciences sociales - ENPC - École des Ponts ParisTech - CNRS - Centre National de la Recherche Scientifique - INRAE - Institut National de Recherche pour l’Agriculture, l’Alimentation et l’Environnement)

  • Julie Subervie

    (CEE-M - Centre d'Economie de l'Environnement - Montpellier - FRE2010 - INRA - Institut National de la Recherche Agronomique - UM - Université de Montpellier - CNRS - Centre National de la Recherche Scientifique - Montpellier SupAgro - Institut national d’études supérieures agronomiques de Montpellier)

Abstract

We illustrate how randomized controlled trials (RCTs) could be used as a learning tool to shed light on various aspects of the Common Agricultural Policy (CAP). RCTs are quasi-absent from the CAP evaluation toolbox, despite their frequent use to evaluate other European Union policies, or agricultural policies in developing countries. We draw upon existing debates on the role of RCTs in policy-making to derive a list of points of attention. We then consider four specific examples of evaluation questions for the CAP, and based on examples drawn from agricultural and social policies in developing and developed countries, argue that the RCT toolbox has the potential to significantly add to existing approaches to evaluating and designing components of the CAP.

Suggested Citation

  • Luc Behaghel & Karen Macours & Julie Subervie, 2018. "Can RCTs help improve the design of CAP," Post-Print hal-02112625, HAL.
  • Handle: RePEc:hal:journl:hal-02112625
    Note: View the original document on HAL open archive server: https://hal.science/hal-02112625
    as

    Download full text from publisher

    File URL: https://hal.science/hal-02112625/document
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Jayachandran, Seema & de Laat, Joost & Lambin, Eric F. & Stanton, Charlotte, 2016. "Cash for Carbon: A Randomized Controlled Trial of Payments for Ecosystem Services to Reduce Deforestation," CEPR Discussion Papers 11349, C.E.P.R. Discussion Papers.
    2. Charles F. Manski, 2013. "Response to the Review of ‘Public Policy in an Uncertain World’," Economic Journal, Royal Economic Society, vol. 0, pages 412-415, August.
    3. Ingvild Almås & Alex Armand & Orazio Attanasio & Pedro Carneiro, 2018. "Measuring and Changing Control: Women's Empowerment and Targeted Transfers," Economic Journal, Royal Economic Society, vol. 128(612), pages 609-639, July.
    4. Luc Behaghel & Bruno Cr?pon & Marc Gurgand, 2014. "Private and Public Provision of Counseling to Job Seekers: Evidence from a Large Controlled Experiment," American Economic Journal: Applied Economics, American Economic Association, vol. 6(4), pages 142-174, October.
    5. Laure Kuhfuss & Raphaële Preget & Sophie Thoyer, 2014. "Préférences individuelles et incitations collectives : quels contrats agroenvironnementaux pour la réduction des herbicides par les viticulteurs ?," Review of Agricultural and Environmental Studies - Revue d'Etudes en Agriculture et Environnement, INRA Department of Economics, vol. 95(1), pages 111-143.
    6. Francesco Avvisati & Marc Gurgand & Nina Guyon & Eric Maurin, 2014. "Getting Parents Involved: A Field Experiment in Deprived Schools," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(1), pages 57-83.
    7. Bruno Crépon & Esther Duflo & Marc Gurgand & Roland Rathelot & Philippe Zamora, 2013. "Do Labor Market Policies have Displacement Effects? Evidence from a Clustered Randomized Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(2), pages 531-580.
    8. Laure Kuhfuss & Raphaële Préget & Sophie Thoyer & Nick Hanley & Philippe Le Coent & Mathieu Désolé, 2016. "Nudges, Social Norms, and Permanence in Agri-environmental Schemes," Land Economics, University of Wisconsin Press, vol. 92(4), pages 641-655.
    9. Heckelei, Thomas & Britz, Wolfgang & Zhang, Yinan, 2012. "Positive Mathematical Programming Approaches – Recent Developments in Literature and Applied Modelling," Bio-based and Applied Economics Journal, Italian Association of Agricultural and Applied Economics (AIEAA), vol. 1(1), pages 1-16, April.
    10. James Berry & Greg Fischer & Raymond Guiteras, 2020. "Eliciting and Utilizing Willingness to Pay: Evidence from Field Trials in Northern Ghana," Journal of Political Economy, University of Chicago Press, vol. 128(4), pages 1436-1473.
    11. Roland Fryer & Steven Levitt & John List & Sally Sadoff, 2012. "Enhancing the Efficacy of Teacher Incentives through Loss Aversion: A Field Experiment," Framed Field Experiments 00591, The Field Experiments Website.
    12. De Cara, Stéphane & Jayet, Pierre-Alain, 2011. "Marginal abatement costs of greenhouse gas emissions from European agriculture, cost effectiveness, and the EU non-ETS burden sharing agreement," Ecological Economics, Elsevier, vol. 70(9), pages 1680-1690, July.
    13. Luc Behaghel & Bruno Crépon & Marc Gurgand & Thomas Le Barbanchon, 2015. "Please Call Again: Correcting Nonresponse Bias in Treatment Effect Models," The Review of Economics and Statistics, MIT Press, vol. 97(5), pages 1070-1080, December.
    14. Esther Duflo & Pascaline Dupas & Michael Kremer, 2011. "Peer Effects, Teacher Incentives, and the Impact of Tracking: Evidence from a Randomized Evaluation in Kenya," American Economic Review, American Economic Association, vol. 101(5), pages 1739-1774, August.
    15. Chabé-Ferret, Sylvain & Subervie, Julie, 2013. "How much green for the buck? Estimating additional and windfall effects of French agro-environmental schemes by DID-matching," Journal of Environmental Economics and Management, Elsevier, vol. 65(1), pages 12-27.
    16. Luc Behaghel & Clément de Chaisemartin & Marc Gurgand, 2017. "Ready for Boarding? The Effects of a Boarding School for Disadvantaged Students," American Economic Journal: Applied Economics, American Economic Association, vol. 9(1), pages 140-164, January.
    17. Schubert, Christian, 2017. "Green nudges: Do they work? Are they ethical?," Ecological Economics, Elsevier, vol. 132(C), pages 329-342.
    18. Guiteras, Raymond P. & Jack, B. Kelsey, 2018. "Productivity in piece-rate labor markets: Evidence from rural Malawi," Journal of Development Economics, Elsevier, vol. 131(C), pages 42-61.
    19. Richard Akresh & Damien de Walque & Harounan Kazianga, 2016. "Evidence from a Randomized Evaluation of the Household Welfare Impacts of Conditional and Unconditional Cash Transfers Given to Mothers or Fathers," Economics Working Paper Series 1611, Oklahoma State University, Department of Economics and Legal Studies in Business.
    20. Steven Wallander & Paul Ferraro & Nathaniel Higgins, 2017. "Addressing Participant Inattention in Federal Programs: A Field Experiment with The Conservation Reserve Program," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 99(4), pages 914-931.
    21. Edward Miguel & Michael Kremer, 2004. "Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities," Econometrica, Econometric Society, vol. 72(1), pages 159-217, January.
    22. William Vickrey, 1961. "Counterspeculation, Auctions, And Competitive Sealed Tenders," Journal of Finance, American Finance Association, vol. 16(1), pages 8-37, March.
    23. Deaton, Angus & Cartwright, Nancy, 2018. "Understanding and misunderstanding randomized controlled trials," Social Science & Medicine, Elsevier, vol. 210(C), pages 2-21.
    24. Gocht, Alexander & Britz, Wolfgang, 2011. "EU-wide farm type supply models in CAPRI--How to consistently disaggregate sector models into farm type models," Journal of Policy Modeling, Elsevier, vol. 33(1), pages 146-167, January.
    25. Liesbeth Colen & Sergio Gomez y Paloma & Uwe Latacz-Lohmann & Marianne Lefebvre & Raphaële Préget & Sophie Thoyer, 2016. "Economic Experiments as a Tool for Agricultural Policy Evaluation: Insights from the European CAP," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 64(4), pages 667-694, December.
    26. Kuhfuss, Laure & Subervie, Julie, 2018. "Do European Agri-environment Measures Help Reduce Herbicide Use? Evidence From Viticulture in France," Ecological Economics, Elsevier, vol. 149(C), pages 202-211.
    27. Esther Duflo & Michael Kremer & Jonathan Robinson, 2011. "Nudging Farmers to Use Fertilizer: Theory and Experimental Evidence from Kenya," American Economic Review, American Economic Association, vol. 101(6), pages 2350-2390, October.
    28. Simanti Banerjee, 2018. "Improving Spatial Coordination Rates under the Agglomeration Bonus Scheme: A Laboratory Experiment with a Pecuniary and a Non-Pecuniary Mechanism (NUDGE)," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 100(1), pages 172-197.
    29. Abhijit Banerjee & Sylvain Chassang & Sergio Montero & Erik Snowberg, 2017. "A Theory of Experimenters," NBER Working Papers 23867, National Bureau of Economic Research, Inc.
    30. Jacob R. Fooks & Nathaniel Higgins & Kent D. Messer & Joshua M. Duke & Daniel Hellerstein & Lori Lynch, 2016. "Conserving Spatially Explicit Benefits in Ecosystem Service Markets: Experimental Tests of Network Bonuses and Spatial Targeting," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 98(2), pages 468-488.
    31. repec:ken:wpaper:0901 is not listed on IDEAS
    32. Richard E. Howitt, 1995. "Positive Mathematical Programming," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 77(2), pages 329-342.
    33. Cason, Timothy N. & Gangadharan, Lata, 2013. "Empowering neighbors versus imposing regulations: An experimental analysis of pollution reduction schemes," Journal of Environmental Economics and Management, Elsevier, vol. 65(3), pages 469-484.
    34. Holmstrom, Bengt & Milgrom, Paul, 1991. "Multitask Principal-Agent Analyses: Incentive Contracts, Asset Ownership, and Job Design," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 7(0), pages 24-52, Special I.
    35. B. Kelsey Jack, 2013. "Private Information and the Allocation of Land Use Subsidies in Malawi," American Economic Journal: Applied Economics, American Economic Association, vol. 5(3), pages 113-135, July.
    36. Gregory L. Poe & William D. Schulze & Kathleen Segerson & Jordan F. Suter & Christian A. Vossler, 2004. "Exploring the Performance of Ambient-Based Policy Instruments When Nonpoint Source Polluters Can Cooperate," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 86(5), pages 1203-1210.
    37. Scott E. Carrell & Bruce I. Sacerdote & James E. West, 2013. "From Natural Variation to Optimal Policy? The Importance of Endogenous Peer Group Formation," Econometrica, Econometric Society, vol. 81(3), pages 855-882, May.
    38. Westerink, Judith & Jongeneel, Roel & Polman, Nico & Prager, Katrin & Franks, Jeremy & Dupraz, Pierre & Mettepenningen, Evy, 2017. "Collaborative governance arrangements to deliver spatially coordinated agri-environmental management," Land Use Policy, Elsevier, vol. 69(C), pages 176-192.
    39. Ariel Fiszbein & Norbert Schady & Francisco H.G. Ferreira & Margaret Grosh & Niall Keleher & Pedro Olinto & Emmanuel Skoufias, 2009. "Conditional Cash Transfers : Reducing Present and Future Poverty," World Bank Publications - Books, The World Bank Group, number 2597, December.
    40. Felipe Barrera-Osorio & Marianne Bertrand & Leigh L. Linden & Francisco Perez-Calle, 2011. "Improving the Design of Conditional Transfer Programs: Evidence from a Randomized Education Experiment in Colombia," American Economic Journal: Applied Economics, American Economic Association, vol. 3(2), pages 167-195, April.
    41. Noah J. Goldstein & Robert B. Cialdini & Vladas Griskevicius, 2008. "A Room with a Viewpoint: Using Social Norms to Motivate Environmental Conservation in Hotels," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 35(3), pages 472-482, March.
    42. Brian E. Roe & David R. Just, 2009. "Internal and External Validity in Economics Research: Tradeoffs between Experiments, Field Experiments, Natural Experiments, and Field Data," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 91(5), pages 1266-1271.
    43. Ferraro, Paul J., 2008. "Asymmetric information and contract design for payments for environmental services," Ecological Economics, Elsevier, vol. 65(4), pages 810-821, May.
    44. Sarah Baird & Craig McIntosh & Berk Özler, 2011. "Cash or Condition? Evidence from a Cash Transfer Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(4), pages 1709-1753.
    45. Liesbeth Colen & Sergio Gomez y Paloma & Uwe Latacz-Lohmann & Marianne Lefebvre & Raphaële Préget & Sophie Thoyer, 2016. "Economic Experiments as a Tool for Agricultural Policy Evaluation: Insights from the European CAP," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 64(4), pages 667-694, December.
    46. Spraggon, John, 2004. "Testing ambient pollution instruments with heterogeneous agents," Journal of Environmental Economics and Management, Elsevier, vol. 48(2), pages 837-856, September.
    47. Manski, Charles F., 2013. "Public Policy in an Uncertain World: Analysis and Decisions," Economics Books, Harvard University Press, number 9780674066892, Spring.
    48. Jordan F. Suter & Christian A. Vossler, 2014. "Towards an Understanding of the Performance of Ambient Tax Mechanisms in the Field: Evidence from Upstate New York Dairy Farmers," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 96(1), pages 92-107.
    49. Karthik Muralidharan & Venkatesh Sundararaman, 2011. "Teacher Performance Pay: Experimental Evidence from India," Journal of Political Economy, University of Chicago Press, vol. 119(1), pages 39-77.
    50. Benjamin A. Olken, 2007. "Monitoring Corruption: Evidence from a Field Experiment in Indonesia," Journal of Political Economy, University of Chicago Press, vol. 115(2), pages 200-249.
    51. Lundberg, Liv & Persson, U. Martin & Alpizar, Francisco & Lindgren, Kristian, 2018. "Context Matters: Exploring the Cost-effectiveness of Fixed Payments and Procurement Auctions for PES," Ecological Economics, Elsevier, vol. 146(C), pages 347-358.
    52. Jordan F. Suter & Joshua M. Duke & Kent D. Messer & Holly A. Michael, 2012. "Behavior in a Spatially Explicit Groundwater Resource: Evidence from the Lab," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 94(5), pages 1094-1112.
    53. Kamel Louhichi & Pavel Ciaian & Maria Espinosa & Angel Perni & Sergio Gomez y Paloma, 2018. "Economic impacts of CAP greening: application of an EU-wide individual farm model for CAP analysis (IFM-CAP)," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 45(2), pages 205-238.
    54. Hoffmann, Vivian & Barrett, Christopher B. & Just, David R., 2009. "Do Free Goods Stick to Poor Households? Experimental Evidence on Insecticide Treated Bednets," World Development, Elsevier, vol. 37(3), pages 607-617, March.
    55. Ferraro, Paul & Messer, Kent D. & Wu, Shang, 2017. "Applying Behavioral Insights to Improve Water Security," Choices: The Magazine of Food, Farm, and Resource Issues, Agricultural and Applied Economics Association, vol. 32(4), November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Luc Behaghel & Karen Macours & Julie Subervie, 2019. "How can randomised controlled trials help improve the design of the common agricultural policy?," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 46(3), pages 473-493.
    2. Leah H. Palm-Forster & Paul J. Ferraro & Nicholas Janusch & Christian A. Vossler & Kent D. Messer, 2019. "Behavioral and Experimental Agri-Environmental Research: Methodological Challenges, Literature Gaps, and Recommendations," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 73(3), pages 719-742, July.
    3. Jörg Peters & Jörg Langbein & Gareth Roberts, 2018. "Generalization in the Tropics – Development Policy, Randomized Controlled Trials, and External Validity," The World Bank Research Observer, World Bank, vol. 33(1), pages 34-64.
    4. Wu, Shang & Palm-Forster, Leah H. & Messer, Kent D., 2021. "Impact of peer comparisons and firm heterogeneity on nonpoint source water pollution: An experimental study," Resource and Energy Economics, Elsevier, vol. 63(C).
    5. Karthik Muralidharan & Paul Niehaus, 2017. "Experimentation at Scale," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 103-124, Fall.
    6. Peters, Jörg & Langbein, Jörg & Roberts, Gareth, 2016. "Policy evaluation, randomized controlled trials, and external validity—A systematic review," Economics Letters, Elsevier, vol. 147(C), pages 51-54.
    7. Tomoki Fujii & Christine Ho & Rohan Ray & Abu S. Shonchoy, 2021. "Conditional Cash Transfer, Loss Framing, and SMS Nudges: Evidence from a Randomized Field Experiment in Bangladesh," Working Papers 2109, Florida International University, Department of Economics.
    8. Stephanie Rosch & Sharon Raszap Skorbiansky & Collin Weigel & Kent D. Messer & Daniel Hellerstein, 2021. "Barriers to Using Economic Experiments in Evidence‐Based Agricultural Policymaking," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 43(2), pages 531-555, June.
    9. Villamayor-Tomas, Sergio & Sagebiel, Julian & Rommel, Jens & Olschewski, Roland, 2021. "Types of collective action problems and farmers’ willingness to accept agri-environmental schemes in Switzerland," Ecosystem Services, Elsevier, vol. 50(C).
    10. Baylis, Kathy & Ham, Andres, 2015. "How important is spatial correlation in randomized controlled trials?," 2015 AAEA & WAEA Joint Annual Meeting, July 26-28, San Francisco, California 205586, Agricultural and Applied Economics Association.
    11. Jean-Marc Blazy & Julie Subervie & Jacky Paul & François Causeret & Loic Guinde & Sarah Moulla & Alban Thomas & Jorge Sierra, 2020. "Ex ante assessment of the cost-effectiveness of Agri-Environmental Schemes promoting compost use to sequester carbon in soils in Guadeloupe," CEE-M Working Papers hal-02748634, CEE-M, Universtiy of Montpellier, CNRS, INRA, Montpellier SupAgro.
    12. Janusch, Nicholas & Palm-Forster, Leah H. & Messer, Kent D. & Ferraro, Paul J., 2017. "Behavioral Insights for Agri-Environmental Program and Policy Design," 2018 Allied Social Sciences Association (ASSA) Annual Meeting, January 5-7, 2018, Philadelphia, Pennsylvania 266299, Agricultural and Applied Economics Association.
    13. Sylvain Chabé-Ferret & Philippe Le Coent & Arnaud Reynaud & Julie Subervie & Daniel Lepercq, 2019. "Can we nudge farmers into saving water? Evidence from a randomised experiment," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 46(3), pages 393-416.
    14. Susan Athey & Guido Imbens, 2016. "The Econometrics of Randomized Experiments," Papers 1607.00698, arXiv.org.
    15. Alejandro J. Ganimian & Richard J. Murnane, 2014. "Improving Educational Outcomes in Developing Countries: Lessons from Rigorous Impact Evaluations," NBER Working Papers 20284, National Bureau of Economic Research, Inc.
    16. Zhaoyang Liu & Jintao Xu & Xiaojun Yang & Qin Tu & Nick Hanley & Andreas Kontoleon, 2019. "Performance of Agglomeration Bonuses in Conservation Auctions: Lessons from a Framed Field Experiment," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 73(3), pages 843-869, July.
    17. Ma, Zhao & Bauchet, Jonathan & Steele, Diana & Godoy, Ricardo & Radel, Claudia & Zanotti, Laura, 2017. "Comparison of Direct Transfers for Human Capital Development and Environmental Conservation," World Development, Elsevier, vol. 99(C), pages 498-517.
    18. Teresa Molina Millán & Karen Macours, 2017. "Attrition in randomized control trials: Using tracking information to correct bias," FEUNL Working Paper Series novaf:wp1702, Universidade Nova de Lisboa, Faculdade de Economia.
    19. Philippe Coent, 2023. "Payment for environmental services related to aquifers: a review of specific issues and existing programmes," Review of Agricultural, Food and Environmental Studies, Springer, vol. 104(3), pages 273-310, December.
    20. Benjamin A. Olken, 2020. "Banerjee, Duflo, Kremer, and the Rise of Modern Development Economics," Scandinavian Journal of Economics, Wiley Blackwell, vol. 122(3), pages 853-878, July.

    More about this item

    Keywords

    field experiments; Common agricultural policy; Impact evaluation; Policy design; Field experiments JEL codes: C93; Q18;
    All these keywords.

    JEL classification:

    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • Q18 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Agriculture - - - Agricultural Policy; Food Policy; Animal Welfare Policy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:journl:hal-02112625. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CCSD (email available below). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.