IDEAS home Printed from https://ideas.repec.org/p/hal/wpceem/hal-01974425.html
   My bibliography  Save this paper

Can RCTs help improve the design of CAP

Author

Listed:
  • Luc Behaghel

    () (PSE - Paris School of Economics - ENPC - École des Ponts ParisTech - ENS Paris - École normale supérieure - Paris - PSL - Université Paris sciences et lettres - UP1 - Université Paris 1 Panthéon-Sorbonne - CNRS - Centre National de la Recherche Scientifique - EHESS - École des hautes études en sciences sociales - INRAE - Institut National de Recherche pour l’Agriculture, l’Alimentation et l’Environnement)

  • Karen Macours

    () (PSE - Paris School of Economics - ENPC - École des Ponts ParisTech - ENS Paris - École normale supérieure - Paris - PSL - Université Paris sciences et lettres - UP1 - Université Paris 1 Panthéon-Sorbonne - CNRS - Centre National de la Recherche Scientifique - EHESS - École des hautes études en sciences sociales - INRAE - Institut National de Recherche pour l’Agriculture, l’Alimentation et l’Environnement)

  • Julie Subervie

    () (CEE-M - Centre d'Economie de l'Environnement - Montpellier - FRE2010 - CNRS - Centre National de la Recherche Scientifique - INRA - Institut National de la Recherche Agronomique - Montpellier SupAgro - Institut national d’études supérieures agronomiques de Montpellier - Institut Agro - Institut national d'enseignement supérieur pour l'agriculture, l'alimentation et l'environnement - UM - Université de Montpellier)

Abstract

We illustrate how randomized controlled trials (RCTs) could be used as a learning tool to shed light on various aspects of the Common Agricultural Policy (CAP). RCTs are quasi-absent from the CAP evaluation toolbox, despite their frequent use to evaluate other European Union policies, or agricultural policies in developing countries. We draw upon existing debates on the role of RCTs in policy-making to derive a list of points of attention. We then consider four specific examples of evaluation questions for the CAP, and based on examples drawn from agricultural and social policies in developing and developed countries, argue that the RCT toolbox has the potential to significantly add to existing approaches to evaluating and designing components of the CAP.

Suggested Citation

  • Luc Behaghel & Karen Macours & Julie Subervie, 2018. "Can RCTs help improve the design of CAP," CEE-M Working Papers hal-01974425, CEE-M, Universtiy of Montpellier, CNRS, INRA, Montpellier SupAgro.
  • Handle: RePEc:hal:wpceem:hal-01974425
    Note: View the original document on HAL open archive server: https://hal.archives-ouvertes.fr/hal-01974425
    as

    Download full text from publisher

    File URL: https://hal.archives-ouvertes.fr/hal-01974425/document
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Jayachandran, Seema & Laat, Joost de & Lambin, Eric F. & Stanton, Charlotte, 2016. "Cash for Carbon: A Randomized Controlled Trial of Payments for Ecosystem Services to Reduce Deforestation," CEPR Discussion Papers 11349, C.E.P.R. Discussion Papers.
    2. Bruno Crépon & Esther Duflo & Marc Gurgand & Roland Rathelot & Philippe Zamora, 2013. "Do Labor Market Policies have Displacement Effects? Evidence from a Clustered Randomized Experiment," The Quarterly Journal of Economics, Oxford University Press, vol. 128(2), pages 531-580.
    3. Charles F. Manski, 2013. "Response to the Review of ‘Public Policy in an Uncertain World’," Economic Journal, Royal Economic Society, vol. 0, pages 412-415, August.
    4. Esther Duflo & Michael Kremer & Jonathan Robinson, 2011. "Nudging Farmers to Use Fertilizer: Theory and Experimental Evidence from Kenya," American Economic Review, American Economic Association, vol. 101(6), pages 2350-2390, October.
    5. Abhijit Banerjee & Sylvain Chassang & Sergio Montero & Erik Snowberg, 2017. "A Theory of Experimenters," NBER Working Papers 23867, National Bureau of Economic Research, Inc.
    6. Ingvild Almås & Alex Armand & Orazio Attanasio & Pedro Carneiro, 2018. "Measuring and Changing Control: Women's Empowerment and Targeted Transfers," Economic Journal, Royal Economic Society, vol. 128(612), pages 609-639, July.
    7. Luc Behaghel & Bruno Cr?pon & Marc Gurgand, 2014. "Private and Public Provision of Counseling to Job Seekers: Evidence from a Large Controlled Experiment," American Economic Journal: Applied Economics, American Economic Association, vol. 6(4), pages 142-174, October.
    8. Kuhfuss, Laure & Preget, Raphaële & Thoyer, Sophie, 2015. "Préférences individuelles et incitations collectives : quels contrats agroenvironnementaux pour la réduction des herbicides par les viticulteurs ?," Review of Agricultural and Environmental Studies - Revue d'Etudes en Agriculture et Environnement (RAEStud), Institut National de la Recherche Agronomique (INRA), vol. 95(1).
    9. Francesco Avvisati & Marc Gurgand & Nina Guyon & Eric Maurin, 2014. "Getting Parents Involved: A Field Experiment in Deprived Schools," Review of Economic Studies, Oxford University Press, vol. 81(1), pages 57-83.
    10. Laure Kuhfuss & Raphaële Préget & Sophie Thoyer & Nick Hanley & Philippe Le Coent & Mathieu Désolé, 2016. "Nudges, Social Norms, and Permanence in Agri-environmental Schemes," Land Economics, University of Wisconsin Press, vol. 92(4), pages 641-655.
    11. Heckelei, Thomas & Britz, Wolfgang & Zhang, Yinan, 2012. "Positive Mathematical Programming Approaches – Recent Developments in Literature and Applied Modelling," Bio-based and Applied Economics Journal, Italian Association of Agricultural and Applied Economics (AIEAA), vol. 1(1), pages 1-16, April.
    12. James Berry & Greg Fischer & Raymond Guiteras, 2020. "Eliciting and Utilizing Willingness to Pay: Evidence from Field Trials in Northern Ghana," Journal of Political Economy, University of Chicago Press, vol. 128(4), pages 1436-1473.
    13. Jacob R. Fooks & Nathaniel Higgins & Kent D. Messer & Joshua M. Duke & Daniel Hellerstein & Lori Lynch, 2016. "Conserving Spatially Explicit Benefits in Ecosystem Service Markets: Experimental Tests of Network Bonuses and Spatial Targeting," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 98(2), pages 468-488.
    14. Roland Fryer & Steven Levitt & John List & Sally Sadoff, 2012. "Enhancing the Efficacy of Teacher Incentives through Loss Aversion: A Field Experiment," Framed Field Experiments 00591, The Field Experiments Website.
    15. Jay R. Corrigan & Dinah Pura T. Depositario & Rodolfo M. Nayga & Ximing Wu & Tiffany P. Laude, 2006. "Comparing Open-Ended Choice Experiments and Experimental Auctions: An Application to Golden Rice," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 91(3), pages 837-853.
    16. Liesbeth Colen & Sergio Gomez y Paloma & Uwe Latacz-Lohmann & Marianne Lefebvre & Raphaële Préget & Sophie Thoyer, 2016. "Economic Experiments as a Tool for Agricultural Policy Evaluation: Insights from the European CAP," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 64(4), pages 667-694, December.
    17. De Cara, Stéphane & Jayet, Pierre-Alain, 2011. "Marginal abatement costs of greenhouse gas emissions from European agriculture, cost effectiveness, and the EU non-ETS burden sharing agreement," Ecological Economics, Elsevier, vol. 70(9), pages 1680-1690, July.
    18. Richard E. Howitt, 1995. "Positive Mathematical Programming," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 77(2), pages 329-342.
    19. Luc Behaghel & Bruno Crépon & Marc Gurgand & Thomas Le Barbanchon, 2015. "Please Call Again: Correcting Nonresponse Bias in Treatment Effect Models," The Review of Economics and Statistics, MIT Press, vol. 97(5), pages 1070-1080, December.
    20. Cason, Timothy N. & Gangadharan, Lata, 2013. "Empowering neighbors versus imposing regulations: An experimental analysis of pollution reduction schemes," Journal of Environmental Economics and Management, Elsevier, vol. 65(3), pages 469-484.
    21. Chabé-Ferret, Sylvain & Subervie, Julie, 2013. "How much green for the buck? Estimating additional and windfall effects of French agro-environmental schemes by DID-matching," Journal of Environmental Economics and Management, Elsevier, vol. 65(1), pages 12-27.
    22. Holmstrom, Bengt & Milgrom, Paul, 1991. "Multitask Principal-Agent Analyses: Incentive Contracts, Asset Ownership, and Job Design," Journal of Law, Economics, and Organization, Oxford University Press, vol. 7(0), pages 24-52, Special I.
    23. Esther Duflo & Pascaline Dupas & Michael Kremer, 2011. "Peer Effects, Teacher Incentives, and the Impact of Tracking: Evidence from a Randomized Evaluation in Kenya," American Economic Review, American Economic Association, vol. 101(5), pages 1739-1774, August.
    24. B. Kelsey Jack, 2013. "Private Information and the Allocation of Land Use Subsidies in Malawi," American Economic Journal: Applied Economics, American Economic Association, vol. 5(3), pages 113-135, July.
    25. Deaton, Angus & Cartwright, Nancy, 2018. "Understanding and misunderstanding randomized controlled trials," Social Science & Medicine, Elsevier, vol. 210(C), pages 2-21.
    26. Gregory L. Poe & William D. Schulze & Kathleen Segerson & Jordan F. Suter & Christian A. Vossler, 2004. "Exploring the Performance of Ambient-Based Policy Instruments When Nonpoint Source Polluters Can Cooperate," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 86(5), pages 1203-1210.
    27. Scott E. Carrell & Bruce I. Sacerdote & James E. West, 2013. "From Natural Variation to Optimal Policy? The Importance of Endogenous Peer Group Formation," Econometrica, Econometric Society, vol. 81(3), pages 855-882, May.
    28. Ariel Fiszbein & Norbert Schady & Francisco H.G. Ferreira & Margaret Grosh & Niall Keleher & Pedro Olinto & Emmanuel Skoufias, 2009. "Conditional Cash Transfers : Reducing Present and Future Poverty," World Bank Publications, The World Bank, number 2597, June.
    29. Luc Behaghel & Clément de Chaisemartin & Marc Gurgand, 2017. "Ready for Boarding? The Effects of a Boarding School for Disadvantaged Students," American Economic Journal: Applied Economics, American Economic Association, vol. 9(1), pages 140-164, January.
    30. Felipe Barrera-Osorio & Marianne Bertrand & Leigh L. Linden & Francisco Perez-Calle, 2011. "Improving the Design of Conditional Transfer Programs: Evidence from a Randomized Education Experiment in Colombia," American Economic Journal: Applied Economics, American Economic Association, vol. 3(2), pages 167-195, April.
    31. Noah J. Goldstein & Robert B. Cialdini & Vladas Griskevicius, 2008. "A Room with a Viewpoint: Using Social Norms to Motivate Environmental Conservation in Hotels," Journal of Consumer Research, Oxford University Press, vol. 35(3), pages 472-482, March.
    32. Brian E. Roe & David R. Just, 2009. "Internal and External Validity in Economics Research: Tradeoffs between Experiments, Field Experiments, Natural Experiments, and Field Data," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 91(5), pages 1266-1271.
    33. Ferraro, Paul J., 2008. "Asymmetric information and contract design for payments for environmental services," Ecological Economics, Elsevier, vol. 65(4), pages 810-821, May.
    34. Sarah Baird & Craig McIntosh & Berk Özler, 2011. "Cash or Condition? Evidence from a Cash Transfer Experiment," The Quarterly Journal of Economics, Oxford University Press, vol. 126(4), pages 1709-1753.
    35. Schubert, Christian, 2017. "Green nudges: Do they work? Are they ethical?," Ecological Economics, Elsevier, vol. 132(C), pages 329-342.
    36. Kuhfuss, Laure & Subervie, Julie, 2018. "Do European Agri-environment Measures Help Reduce Herbicide Use? Evidence From Viticulture in France," Ecological Economics, Elsevier, vol. 149(C), pages 202-211.
    37. Liesbeth Colen & Sergio Gomez y Paloma & Uwe Latacz-Lohmann & Marianne Lefebvre & Raphaële Préget & Sophie Thoyer, 2016. "Economic Experiments as a Tool for Agricultural Policy Evaluation: Insights from the European CAP," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 64(4), pages 667-694, December.
    38. Guiteras, Raymond P. & Jack, B. Kelsey, 2018. "Productivity in piece-rate labor markets: Evidence from rural Malawi," Journal of Development Economics, Elsevier, vol. 131(C), pages 42-61.
    39. Spraggon, John, 2004. "Testing ambient pollution instruments with heterogeneous agents," Journal of Environmental Economics and Management, Elsevier, vol. 48(2), pages 837-856, September.
    40. Manski, Charles F., 2013. "Public Policy in an Uncertain World: Analysis and Decisions," Economics Books, Harvard University Press, number 9780674066892, Spring.
    41. Jordan F. Suter & Christian A. Vossler, 2014. "Towards an Understanding of the Performance of Ambient Tax Mechanisms in the Field: Evidence from Upstate New York Dairy Farmers," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 96(1), pages 92-107.
    42. Steven Wallander & Paul Ferraro & Nathaniel Higgins, 2017. "Addressing Participant Inattention in Federal Programs: A Field Experiment with The Conservation Reserve Program," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 99(4), pages 914-931.
    43. Edward Miguel & Michael Kremer, 2004. "Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities," Econometrica, Econometric Society, vol. 72(1), pages 159-217, January.
    44. William Vickrey, 1961. "Counterspeculation, Auctions, And Competitive Sealed Tenders," Journal of Finance, American Finance Association, vol. 16(1), pages 8-37, March.
    45. Karthik Muralidharan & Venkatesh Sundararaman, 2011. "Teacher Performance Pay: Experimental Evidence from India," Journal of Political Economy, University of Chicago Press, vol. 119(1), pages 39-77.
    46. Benjamin A. Olken, 2007. "Monitoring Corruption: Evidence from a Field Experiment in Indonesia," Journal of Political Economy, University of Chicago Press, vol. 115, pages 200-249.
    47. Lundberg, Liv & Persson, U. Martin & Alpizar, Francisco & Lindgren, Kristian, 2018. "Context Matters: Exploring the Cost-effectiveness of Fixed Payments and Procurement Auctions for PES," Ecological Economics, Elsevier, vol. 146(C), pages 347-358.
    48. Gocht, Alexander & Britz, Wolfgang, 2011. "EU-wide farm type supply models in CAPRI--How to consistently disaggregate sector models into farm type models," Journal of Policy Modeling, Elsevier, vol. 33(1), pages 146-167, January.
    49. Jordan F. Suter & Joshua M. Duke & Kent D. Messer & Holly A. Michael, 2012. "Behavior in a Spatially Explicit Groundwater Resource: Evidence from the Lab," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 94(5), pages 1094-1112.
    50. Kamel Louhichi & Pavel Ciaian & Maria Espinosa & Angel Perni & Sergio Gomez y Paloma, 2018. "Economic impacts of CAP greening: application of an EU-wide individual farm model for CAP analysis (IFM-CAP)," European Review of Agricultural Economics, Foundation for the European Review of Agricultural Economics, vol. 45(2), pages 205-238.
    51. Simanti Banerjee, 2018. "Improving Spatial Coordination Rates under the Agglomeration Bonus Scheme: A Laboratory Experiment with a Pecuniary and a Non-Pecuniary Mechanism (NUDGE)," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 100(1), pages 172-197.
    52. Hoffmann, Vivian & Barrett, Christopher B. & Just, David R., 2009. "Do Free Goods Stick to Poor Households? Experimental Evidence on Insecticide Treated Bednets," World Development, Elsevier, vol. 37(3), pages 607-617, March.
    53. Ferraro, Paul & Messer, Kent D. & Wu, Shang, 2017. "Applying Behavioral Insights to Improve Water Security," Choices: The Magazine of Food, Farm, and Resource Issues, Agricultural and Applied Economics Association, vol. 32(4), November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Luc Behaghel & Karen Macours & Julie Subervie, 2019. "How can randomised controlled trials help improve the design of the common agricultural policy?," European Review of Agricultural Economics, Foundation for the European Review of Agricultural Economics, vol. 46(3), pages 473-493.
    2. Leah H. Palm-Forster & Paul J. Ferraro & Nicholas Janusch & Christian A. Vossler & Kent D. Messer, 2019. "Behavioral and Experimental Agri-Environmental Research: Methodological Challenges, Literature Gaps, and Recommendations," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 73(3), pages 719-742, July.
    3. Jörg Peters & Jörg Langbein & Gareth Roberts, 2018. "Generalization in the Tropics – Development Policy, Randomized Controlled Trials, and External Validity," World Bank Research Observer, World Bank Group, vol. 33(1), pages 34-64.
    4. Wu, Shang & Palm-Forster, Leah H. & Messer, Kent D., 2021. "Impact of peer comparisons and firm heterogeneity on nonpoint source water pollution: An experimental study," Resource and Energy Economics, Elsevier, vol. 63(C).
    5. Peters, Jörg & Langbein, Jörg & Roberts, Gareth, 2016. "Policy evaluation, randomized controlled trials, and external validity—A systematic review," Economics Letters, Elsevier, vol. 147(C), pages 51-54.
    6. Sylvain Chabé-Ferret & Philippe Le Coent & Arnaud Reynaud & Julie Subervie & Daniel Lepercq, 2019. "Can we nudge farmers into saving water? Evidence from a randomised experiment," European Review of Agricultural Economics, Foundation for the European Review of Agricultural Economics, vol. 46(3), pages 393-416.
    7. Benjamin A. Olken, 2020. "Banerjee, Duflo, Kremer, and the Rise of Modern Development Economics," Scandinavian Journal of Economics, Wiley Blackwell, vol. 122(3), pages 853-878, July.
    8. Susan Athey & Guido Imbens, 2016. "The Econometrics of Randomized Experiments," Papers 1607.00698, arXiv.org.
    9. Zhaoyang Liu & Jintao Xu & Xiaojun Yang & Qin Tu & Nick Hanley & Andreas Kontoleon, 2019. "Performance of Agglomeration Bonuses in Conservation Auctions: Lessons from a Framed Field Experiment," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 73(3), pages 843-869, July.
    10. Rommel, Jens & Anggraini, Eva, 2018. "Spatially explicit framed field experiments on ecosystem services governance," Ecosystem Services, Elsevier, vol. 34(PB), pages 201-205.
    11. Damgaard, Mette Trier & Nielsen, Helena Skyt, 2018. "Nudging in education," Economics of Education Review, Elsevier, vol. 64(C), pages 313-342.
    12. Samuel D. Bell & Nadia A. Streletskaya, 2019. "The Random Quantity Mechanism: Laboratory and Field Tests of a Novel Cost-Revealing Procurement Mechanism," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 73(3), pages 899-921, July.
    13. Baylis, Kathy & Ham, Andres, 2015. "How important is spatial correlation in randomized controlled trials?," 2015 AAEA & WAEA Joint Annual Meeting, July 26-28, San Francisco, California 205586, Agricultural and Applied Economics Association.
    14. Jean-Marc Blazy & Subervie Julie & Jacky Paul & François Causeret & Loic Guinde & Sarah Moulla & Alban Thomas & Jorge Sierra, 2020. "Ex ante assessment of the cost-effectiveness of Agri-Environmental Schemes promoting compost use to sequester carbon in soils in Guadeloupe," CEE-M Working Papers hal-02748634, CEE-M, Universtiy of Montpellier, CNRS, INRA, Montpellier SupAgro.
    15. Viaggi, Davide & Raggi, Meri & Gomez y Paloma, Sergio, 2011. "Farm-household investment behaviour and the CAP decoupling: Methodological issues in assessing policy impacts," Journal of Policy Modeling, Elsevier, vol. 33(1), pages 127-145, January.
    16. Janusch, Nicholas & Palm-Forster, Leah H. & Messer, Kent D. & Ferraro, Paul J., 2017. "Behavioral Insights for Agri-Environmental Program and Policy Design," 2018 Allied Social Sciences Association (ASSA) Annual Meeting, January 5-7, 2018, Philadelphia, Pennsylvania 266299, Agricultural and Applied Economics Association.
    17. Roland G. Fryer, Jr, 2016. "The Production of Human Capital in Developed Countries: Evidence from 196 Randomized Field Experiments," NBER Working Papers 22130, National Bureau of Economic Research, Inc.
    18. Richard Akresh & Damien de Walque & Harounan Kazianga, 2013. "Cash Transfers and Child Schooling: Evidence from a Randomized Evaluation of the Role of Conditionality," Economics Working Paper Series 1301, Oklahoma State University, Department of Economics and Legal Studies in Business.
    19. Eduard Marinov, 2019. "The 2019 Nobel Prize in Economics," Economic Thought journal, Bulgarian Academy of Sciences - Economic Research Institute, issue 6, pages 78-116.
    20. Susan Athey & Guido W. Imbens, 2017. "The State of Applied Econometrics: Causality and Policy Evaluation," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 3-32, Spring.

    More about this item

    Keywords

    field experiments; policy design; impact evaluation; Common agricultural policy;
    All these keywords.

    JEL classification:

    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • Q18 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Agriculture - - - Agricultural Policy; Food Policy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:wpceem:hal-01974425. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Laurent Garnier). General contact details of provider: https://edirc.repec.org/data/lamplfr.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.