IDEAS home Printed from https://ideas.repec.org/a/wly/apecpp/v43y2021i2p556-572.html
   My bibliography  Save this article

Challenges in Recruiting U.S. Farmers for Policy‐Relevant Economic Field Experiments

Author

Listed:
  • Collin Weigel
  • Laura A. Paul
  • Paul J. Ferraro
  • Kent D. Messer

Abstract

To develop evidence‐based agricultural policies, researchers increasingly use insights from economic field experiments. These insights are often limited by the challenges of recruiting large and representative samples of farmers. To improve the effectiveness and cost efficiency of farmer recruitment, researchers should apply the same experimental methods to the recruitment process that they apply to their main research questions. Here we experimentally evaluate ten recruiting strategies in two large‐scale, high stakes experiments. We find that monetary incentives and reminders are effective, but costly. Costless strategies, such as prominently citing a well‐known institution as the sponsor, had positive but small, effects on recruitment.

Suggested Citation

  • Collin Weigel & Laura A. Paul & Paul J. Ferraro & Kent D. Messer, 2021. "Challenges in Recruiting U.S. Farmers for Policy‐Relevant Economic Field Experiments," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 43(2), pages 556-572, June.
  • Handle: RePEc:wly:apecpp:v:43:y:2021:i:2:p:556-572
    DOI: 10.1002/aepp.13066
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/aepp.13066
    Download Restriction: no

    File URL: https://libkey.io/10.1002/aepp.13066?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Higgins, Nathaniel & Hellerstein, Daniel & Wallander, Steven & Lynch, Lori, 2017. "Economic Experiments for Policy Analysis and Program Design: A Guide for Agricultural Decisionmakers," Economic Research Report 262181, United States Department of Agriculture, Economic Research Service.
    2. Van Essen, Matt & Wooders, John, 2015. "Blind stealing: Experience and expertise in a mixed-strategy poker experiment," Games and Economic Behavior, Elsevier, vol. 91(C), pages 186-206.
    3. Glenn W. Harrison & John A. List, 2004. "Field Experiments," Journal of Economic Literature, American Economic Association, vol. 42(4), pages 1009-1055, December.
    4. Michael S. Haigh & John A. List, 2005. "Do Professional Traders Exhibit Myopic Loss Aversion? An Experimental Analysis," Journal of Finance, American Finance Association, vol. 60(1), pages 523-534, February.
    5. Ronald G. Cummings & Charles A. Holt & Susan K. Laury, 2004. "Using laboratory experiments for policymaking: An example from the Georgia irrigation reduction auction," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 23(2), pages 341-363.
    6. Timothy N. Cason & Steven Y. Wu, 2019. "Subject Pools and Deception in Agricultural and Resource Economics Experiments," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 73(3), pages 743-758, July.
    7. Maart-Noelck, Syster C. & Musshoff, Oliver, 2014. "Measuring the risk attitude of decision-makers: are there differences between groups of methods and persons?," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 58(3), July.
    8. Joost M.E. Pennings & Scott H. Irwin & Darrel L. Good, 2002. "Surveying Farmers: A Case Study," Review of Agricultural Economics, Agricultural and Applied Economics Association, vol. 24(1), pages 266-277.
    9. Steven D. Levitt & John A. List & David H. Reiley, 2010. "What Happens in the Field Stays in the Field: Exploring Whether Professionals Play Minimax in Laboratory Experiments," Econometrica, Econometric Society, vol. 78(4), pages 1413-1434, July.
    10. David H. Herberich & John A. List, 2012. "Digging into Background Risk: Experiments with Farmers and Students," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 94(2), pages 457-463.
    11. repec:feb:artefa:0094 is not listed on IDEAS
    12. Steven Levitt & John List & David Reiley, 2010. "What happens in the field stays in the field: Professionals do not play minimax in laboratory experiments," Artefactual Field Experiments 00080, The Field Experiments Website.
    13. Jeffrey Carpenter & Erika Seki, 2011. "Do Social Preferences Increase Productivity? Field Experimental Evidence From Fishermen In Toyama Bay," Economic Inquiry, Western Economic Association International, vol. 49(2), pages 612-630, April.
    14. Christoph Bartneck & Andreas Duenser & Elena Moltchanova & Karolina Zawieska, 2015. "Comparing the Similarity of Responses Received from Studies in Amazon’s Mechanical Turk to Studies Conducted Online and with Direct Recruitment," PLOS ONE, Public Library of Science, vol. 10(4), pages 1-23, April.
    15. repec:feb:artefa:0087 is not listed on IDEAS
    16. Wu, JunJie, 2014. "The Oxford Handbook of Land Economics," OUP Catalogue, Oxford University Press, number 9780199763740 edited by Duke, Joshua M., Decembrie.
    17. Erika Deserranno, 2019. "Financial Incentives as Signals: Experimental Evidence from the Recruitment of Village Promoters in Uganda," American Economic Journal: Applied Economics, American Economic Association, vol. 11(1), pages 277-317, January.
    18. Jordan F. Suter & Christian A. Vossler, 2014. "Towards an Understanding of the Performance of Ambient Tax Mechanisms in the Field: Evidence from Upstate New York Dairy Farmers," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 96(1), pages 92-107.
    19. Steven Wallander & Paul Ferraro & Nathaniel Higgins, 2017. "Addressing Participant Inattention in Federal Programs: A Field Experiment with The Conservation Reserve Program," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 99(4), pages 914-931.
    20. Levitt, Steven D. & List, John A., 2009. "Field experiments in economics: The past, the present, and the future," European Economic Review, Elsevier, vol. 53(1), pages 1-18, January.
    21. R. C. Buse, 1973. "Increasing Response Rates in Mailed Questionnaires," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 55(3), pages 503-508.
    22. Armstrong, J. Scott, 1975. "Monetary incentives in mail surveys," MPRA Paper 81695, University Library of Munich, Germany.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Michels, Marius & Luo, Hao & Weller von Ahlefeld, Paul Johann & Mußhoff, Oliver, 2023. "Compliance with pre-harvest interval rules in apple production—A comparative analysis of green nudges among fruit growers and agricultural students in Germany," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 102(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Stephanie Rosch & Sharon Raszap Skorbiansky & Collin Weigel & Kent D. Messer & Daniel Hellerstein, 2021. "Barriers to Using Economic Experiments in Evidence‐Based Agricultural Policymaking," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 43(2), pages 531-555, June.
    2. Leah H. Palm-Forster & Paul J. Ferraro & Nicholas Janusch & Christian A. Vossler & Kent D. Messer, 2019. "Behavioral and Experimental Agri-Environmental Research: Methodological Challenges, Literature Gaps, and Recommendations," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 73(3), pages 719-742, July.
    3. Matteo M. Galizzi & Daniel Navarro-Martinez, 2019. "On the External Validity of Social Preference Games: A Systematic Lab-Field Study," Management Science, INFORMS, vol. 65(3), pages 976-1002, March.
    4. Timothy N. Cason & Steven Y. Wu, 2019. "Subject Pools and Deception in Agricultural and Resource Economics Experiments," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 73(3), pages 743-758, July.
    5. Charness, Gary & Gneezy, Uri & Kuhn, Michael A., 2013. "Experimental methods: Extra-laboratory experiments-extending the reach of experimental economics," Journal of Economic Behavior & Organization, Elsevier, vol. 91(C), pages 93-100.
    6. Omar Al-Ubaydli & John List, 2013. "On the Generalizability of Experimental Results in Economics: With A Response To Camerer," Artefactual Field Experiments j0001, The Field Experiments Website.
    7. Omar Al-Ubaydli & John A. List, 2013. "On the Generalizability of Experimental Results in Economics: With a Response to Commentors," CESifo Working Paper Series 4543, CESifo.
    8. Peth, Denise & Mußhoff, Oliver, 2018. "Comparing compliance behaviour of students and farmers: Implications for agricultural policy impact analysis," DARE Discussion Papers 1809, Georg-August University of Göttingen, Department of Agricultural Economics and Rural Development (DARE).
    9. Etan A. Green & Justin M. Rao & David Rothschild, 2019. "A Sharp Test of the Portability of Expertise," Management Science, INFORMS, vol. 67(6), pages 2820-2831, June.
    10. Kyriaki Remoundou & Drichoutis Andreas & Phoebe Koundouri, 2010. "Warm glow in charitable auctions: Are the WEIRDos driving the results?," DEOS Working Papers 1028, Athens University of Economics and Business.
    11. Emara, Noha & Owens, David & Smith, John & Wilmer, Lisa, 2017. "Serial correlation in National Football League play calling and its effects on outcomes," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 69(C), pages 125-132.
    12. Van Essen, Matt & Wooders, John, 2015. "Blind stealing: Experience and expertise in a mixed-strategy poker experiment," Games and Economic Behavior, Elsevier, vol. 91(C), pages 186-206.
    13. Eric Floyd & John A. List, 2016. "Using Field Experiments in Accounting and Finance," Journal of Accounting Research, Wiley Blackwell, vol. 54(2), pages 437-475, May.
    14. Alves, Guillermo & Blanchard, Pablo & Burdin, Gabriel & Chávez, Mariana & Dean, Andrés, 2022. "Like principal, like agent? Managerial preferences in employee-owned firms," Journal of Institutional Economics, Cambridge University Press, vol. 18(6), pages 877-899, December.
    15. Janusch, Nicholas & Palm-Forster, Leah H. & Messer, Kent D. & Ferraro, Paul J., 2017. "Behavioral Insights for Agri-Environmental Program and Policy Design," 2018 Allied Social Sciences Association (ASSA) Annual Meeting, January 5-7, 2018, Philadelphia, Pennsylvania 266299, Agricultural and Applied Economics Association.
    16. Marianne Lefebvre & Estelle Midler & Philippe Bontems, 2020. "Adoption of Environment-Friendly Agricultural Practices with Background Risk: Experimental Evidence," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 76(2), pages 405-428, July.
    17. Geng, Sen & Peng, Yujia & Shachat, Jason & Zhong, Huizhen, 2015. "Adolescents, cognitive ability, and minimax play," Economics Letters, Elsevier, vol. 128(C), pages 54-58.
    18. Sven Grüner & Mira Lehberger & Norbert Hirschauer & Oliver Mußhoff, 2022. "How (un)informative are experiments with students for other social groups? A study of agricultural students and farmers," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 66(3), pages 471-504, July.
    19. Duffy, Sean & Naddeo, JJ & Owens, David & Smith, John, 2016. "Cognitive load and mixed strategies: On brains and minimax," MPRA Paper 71878, University Library of Munich, Germany.
    20. Dolan, Paul & Galizzi, Matteo M., 2015. "Like ripples on a pond: Behavioral spillovers and their implications for research and policy," Journal of Economic Psychology, Elsevier, vol. 47(C), pages 1-16.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:apecpp:v:43:y:2021:i:2:p:556-572. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1002/(ISSN)2040-5804 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.