IDEAS home Printed from https://ideas.repec.org/a/wly/apecpp/v47y2025i1p49-64.html
   My bibliography  Save this article

Are we measuring impact accurately? Identifying potential sources of bias in the evaluation of extension personnel and programs

Author

Listed:
  • Andrew Wright
  • Jeffrey Wright
  • Dean McCorkle
  • Jeffrey Hyde

Abstract

Agricultural extension programs must demonstrate their value to compete for limited government funding. As extension professionals measure the value of their programs, the risk exists that the information they report will provide a biased or an inaccurate measure of value. We examine the evaluation process for extension programs and extension personnel to identify potential sources of bias or inaccuracies. We find that bias and inaccuracy in program evaluation often stems from a focus on short‐term outcomes, rather than long‐term impacts, while bias in personnel evaluation can result from information asymmetries that exist between extension personnel and their evaluators.

Suggested Citation

  • Andrew Wright & Jeffrey Wright & Dean McCorkle & Jeffrey Hyde, 2025. "Are we measuring impact accurately? Identifying potential sources of bias in the evaluation of extension personnel and programs," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 47(1), pages 49-64, March.
    • Handle: RePEc:wly:apecpp:v:47:y:2025:i:1:p:49-64
    DOI: 10.1002/aepp.13478
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/aepp.13478
    Download Restriction: no
    File URL: https://libkey.io/10.1002/aepp.13478?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Md. Sajjad Hosain, 2016. "360 Degree Feedback as a Technique of Performance Appraisal: Does it Really Work?," Asian Business Review, Asian Business Consortium, vol. 6(1), pages 21-24.
    2. David Orden & Steven T. Buccola, 1980. "An Evaluation of Cooperative Extension Small Farm Programs in the Southern United States," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 62(2), pages 218-223.
    3. Alberto Abadie & Javier Gardeazabal, 2003. "The Economic Costs of Conflict: A Case Study of the Basque Country," American Economic Review, American Economic Association, vol. 93(1), pages 113-132, March.
    4. Brian Roe & Timothy C. Haab & Brent Sohngen, 2004. "The Value of Agricultural Economics Extension Programming: An Application of Contingent Valuation," Review of Agricultural Economics, Agricultural and Applied Economics Association, vol. 26(3), pages 373-390.
    5. Joshua D. Angrist & Jörn-Steffen Pischke, 2009. "Mostly Harmless Econometrics: An Empiricist's Companion," Economics Books, Princeton University Press, edition 1, number 8769.
    6. Anders Fredriksson & Gustavo Magalhães de Oliveira, 2019. "Impact evaluation using Difference-in-Differences," RAUSP Management Journal, Emerald Group Publishing Limited, vol. 54(4), pages 519-532, October.
    7. Abadie, Alberto & Diamond, Alexis & Hainmueller, Jens, 2010. "Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California’s Tobacco Control Program," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 493-505.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Arne Henningsen & Guy Low & David Wuepper & Tobias Dalhaus & Hugo Storm & Dagim Belay & Stefan Hirsch, 2024. "Estimating Causal Effects with Observational Data: Guidelines for Agricultural and Applied Economists," IFRO Working Paper 2024/03, University of Copenhagen, Department of Food and Resource Economics.
    2. Dennis Shen & Peng Ding & Jasjeet Sekhon & Bin Yu, 2022. "Same Root Different Leaves: Time Series and Cross-Sectional Methods in Panel Data," Papers 2207.14481, arXiv.org, revised Oct 2022.
    3. Eleftherios Giovanis & Oznur Ozdamar, 2021. "Regional employment support programs and multidimensional poverty of youth in Turkey," Eurasian Economic Review, Springer;Eurasia Business and Economics Society, vol. 11(4), pages 583-609, December.
    4. Peter Backus & Thien Nguyen, 2021. "The Effect of the Sex Buyer Law on the Market for Sex, Sexual Health and Sexual Violence," Economics Discussion Paper Series 2106, Economics, The University of Manchester.
    5. Johanna Catherine Maclean & Brendan Saloner, 2018. "Substance Use Treatment Provider Behavior and Healthcare Reform: Evidence from Massachusetts," Health Economics, John Wiley & Sons, Ltd., vol. 27(1), pages 76-101, January.
    6. Jason Poulos & Andrea Albanese & Andrea Mercatanti & Fan Li, 2021. "Retrospective causal inference via matrix completion, with an evaluation of the effect of European integration on cross-border employment," Papers 2106.00788, arXiv.org.
    7. Blouri, Yashar & Ehrlich, Maximilian V., 2020. "On the optimal design of place-based policies: A structural evaluation of EU regional transfers," Journal of International Economics, Elsevier, vol. 125(C).
    8. Alexander S. Skorobogatov, 2021. "The effect of alcohol sales restrictions on alcohol poisoning mortality: Evidence from Russia," Health Economics, John Wiley & Sons, Ltd., vol. 30(6), pages 1417-1442, June.
    9. Peter Hull & Michal Kolesár & Christopher Walters, 2022. "Labor by design: contributions of David Card, Joshua Angrist, and Guido Imbens," Scandinavian Journal of Economics, Wiley Blackwell, vol. 124(3), pages 603-645, July.
    10. Hernæs, Øystein, 2018. "Activation against absenteeism – Evidence from a sickness insurance reform in Norway," Journal of Health Economics, Elsevier, vol. 62(C), pages 60-68.
    11. Reimer, Matthew N. & Haynie, Alan C., 2018. "Mechanisms matter for evaluating the economic impacts of marine reserves," Journal of Environmental Economics and Management, Elsevier, vol. 88(C), pages 427-446.
    12. Nicolas R. Ziebarth, 2018. "Social Insurance and Health," Contributions to Economic Analysis, in: Health Econometrics, volume 127, pages 57-84, Emerald Group Publishing Limited.
    13. Bibek Adhikari & James Alm, 2016. "Evaluating the Economic Effects of Flat Tax Reforms Using Synthetic Control Methods," Southern Economic Journal, John Wiley & Sons, vol. 83(2), pages 437-463, October.
    14. Saleem, Adil & Zahid, R.M. Ammar & Sági, Judit, 2025. "Differential impact of adopting Islamic banking: A quasi-experimental approach," Research in International Business and Finance, Elsevier, vol. 76(C).
    15. Bruno Ferman & Cristine Pinto, 2019. "Inference in Differences-in-Differences with Few Treated Groups and Heteroskedasticity," The Review of Economics and Statistics, MIT Press, vol. 101(3), pages 452-467, July.
    16. Florian F Gunsilius, 2025. "A primer on optimal transport for causal inference with observational data," Papers 2503.07811, arXiv.org, revised Mar 2025.
    17. Bibek Adhikari, 2022. "A Guide to Using the Synthetic Control Method to Quantify the Effects of Shocks, Policies, and Shocking Policies," The American Economist, Sage Publications, vol. 67(1), pages 46-63, March.
    18. Saffer, Henry & Gehrsitz, Markus, 2016. "The effect of post-and-hold laws on alcohol consumption," International Review of Law and Economics, Elsevier, vol. 45(C), pages 63-71.
    19. Eunji Choi & Jonghoon Park & Seongwoo Lee, 2020. "The Effect of the Comprehensive Rural Village Development Program on Farm Income in South Korea," Sustainability, MDPI, vol. 12(17), pages 1-23, August.
    20. Taylor K. Odle, 2022. "Free to Spend? Institutional Autonomy and Expenditures on Executive Compensation, Faculty Salaries, and Research Activities," Research in Higher Education, Springer;Association for Institutional Research, vol. 63(1), pages 1-32, February.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:apecpp:v:47:y:2025:i:1:p:49-64. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1002/(ISSN)2040-5804 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.