IDEAS home Printed from https://ideas.repec.org/a/wly/apecpp/v47y2025i1p49-64.html
   My bibliography  Save this article

Are we measuring impact accurately? Identifying potential sources of bias in the evaluation of extension personnel and programs

Author

Listed:
  • Andrew Wright
  • Jeffrey Wright
  • Dean McCorkle
  • Jeffrey Hyde

Abstract

Agricultural extension programs must demonstrate their value to compete for limited government funding. As extension professionals measure the value of their programs, the risk exists that the information they report will provide a biased or an inaccurate measure of value. We examine the evaluation process for extension programs and extension personnel to identify potential sources of bias or inaccuracies. We find that bias and inaccuracy in program evaluation often stems from a focus on short‐term outcomes, rather than long‐term impacts, while bias in personnel evaluation can result from information asymmetries that exist between extension personnel and their evaluators.

Suggested Citation

  • Andrew Wright & Jeffrey Wright & Dean McCorkle & Jeffrey Hyde, 2025. "Are we measuring impact accurately? Identifying potential sources of bias in the evaluation of extension personnel and programs," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 47(1), pages 49-64, March.
    • Handle: RePEc:wly:apecpp:v:47:y:2025:i:1:p:49-64
    DOI: 10.1002/aepp.13478
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/aepp.13478
    Download Restriction: no
    File URL: https://libkey.io/10.1002/aepp.13478?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Hosain, Md. Sajjad, 2016. "360 Degree Feedback as a Technique of Performance Appraisal: Does it Really Work?," Asian Business Review, Asian Business Consortium, vol. 6(1), pages 21-24.
    2. David Orden & Steven T. Buccola, 1980. "An Evaluation of Cooperative Extension Small Farm Programs in the Southern United States," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 62(2), pages 218-223.
    3. Alberto Abadie & Javier Gardeazabal, 2003. "The Economic Costs of Conflict: A Case Study of the Basque Country," American Economic Review, American Economic Association, vol. 93(1), pages 113-132, March.
    4. Brian Roe & Timothy C. Haab & Brent Sohngen, 2004. "The Value of Agricultural Economics Extension Programming: An Application of Contingent Valuation," Review of Agricultural Economics, Agricultural and Applied Economics Association, vol. 26(3), pages 373-390.
    5. Joshua D. Angrist & Jörn-Steffen Pischke, 2009. "Mostly Harmless Econometrics: An Empiricist's Companion," Economics Books, Princeton University Press, edition 1, number 8769.
    6. Anders Fredriksson & Gustavo Magalhães de Oliveira, 2019. "Impact evaluation using Difference-in-Differences," RAUSP Management Journal, Emerald Group Publishing Limited, vol. 54(4), pages 519-532, October.
    7. Abadie, Alberto & Diamond, Alexis & Hainmueller, Jens, 2010. "Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California’s Tobacco Control Program," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 493-505.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Johanna Catherine Maclean & Brendan Saloner, 2018. "Substance Use Treatment Provider Behavior and Healthcare Reform: Evidence from Massachusetts," Health Economics, John Wiley & Sons, Ltd., vol. 27(1), pages 76-101, January.
    2. Alexander S. Skorobogatov, 2021. "The effect of alcohol sales restrictions on alcohol poisoning mortality: Evidence from Russia," Health Economics, John Wiley & Sons, Ltd., vol. 30(6), pages 1417-1442, June.
    3. Peter Hull & Michal Kolesár & Christopher Walters, 2022. "Labor by design: contributions of David Card, Joshua Angrist, and Guido Imbens," Scandinavian Journal of Economics, Wiley Blackwell, vol. 124(3), pages 603-645, July.
    4. Bibek Adhikari & James Alm, 2016. "Evaluating the Economic Effects of Flat Tax Reforms Using Synthetic Control Methods," Southern Economic Journal, John Wiley & Sons, vol. 83(2), pages 437-463, October.
    5. Bruno Ferman & Cristine Pinto, 2019. "Inference in Differences-in-Differences with Few Treated Groups and Heteroskedasticity," The Review of Economics and Statistics, MIT Press, vol. 101(3), pages 452-467, July.
    6. Florian F Gunsilius, 2025. "A primer on optimal transport for causal inference with observational data," Papers 2503.07811, arXiv.org, revised Mar 2025.
    7. Nicolas R. Ziebarth, 2018. "Social Insurance and Health," Contributions to Economic Analysis, in: Health Econometrics, volume 127, pages 57-84, Emerald Group Publishing Limited.
    8. Taylor K. Odle, 2022. "Free to Spend? Institutional Autonomy and Expenditures on Executive Compensation, Faculty Salaries, and Research Activities," Research in Higher Education, Springer;Association for Institutional Research, vol. 63(1), pages 1-32, February.
    9. Francesca Caselli, 2017. "Did the Exchange Rate Floor Prevent Deflation in the Czech Republic?," Review of Economics and Institutions, Università di Perugia, vol. 8(2).
    10. Hernæs, Øystein, 2018. "Activation against absenteeism – Evidence from a sickness insurance reform in Norway," Journal of Health Economics, Elsevier, vol. 62(C), pages 60-68.
    11. Fredriksen, Kaja & Runst, Petrik, 2018. "Are estimates of the "natural experiment" in the German crafts sector causal?," ifh Working Papers 16/2018, Volkswirtschaftliches Institut für Mittelstand und Handwerk an der Universität Göttingen (ifh).
    12. Blouri, Yashar & Ehrlich, Maximilian V., 2020. "On the optimal design of place-based policies: A structural evaluation of EU regional transfers," Journal of International Economics, Elsevier, vol. 125(C).
    13. Fink, Johanna, 2024. "Do separate bidding zones within countries create imbalances in PV uptake? Evidence from Sweden," Applied Energy, Elsevier, vol. 374(C).
    14. Gershenson, Seth & Hayes, Michael S., 2016. "Short-Run Externalities of Civic Unrest: Evidence from Ferguson, Missouri," IZA Discussion Papers 10091, Institute of Labor Economics (IZA).
    15. Keegan Harris & Anish Agarwal & Chara Podimata & Zhiwei Steven Wu, 2022. "Strategyproof Decision-Making in Panel Data Settings and Beyond," Papers 2211.14236, arXiv.org, revised Dec 2023.
    16. Balmori de la Miyar Jose Roberto, 2016. "The Economic Consequences of the Mexican Drug War," Peace Economics, Peace Science, and Public Policy, De Gruyter, vol. 22(3), pages 213-246, August.
    17. Bryan Bollinger & Steven E. Sexton, 2023. "Local excise taxes, sticky prices, and spillovers: evidence from Berkeley’s soda tax," Quantitative Marketing and Economics (QME), Springer, vol. 21(2), pages 281-331, June.
    18. Rómulo A. Chumacero, 2019. "Skills versus Luck: Bolivia and its recent Bonanza," Latin American Economic Review, Springer;Centro de Investigaciòn y Docencia Económica (CIDE), vol. 28(1), pages 1-27, December.
    19. Saffer, Henry & Gehrsitz, Markus, 2016. "The effect of post-and-hold laws on alcohol consumption," International Review of Law and Economics, Elsevier, vol. 45(C), pages 63-71.
    20. Johanna Fink, 2023. "Can the creation of separate bidding zones within countries create imbalances in PV uptake? Evidence from Sweden," Papers 2312.16161, arXiv.org.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:apecpp:v:47:y:2025:i:1:p:49-64. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1002/(ISSN)2040-5804 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.