IDEAS home Printed from https://ideas.repec.org/p/ags/aaea25/361106.html

Exaggeration Bias and Article Citations in Agricultural Economics

Author

Listed:
  • Han, Donggeun
  • Adom, Enoch
  • Lambert, Dayton M.

Abstract

Research credibility in agricultural economics is compromised by two interrelated factors: selective reporting and low statistical power. These factors contribute to exaggerated findings that appear more persuasive and garner more citations. This study analyzes 849 articles published in leading U.S. agricultural economics journals between 2018 and 2023, with 48,962 observations. Two empirical analyses are conducted. The first regresses citation counts on p-values reported in article tables, a proxy for statistical power, article topics, and journal and year fixed effects. The second predicts the time it takes a journal to be cited ‘10’ times, given p-values and statistical power. We hypothesized that citation counts would be negatively associated with p-values (i.e., lower p-value attract more citations), while no specific hypothesis was formed for statistical power, as it is unobservable to readers. The results show that citation counts are strongly influenced by topic novelty and journal prestige, with studies reporting lower p-values receiving more citations, whereas adequately powered studies receive fewer. The misalignment between research rigor and citation counts raises concerns that farmers may adopt recommendations based on less reliable findings, as agricultural extension services may rely on citation metrics when evaluating scientific research. Thus, aligning citation-based evaluations with empirical credibility is important not only for maintaining trust in science but also for informing decisions made by farmers and extension agents.

Suggested Citation

  • Han, Donggeun & Adom, Enoch & Lambert, Dayton M., 2025. "Exaggeration Bias and Article Citations in Agricultural Economics," 2025 AAEA & WAEA Joint Annual Meeting, July 27-29, 2025, Denver, CO 361106, Agricultural and Applied Economics Association.
    • Handle: RePEc:ags:aaea25:361106
    DOI: 10.22004/ag.econ.361106
    as

    Download full text from publisher

    File URL: https://ageconsearch.umn.edu/record/361106/files/75307_110296_105300_Exaggeration_Bias_and_Article_Citations_in_Agricultural_Economics_Donggeun_Han.pdf
    Download Restriction: no
    File URL: https://libkey.io/10.22004/ag.econ.361106?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Thelwall, Mike & Wilson, Paul, 2014. "Regression for citation data: An evaluation of different methods," Journal of Informetrics, Elsevier, vol. 8(4), pages 963-971.
    2. Grimmer, Justin & Stewart, Brandon M., 2013. "Text as Data: The Promise and Pitfalls of Automatic Content Analysis Methods for Political Texts," Political Analysis, Cambridge University Press, vol. 21(3), pages 267-297, July.
    3. Tim Loughran & Bill McDonald, 2015. "The Use of Word Lists in Textual Analysis," Journal of Behavioral Finance, Taylor & Francis Journals, vol. 16(1), pages 1-11, January.
    4. Larsen, Vegard H. & Thorsrud, Leif A., 2019. "The value of news for economic developments," Journal of Econometrics, Elsevier, vol. 210(1), pages 203-218.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Christina Bannier & Thomas Pauls & Andreas Walter, 2019. "Content analysis of business communication: introducing a German dictionary," Journal of Business Economics, Springer, vol. 89(1), pages 79-123, February.
    2. Andres Algaba & David Ardia & Keven Bluteau & Samuel Borms & Kris Boudt, 2020. "Econometrics Meets Sentiment: An Overview Of Methodology And Applications," Journal of Economic Surveys, Wiley Blackwell, vol. 34(3), pages 512-547, July.
    3. Djourelova, Milena & Durante, Ruben, 2019. "Media Attention and Strategic Timing in Politics: Evidence from U.S. Presidential Executive Orders," CEPR Discussion Papers 13961, Centre for Economic Policy Research.
    4. Jason Cory Brunson & Xiaoyan Wang & Reinhard C Laubenbacher, 2017. "Effects of research complexity and competition on the incidence and growth of coauthorship in biomedicine," PLOS ONE, Public Library of Science, vol. 12(3), pages 1-23, March.
    5. Asutay, Mehmet & Chien, Wen Che, 2026. "The impact of FOMC monetary policy reports on the forecasts of Taiwan's economic variables: Sentiment analysis through text mining," International Review of Economics & Finance, Elsevier, vol. 109(C).
    6. Bernhardt, Lea & Dewenter, Ralf & Thomas, Tobias, 2023. "Measuring partisan media bias in US newscasts from 2001 to 2012," European Journal of Political Economy, Elsevier, vol. 78(C).
    7. Johan, Sofia & Zhang, Yelin, 2020. "Quality revealing versus overstating in equity crowdfunding," Journal of Corporate Finance, Elsevier, vol. 65(C).
    8. Ntentas, Raphael, 2021. "Quantifying political populism and examining the link with economic insecurity: evidence from Greece," LSE Research Online Documents on Economics 112579, London School of Economics and Political Science, LSE Library.
    9. James Demastus & Nancy E. Landrum, 2024. "Organizational sustainability schemes align with weak sustainability," Business Strategy and the Environment, Wiley Blackwell, vol. 33(2), pages 707-725, February.
    10. Oz, Seda, 2024. "The impact of terrorist attacks and mass shootings on earnings management," The British Accounting Review, Elsevier, vol. 56(3).
    11. Helena Seibicke & Asimina Michailidou, 2022. "The Challenges of Reconstructing Citizen-Driven EU Contestation in the Digital Media Sphere," Politics and Governance, Cogitatio Press, vol. 10(1), pages 97-107.
    12. Chen, Shaoling & Gao, Qing & Peng, Qing & Yang, Haisheng, 2021. "Government-decentralized power: Measurement and effects," Emerging Markets Review, Elsevier, vol. 48(C).
    13. Leek, Lauren Caroline, 2025. "Who Sets the Agenda of the European Central Bank? The Role of National Central Banks in the Eurosystem," SocArXiv pb24v_v1, Center for Open Science.
    14. David M. Arseneau & Alejandro Drexler & Mitsuhiro Osada, 2022. "Central Bank Communication about Climate Change," Finance and Economics Discussion Series 2022-031, Board of Governors of the Federal Reserve System (U.S.).
    15. repec:osf:osfxxx:pt3q9_v1 is not listed on IDEAS
    16. Lin, Annie E. & Young, Jimmy A. & Guarino, Jeannine E., 2022. "Mother-Daughter sexual abuse: An exploratory study of the experiences of survivors of MDSA using Reddit," Children and Youth Services Review, Elsevier, vol. 138(C).
    17. Yasuhiro Hara, 2024. "Dynamic Relationship between Information Dissemination by Local Governors and Mobility during the COVID-19 Pandemic," Discussion papers ron373, Policy Research Institute, Ministry of Finance Japan.
    18. repec:rim:rimwps:22-04 is not listed on IDEAS
    19. Thewissen, James & Shrestha, Prabal & Torsin, Wouter & Pastwa, Anna M., 2022. "Unpacking the black box of ICO white papers: A topic modeling approach," Journal of Corporate Finance, Elsevier, vol. 75(C).
    20. Levy, Daniel & Mayer, Tamir & Raviv, Alon, 2022. "Economists in the 2008 financial crisis: Slow to see, fast to act," Journal of Financial Stability, Elsevier, vol. 60(C).
    21. Natalie A. Carlson, 2023. "Differentiation in microenterprises," Strategic Management Journal, Wiley Blackwell, vol. 44(5), pages 1141-1167, May.
    22. Mark Quigley & Jeremy D. Silver, 2022. "Science advocacy in political rhetoric and actions," Environment Systems and Decisions, Springer, vol. 42(3), pages 462-476, September.

    More about this item

    Keywords

    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ags:aaea25:361106. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: AgEcon Search (email available below). General contact details of provider: https://edirc.repec.org/data/aaeaaea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.