IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0291337.html

Benford’s Law applies to word frequency rank in English, German, French, Spanish, and Italian

Author

Listed:
  • Jennifer Golbeck

Abstract

Benford’s Law states that, in many real-world data sets, the frequency of numbers’ first digits is predicted by the formula log(1 + (1/d)). Numbers beginning with a 1 occur roughly 30% of the time, and are six times more common than numbers beginning with a 9. We show that Benford’s Law applies to the the frequency rank of words in English, German, French, Spanish, and Italian. We calculated the frequency rank of words in the Google Ngram Viewer corpora. Then, using the first significant digit of the frequency rank, we found the FSD distribution adhered to the expected Benford’s Law distribution. Over a series of additional corpora from sources ranging from news to books to social media and across the languages studied, we consistently found adherence to Benford’s Law. Furthermore, at the user-level on social media, we found Benford’s Law holds for the vast majority of users’ collected posts and significant deviations from Benford’s Law tends to be a mark of spam bots.

Suggested Citation

  • Jennifer Golbeck, 2023. "Benford’s Law applies to word frequency rank in English, German, French, Spanish, and Italian," PLOS ONE, Public Library of Science, vol. 18(9), pages 1-12, September.
    • Handle: RePEc:plo:pone00:0291337
    DOI: 10.1371/journal.pone.0291337
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0291337
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0291337&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0291337?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Pietronero, L. & Tosatti, E. & Tosatti, V. & Vespignani, A., 2001. "Explaining the uneven distribution of numbers in nature: the laws of Benford and Zipf," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 293(1), pages 297-304.
    2. Andreas Diekmann, 2007. "Not the First Digit! Using Benford's Law to Detect Fraudulent Scientif ic Data," Journal of Applied Statistics, Taylor & Francis Journals, vol. 34(3), pages 321-329.
    3. George Judge & Laura Schechter, 2009. "Detecting Problems in Survey Data Using Benford’s Law," Journal of Human Resources, University of Wisconsin Press, vol. 44(1).
    4. David Giles, 2007. "Benford's law and naturally occurring prices in certain ebaY auctions," Applied Economics Letters, Taylor & Francis Journals, vol. 14(3), pages 157-161.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Parnes, Dror, 2022. "Banks' off-balance sheet manipulations," The Quarterly Review of Economics and Finance, Elsevier, vol. 86(C), pages 314-331.
    2. Holz, Carsten A., 2014. "The quality of China's GDP statistics," China Economic Review, Elsevier, vol. 30(C), pages 309-338.
    3. Mir, T.A., 2014. "The Benford law behavior of the religious activity data," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 408(C), pages 1-9.
    4. Vadim S. Balashov & Yuxing Yan & Xiaodi Zhu, 2020. "Who Manipulates Data During Pandemics? Evidence from Newcomb-Benford Law," Papers 2007.14841, arXiv.org, revised Jan 2021.
    5. Matthew A. Cole & David J. Maddison & Liyun Zhang, 2020. "Testing the emission reduction claims of CDM projects using the Benford’s Law," Climatic Change, Springer, vol. 160(3), pages 407-426, June.
    6. T. Mir, 2016. "The leading digit distribution of the worldwide illicit financial flows," Quality & Quantity: International Journal of Methodology, Springer, vol. 50(1), pages 271-281, January.
    7. Horton, Joanne & Krishna Kumar, Dhanya & Wood, Anthony, 2020. "Detecting academic fraud using Benford law: The case of Professor James Hunton," Research Policy, Elsevier, vol. 49(8).
    8. Bernhard Rauch & Max G�ttsche & Stephan Langenegger, 2014. "Detecting Problems in Military Expenditure Data Using Digital Analysis," Defence and Peace Economics, Taylor & Francis Journals, vol. 25(2), pages 97-111, April.
    9. Lee, Joanne & Judge, George G., 2008. "Identifying falsified clinical data," CUDARE Working Papers 47001, University of California, Berkeley, Department of Agricultural and Resource Economics.
    10. Sitsofe Tsagbey & Miguel de Carvalho & Garritt L. Page, 2017. "All Data are Wrong, but Some are Useful? Advocating the Need for Data Auditing," The American Statistician, Taylor & Francis Journals, vol. 71(3), pages 231-235, July.
    11. Theoharry Grammatikos & Nikolaos I. Papanikolaou, 2021. "Applying Benford’s Law to Detect Accounting Data Manipulation in the Banking Industry," Journal of Financial Services Research, Springer;Western Finance Association, vol. 59(1), pages 115-142, April.
    12. Kalaichelvan, Mohandass & Lim Kai Jie, Shawn, 2012. "A Critical Evaluation of the Significance of Round Numbers in European Equity Markets in Light of the Predictions from Benford’s Law," MPRA Paper 40960, University Library of Munich, Germany.
    13. Clippe, Paulette & Ausloos, Marcel, 2012. "Benford’s law and Theil transform of financial data," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 391(24), pages 6556-6567.
    14. Karlo Kauko, 2024. "How to detect what drives deviations from Benford’s law? An application to bank deposit data," Empirical Economics, Springer, vol. 67(3), pages 1045-1061, September.
    15. Montag, Josef, 2017. "Identifying odometer fraud in used car market data," Transport Policy, Elsevier, vol. 60(C), pages 10-23.
    16. Adriano Silva & Sergio Floquet & Ricardo Lima, 2023. "Newcomb–Benford’s Law in Neuromuscular Transmission: Validation in Hyperkalemic Conditions," Stats, MDPI, vol. 6(4), pages 1-19, October.
    17. Lee, Joanne & Cho, Wendy K. Tam & Judge, George G., 2010. "Stigler's approach to recovering the distribution of first significant digits in natural data sets," Statistics & Probability Letters, Elsevier, vol. 80(2), pages 82-88, January.
    18. Montag, Josef, 2015. "Identifying Odometer Fraud: Evidence from the Used Car Market in the Czech Republic," MPRA Paper 65182, University Library of Munich, Germany.
    19. Rosa Abrantes-Metz & Sofia Villas-Boas & George Judge, 2011. "Tracking the Libor rate," Applied Economics Letters, Taylor & Francis Journals, vol. 18(10), pages 893-899.
    20. Brähler, Gernot & Bensmann, Markus & Emke, Anna-Lena, 2010. "Der Einsatz mathematisch-statistischer Methoden in der digitalen Betriebsprüfung," Ilmenauer Schriften zur Betriebswirtschaftslehre, Technische Universität Ilmenau, Institut für Betriebswirtschaftslehre, volume 4, number 42010.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0291337. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.