IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0291337.html

Benford’s Law applies to word frequency rank in English, German, French, Spanish, and Italian

Author

Listed:
  • Jennifer Golbeck

Abstract

Benford’s Law states that, in many real-world data sets, the frequency of numbers’ first digits is predicted by the formula log(1 + (1/d)). Numbers beginning with a 1 occur roughly 30% of the time, and are six times more common than numbers beginning with a 9. We show that Benford’s Law applies to the the frequency rank of words in English, German, French, Spanish, and Italian. We calculated the frequency rank of words in the Google Ngram Viewer corpora. Then, using the first significant digit of the frequency rank, we found the FSD distribution adhered to the expected Benford’s Law distribution. Over a series of additional corpora from sources ranging from news to books to social media and across the languages studied, we consistently found adherence to Benford’s Law. Furthermore, at the user-level on social media, we found Benford’s Law holds for the vast majority of users’ collected posts and significant deviations from Benford’s Law tends to be a mark of spam bots.

Suggested Citation

  • Jennifer Golbeck, 2023. "Benford’s Law applies to word frequency rank in English, German, French, Spanish, and Italian," PLOS ONE, Public Library of Science, vol. 18(9), pages 1-12, September.
    • Handle: RePEc:plo:pone00:0291337
    DOI: 10.1371/journal.pone.0291337
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0291337
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0291337&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0291337?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Pietronero, L. & Tosatti, E. & Tosatti, V. & Vespignani, A., 2001. "Explaining the uneven distribution of numbers in nature: the laws of Benford and Zipf," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 293(1), pages 297-304.
    2. Andreas Diekmann, 2007. "Not the First Digit! Using Benford's Law to Detect Fraudulent Scientif ic Data," Journal of Applied Statistics, Taylor & Francis Journals, vol. 34(3), pages 321-329.
    3. George Judge & Laura Schechter, 2009. "Detecting Problems in Survey Data Using Benford’s Law," Journal of Human Resources, University of Wisconsin Press, vol. 44(1).
    4. David Giles, 2007. "Benford's law and naturally occurring prices in certain ebaY auctions," Applied Economics Letters, Taylor & Francis Journals, vol. 14(3), pages 157-161.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Parnes, Dror, 2022. "Banks' off-balance sheet manipulations," The Quarterly Review of Economics and Finance, Elsevier, vol. 86(C), pages 314-331.
    2. Matthew A. Cole & David J. Maddison & Liyun Zhang, 2020. "Testing the emission reduction claims of CDM projects using the Benford’s Law," Climatic Change, Springer, vol. 160(3), pages 407-426, June.
    3. T. Mir, 2016. "The leading digit distribution of the worldwide illicit financial flows," Quality & Quantity: International Journal of Methodology, Springer, vol. 50(1), pages 271-281, January.
    4. Horton, Joanne & Krishna Kumar, Dhanya & Wood, Anthony, 2020. "Detecting academic fraud using Benford law: The case of Professor James Hunton," Research Policy, Elsevier, vol. 49(8).
    5. Holz, Carsten A., 2014. "The quality of China's GDP statistics," China Economic Review, Elsevier, vol. 30(C), pages 309-338.
    6. Mir, T.A., 2014. "The Benford law behavior of the religious activity data," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 408(C), pages 1-9.
    7. Bernhard Rauch & Max G�ttsche & Stephan Langenegger, 2014. "Detecting Problems in Military Expenditure Data Using Digital Analysis," Defence and Peace Economics, Taylor & Francis Journals, vol. 25(2), pages 97-111, April.
    8. Vadim S. Balashov & Yuxing Yan & Xiaodi Zhu, 2020. "Who Manipulates Data During Pandemics? Evidence from Newcomb-Benford Law," Papers 2007.14841, arXiv.org, revised Jan 2021.
    9. Lee, Joanne & Judge, George G., 2008. "Identifying falsified clinical data," CUDARE Working Papers 47001, University of California, Berkeley, Department of Agricultural and Resource Economics.
    10. Sitsofe Tsagbey & Miguel de Carvalho & Garritt L. Page, 2017. "All Data are Wrong, but Some are Useful? Advocating the Need for Data Auditing," The American Statistician, Taylor & Francis Journals, vol. 71(3), pages 231-235, July.
    11. Theoharry Grammatikos & Nikolaos I. Papanikolaou, 2021. "Applying Benford’s Law to Detect Accounting Data Manipulation in the Banking Industry," Journal of Financial Services Research, Springer;Western Finance Association, vol. 59(1), pages 115-142, April.
    12. Kalaichelvan, Mohandass & Lim Kai Jie, Shawn, 2012. "A Critical Evaluation of the Significance of Round Numbers in European Equity Markets in Light of the Predictions from Benford’s Law," MPRA Paper 40960, University Library of Munich, Germany.
    13. Clippe, Paulette & Ausloos, Marcel, 2012. "Benford’s law and Theil transform of financial data," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 391(24), pages 6556-6567.
    14. Faraji Kasidi & H. Chaturvedi & Rahul Singh, 2010. "Detecting Data Error and Inaccuracy," Margin: The Journal of Applied Economic Research, National Council of Applied Economic Research, vol. 4(4), pages 405-425, November.
    15. Cheng Zhao & Chong Alex Wang, 2023. "A cross-site comparison of online review manipulation using Benford’s law," Electronic Commerce Research, Springer, vol. 23(1), pages 365-406, March.
    16. Bormashenko, Ed. & Shulzinger, E. & Whyman, G. & Bormashenko, Ye., 2016. "Benford’s law, its applicability and breakdown in the IR spectra of polymers," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 444(C), pages 524-529.
    17. Whyman, G. & Ohtori, N. & Shulzinger, E. & Bormashenko, Ed., 2016. "Revisiting the Benford law: When the Benford-like distribution of leading digits in sets of numerical data is expectable?," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 461(C), pages 595-601.
    18. Karlo Kauko, 2024. "How to detect what drives deviations from Benford’s law? An application to bank deposit data," Empirical Economics, Springer, vol. 67(3), pages 1045-1061, September.
    19. Montag, Josef, 2017. "Identifying odometer fraud in used car market data," Transport Policy, Elsevier, vol. 60(C), pages 10-23.
    20. Andrea Cerasa, 2022. "Testing for Benford’s Law in very small samples: Simulation study and a new test proposal," PLOS ONE, Public Library of Science, vol. 17(7), pages 1-17, July.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0291337. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.