IDEAS home Printed from https://ideas.repec.org/a/ibn/ijefaa/v10y2018i2p1-9.html
   My bibliography  Save this article

Empirical Information on the Small Size Effect Bias Relative to the False Positive Rejection Error for Benford Test-Screening

Author

Listed:
  • Yan Bao
  • Chuo-Hsuan Lee
  • Frank Heilig
  • Edward J. Lusk

Abstract

Due to the theoretical work of Hill Benford digital profile testing is now a staple in screening data for forensic investigations and audit examinations. Prior empirical literature indicates that Benford testing when applied to a large Benford Conforming Dataset often produces a bias called the FPE Screening Signal [FPESS] that misleads investigators into believing that the dataset is Non-Conforming in nature. Interestingly, the same FPESS can also be observed when investigators partition large datasets into smaller datasets to address a variety of auditing questions. In this study, we fill the empirical gap in the literature by investigating the sensitivity of the FPESS to partitioned datasets. We randomly selected 16 balance-sheet datasets from: China Stock Market Financial Statements Database?, that tested to be Benford Conforming noted as RBCD. We then explore how partitioning these datasets affects the FPESS by repeated randomly sampling: first 10% of the RBCD and then selecting 250 observations from the RBCD. This created two partitioned groups of 160 datasets each. The Statistical profile observed was: For the RBCD there were no indications of Non-Conformity; for the 10%-Sample there were no overall indications that Extended Procedures would be warranted; and for the 250-Sample there were a number of indications that the dataset was Non-Conforming. This demonstrated clearly that small datasets are indeed likely to create the FPESS. We offer a discussion of these results with implications for audits in the Big-Data context where the audit In-charge would find it necessary to partition the datasets of the client.

Suggested Citation

  • Yan Bao & Chuo-Hsuan Lee & Frank Heilig & Edward J. Lusk, 2018. "Empirical Information on the Small Size Effect Bias Relative to the False Positive Rejection Error for Benford Test-Screening," International Journal of Economics and Finance, Canadian Center of Science and Education, vol. 10(2), pages 1-9, February.
  • Handle: RePEc:ibn:ijefaa:v:10:y:2018:i:2:p:1-9
    as

    Download full text from publisher

    File URL: http://ccsenet.org/journal/index.php/ijef/article/view/72797/39906
    Download Restriction: no

    File URL: http://ccsenet.org/journal/index.php/ijef/article/view/72797
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Tam Cho, Wendy K. & Gaines, Brian J., 2007. "Breaking the (Benford) Law: Statistical Fraud Detection in Campaign Finance," The American Statistician, American Statistical Association, vol. 61, pages 218-223, August.
    2. T. Mir, 2016. "The leading digit distribution of the worldwide illicit financial flows," Quality & Quantity: International Journal of Methodology, Springer, vol. 50(1), pages 271-281, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yan Bao & Frank Heilig & Chuo-Hsuan Lee & Edward Lusk, 2018. "Full Range Testing of the Small Size Effect Bias for Benford Screening: A Note," International Journal of Economics and Finance, Canadian Center of Science and Education, vol. 10(6), pages 47-52, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Riccioni, Jessica & Cerqueti, Roy, 2018. "Regular paths in financial markets: Investigating the Benford's law," Chaos, Solitons & Fractals, Elsevier, vol. 107(C), pages 186-194.
    2. Ronelle Burger & Canh Thien Dang & Trudy Owens, 2017. "Better performing NGOs do report more accurately: Evidence from investigating Ugandan NGO financial accounts," Discussion Papers 2017-10, University of Nottingham, CREDIT.
    3. Roy Cerqueti & Claudio Lupi, 2023. "Severe testing of Benford’s law," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 32(2), pages 677-694, June.
    4. Dang, Canh Thien & Owens, Trudy, 2020. "Does transparency come at the cost of charitable services? Evidence from investigating British charities," Journal of Economic Behavior & Organization, Elsevier, vol. 172(C), pages 314-343.
    5. Matthew A. Cole & David J. Maddison & Liyun Zhang, 2020. "Testing the emission reduction claims of CDM projects using the Benford’s Law," Climatic Change, Springer, vol. 160(3), pages 407-426, June.
    6. John Morrow, 2014. "Benford's Law, Families of Distributions and a Test Basis," CEP Discussion Papers dp1291, Centre for Economic Performance, LSE.
    7. Edward J. Lusk & Michael Halperin, 2014. "Detecting Newcomb-Benford Digital Frequency Anomalies in the Audit Context: Suggested Chi2 Test Possibilities," Accounting and Finance Research, Sciedu Press, vol. 3(2), pages 191-191, May.
    8. Stefan Günnel & Karl-Heinz Tödter, 2009. "Does Benford’s Law hold in economic research and forecasting?," Empirica, Springer;Austrian Institute for Economic Research;Austrian Economic Association, vol. 36(3), pages 273-292, August.
    9. Fu, Qiuzi & Villas-Boas, Sofia B & Judge, George, 2019. "Does china income FSDs follow Benford? A comparison between Chinese income first significant digit distribution with Benford distribution," Department of Agricultural & Resource Economics, UC Berkeley, Working Paper Series qt7bd3t95j, Department of Agricultural & Resource Economics, UC Berkeley.
    10. Lee, Joanne & Cho, Wendy K. Tam & Judge, George G., 2010. "Stigler's approach to recovering the distribution of first significant digits in natural data sets," Statistics & Probability Letters, Elsevier, vol. 80(2), pages 82-88, January.
    11. Montag, Josef, 2017. "Identifying odometer fraud in used car market data," Transport Policy, Elsevier, vol. 60(C), pages 10-23.
    12. Wójcik, Michał Ryszard, 2014. "A characterization of Benford’s law through generalized scale-invariance," Mathematical Social Sciences, Elsevier, vol. 71(C), pages 1-5.
    13. Ausloos, Marcel & Ficcadenti, Valerio & Dhesi, Gurjeet & Shakeel, Muhammad, 2021. "Benford’s laws tests on S&P500 daily closing values and the corresponding daily log-returns both point to huge non-conformity," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 574(C).
    14. Montag, Josef, 2015. "Identifying Odometer Fraud: Evidence from the Used Car Market in the Czech Republic," MPRA Paper 65182, University Library of Munich, Germany.
    15. Frank Heilig & Edward J. Lusk, 2017. "A Robust Newcomb-Benford Account Screening Profiler: An Audit Decision Support System," International Journal of Financial Research, International Journal of Financial Research, Sciedu Press, vol. 8(3), pages 27-39, July.
    16. Jalan, Akanksha & Matkovskyy, Roman & Yarovaya, Larisa, 2021. "“Shiny” crypto assets: A systemic look at gold-backed cryptocurrencies during the COVID-19 pandemic," International Review of Financial Analysis, Elsevier, vol. 78(C).
    17. Ausloos, Marcel & Cerqueti, Roy & Mir, Tariq A., 2017. "Data science for assessing possible tax income manipulation: The case of Italy," Chaos, Solitons & Fractals, Elsevier, vol. 104(C), pages 238-256.
    18. Rosa Abrantes-Metz & Sofia Villas-Boas & George Judge, 2011. "Tracking the Libor rate," Applied Economics Letters, Taylor & Francis Journals, vol. 18(10), pages 893-899.
    19. Tariq Ahmad Mir & Marcel Ausloos & Roy Cerqueti, 2014. "Benford's law predicted digit distribution of aggregated income taxes: the surprising conformity of Italian cities and regions," Papers 1410.2890, arXiv.org.
    20. Druică, Elena & Oancea, Bogdan & Vâlsan, Călin, 2018. "Benford's law and the limits of digit analysis," International Journal of Accounting Information Systems, Elsevier, vol. 31(C), pages 75-82.

    More about this item

    Keywords

    extended procedures; audit risk; partitioning large datasets;
    All these keywords.

    JEL classification:

    • R00 - Urban, Rural, Regional, Real Estate, and Transportation Economics - - General - - - General
    • Z0 - Other Special Topics - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ibn:ijefaa:v:10:y:2018:i:2:p:1-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Canadian Center of Science and Education (email available below). General contact details of provider: https://edirc.repec.org/data/cepflch.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.