IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2607.13564.html

Manipulation testing based on Benford's Law for discrete scores

Author

Listed:
  • Roy Cerqueti
  • Marco Ventura

Abstract

This paper addresses the problem of running variable manipulation in Regression Discontinuity Designs. Leveraging the observation that manipulation often alters the density balance around the cutoff, we detect these structural imbalances using Benford's Law -a natural statistical regularity widely applied in fraud detection. Our framework serves as a vital precautionary safeguard alongside traditional McCrary-type tests. It eliminates researcher-chosen parameters that can skew outcomes, while delivering a deeper diagnostic breakdown of the density's behavior. Crucially, whereas the classic McCrary test can overlook systemic imbalances due to its rigid symmetric setup, our method separates the data into directional components. This allows researchers to pinpoint the exact origin of a deviation and spot hidden manipulation that standard frameworks fail to capture. To achieve this, we introduce an innovative method for selecting a bandwidth consistent with BL, and construct two distinct, complementary tests using threshold values adapted from Nigrini (2012) that successfully transition the law's application from digits to probabilities. Empirical applications confirm the enhanced protective value of this diagnostic framework.

Suggested Citation

  • Roy Cerqueti & Marco Ventura, 2026. "Manipulation testing based on Benford's Law for discrete scores," Papers 2607.13564, arXiv.org.
  • Handle: RePEc:arx:papers:2607.13564
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2607.13564
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Manuel Cano-Rodriguez, 2025. "How much is too much? Measuring divergence from Benford's Law with the Equivalent Contamination Proportion (ECP)," Papers 2506.09915, arXiv.org, revised Jun 2025.
    2. Taisuke Otsu & Ke-Li Xu & Yukitoshi Matsushita, 2013. "Estimation and Inference of Discontinuity in Density," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(4), pages 507-524, October.
    3. Bernhard Rauch & Max Göttsche & Gernot Brähler & Stefan Engel, 2011. "Fact and Fiction in EU‐Governmental Economic Data," German Economic Review, Verein für Socialpolitik, vol. 12(3), pages 243-255, August.
    4. Cano-Rodríguez, Manuel & Núñez-Nickel, Manuel & Licerán-Gutiérrez, Ana, 2025. "Divergence from Benford’s law fails to measure financial statement accuracy," International Journal of Accounting Information Systems, Elsevier, vol. 56(C).
    5. Matias D. Cattaneo & Michael Jansson & Xinwei Ma, 2020. "Simple Local Polynomial Density Estimators," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(531), pages 1449-1455, July.
    6. Andreas Diekmann, 2007. "Not the First Digit! Using Benford's Law to Detect Fraudulent Scientif ic Data," Journal of Applied Statistics, Taylor & Francis Journals, vol. 34(3), pages 321-329.
    7. Ausloos, Marcel & Castellano, Rosella & Cerqueti, Roy, 2016. "Regularities and discrepancies of credit default swaps: a data science approach through Benford's law," Chaos, Solitons & Fractals, Elsevier, vol. 90(C), pages 8-17.
    8. Tödter Karl-Heinz, 2009. "Benford’s Law as an Indicator of Fraud in Economics," German Economic Review, De Gruyter, vol. 10(3), pages 339-351, August.
    9. Erik Meyersson, 2014. "Islamic Rule and the Empowerment of the Poor and Pious," Econometrica, Econometric Society, vol. 82(1), pages 229-269, January.
    10. McCrary, Justin, 2008. "Manipulation of the running variable in the regression discontinuity design: A density test," Journal of Econometrics, Elsevier, vol. 142(2), pages 698-714, February.
    11. Rauch Bernhard & Göttsche Max & Engel Stefan & Brähler Gernot, 2011. "Fact and Fiction in EU-Governmental Economic Data," German Economic Review, De Gruyter, vol. 12(3), pages 243-255, August.
    12. Matias D. Cattaneo & Michael Jansson & Xinwei Ma, 2018. "Manipulation testing based on density discontinuity," Stata Journal, StataCorp LLC, vol. 18(1), pages 234-261, March.
    13. Otsu, Taisuke & Xu, Ke-Li & Matsushita, Yukitoshi, 2013. "Estimation and inference of discontinuity in density," LSE Research Online Documents on Economics 85878, London School of Economics and Political Science, LSE Library.
    14. Mellace, Giovanni & Ventura, Marco, 2023. "The short-run effects of public incentives for innovation in Italy," Economic Modelling, Elsevier, vol. 120(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fusejima, Koki & Ishihara, Takuya & Sawada, Masayuki, 2025. "A unified test for regression discontinuity designs," Journal of Econometrics, Elsevier, vol. 251(C).
    2. Mauricio Villamizar‐Villegas & Freddy A. Pinzon‐Puerto & Maria Alejandra Ruiz‐Sanchez, 2022. "A comprehensive history of regression discontinuity designs: An empirical survey of the last 60 years," Journal of Economic Surveys, Wiley Blackwell, vol. 36(4), pages 1130-1178, September.
    3. Blaise Melly & Rafael Lalive, 2020. "Estimation, Inference, and Interpretation in the Regression Discontinuity Design," Diskussionsschriften dp2016, Universitaet Bern, Departement Volkswirtschaft.
    4. Takuya Ishihara & Masayuki Sawada, 2020. "Manipulation-Robust Regression Discontinuity Designs," Papers 2009.07551, arXiv.org, revised Sep 2024.
    5. Jin‐young Choi & Myoung‐jae Lee, 2023. "Score manipulation, density continuity and intent‐to‐treat effect for regression discontinuity," Pacific Economic Review, Wiley Blackwell, vol. 28(4), pages 552-569, October.
    6. Anja Roth & Michaela Slotwinski, 2018. "Gender Norms and Income Misreporting within Households," CESifo Working Paper Series 7298, CESifo.
    7. Bugni, Federico A. & Canay, Ivan A., 2021. "Testing continuity of a density via g-order statistics in the regression discontinuity design," Journal of Econometrics, Elsevier, vol. 221(1), pages 138-159.
    8. Yoichi Arai & Yu‐Chin Hsu & Toru Kitagawa & Ismael Mourifié & Yuanyuan Wan, 2022. "Testing identifying assumptions in fuzzy regression discontinuity designs," Quantitative Economics, Econometric Society, vol. 13(1), pages 1-28, January.
    9. Matias D. Cattaneo & Rocío Titiunik, 2022. "Regression Discontinuity Designs," Annual Review of Economics, Annual Reviews, vol. 14(1), pages 821-851, August.
    10. Tohari, Achmad & Parsons, Christopher & Rammohan, Anu, 2021. "Capital Fundamentalism and Structural Transformation," IZA Discussion Papers 14444, IZA Network @ LISER.
    11. Ulrich Matter & Michaela Slotwinski, 2016. "Precise Control over Legislative Vote Outcomes: A Forensic Approach to Political Economics," CESifo Working Paper Series 6007, CESifo.
    12. Funke, Benedikt & Hirukawa, Masayuki, 2019. "Nonparametric estimation and testing on discontinuity of positive supported densities: a kernel truncation approach," Econometrics and Statistics, Elsevier, vol. 9(C), pages 156-170.
    13. David M. Brasington, 2026. "The Effect of Increased Police Spending on House Prices and Sales Volume: A Tale of Two Types of Cities," The Journal of Real Estate Finance and Economics, Springer, vol. 72(2), pages 425-450, February.
    14. Brasington, David M. & Parent, Olivier, 2024. "Fire protection services and house prices: A regression discontinuity investigation," Regional Science and Urban Economics, Elsevier, vol. 105(C).
    15. Bedri Kamil Onur Tas, 2023. "Bunching below thresholds to manipulate public procurement," Empirical Economics, Springer, vol. 64(1), pages 303-319, January.
    16. Lee Myoung-Jae, 2017. "Regression Discontinuity with Errors in the Running Variable: Effect on Truthful Margin," Journal of Econometric Methods, De Gruyter, vol. 6(1), pages 1-8, January.
    17. Slotwinski, Michaela & Schmidheiny, Kurt, 2014. "Behavioral Responses to Local Tax Rates: Quasi-Experimental Evidence from a Foreigners Tax Scheme in Switzerland," VfS Annual Conference 2014 (Hamburg): Evidence-based Economic Policy 100292, Verein für Socialpolitik / German Economic Association.
    18. Chen, Wei-Lin & Lin, Ming-Jen & Yang, Tzu-Ting, 2023. "Curriculum and national identity: Evidence from the 1997 curriculum reform in Taiwan," Journal of Development Economics, Elsevier, vol. 163(C).
    19. Hsu, Yu-Chin & Shiu, Ji-Liang & Wan, Yuanyuan, 2024. "Testing identification conditions of LATE in fuzzy regression discontinuity designs," Journal of Econometrics, Elsevier, vol. 241(1).
    20. Kuo, Fang-Chang, 2024. "Shirking with good reputation? Evidence from hotel industry," International Journal of Industrial Organization, Elsevier, vol. 97(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2607.13564. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.