IDEAS home Printed from https://ideas.repec.org/p/hal/wpaper/hal-05676773.html

When can bibliometric evidence be trusted? Developing a conditional robustness theory for research evaluation in business research
[Quand peut-on faire confiance aux données bibliométriques ? Développement d’une théorie de la robustesse contingente pour l'évaluation de la recherche en sciences de gestion]

Author

Listed:
  • Kaïs Ferjani

    (UMA - Université de la Manouba [Tunisie])

  • Chokri Slim

    (UMA - Université de la Manouba [Tunisie])

Abstract

Bibliometrics has become one of the most widely used tools in management and accounting research, yet the method that measures scholarly impact is rarely asked to justify its own statistical footing. This paper turns the bibliometric lens on bibliometrics itself. Drawing on a Scopus and Web of Science corpus assembled through a PRISMA-guided identification and screening process (6,144 unique records, 763 retained at the eligibility stage), we combine science mapping (co-word analysis, thematic mapping and thematic evolution, co-citation analysis and a historiographic map) with a systematic reading of the 57 most influential works in the field to ask a single question: is bibliometrics a statistically robust and econometrically reliable research method, and why do some journals and researchers accept it while others do not? We find that the field's own most-cited literature is dominated by critical and nuanced positions (33 of 57 works) rather than unconditional endorsement (8 of 57), converging instead on a small set of recurring validity threats spanning data coverage, indicator construction, citer behaviour and research governance. From this evidence we develop the Contingent Theory of Bibliometric Robustness, which reframes bibliometric robustness not as an inherent property of citation counts but as an achievement that depends on triangulation with peer judgement, field normalisation, transparent construction rules and adequate sample scale. We discuss the implications of this model for research evaluation in accounting, finance and management, where journal-ranking lists such as the ABS Academic Journal Guide, the ABDC list and the Financial Times 50 sit at the exact intersection of indicator construction and institutional governance, and we close with a nine-point research agenda derived directly from the threats identified.

Suggested Citation

  • Kaïs Ferjani & Chokri Slim, 2026. "When can bibliometric evidence be trusted? Developing a conditional robustness theory for research evaluation in business research [Quand peut-on faire confiance aux données bibliométriques ? Développement d’une théorie de la robustesse contingent," Working Papers hal-05676773, HAL.
  • Handle: RePEc:hal:wpaper:hal-05676773
    Note: View the original document on HAL open archive server: https://hal.science/hal-05676773v2
    as

    Download full text from publisher

    File URL: https://hal.science/hal-05676773v2/document
    Download Restriction: no
    ---><---

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:wpaper:hal-05676773. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CCSD (email available below). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.