IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v51y2001i2d10.1023_a1012705818635.html

The editorial policies of scientific journals: Testing an impact factor model

Author

Listed:
  • Mario de Marchi

    (CNR-ISRDS)

  • Maurizio Rocchi

    (CNR-ISRDS)

Abstract

There is an evident need for the most scrupulous assessment possibleof the fruits of research (in the context considered here; namely, publications)with a qualitative, hence in-depth analysis of the single products of . Butthis would require time and competences which not all policy makers have attheir disposal. Hopefully, quantitative procedures, apparently objective andeasy to apply, would be able to surmount these difficulties. The diffusionof the quantitative evaluation of research is, that is, the policy makers'adaptive response to the need to increase controls of the efficiency of publicspending in since public investment clearly could not be determined at theoutset on the basis of the market's spontaneous, decentralised balancingmechanisms. An essential step towards the prevention of the distortions mostlikely to result from quantitative evaluation is the adoption of quantitativeprocedures of evaluation of the editorial policies of scientific journals– or, rather, of journals which claim to be scientific. Such proceduresmust be designed to highlight any distortions caused by the non-optimal editorialpolicies of journals. With quantitative evaluation, in fact, journals playa crucial role in the formation of public science policies. They thus haveto be subjected to specific monitoring to make sure that their conduct fitsin with the prerequisites necessary for them to perform their semi-officialactivity as certifiers of the quality of the products of research. The phenomenaof the production, divulgation and fruition of scientific discovery are, ofcourse, so complex that it is necessary to weigh them not with a single indicator,however helpful it may be, but with a constellation of indicators. We receivedconfirmation of the reliability of the impact factor as an instrument to monitorthe quality of research and as a means of evaluating the research itself.This is a reassuring result for the current formulation of public policiesand confirms the substantial honesty of the competition mechanisms of thescientific enterprise.

Suggested Citation

  • Mario de Marchi & Maurizio Rocchi, 2001. "The editorial policies of scientific journals: Testing an impact factor model," Scientometrics, Springer;Akadémiai Kiadó, vol. 51(2), pages 395-404, June.
    • Handle: RePEc:spr:scient:v:51:y:2001:i:2:d:10.1023_a:1012705818635
    DOI: 10.1023/A:1012705818635
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1023/A:1012705818635
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1023/A:1012705818635?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Helmut A. Abt, 2000. "Do Important Papers Produce High Citation Counts?," Scientometrics, Springer;Akadémiai Kiadó, vol. 48(1), pages 65-70, June.
    2. Albert, M. B. & Avery, D. & Narin, F. & McAllister, P., 1991. "Direct validation of citation counts as indicators of industrially important patents," Research Policy, Elsevier, vol. 20(3), pages 251-259, June.
    3. Moed, H. F. & Burger, W. J. M. & Frankfort, J. G. & Van Raan, A. F. J., 1985. "The use of bibliometric data for the measurement of university research performance," Research Policy, Elsevier, vol. 14(3), pages 131-149, June.
    4. Pavitt, Keith, 1998. "The inevitable limits of EU R&D funding," Research Policy, Elsevier, vol. 27(6), pages 559-568, September.
    5. Ana M. Ramírez & Esther O. García & J. Antonio Del Río, 2000. "Renormalized Impact Factor," Scientometrics, Springer;Akadémiai Kiadó, vol. 47(1), pages 3-9, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mansilla, R. & Köppen, E. & Cocho, G. & Miramontes, P., 2007. "On the behavior of journal impact factor rank-order distribution," Journal of Informetrics, Elsevier, vol. 1(2), pages 155-160.
    2. Si Shen & Ronald Rousseau & Dongbo Wang & Danhao Zhu & Huoyu Liu & Ruilun Liu, 2015. "Editorial delay and its relation to subsequent citations: the journals Nature, Science and Cell," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(3), pages 1867-1873, December.
    3. David I. Stern, 2013. "Uncertainty Measures for Economics Journal Impact Factors," Journal of Economic Literature, American Economic Association, vol. 51(1), pages 173-189, March.
    4. Mario Marchi & Edoardo Lorenzetti, 2016. "Measuring the impact of scholarly journals in the humanities field," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(1), pages 253-261, January.
    5. Xie, Yundong & Wu, Qiang & Wang, Yezhu & Hou, Li & Liu, Yuanyuan, 2024. "Does the handling time of scientific papers relate to their academic impact and social attention? Evidence from Nature, Science, and PNAS," Journal of Informetrics, Elsevier, vol. 18(2).
    6. Emanuela Reale & Anna Barbara & Antonio Costantini, 2006. "Peer review for the evaluation of the academic research: the Italian experience," CERIS Working Paper 200615, CNR-IRCrES Research Institute on Sustainable Economic Growth - Torino (TO) ITALY - former Institute for Economic Research on Firms and Growth - Moncalieri (TO) ITALY.
    7. M. Marchi & E. Lorenzetti, 2016. "Measuring the impact of journals, a reprise," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(2), pages 995-997, August.
    8. Eungi Kim, 2024. "Analyzing AI use policy in LIS: association with journal metrics and publisher volume," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(12), pages 7623-7644, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nils Omland, 2011. "Valuing Patents through Indicators," Chapters, in: Federico Munari & Raffaele Oriani (ed.), The Economic Valuation of Patents, chapter 7, Edward Elgar Publishing.
    2. M. Marchi & M. Rocchi, 1999. "Summing up approaches to the study of science and technology indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 46(1), pages 39-49, September.
    3. Domingo Docampo & Lawrence Cram, 2019. "Highly cited researchers: a moving target," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(3), pages 1011-1025, March.
    4. Daniel Torres-Salinas & Wenceslao Arroyo-Machado & Nicolas Robinson-Garcia, 2023. "Bibliometric denialism," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(9), pages 5357-5359, September.
    5. Jos� Lobo & Charlotta Mellander & Kevin Stolarick & Deborah Strumsky, 2014. "The Inventive, the Educated and the Creative: How Do They Affect Metropolitan Productivity?," Industry and Innovation, Taylor & Francis Journals, vol. 21(2), pages 155-177, February.
    6. Satoshi Yasukawa & Shingo Kano, 2014. "Validating the usefulness of examiners’ forward citations from the viewpoint of applicants’ self-selection during the patent application procedure," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(3), pages 895-909, June.
    7. Bradley, Wendy A. & Kolev, Julian, 2023. "How does digital piracy affect innovation? Evidence from software firms," Research Policy, Elsevier, vol. 52(3).
    8. repec:plo:pone00:0049156 is not listed on IDEAS
    9. Lorenzo Cassi & Anne Plunket, 2014. "Proximity, network formation and inventive performance: in search of the proximity paradox," The Annals of Regional Science, Springer;Western Regional Science Association, vol. 53(2), pages 395-422, September.
    10. Juranek, Steffen, 2018. "Investing in legal advice," Information Economics and Policy, Elsevier, vol. 44(C), pages 28-46.
    11. Javier Ruiz-Castillo, 2013. "The role of statistics in establishing the similarity of citation distributions in a static and a dynamic context," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(1), pages 173-181, July.
    12. Motchenkova, E.I. & Rus, O., 2011. "Research joint ventures and price collusion: Joint analysis of the impact of R&D subsidies and antitrust fines," Serie Research Memoranda 0025, VU University Amsterdam, Faculty of Economics, Business Administration and Econometrics.
    13. Guoqiang Liang & Haiyan Hou & Xiaodan Lou & Zhigang Hu, 2019. "Qualifying threshold of “take-off” stage for successfully disseminated creative ideas," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(3), pages 1193-1208, September.
    14. Lee, Changyong & Cho, Yangrae & Seol, Hyeonju & Park, Yongtae, 2012. "A stochastic patent citation analysis approach to assessing future technological impacts," Technological Forecasting and Social Change, Elsevier, vol. 79(1), pages 16-29.
    15. Amore, Mario Daniele & Schneider, Cédric & Žaldokas, Alminas, 2013. "Credit supply and corporate innovation," Journal of Financial Economics, Elsevier, vol. 109(3), pages 835-855.
    16. Sahar Araghi & Alfons Palangkaraya & Elizabeth Webster, 2024. "The impact of language translation quality on commerce: The example of patents," Journal of International Business Policy, Palgrave Macmillan, vol. 7(2), pages 224-246, June.
    17. Dar-Zen Chen & Wen-Yau Cathy Lin & Mu-Hsuan Huang, 2007. "Using Essential Patent Index and Essential Technological Strength to evaluate industrial technological innovation competitiveness," Scientometrics, Springer;Akadémiai Kiadó, vol. 71(1), pages 101-116, April.
    18. Viral V. Acharya & Krishnamurthy V. Subramanian, 2009. "Bankruptcy Codes and Innovation," The Review of Financial Studies, Society for Financial Studies, vol. 22(12), pages 4949-4988, December.
    19. Jaideep Shenoy, 2012. "An Examination of the Efficiency, Foreclosure, and Collusion Rationales for Vertical Takeovers," Management Science, INFORMS, vol. 58(8), pages 1482-1501, August.
    20. Moed, H. F. & Hesselink, F. Th., 1996. "The publication output and impact of academic chemistry research in the Netherlands during the 1980s: bibliometric analyses and policy implications," Research Policy, Elsevier, vol. 25(5), pages 819-836, August.
    21. Hannemann-Weber, Henrike & Kessel, Maura & Schultz, Carsten, 2012. "Research performance of centers of expertise for rare diseases—The influence of network integration, internal resource access and operational experience," Health Policy, Elsevier, vol. 105(2), pages 138-145.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:51:y:2001:i:2:d:10.1023_a:1012705818635. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.