IDEAS home Printed from https://ideas.repec.org/p/usi/wpaper/527.html
   My bibliography  Save this paper

L’ “R-Factor”: un nuovo modo di valutare la ricerca scientifica

Author

Listed:
  • Marco p. Tucci
  • Sandra Fontani
  • Silvia Ferrini

Abstract

As pointed out in Amin e Mabe (2000, p. 1), the journal impact factor (IF) “has moved in recent years from an obscure bibliometric indicator to become the chief quantitative measure of the quality of a journal, its research papers, the researchers who wrote those papers, and even the institution they work in.” However, the use of this index for evaluating individual scientists is dubious and may “skew the course of scientific research” (Monastersky, 2005, p, 1). Moreover the IF is, at most, able to measure only the quality of a very restricted range of research activities: namely, publishing journal articles. In the present work a new indicator of a researcher quality, named the Researcher Impact Factor (RF), is introduced. It is constructed as a function of the number and quality of publications (articles, books and working papers) and of the “other activities” usually associated with being a researcher (attending and/or organizing conferences, being the Editor, Associate Editor or referee for a journal, teaching or supervising at graduate level, coordinating research groups and so on). To show the characteristics of the new index, a numerical example is carried out to rank two hypothetical scientists. The main conclusion is that by replacing the IF with the RF in hiring, tenure decisions and awarding of grants would greatly increase the number of topics investigated and the number and quality of long run projects. The Excel spreadsheet used for the computations is available on demand from the authors.

Suggested Citation

  • Marco p. Tucci & Sandra Fontani & Silvia Ferrini, 2008. "L’ “R-Factor”: un nuovo modo di valutare la ricerca scientifica," Department of Economics University of Siena 527, Department of Economics, University of Siena.
  • Handle: RePEc:usi:wpaper:527
    as

    Download full text from publisher

    File URL: http://repec.deps.unisi.it/quaderni/527.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Martin Davies & Joe Hirschberg & Jenny Lye & Carol Johnston & Ian Mcdonald, 2007. "Systematic Influences On Teaching Evaluations: The Case For Caution," Australian Economic Papers, Wiley Blackwell, vol. 46(1), pages 18-38, March.
    2. Stigler, George J & Stigler, Stephen M & Friedland, Claire, 1995. "The Journals of Economics," Journal of Political Economy, University of Chicago Press, vol. 103(2), pages 331-359, April.
    3. Maria Cristina Marcuzzo & Giulia Zacchia, 2007. "L'ECONLIT e gli strumenti per la valutazione della ricerca economica in Italia," Rivista italiana degli economisti, Società editrice il Mulino, issue 2, pages 277-306.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Silvia Ferrini & Marco P. Tucci, 2011. "Evaluating Research Activity:Impact Factor vs. Research Factor," Department of Economics University of Siena 614, Department of Economics, University of Siena.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Silvia Ferrini & Marco P. Tucci, 2011. "Evaluating Research Activity:Impact Factor vs. Research Factor," Department of Economics University of Siena 614, Department of Economics, University of Siena.
    2. Ignacio Palacios-Huerta & Oscar Volij, 2004. "The Measurement of Intellectual Influence," Econometrica, Econometric Society, vol. 72(3), pages 963-977, May.
    3. Nadia Fernández-de-Pinedo & Alvaro La Parra-Perez & Félix-Fernando Muñoz, 2023. "Recent trends in publications of economic historians in Europe and North America (1980–2019): an empirical analysis," Cliometrica, Springer;Cliometric Society (Association Francaise de Cliométrie), vol. 17(1), pages 1-22, January.
    4. Jinyoung Kim & Kanghyock Koh, 2014. "Incentives for Journal Editors," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 47(1), pages 348-371, February.
    5. Florentin Gloetzl & Ernest Aigner, 2015. "Pluralism in the Market of Science? A citation network analysis of economic research at universities in Vienna," Ecological Economics Papers ieep5, Institute of Ecological Economics.
    6. Besancenot, Damien & Vranceanu, Radu, 2008. "Can incentives for research harm research? A business schools' tale," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 37(3), pages 1248-1265, June.
    7. Antonio García-Romero & Daniel Santín & Gabriela Sicilia, 2016. "Another brick in the wall: a new ranking of academic journals in Economics using FDH," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(1), pages 91-101, April.
    8. Thiago Dumont Oliveira & Marwil J. Dávila-Fernández, 2020. "From modelmania to datanomics? The rise of mathematical and quantitative methods in three top economics journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(1), pages 51-70, April.
    9. Kocher, Martin G. & Luptacik, Mikulas & Sutter, Matthias, 2006. "Measuring productivity of research in economics: A cross-country study using DEA," Socio-Economic Planning Sciences, Elsevier, vol. 40(4), pages 314-332, December.
    10. Cristiano Varin & Manuela Cattelan & David Firth, 2016. "Statistical modelling of citation exchange between statistics journals," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 179(1), pages 1-63, January.
    11. Kalaitzidakis, Pantelis & Mamuneas, Theofanis P. & Stengos, Thanasis, 1999. "European economics: An analysis based on publications in the core journals," European Economic Review, Elsevier, vol. 43(4-6), pages 1150-1168, April.
    12. Bruno S. Frey & Katja Rost, 2010. "Do rankings reflect research quality?," Journal of Applied Economics, Universidad del CEMA, vol. 13, pages 1-38, May.
    13. Kim‐Sau Chung & Meng‐Yu Liang & Melody Lo, 2022. "On the information contents of indirect citations," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 55(1), pages 156-173, February.
    14. Klaus Ritzberger, 2008. "Eine invariante Bewertung wirtschaftswissenschaftlicher Fachzeitschriften," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 9(3), pages 267-285, August.
    15. De Witte, Kristof & Rogge, Nicky, 2011. "Accounting for exogenous influences in performance evaluations of teachers," Economics of Education Review, Elsevier, vol. 30(4), pages 641-653, August.
    16. Monacciani, Fabiana, 2010. "University departments evaluation: a multivariate approach," MPRA Paper 24224, University Library of Munich, Germany.
    17. Pierre-Philippe Combes & Laurent Linnemer, 2003. "L'impact international des articles de recherche français en économie," Revue économique, Presses de Sciences-Po, vol. 54(1), pages 181-217.
    18. Rieger, Matthias & Voorvelt, Katherine, 2016. "Gender, ethnicity and teaching evaluations: Evidence from mixed teaching teamsAuthor-Name: Wagner, Natascha," Economics of Education Review, Elsevier, vol. 54(C), pages 79-94.
    19. Kocher, Martin G & Sutter, Matthias, 2001. "The Institutional Concentration of Authors in Top Journals of Economics during the Last Two Decades," Economic Journal, Royal Economic Society, vol. 111(472), pages 405-421, June.
    20. Fontana, Magda & Iori, Martina & Leone Sciabolazza, Valerio & Souza, Daniel, 2022. "The interdisciplinarity dilemma: Public versus private interests," Research Policy, Elsevier, vol. 51(7).

    More about this item

    Keywords

    Impact factor; bibliometric indices; research evaluation; researcher impact factor;
    All these keywords.

    JEL classification:

    • A11 - General Economics and Teaching - - General Economics - - - Role of Economics; Role of Economists
    • A12 - General Economics and Teaching - - General Economics - - - Relation of Economics to Other Disciplines

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:usi:wpaper:527. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Fabrizio Becatti (email available below). General contact details of provider: https://edirc.repec.org/data/desieit.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.