Designing indicators for opening up evaluation. Insights from research assessment
Author
Abstract
Suggested Citation
DOI: 10.31219/osf.io/h2fxp
Download full text from publisher
References listed on IDEAS
- Grupp, Hariolf & Schubert, Torben, 2010. "Review and new evidence on composite innovation indicators for evaluating national performance," Research Policy, Elsevier, vol. 39(1), pages 67-78, February.
- Benedetto Lepori & Rémi Barré & Ghislaine Filliatreau, 2008. "New perspectives and challenges for the design and production of S&T indicators," Research Evaluation, Oxford University Press, vol. 17(1), pages 33-44, March.
- Irwin Feller, 2013. "Performance measures as forms of evidence for science and technology policy decisions," The Journal of Technology Transfer, Springer, vol. 38(5), pages 565-576, October.
- Diana Hicks, 1999. "The difficulty of achieving full coverage of international social science literature and the bibliometric consequences," Scientometrics, Springer;Akadémiai Kiadó, vol. 44(2), pages 193-215, February.
- Thed N. Van Leeuwen & Henk F. Moed & Robert J. W. Tijssen & Martijn S. Visser & Anthony F. J. Van Raan, 2001. "Language biases in the coverage of the Science Citation Index and its consequencesfor international comparisons of national research performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 51(1), pages 335-346, April.
- Cassidy R. Sugimoto & Sam Work & Vincent Larivière & Stefanie Haustein, 2017. "Scholarly use of social media and altmetrics: A review of the literature," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(9), pages 2037-2062, September.
- Ismael Ràfols, 2019. "S&T indicators in the wild: Contextualization and participation for responsible metrics," Research Evaluation, Oxford University Press, vol. 28(1), pages 7-22.
- Jean Lebel & Robert McLean, 2018. "A better measure of research from the global south," Nature, Nature, vol. 559(7712), pages 23-26, July.
- Grupp, Hariolf & Mogee, Mary Ellen, 2004. "Indicators for national science and technology policy: how robust are composite indicators?," Research Policy, Elsevier, vol. 33(9), pages 1373-1384, November.
- Martin, Ben R. & Irvine, John, 1993.
"Assessing basic research : Some partial indicators of scientific progress in radio astronomy,"
Research Policy, Elsevier, vol. 22(2), pages 106-106, April.
- Martin, Ben R. & Irvine, John, 1983. "Assessing basic research : Some partial indicators of scientific progress in radio astronomy," Research Policy, Elsevier, vol. 12(2), pages 61-90, April.
- Andy Stirling, 2012. "Opening Up the Politics of Knowledge and Power in Bioscience," PLOS Biology, Public Library of Science, vol. 10(1), pages 1-5, January.
- Rinze Benedictus & Frank Miedema & Mark W. J. Ferguson, 2016. "Fewer numbers, better science," Nature, Nature, vol. 538(7626), pages 453-455, October.
- Diana Hicks & Paul Wouters & Ludo Waltman & Sarah de Rijcke & Ismael Rafols, 2015. "Bibliometrics: The Leiden Manifesto for research metrics," Nature, Nature, vol. 520(7548), pages 429-431, April.
- Andy Stirling, 2010. "Keep it complex," Nature, Nature, vol. 468(7327), pages 1029-1031, December.
- Michel Zitt & Suzy Ramanana-Rahary & Elise Bassecoulard, 2005. "Relativity of citation performance and excellence measures: From cross-field to cross-scale effects of field-normalisation," Scientometrics, Springer;Akadémiai Kiadó, vol. 63(2), pages 373-401, April.
- Rafols, Ismael & Leydesdorff, Loet & O’Hare, Alice & Nightingale, Paul & Stirling, Andy, 2012.
"How journal rankings can suppress interdisciplinary research: A comparison between Innovation Studies and Business & Management,"
Research Policy, Elsevier, vol. 41(7), pages 1262-1282.
- Ismael Rafols & Loet Leydesdorff & Alice O'Hare & Paul Nightingale & Andy Stirling, 2011. "How Journal Rankings can suppress Interdisciplinary Research – A Comparison between Innovation Studies and Business & Management," DRUID Working Papers 11-05, DRUID, Copenhagen Business School, Department of Industrial Economics and Strategy/Aalborg University, Department of Business Studies.
- Sarah de Rijcke & Paul F. Wouters & Alex D. Rushforth & Thomas P. Franssen & Björn Hammarfelt, 2016. "Evaluation practices and effects of indicator use—a literature review," Research Evaluation, Oxford University Press, vol. 25(2), pages 161-169.
- David Roessner, 2000. "Quantitative and qualitative methods and measures in the evaluation of research," Research Evaluation, Oxford University Press, vol. 9(2), pages 125-132, August.
- Chavarro, Diego & Tang, Puay & Ràfols, Ismael, 2017.
"Why researchers publish in non-mainstream journals: Training, knowledge bridging, and gap filling,"
Research Policy, Elsevier, vol. 46(9), pages 1666-1680.
- Diego Chavarro & Puay Tang & Ismael Rafols, 2016. "Why researchers publish in non-mainstream journals: Training, knowledge bridging, and gap filling," SPRU Working Paper Series 2016-22, SPRU - Science Policy Research Unit, University of Sussex Business School.
- Anthony F. J. van Raan, 2005. "Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods," Scientometrics, Springer;Akadémiai Kiadó, vol. 62(1), pages 133-143, January.
- Hicks, Diana, 2012. "Performance-based university research funding systems," Research Policy, Elsevier, vol. 41(2), pages 251-261.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
Cited by:
- Rafols, Ismael & Noyons, Ed & Confraria, Hugo & Ciarli, Tommaso, 2021. "Visualising plural mappings of science for Sustainable Development Goals (SDGs)," SocArXiv yfqbd, Center for Open Science.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Rafols, Ismael & Leydesdorff, Loet & O’Hare, Alice & Nightingale, Paul & Stirling, Andy, 2012.
"How journal rankings can suppress interdisciplinary research: A comparison between Innovation Studies and Business & Management,"
Research Policy, Elsevier, vol. 41(7), pages 1262-1282.
- Ismael Rafols & Loet Leydesdorff & Alice O'Hare & Paul Nightingale & Andy Stirling, 2011. "How Journal Rankings can suppress Interdisciplinary Research – A Comparison between Innovation Studies and Business & Management," DRUID Working Papers 11-05, DRUID, Copenhagen Business School, Department of Industrial Economics and Strategy/Aalborg University, Department of Business Studies.
- Giovanni Abramo & Ciriaco Andrea D’Angelo & Myroslava Hladchenko, 2023. "Assessing the effects of publication requirements for professorship on research performance and publishing behaviour of Ukrainian academics," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4589-4609, August.
- David A. Pendlebury, 2019. "Charting a path between the simple and the false and the complex and unusable: Review of Henk F. Moed, Applied Evaluative Informetrics [in the series Qualitative and Quantitative Analysis of Scientifi," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(1), pages 549-560, April.
- Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
- Berlemann, Michael & Haucap, Justus, 2015. "Which factors drive the decision to opt out of individual research rankings? An empirical study of academic resistance to change," Research Policy, Elsevier, vol. 44(5), pages 1108-1115.
- Domingo Docampo & Lawrence Cram, 2019. "Highly cited researchers: a moving target," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(3), pages 1011-1025, March.
- Eugenio Petrovich, 2022. "Bibliometrics in Press. Representations and uses of bibliometric indicators in the Italian daily newspapers," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(5), pages 2195-2233, May.
- Bertocchi, Graziella & Gambardella, Alfonso & Jappelli, Tullio & Nappi, Carmela A. & Peracchi, Franco, 2015.
"Bibliometric evaluation vs. informed peer review: Evidence from Italy,"
Research Policy, Elsevier, vol. 44(2), pages 451-466.
- Bertocchi, Graziella & Gambardella, Alfonso & Jappelli, Tullio & Nappi, Carmela A. & Peracchi, Franco, 2013. "Bibliometric Evaluation vs. Informed Peer Review: Evidence from Italy," IZA Discussion Papers 7739, Institute of Labor Economics (IZA).
- Graziella Bertocchi & Alfonso Gambardella & Tullio Jappelli & Carmela A. Nappi & Franco Peracchi, 2013. "Bibliometric Evaluation vs. Informed Peer Review: Evidence from Italy," Department of Economics (DEMB) 0020, University of Modena and Reggio Emilia, Department of Economics "Marco Biagi".
- Graziella Bertocchi & Alfonso Gambardella & Tullio Jappelli & Carmela A. Nappi & Franco Peracchi, 2013. "Bibliometric Evaluation vs. Informed Peer Review: Evidence from Italy," CSEF Working Papers 344, Centre for Studies in Economics and Finance (CSEF), University of Naples, Italy.
- Graziella Bertocchi & Alfonso Gambardella & Tullio Jappelli & Carmela A. Nappi & Franco Peracchi, 2013. "Bibliometric Evaluation vs. Informed Peer Review: Evidence from Italy," Center for Economic Research (RECent) 093, University of Modena and Reggio E., Dept. of Economics "Marco Biagi".
- Jappelli, Tullio & Peracchi, Franco & Bertocchi, Graziella & Gambardella, Alfonso & Nappi, Carmela A, 2013. "Bibliometric Evaluation vs. Informed Peer Review: Evidence from Italy," CEPR Discussion Papers 9724, C.E.P.R. Discussion Papers.
- Mingers, John & Yang, Liying, 2017. "Evaluating journal quality: A review of journal citation indicators and ranking in business and management," European Journal of Operational Research, Elsevier, vol. 257(1), pages 323-337.
- van den Besselaar, Peter & Heyman, Ulf & Sandström, Ulf, 2017. "Perverse effects of output-based research funding? Butler’s Australian case revisited," Journal of Informetrics, Elsevier, vol. 11(3), pages 905-918.
- Bar-Ilan, Judit, 2008. "Informetrics at the beginning of the 21st century—A review," Journal of Informetrics, Elsevier, vol. 2(1), pages 1-52.
- Lutz Bornmann & Julian N. Marewski, 2019. "Heuristics as conceptual lens for understanding and studying the usage of bibliometrics in research evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(2), pages 419-459, August.
- Kulczycki, Emanuel & Korzeń, Marcin & Korytkowski, Przemysław, 2017. "Toward an excellence-based research funding system: Evidence from Poland," Journal of Informetrics, Elsevier, vol. 11(1), pages 282-298.
- Jan Schulz, 2016. "Using Monte Carlo simulations to assess the impact of author name disambiguation quality on different bibliometric analyses," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(3), pages 1283-1298, June.
- Shibayama, Sotaro & Baba, Yasunori, 2015. "Impact-oriented science policies and scientific publication practices: The case of life sciences in Japan," Research Policy, Elsevier, vol. 44(4), pages 936-950.
- Nicky Agate & Rebecca Kennison & Stacy Konkiel & Christopher P. Long & Jason Rhody & Simone Sacchi & Penelope Weber, 2020. "The transformative power of values-enacted scholarship," Palgrave Communications, Palgrave Macmillan, vol. 7(1), pages 1-12, December.
- Alessandro Margherita & Gianluca Elia & Claudio Petti, 2022. "What Is Quality in Research? Building a Framework of Design, Process and Impact Attributes and Evaluation Perspectives," Sustainability, MDPI, vol. 14(5), pages 1-18, March.
- Chavarro, Diego & Tang, Puay & Ràfols, Ismael, 2017.
"Why researchers publish in non-mainstream journals: Training, knowledge bridging, and gap filling,"
Research Policy, Elsevier, vol. 46(9), pages 1666-1680.
- Diego Chavarro & Puay Tang & Ismael Rafols, 2016. "Why researchers publish in non-mainstream journals: Training, knowledge bridging, and gap filling," SPRU Working Paper Series 2016-22, SPRU - Science Policy Research Unit, University of Sussex Business School.
- Dag W. Aksnes & Liv Langfeldt & Paul Wouters, 2019. "Citations, Citation Indicators, and Research Quality: An Overview of Basic Concepts and Theories," SAGE Open, , vol. 9(1), pages 21582440198, February.
- Benedetto Lepori & Aldo Geuna & Antonietta Mira, 2019. "Scientific output scales with resources. A comparison of US and European universities," PLOS ONE, Public Library of Science, vol. 14(10), pages 1-18, October.
Corrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:socarx:h2fxp. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://arabixiv.org .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.