Content
2023, Volume 32, Issue 1
- 1-1 Voices from the field
by Julia Melkers & Emanuela Reale & Thed van Leeuwen - 2-3 Tilting at twin windmills: On article quotas and journal impact factors
by Joseph E Serafy - 4-18 When publication metrics become the fetish: The research evaluation systems’ relationship with academic work engagement and burnout
by Konrad Kulikowski & Sylwia Przytuła & Łukasz Sułkowski - 19-31 Evaluation of the arts in performance-based research funding systems: An international perspective
by Kamila Lewandowska & Emanuel Kulczycki & Michael Ochsner - 32-46 The footprint of a metrics-based research evaluation system on Spain’s philosophical scholarship: An analysis of researchers’ perceptions
by Ramón A Feenstra & Emilio Delgado López-Cózar - 47-57 The impact of Italian performance-based research funding systems on the intensity of international research collaboration
by Giovanni Abramo & Ciriaco Andrea D’Angelo - 58-69 S&T resource allocation considering both performance and potential: The case of Chinese research institutes
by Teng-Yu Zhao| & Ruimin Pei & Guo-Liang Yang - 70-85 Quis judicabit ipsos judices? A case study on the dynamics of competitive funding panel evaluations
by João M Santos - 86-100 Peer review in funding-by-lottery: A systematic overview and expansion
by Jamie Shaw - 101-115 What makes databases tick: Logics that underpin national databases for research output in Europe
by Linda Sīle & Sarah de Rijcke - 116-127 Research governance and the dynamics of science: A framework for the study of governance effects on research fields
by Maria Nedeva & Mayra M Tirado & Duncan A Thomas - 128-143 Toward a modular evaluation approach of real-world laboratories: Findings from a literature review
by Teresa Kampfmann & Philip Bernert & Daniel J Lang - 144-156 Explaining employment sector choices of doctoral graduates in Germany
by Lea Goldan & Steffen Jaksztat & Christiane Gross - 157-169 Globalization of scientific communication: Evidence from authors in academic journals by country of origin
by Vít Macháček
2022, Volume 31, Issue 3
- 289-296 Research calls, competition for funding and inefficiency
by António Osório & Lutz Bornmann - 297-310 The funding and research trends in library and information science of NSSFC: Comparison of awards and papers
by Jianqin Xiang & Haiyan Wang - 311-320 Enriching research quality: A proposition for stakeholder heterogeneity
by Thomas Franssen - 321-325 Automated citation recommendation tools encourage questionable citations
by Serge P J M Horbach & Freek J W Oude Maatman & Willem Halffman & Wytske M Hepkema - 326-343 Pathways for assessing interdisciplinarity: A systematic review
by Bethany K Laursen & Nicole Motzer & Kelly J Anderson - 344-354 Interdisciplinary research and policy impacts: Assessing the significance of knowledge coproduction
by Luisa Veras de Sandes-Guimarães & Raquel Velho & Guilherme Ary Plonski - 355-371 Valorization of transdisciplinary research: An evaluation approach and empirical illustration
by Stefania Munaretto & Caro E Mooren & Laurens K Hessels - 372-384 University policy engagement bodies in the UK and the variable meanings of and approaches to impact
by Hannah Durrant & Eleanor MacKillop - 385-409 Under pressure: The extent and distribution of perceived pressure among scientists in Germany, Austria, and Switzerland
by David Johann & Isabel J Raabe & Heiko Rauhut - 410-422 Creating evaluative homogeneity: Experience of constructing a national journal ranking
by Jakub Krzeski & Krystian Szadkowski & Emanuel Kulczycki
2022, Volume 31, Issue 2
- 173-187 Assessing research excellence: Evaluating the Research Excellence Framework
by Mehmet Pinar & Timothy J Horne - 188-201 Key factors affecting the promotion of researchers of the Argentine Scientific and Technical Research Council (CONICET)
by MarÃa Guillermina D'Onofrio & Juan D Rogers - 202-213 Societal targeting in researcher funding: An exploratory approach
by Irene Ramos-Vielba & Duncan A Thomas & Kaare Aagaard - 214-225 The epistemic, production, and accountability prospects of social impact: An analysis of strategic research proposals
by Juha-Pekka Lauronen - 226-235 Does R&D tax credit impact firm behaviour? Micro evidence for Portugal
by Alexandre Paredes & Joana Mendonça & Fernando Bação & Bruno Damásio - 236-248 Does monitoring performance act as an incentive for improving research performance? National and organizational level analysis of Finnish universities
by Laura Himanen & Hanna-Mari Puuska - 249-256 Evaluating the Revised National Institutes of Health clinical trial definition impact on recruitment progress
by Eugene I KaneIII & Gail L Daumit & Kevin M Fain & Roberta W Scherer & Emma Elizabeth McGinty - 257-270 Predicting funded research project performance based on machine learning
by Hoon Jang - 271-287 A participatory approach to tracking system transformation in clusters and innovation ecosystems—Evolving practice in Sweden’s Vinnväxt programme
by Emily Wise & Moa Eklund & Madeline Smith & James Wilson
2022, Volume 31, Issue 1
- 1-14 Self-made university rankings: Categorization tactics and communication activism in Italian universities
[Factors Contributing to University Image. The Postgraduate Students’ Point of View]
by Andrea Bonaccorsi & Paola Belingheri & Brigida Blasi & Sandra Romagnosi - 15-23 Fraud, specialization, and efficiency in peer review
[A Theory of Fraud and Overtreatment in Experts Markets]
by J A Garcia & Rosa Rodriguez-Sanchez & J Fdez-Valdivia - 24-48 A Research Pathway Model for evaluating the implementation of practice-based research: The case of self-management health innovations
[Self-Management Approaches for People with Chronic Conditions: A Review]
by Wilke van Beest & Wouter P C Boon & Daan Andriessen & Harald Pol & Gerrita van der Veen & Ellen H M Moors - 49-60 Evaluation of rice research: An alternate method to capture outcomes
[Rainfed Rice Production Systems in Eastern India: An on-Farm Diagnosis and Policy Alternatives’ – A]
by Parshuram Samal & Biswajit Mondal & Nitiprasad N Jambhulkar & Onkar N Singh & Ramlakhan Verma & Sushant K Dash & Anup K Das & Himanshu Pathak - 61-79 Using the catastrophe theory to discover transformative research topics
[Nonlinear Analysis: Catastrophe Theory Modeling and Cobb’s Cusp Surface Analysis Program]
by Haiyun Xu & Jos Winnink & Huawei Wu & Hongshen Pang & Chao Wang - 80-92 Research evaluations for an energy transition? Insights from a review of Swedish research evaluation reports
[Defining and Assessing Research Quality in a Transdisciplinary Context]
by Sofie Sandin & Mats Benner - 93-103 The Corona-Eye: Exploring the risks of COVID-19 on fair assessments of impact for REF2021
[ISRIA Statement: Ten-Point Guidelines for an Effective Process of Research Impact Assessment]
by Gemma E Derrick & Julie Bayley - 104-117 Do peers share the same criteria for assessing grant applications?
[Estimating the Association between Latent Class Membership and External Variables Using Bias-Adjusted Three-Step Approaches]
by Sven E Hug & Michael Ochsner - 118-131 Measuring societal impact of research—Developing and validating an impact instrument for occupational health and safety
[Can Beliefs about Musculoskeletal Pain and Work Be Changed at the National Level? Prospective Evaluation of the Danish National Job & Body Campaign]
by Ole Henning Sørensen & Jakob Bjørner & Andreas Holtermann & Johnny Dyreborg & Jorid Birkelund Sørli & Jesper Kristiansen & Steffen Bohni Nielsen - 132-144 Beyond bean counting: Is the policy effective for the innovation efficiency of wind power industry in China?
[Do Financial Constraints Moderate the Relationship between Innovation Subsidies and Firms’ R&D Investment]
by Zihao Jiang & Jiarong Shi & Zhiying Liu & Lei Gong - 145-158 Capabilities for transdisciplinary research
[Why the Capability Approach?]
by Cian O’Donovan & Aleksandra (Ola) Michalec & Joshua R Moon - 159-172 Documenting development of interdisciplinary collaboration among researchers by visualizing connections
[Academic-Practitioner Collaboration in Management Research: A Case of Cross-Profession Collaboration]
by Linden E Higgins & Julia M Smith
2021, Volume 30, Issue 4
- 421-430 Researcher experiences in practice-based interdisciplinary research
[Imagining Autism: Feasibility and Impact of a Drama-Based Intervention on the Social Communicative and Imaginative Behaviour of Children with Autism]
by Jennifer Leigh & Nicole Brown - 431-442 A formative approach to the evaluation of Transformative Innovation Policies
[The Need for Reflexive Evaluation Approaches in Development Cooperation]
by Jordi Molas-Gallart & Alejandra Boni & Sandro Giachi & Johan Schot - 443-457 Exploring research impact models: A systematic scoping review
[AsseCssment of the Impact of a Clinical and Health Services Research Call in Catalonia]
by Maryam Razmgir & Sirous Panahi & Leila Ghalichi & Seyed Ali Javad Mousavi & Shahram Sedghi - 458-469 Looking for evidence of research impact and use: A qualitative study of an Australian research-policy system
[Public Social Policy Development and Implementation: A Case Study of the Ghana National Health Insurance Scheme]
by Robyn S. Newson & Lucie Rychetnik & Lesley King & Andrew J. Milat & Adrian E. Bauman - 470-483 Profile of authors publishing in ‘predatory’ journals and causal factors behind their decision: A systematic review
[Understanding of Medical Students about Predatory Journals: A Comparative Study from KSA and New Zealand]
by Sefika Mertkan & Gulen Onurkan Aliusta & Nilgun Suphi - 484-499 Systematizing societal effects of transdisciplinary research
[‚Wirkungen in Der Partizipativen Gesundheitsforschung: Eine Einordnung in Die Diskurse Zum Forschungsimpact]
by Martina Schäfer & Matthias Bergmann & Lena Theiler - 500-513 Self-evaluating participatory research projects: A content validation of the InSPIRES online impact evaluation tool
[Content Validity and Reliability of Single Items or Questionnaires]
by Florence Gignac & Anne-Sophie Gresle & Valeria Santoro Lamelas & Montserrat Yepes-Baldó & Leonardo de la Torre & Maria-Jesus Pinazo & the InSPIRES Consortium - 514-528 The different responses of universities to introduction of performance-based research funding
[How Incentives Trickle down: Local Use of a National Bibliometric Indicator System]
by Giovanni Abramo & Ciriaco Andrea D’Angelo - 529-539 It takes two to tango: Examining productive interactions in urban research collaboration
[Generating Research Questions through Problematization]
by Helka Kalliomäki & Sampo Ruoppila & Jenni Airaksinen - 540-551 Teachers conceptualizing and developing assessment for skill development: Trialing a maker assessment framework
[A Brief History of Inquiry: From Dewey to Standards]
by Jennifer Lock & Sandra Becker & Petrea Redmond - 552-562 Being a female academic under neoliberal evaluation: A systematic review
[I Want to Be Both but Is That Possible?”: Communicating Mother-Scholar Uncertainty during Doctoral Candidacy]
by Javier Mula-Flacón & Cristina Cruz-González & Jesús Domingo Segovia & Carmen Lucena Rodríguez - 563-571 Evidence of research mastery: How applicants argue the feasibility of their research projects
[Concepts of originality in the natural science, medical, and engineering disciplines: An analysis of research proposals, Science, Technology]
by Eva Barlösius & Kristina Blem
2021, Volume 30, Issue 3
- 231-239 No time for that now! Qualitative changes in manuscript peer review during the Covid-19 pandemic
[COVID-19 Medical Papers Have Fewer Women First Authors than Expected]
by Serge P J M Horbach - 240-255 Does government support of a few leading universities have a broader impact on the higher education system? Evaluation of the Russian University Excellence Initiative
[The Costs and Benefits of World-Class Universities]
by Andrey Lovakov & Anna Panova & Ivan Sterligov & Maria Yudkevich - 256-268 On the relationship between interdisciplinarity and impact: Distinct effects on academic and broader impact
[A Comparison of Two Approaches for Measuring Interdisciplinary Research Output: The Disciplinary Diversity of Authors vs the Disciplinary Diversity of the Reference List]
by Lin Zhang & Beibei Sun & Lidan Jiang & Ying Huang - 269-289 SSH researchers make an impact differently. Looking at public research from the perspective of users
[ISRIA Statement. Ten Point Guidelines for an Effective Process of Research Impact Assessment]
by Andrea Bonaccorsi & Filippo Chiarello & Gualtiero Fantoni - 290-313 Estimating the effects of public subsidies on the performance of supported enterprises across firm sizes
[Implementing Matching Estimators for Average Treatment Effects in Stata]
by Ondřej Dvouletý & Ivana Blažková & Oto Potluka - 314-322 An exploration of referees’ comments published in open peer review journals: The characteristics of review language and the association between review scrutiny and citations
[Peer Review for Journals: Evidence on Quality Control, Fairness, and Innovation]
by Dietmar Wolfram & Peiling Wang & Fuad Abuzahra - 323-335 The production of scientific and societal value in research evaluation: a review of societal impact assessment methods
[Systems Thinking, Knowledge and Action: Towards Better Models and Methods]
by Jorrit P Smit & Laurens K Hessels - 336-348 The systemic approach as an instrument to evaluate higher education systems: Opportunities and challenges
[Benchmarking Universities’ Efficiency Indicators in the Presence of Internal Heterogeneity]
by Juan Aparicio & Dorys Yaneth Rodríguez & Jon Mikel Zabala-Iturriagagoitia - 349-360 Does reviewing experience reduce disagreement in proposals evaluation? Insights from Marie Skłodowska-Curie and COST Actions
[Peer Review of Grant Applications: Criteria Used and Qualitative Study of Reviewer Practices]
by Marco Seeber & Jef Vlegels & Elwin Reimink & Ana Marušić & David G Pina - 361-369 How far does an emphasis on stakeholder engagement and co-production in research present a threat to academic identity and autonomy? A prospective study across five European countries
[Systems Thinking, Knowledge and Action: Towards Better Models and Methods]
by Annette Boaz & Robert Borst & Maarten Kok & Alison O’Shea - 370-381 ‘Scaling’ the academia: Perspectives of academics on the impact of their practices
[Comparing University Rankings’]
by Yasar Kondakci & Merve Zayim-Kurtay & Sevgi Kaya-Kasikci & Hanife Hilal Senay & Busra Kulakoglu - 382-392 Say my name, say my name: Academic authorship conventions between editorial policies and disciplinary practices
[Rethinking Authorship in the Era of Collaborative Research]
by Felicitas Hesselmann & Cornelia Schendzielorz & Nikita Sorgatz - 393-404 Research and the real world: Analyzing the short- and long-term impact of knowledge transfer
[ISRIA Statement: Ten-Point Guidelines for an Effective Process of Research Impact Assessment]
by Katherine Caves & Sarah Lueling - 405-419 Journal citation reports and the definition of a predatory journal: The case of the Multidisciplinary Digital Publishing Institute (MDPI)
[Plagiarism and Predatory Journals: A Threat to Scientific Integrity]
by M Ángeles Oviedo-García - 420-420 Expression of concern: Journal citation reports and the definition of a predatory journal: The case of the Multidisciplinary Digital Publishing Institute (MDPI)
by M Ángeles Oviedo-García
2021, Volume 30, Issue 2
- 141-153 The use of an impact framework to evaluate the impact of research on policy and practice: Screening questionnaires for intellectual disability
by Karen McKenzie & Aja Murray & George Murray & Rachel Martin - 154-168 Understanding and evaluating the impact of integrated problem-oriented research programmes: Concepts and considerations
by Brian M Belcher & Karl Hughes - 169-178 Gathering evidence of impact from research support services: Examining impact in the context of the Centre for Environmental Data Analysis
by Poppy Townsend & Clare Wilkinson - 179-190 Understanding collaborative interactions in relation to research impact in social sciences and humanities: A meta-ethnography
by Alexis Dewaele & Kristof Vandael & Stefan Meysman & Ann Buysse - 191-200 Transformative academic institutions: An experimental framework for understanding regional impacts of research
by María José Aranguren & Patricia Canto-Farachala & James R Wilson - 201-214 The program and policy change framework: A new tool to measure research use in low- and middle-income countries
by Karen Fowle & Brent Wells & Melissa Day & Anjali Kumar & Cameron Bess & Brian Bingham & Annica Wayman - 215-229 Proposed methodology for measuring the effectiveness of policies designed to further research
by Núria Bautista-Puig & Luis Moreno Lorente & Elías Sanz-Casado
2021, Volume 30, Issue 1
- 1-12 What are the social and scientific benefits of participating at academic conferences? Insights from a survey among doctoral students and postdocs in Germany
[Postdoctoral Researchers: Roles, Functions and Career Prospects]
by Kalle Hauss - 13-25 The effect of facilitating interdisciplinary cooperation on the research productivity of university research teams: The moderating role of government assistance
[Defining Interdisciplinary Research: Conclusions from a Critical Review of the Literature]
by Aihua Chen & Xiaoting Wang - 26-38 Evaluating socially engaged climate research: Scientists’ visions of a climate resilient U.S. Southwest
[A How-to Guide for Coproduction of Actionable Science]
by Gigi Owen - 39-50 Transdisciplinary research outcomes based on the Transdisciplinary Research on Energetics and Cancer II initiative experience
[Addressing Social Determinants of Health and Health Inequalities]
by Sarah D Hohl & Sarah Knerr & Sarah Gehlert & Marian L Neuhouser & Shirley A A Beresford & Joseph M Unger & Paul A Fishman & Beti Thompson - 51-56 Quantifying the contributions technicians make to research
[‘How Can We Ensure Visibility and Diversity in Research Contributions? How the Contributor Role Taxonomy (CRediT) is Helping the Shift From Authorship to Contributorship’]
by Clare McLaren & Alan Dent - 57-72 Mirror, mirror on the wall: is economics the fairest of them all? An investigation into the social sciences and humanities in Vietnam
[Cash Bonuses for Peer-Reviewed Papers Go Global]
by Quan-Hoang Vuong & Anh-Tuan Bui & Viet-Phuong La & Minh-Hoang Nguyen & Hung-Hiep Pham & Thanh-Hang Pham & Thi-Hanh Vu & Thu-Trang Vuong & Manh-Toan Ho - 73-89 Transforming science and society? Methodological lessons from and for transformation research
[Shifting Power Relations in Sustainability Transitions: A Multi-Actor Perspective]
by Katharina Hölscher & Julia M Wittmayer & Martin Hirschnitz-Garbers & Alfred Olfert & Jörg Walther & Georg Schiller & Benjamin Brunnow - 90-101 Lessons from mixed-method evaluations—An example from labor market research
[Instrumental Variables and the Search for Identification: From Supply and Demand to Natural Experiments]
by Christopher Osiander - 102-111 Science rules! A qualitative study of scientists’ approaches to grant lottery
[The Secret to Germany’s Scientific Excellence]
by Axel Philipps - 112-126 The role of metrics in peer assessments
[How Incentives Trickle down: Local Use of a National Bibliometric Indicator System]
by Liv Langfeldt & Ingvild Reymert & Dag W Aksnes - 127-140 Interdisciplinary knowledge combinations and emerging technological topics: Implications for reducing uncertainties in research evaluation
[Blade Runner Economics: Will Innovation Lead the Economic Recovery?]
by Seokbeom Kwon & Jan Youtie & Alan L Porter
2020, Volume 29, Issue 3
- 231-244 Determinants of quality of research environment: An assessment of the environment submissions in the UK’s Research Excellence Framework in 2014
by Mehmet Pinar & Emre Unlu - 245-262 Fast growth of the number of proceedings papers in atypical fields in the Czech Republic is a likely consequence of the national performance-based research funding system
by Jiri Vanecek & Ondrej Pecha - 263-274 Millennial researchers in a metric-driven scholarly world: An international study
by David Nicholas & Eti Herman & Hamid R Jamali & Abdullah Abrizah & Cherifa Boukacem-Zeghmouri & Jie Xu & Blanca Rodríguez-Bravo & Anthony Watkinson & Tatiana Polezhaeva & Marzena Świgon - 275-288 Changing research on research evaluation: A critical literature review to revisit the agenda
by Duncan A Thomas & Maria Nedeva & Mayra M Tirado & Merle Jacob - 289-299 How to select the best: Selection procedures of innovation agencies
by Peter Biegelbauer & Thomas Palfinger & Sabine Mayer - 300-315 DARE to be different? A novel approach for analysing diversity in collaborative research projects
by Frédérique Bone & Michael M Hopkins & Ismael Ràfols & Jordi Molas-Gallart & Puay Tang & Gail Davey & Antony M Carr - 316-326 Unravelling the panel contribution upon peer review evaluation of numerous, unstructured and highly interdisciplinary research proposals
by Theodoros Baimpos & Nils Dittel & Roumen Borissov - 327-351 What effects does international mobility have on scientists’ careers? A systematic review
by Nicolai Netz & Svenja Hampel & Valeria Aman - 352-353 A superb example of policy evaluation
by Diana Hicks
2020, Volume 29, Issue 2
- 121-134 Tax incentives for R&D: supporting innovative scale-ups?
by Jessica Mitchell & Giuseppina Testa & Miguel Sanchez Martinez & Paul N Cunningham & Katarzyna Szkuta - 135-149 Introducing and testing an advanced quantitative methodological approach for the evaluation of research centers: a case study on sustainability science
by Omar Kassab & Rüdiger Mutz & Hans-Dieter Daniel - 150-157 Should we fund research randomly? An epistemological criticism of the lottery model as an alternative to peer review for the funding of science
by Baptiste Bedessem - 158-170 A participatory method to assess the contribution of agricultural research to societal changes in developing countries
by Guy Faure & Genowefa Blundo-Canto & Agathe Devaux-Spatarakis & Jean Louis Le Guerroué & Syndhia Mathé & Ludovic Temple & Aurélie Toillier & Bernard Triomphe & Etienne Hainzelin - 171-190 The role of Egyptian State Awards in changing researchers’ performance in the science and technology sector
by Bahaa Ibrahim - 191-202 Playing the fields: Theorizing research impact and its assessment
by Kate Williams - 203-214 The field-specific citation and usage patterns of book literature in the Book Citation Index
by Pei-Shan Chi - 215-230 Like-for-like bibliometric substitutes for peer review: Advantages and limits of indicators calculated from the ep index
by Alonso Rodríguez-Navarro & Ricardo Brito
2020, Volume 29, Issue 1
- 1-3 Assessing societal impact of SSH in an engaging world: focus on productive interaction, creative pathways and enhanced visibility of SSH research
by Jack Spaapen & Gunnar Sivertsen - 4-21 Methods for mapping the impact of social sciences and humanities—A literature review
by David Budtz Pedersen & Jonas Følsgaard Grønvad & Rolf Hvidtfeldt - 22-33 Who benefits from ex ante societal impact evaluation in the European funding arena? A cross-country comparison of societal impact capacity in the social sciences and humanities
by Stefan P L de Jong & Reetta Muhonen - 34-47 From productive interactions to impact pathways: Understanding the key dimensions in developing SSH research societal impact
by Reetta Muhonen & Paul Benneworth & Julia Olmos-Peñuela - 48-65 Conceptualizing the societal impact of research in terms of elements of logic models: a survey of researchers in sub-Saharan Africa
by Nelius Boshoff & Stefan P L de Jong - 66-70 Normal versus extraordinary societal impact: how to understand, evaluate, and improve research activities in their relations to society?
by Gunnar Sivertsen & Ingeborg Meijer - 71-76 Capacities, capabilities, and the societal impact of the humanities
by Eiríkur Smári Sigurðarson - 77-86 Efficiency evaluation of S&T resource allocation using an accurate quantification of the time-lag effect and relation effect: a case study of Chinese research institutes
by Weizhen Yue & Jun Gao & Weilan Suo - 87-99 Performing under ‘the baton of administrative power’? Chinese academics’ responses to incentives for international publications
by Xin Xu - 100-119 It is not all about performance: Importance of the funding formula in the allocation of performance-based research funding in England
by Mehmet Pinar
2019, Volume 28, Issue 4
- 295-303 Scholarly understanding, mediating artefacts and the social impact of research in the educational sciences
by Terhi Esko & Reijo Miettinen - 304-312 Money, morale, and motivation: a study of the Output-Based Research Support Scheme in University College Dublin
by Lai Ma - 313-325 Measuring scientific impact of fisheries and aquaculture research-for-development projects in South East Asia and the Pacific
by Kiros Hiruy & Ray Murphy & Tom Lewis & William T White & Steven W Purcell - 326-343 Developing an evaluation framework for university-driven technology-based, innovation for inclusive development (UTI4ID) projects
by L Botha & S S Grobbelaar & W G Bam - 344-354 The balancing role of evaluation mechanisms in organizational governance—The case of publicly funded research institutions
by Junwen Luo & Gonzalo Ordóñez-Matamoros & Stefan Kuhlmann - 355-369 Improving access to finance for young innovative enterprises with growth potential: Evidence of impact of R&D grant schemes on firms' outputs
by Giuseppina Testa & Katarzyna Szkuta & Paul N Cunningham - 370-382 European Research Council: excellence and leadership over time from a gender perspective
by Núria Bautista-Puig & Carlos García-Zorita & Elba Mauleón - 383-393 Do we need a book citation index for research evaluation?
by Yves Gingras & Mahdi Khelfaoui - 394-404 Using mixed methods to map vaguely defined research areas
by Lise Degn & Niels Mejlgaard & Jesper Wiborg Schneider
2019, Volume 28, Issue 2
- 1-1 Retraction: A response to Hansson and Polk (2018) “Assessing the impact of transdisciplinary research: The usefulness of relevance, credibility, and legitimacy for understanding the link between process and impact”
by Brian M Belcher & Luisa F Ramirez & Rachel Davel & Rachel Claus - 109-122 Government programs for university–industry partnerships: Logics, design, and implications for academic science
by Emina Veletanlić & Creso Sá - 123-135 Making a difference in the real world? A meta-analysis of the quality of use-oriented research using the Research Quality Plus approach
by Robert K D McLean & Kunal Sen - 136-144 Building a culture of impact in an international agricultural research organization: Process and reflective learning
by Genowefa Blundo-Canto & Bernard Triomphe & Guy Faure & Danielle Barret & Aurelle de Romemont & Etienne Hainzelin - 145-157 Creating research impact through the productive interactions of an individual: an example from South African research on maritime piracy
by Nelius Boshoff & Mpho Sefatsa - 158-168 How is gender being addressed in the international development evaluation literature? A meta-evaluation
by Steven Lam & Warren Dodd & Jane Whynot & Kelly Skinner - 169-181 Field patterns of scientometric indicators use for presenting research portfolio for assessment
by Emanuel Kulczycki - 182-195 The impact of Ph.D. funding on time to Ph.D. completion
by Hugo Horta & Mattia Cattaneo & Michele Meoli - 196-201 A response to Hansson and Polk (2018) “Assessing the impact of transdisciplinary research: The usefulness of relevance, credibility, and legitimacy for understanding the link between process and impact”
by Brian M Belcher & Luisa F Ramirez & Rachel Davel & Rachel Claus - 202-205 Comments to Belcher et al. 2018’s critique of Hansson and Polk 2018
by Stina Hansson & Merritt Polk - 206-208 Evaluation of research in social sciences and humanities
by Thomas Heinze & Arlette Jappe
2019, Volume 28, Issue 1
- 1-1 Introduction to special section: Keynotes from STI 2017
by Diana Hicks - 2-6 Les indicateurs sont morts, vive les indicateurs! Towards a political economy of S&T indicators: A critical overview of the past 35 years
by Rémi Barré - 7-22 S&T indicators in the wild: Contextualization and participation for responsible metrics
by Ismael Ràfols - 23-36 Multi/inter/transdisciplinary assessment: A systemic framework proposal to evaluate graduate courses and research teams
by Talita Moreira de Oliveira & Livio Amaral & Roberto Carlos dos Santos Pacheco - 37-50 Formative, embedded evaluation to strengthen interdisciplinary team science: Results of a 4-year, mixed methods, multi-country case study
by Susan Roelofs & Nancy Edwards & Sarah Viehbeck & Cody Anderson - 51-62 Challenge-led interdisciplinary research in practice: Program design, early career research, and a dialogic approach to building unlikely collaborations
by Chris Gibson & Tamantha Stutchbury & Victoria Ikutegbe & Nicole Michielin - 63-72 Referees or sponsors? The role of evaluators in the promotion of research scientists in a public research organization
by Miriam Glennie & Michael O’Donnell & Michelle Brown & John Benson - 73-83 Does counting change what is counted? Potential for paradigm change through performance metrics
by Ann Rudinow Sætnan & Gunhild Tøndel & Bente Rasmussen - 84-93 The missing link: How university managers mediate the impact of a performance-based research funding system
by Jonas Krog Lind - 94-107 Understanding the use and usability of research evaluation studies1,2
by Katrin Milzow & Anke Reinhardt & Sten Söderberg & Klaus ZinöckerDeceased
2018, Volume 27, Issue 4
- 285-286 Introduction: Measuring the impact of arts and humanities research in Europe
by Claire Donovan & Magnus Gulbrandsen - 287-297 Humanities of transformation: From crisis and critique towards the emerging integrative humanities
by Sverker Sörlin - 298-308 A review of literature on evaluating the scientific, social and political impact of social sciences and humanities research
by Emanuela Reale & Dragana Avramov & Kubra Canhial & Claire Donovan & Ramon Flecha & Poul Holm & Charles Larkin & Benedetto Lepori & Judith Mosoni-Fried & Esther Oliver & Emilia Primeri & Lidia Puigvert & Andrea Scharnhorst & Andràs Schubert & Marta Soler & Sàndor Soòs & Teresa Sordé & Charles Travis & René Van Horik - 310-322 Comprehensiveness of national bibliographic databases for social sciences and humanities: Findings from a European survey
by Linda Sīle & Janne Pölönen & Gunnar Sivertsen & Raf Guns & Tim C E Engels & Pavel Arefiev & Marta Dušková & Lotte Faurbæk & András Holl & Emanuel Kulczycki & Bojan Macan & Gustaf Nelhans & Michal Petr & Marjeta Pisk & Sándor Soós & Jadranka Stojanovski & Ari Stone & Jaroslav Šušol & Ruth Teitelbaum - 323-334 Evaluation of research in the arts: Evidence from Poland
by Kamila Lewandowska & Paweł Mirosław Stano - 335-346 Procedures and criteria for evaluating academic legal publications: Results of a survey in Switzerland
by Martin Schmied & Karin Byland & Andreas Lienhard - 347-357 Continued publications by health science PhDs, 5 years post PhD-Defence
by Lorna Wildgaard & Kim Wildgaard - 358-366 The impact of academic events—A literature review
by Thomas Trøst Hansen & David Budtz Pedersen - 367-379 Tracking research performance before and after receiving the Cheung Kong Scholars award: A case study of recipients in 2005
by Xiaojuan Liu & Mengxia Yu & Dar-Zen Chen & Mu-Hsuan Huang - 380-387 An evaluation of the National Institutes of Health Early Stage Investigator policy: Using existing data to evaluate federal policy
by Rachael Walsh & Robert F Moore & Jamie Mihoko Doyle - 388-403 Defining typologies of universities through a DEA-MDS analysis: An institutional characterization for formative evaluation purposes
by Eva M de la Torre & Fernando Casani & Marti Sagarra
2018, Volume 27, Issue 3
- 171-183 Conceptualizing and measuring performance orientation of research funding systems
by Benedetto Lepori & Emanuela Reale & Andrea Orazio Spinello - 184-195 Follow the money? How Australian universities replicate national performance-based funding mechanisms
by Peter Woelert & Lachlan McKenzie - 196-211 On the meaning of innovation performance: Is the synthetic indicator of the Innovation Union Scoreboard flawed?
by Charles Edquist & Jon Mikel Zabala-Iturriagagoitia & Javier Barbero & Jose Luis Zofío - 212-221 Making citations of publications in languages other than English visible: On the feasibility of a PLOTE-index
by Peter Dahler-Larsen - 222-237 The characteristics of highly cited researchers in Africa
by Hugo Confraria & Jaco Blanckenberg & Charl Swart - 238-245 The effects of listing authors in alphabetical order: A review of the empirical evidence
by Matthias Weber - 246-261 The peer-review process: The most valued dimensions according to the researcher’s scientific career
by Elizabeth S Vieira & José A N F Gomes - 262-269 Gender differences in scientific productivity and visibility in core neurosurgery journals: Citations and social media metrics
by Hajar Sotudeh & Tahereh Dehdarirad & Jonathan Freer - 270-282 The impacts of diabetes research from 31 European Countries in 2002 to 2013
by Elena Pallari & Grant Lewison & Oriana Ciani & Rosanna Tarricone & Silvia Sommariva & Mursheda Begum & Richard Sullivan - 283-283 Thinking with indicators. Exploring the epistemic impacts of academic performance indicators in the life sciences
by Ruth Müller & Sarah de Rijcke - 284-284 To what extent is inclusion in the Web of Science an indicator of journal ‘quality’?
by Diego Chavarro & Ismael Ràfols & Puay Tang
2018, Volume 27, Issue 2
- 53-62 Semantic tone of research ‘environment’ submissions in the UK’s Research Evaluation Framework 2014
by Andy Thorpe & Russell Craig & Glenn Hadikin & Sasa Batistic - 63-72 Authorship in science: A critical analysis from a Foucauldian perspective
by Carla Mara Hilário & Daniel Martínez-Ávila & Maria Cláudia Cabrini Grácio & Dietmar Wolfram - 73-81 Center of excellence funding: Connecting organizational capacities and epistemic effects
by Tomas Hellström & Leila Jabrane & Erik Brattström - 82-92 Geography of doctoral education in The Netherlands: Origin and current work location of recent PhDs from five Dutch universities
by Cathelijn J F Waaijer - 93-105 A comparative review of how the policy and procedures to assess research impact evolved in Australia and the UK
by Kate Williams & Jonathan Grant - 106-118 To what extent is inclusion in the Web of Science an indicator of journal ‘quality’?
by Diego Chavarro & Ismael Ràfols & Puay Tang - 119-131 Factors enabling and constraining research in a small, research-intensive South African University
by Jen D Snowball & Charlie M Shackleton - 132-144 Assessing the impact of transdisciplinary research: The usefulness of relevance, credibility, and legitimacy for understanding the link between process and impact
by Stina Hansson & Merritt Polk - 145-156 Comparing modeling approaches for assessing priorities in international agricultural research
by Athanasios Petsakos & Guy Hareau & Ulrich Kleinwechter & Keith Wiebe & Timothy B Sulser - 157-170 Assessing impacts of agricultural research for development: A systemic model focusing on outcomes
by Ludovic Temple & Danielle Barret & Genowefa Blundo Canto & Marie-Hélène Dabat & Agathe Devaux-Spatarakis & Guy Faure & Etienne Hainzelin & Syndhia Mathé & Aurelie Toillier & Bernard Triomphe
2018, Volume 27, Issue 1
- 1-15 Prevalence and citation advantage of gold open access in the subject areas of the Scopus database
by Pablo Dorta-González & Yolanda Santana-Jiménez - 16-27 Using contribution analysis to evaluate the impacts of research on policy: Getting to ‘good enough’
by Barbara L Riley & Alison Kernoghan & Lisa Stockton & Steve Montague & Jennifer Yessis & Cameron D Willis - 28-35 Researcher mobility at a US research-intensive university: Implications for research and internationalization strategies
by Jane G Payumo & George Lan & Prema Arasu - 36-42 Research impact assessment in agriculture—A review of approaches and impact areas
by Peter Weißhuhn & Katharina Helming & Johanna Ferretti - 43-51 ‘Tracking of ideas’: A method to evaluate the integration of ideas in cross-disciplinary collaboration
by Julia M Budd
2017, Volume 27, Issue 1
- 00 Unravelling complexities of university-industry research interactions: Theanalytical power of case studies
by Robert J. W. Tijssen & Poh Kam Wong
2017, Volume 26, Issue 4
- 269-283 The impact of subsidies on researcher’s productivity: Evidence from a developing country
by Diego Aboal & Ezequiel Tacsir - 284-291 An evolving research culture: Analysis of biomedical publications from Libya, 2003–13
by Mohamed O Ahmed & Mohamed A Daw & Jennifer C van Velkinburgh - 292-301 Structured Diversity – The changing landscape of doctoral training in Germany after the introduction of structured doctoral programs
by Jens Ambrasat & Jakob Tesch - 302-315 Qualitative network analysis tools for the configurative articulation of cultural value and impact from research
by Alis Oancea & Teresa Florez Petour & Jeanette Atkinson - 316-325 Social network analysis of a scientist–practitioner research initiative established to facilitate science dissemination and implementation within states and communities
by Elizabeth M Ginexi & Grace Huang & Michael Steketee & Sophia Tsakraklides & Keith MacAllum & Julie Bromberg & Amanda Huffman & Douglas A Luke & Scott J Leischow & Janet M Okamoto & Todd Rogers - 326-336 Patterns of third mission engagement among scientists and engineers
by Niels Mejlgaard & Thomas Kjeldager Ryan - 337-348 Knowledge production at industrial research institutes: Institutional logics and struggles for relevance in the Swedish Institute for Surface Chemistry, 1980–2005
by Karl Bruno & Katarina Larsen & Thed N van Leeuwen - 349-351 Counterintuitive effects of incentives?
by Peter van den Besselaar & Ulf Sandström - 352-352 Reply to van den Besselaar and Sandström
by Jesper W Schneider & Kaare Aagaard & Carter W Bloch - 353-357 A letter on Ancaiani et al. ‘Evaluating scientific research in Italy: the 2004-10 research evaluation exercise’
by Alberto Baccini & Giuseppe De Nicolao - 358-360 Reply to the letter on Ancaiani et al. ‘Evaluating Scientific research in Italy: The 2004–10 research evaluation exercise’
by Sergio Benedetto & Tindaro Cicero & Marco Malgarini & Carmen Nappi - 361-361 Thinking with Indicators. Exploring the Epistemic Impacts of Academic Performance Indicators in the Life Sciences
by Ruth Müller & Sarah de Rijcke
2017, Volume 26, Issue 3
- 157-168 Exploring the epistemic impacts of academic performance indicators in the life sciences
by Ruth Müller & Sarah de Rijcke - 169-180 Indicators as judgment devices: An empirical study of citizen bibliometrics in research evaluation
by Björn Hammarfelt & Alexander D. Rushforth