Printed from https://ideas.repec.org/s/oup/rseval.html
Content
2023, Volume 32, Issue 3
- 545-556 Do funding modes matter? A multilevel analysis of funding allocation mechanisms on university research performance
by Thomas Zacharewicz & Noemi Pulido Pavón & Luis Antonio & Benedetto Lepori - 557-565 Warnings of declining research productivity: Does Italy buck the trend?
by Giovanni Abramo & Ciriaco Andrea - 566-576 The effect of applied research institutes on invention: Evidence from the Fraunhofer centres in Europe
by Pedro Llanos-Paredes - 577-590 Evaluating transformative innovation policy in a formative way: Insights from Vinnova’s food mission experiment
by Alejandra Boni & Diana Velasco & Jordi Molas-Gallart & Johan Schot - 591-602 Research impact seen from the user side
by Richard Woolley & Jordi Molas-Gallart - 603-621 Theory of systems change: An initial, middle-range theory of public health research impact
by Melinda Craike & Bojana Klepac & Amy Mowle & Therese Riley
2023, Volume 32, Issue 2
- 171-187 Stated preference methods and STI policy studies: a foreground approach
by Víctor Gómez-Valenzuela - 188-199 Describing the state of a research network: A mixed methods approach to network evaluation
by James M Bowen & Mathieu Ouimet & Justin Lawarée & Joanna Bielecki & Ashley Rhéaume & Caylee Greenberg & Valeria E - 200-212 Using theory to understand how policy change happens: Insights from agricultural research for development
by Boru Douthwaite & Claudio Proietti & Vivian Polar & Graham Thiele - 213-227 Pathway profiles: Learning from five main approaches to assessing interdisciplinarity
by Bethany K & Nicole Motzer & Kelly J - 228-243 Open Editors: A dataset of scholarly journals’ editorial board positions
by Andreas Nishikawa-Pacher & Tamara Heck & Kerstin Schoch - 244-255 Turning academics into researchers: The development of National Researcher Categorization Systems in Latin America
by Federico Vasen & Nerina F & Silvina A & Brenda D & Manuel Pintos - 256-272 Methods for measuring social and conceptual dimensions of convergence science
by Alexander Michael & Felber Arroyave & Ioannis Pavlidis - 273-285 How unpredictable is research impact? Evidence from the UK’s Research Excellence Framework
by Ohid Yaqub & Dmitry Malkov & Josh Siepel - 286-298 Evaluating co-creation in social innovation projects: Towards a process orientated framework for EU projects and beyond
by Peter Meister & Elisabeth A M & Lummina G - 299-312 The price of quality: Scholarly publishing business is the primary predictor of citation-based indicators of journal performance in ecology and evolutionary biology
by Adriana Ruggiero - 313-320 Promoting narrative CVs to improve research evaluation? A review of opinion pieces and experiments
by Frédérique Bordignon & Lauranne Chaignon & Daniel Egret - 321-331 Gender diversity and publication activity—an analysis of STEM in the UK
by Yasaman Sarabi & Matthew Smith - 332-347 The rocky road to translational science: An analysis of Clinical and Translational Science Awards
by Yeon Hak & You-Na Lee & Seokkyun Woo - 348-355 From intent to impact—The decline of broader impacts throughout an NSF project life cycle
by Thomas Woodson & Sophia Boutilier - 356-370 Prestige of scholarly book publishers—An investigation into criteria, processes, and practices across countries
by Eleonora Dagienė - 371-383 Assessing university policies for enhancing societal impact of academic research: A multicriteria mapping approach
by Rosa Kuipers-Dirven & Matthijs Janssen & Jarno Hoekman - 384-394 Predicting future publishing success among sociologists at time of hire in the US Higher education system
by Joseph C Hermanowicz & Christopher P - 395-411 Research impact as understood by two funders of agricultural research in South Africa
by Harrie Esterhuyse & Nelius Boshoff - 412-425 ASIRPAReal-Time in the making or how to empower researchers to steer research towards desired societal goals
by Mireille MattLISIS—Université & Douglas K R & Pierre-Benoît Joly & Renée Van Dis & Laurence Colinet - 426-440 Assessing the variety of collaborative practices in translational research: An analysis of scientists’ ego-networks
by Adrián A & Oscar Llopis & Pablo D’Este & Jordi Molas-Gallart - 441-457 On the societal impact of publicly funded Circular Bioeconomy research in Europe
by Ana Sofia & José M R C A - 458-466 Early career academic's odyssey: A narrative study of her professional identity construction
by Javier Mula-Falcón & Katia Caballero - 467-483 Improving universities’ activities in academic startup support through public interventions: The effectiveness of the German programme ‘EXIST—leverage of potentials’
by Christoph E Mueller - 484-495 The nexus between research impact and sustainability assessment: From stakeholders’ perspective
by Nour Chams & Bouali Guesmi & José María - 496-514 Valuation regimes in academia: Researchers’ attitudes towards their diversity of activities and academic performance
by Nicolas Robinson-Garcia & Rodrigo Costas & Gabriela F & Thed N van - 515-525 Boundary-work and social closure in academic recruitment: Insights from the transdisciplinary subject area Swedish as a Second Language
by Natalia Ganuza & Linus Salö - 526-542 Can journal reviewers dependably assess rigour, significance, and originality in theoretical papers? Evidence from physics
by Mike Thelwall & Janusz A Hołyst
2023, Volume 32, Issue 1
- 1-1 Voices from the field
by Julia Melkers & Emanuela Reale & Thed van Leeuwen - 2-3 Tilting at twin windmills: On article quotas and journal impact factors
by Joseph E Serafy - 4-18 When publication metrics become the fetish: The research evaluation systems’ relationship with academic work engagement and burnout
by Konrad Kulikowski & Sylwia Przytuła & Łukasz Sułkowski - 19-31 Evaluation of the arts in performance-based research funding systems: An international perspective
by Kamila Lewandowska & Emanuel Kulczycki & Michael Ochsner - 32-46 The footprint of a metrics-based research evaluation system on Spain’s philosophical scholarship: An analysis of researchers’ perceptions
by Ramón A Feenstra & Emilio Delgado López-Cózar - 47-57 The impact of Italian performance-based research funding systems on the intensity of international research collaboration
by Giovanni Abramo & Ciriaco Andrea D’Angelo - 58-69 S&T resource allocation considering both performance and potential: The case of Chinese research institutes
by Teng-Yu Zhao| & Ruimin Pei & Guo-Liang Yang - 70-85 Quis judicabit ipsos judices? A case study on the dynamics of competitive funding panel evaluations
by João M Santos - 86-100 Peer review in funding-by-lottery: A systematic overview and expansion
by Jamie Shaw - 101-115 What makes databases tick: Logics that underpin national databases for research output in Europe
by Linda Sīle & Sarah de Rijcke - 116-127 Research governance and the dynamics of science: A framework for the study of governance effects on research fields
by Maria Nedeva & Mayra M Tirado & Duncan A Thomas - 128-143 Toward a modular evaluation approach of real-world laboratories: Findings from a literature review
by Teresa Kampfmann & Philip Bernert & Daniel J Lang - 144-156 Explaining employment sector choices of doctoral graduates in Germany
by Lea Goldan & Steffen Jaksztat & Christiane Gross - 157-169 Globalization of scientific communication: Evidence from authors in academic journals by country of origin
by Vít Macháček
2022, Volume 31, Issue 4
- 423-428 Devices of evaluation: Institutionalization and impact—Introduction to the special issue
by Julian Hamann & Frerk Blome & Anna Kosmützky - 429-437 Competitive exposure and existential recognition: Visibility and legitimacy on academic social networking sites
by Helena Francke & Björn Hammarfelt - 438-451 Biographical representation, from narrative to list: The evolution of curricula vitae in the humanities, 1950 to 2010
by Julian Hamann & Wolfgang Kaltenbrunner - 452-462 Devices of future excellence: Detaching excellence recognition from ‘eminent men’
by Roland Bloch & Alexander Mitterle - 463-474 Spreading the gospel: Legitimating university rankings as boundary work
by Jelena Brankovic & Leopold Ringel & Tobias Werron - 475-485 ‘I want to be able to do what I know the tools will allow us to do’: Practicing evaluative bibliometrics through digital infrastructure
by Anne K Krüger & Sabrina Petersohn - 486-497 Making the cut: How panel reviewers use evaluation devices to select applications at the European Research Council
by Lucas Brunet & Ruth Müller - 498-506 Affective auditing: The emotional weight of the research excellence framework
by Richard Watermeyer & Gemma Elizabeth Derrick & Mar Borras Batalla
2022, Volume 31, Issue 3
- 289-296 Research calls, competition for funding and inefficiency
by António Osório & Lutz Bornmann - 297-310 The funding and research trends in library and information science of NSSFC: Comparison of awards and papers
by Jianqin Xiang & Haiyan Wang - 311-320 Enriching research quality: A proposition for stakeholder heterogeneity
by Thomas Franssen - 321-325 Automated citation recommendation tools encourage questionable citations
by Serge P J M Horbach & Freek J W Oude Maatman & Willem Halffman & Wytske M Hepkema - 326-343 Pathways for assessing interdisciplinarity: A systematic review
by Bethany K Laursen & Nicole Motzer & Kelly J Anderson - 344-354 Interdisciplinary research and policy impacts: Assessing the significance of knowledge coproduction
by Luisa Veras de Sandes-Guimarães & Raquel Velho & Guilherme Ary Plonski - 355-371 Valorization of transdisciplinary research: An evaluation approach and empirical illustration
by Stefania Munaretto & Caro E Mooren & Laurens K Hessels - 372-384 University policy engagement bodies in the UK and the variable meanings of and approaches to impact
by Hannah Durrant & Eleanor MacKillop - 385-409 Under pressure: The extent and distribution of perceived pressure among scientists in Germany, Austria, and Switzerland
by David Johann & Isabel J Raabe & Heiko Rauhut - 410-422 Creating evaluative homogeneity: Experience of constructing a national journal ranking
by Jakub Krzeski & Krystian Szadkowski & Emanuel Kulczycki
2022, Volume 31, Issue 2
- 173-187 Assessing research excellence: Evaluating the Research Excellence Framework
by Mehmet Pinar & Timothy J Horne - 188-201 Key factors affecting the promotion of researchers of the Argentine Scientific and Technical Research Council (CONICET)
by María Guillermina D'Onofrio & Juan D Rogers - 202-213 Societal targeting in researcher funding: An exploratory approach
by Irene Ramos-Vielba & Duncan A Thomas & Kaare Aagaard - 214-225 The epistemic, production, and accountability prospects of social impact: An analysis of strategic research proposals
by Juha-Pekka Lauronen - 226-235 Does R&D tax credit impact firm behaviour? Micro evidence for Portugal
by Alexandre Paredes & Joana Mendonça & Fernando Bação & Bruno Damásio - 236-248 Does monitoring performance act as an incentive for improving research performance? National and organizational level analysis of Finnish universities
by Laura Himanen & Hanna-Mari Puuska - 249-256 Evaluating the Revised National Institutes of Health clinical trial definition impact on recruitment progress
by Eugene I KaneIII & Gail L Daumit & Kevin M Fain & Roberta W Scherer & Emma Elizabeth McGinty - 257-270 Predicting funded research project performance based on machine learning
by Hoon Jang - 271-287 A participatory approach to tracking system transformation in clusters and innovation ecosystems—Evolving practice in Sweden’s Vinnväxt programme
by Emily Wise & Moa Eklund & Madeline Smith & James Wilson
2022, Volume 31, Issue 1
- 1-14 Self-made university rankings: Categorization tactics and communication activism in Italian universities
by Andrea Bonaccorsi & Paola Belingheri & Brigida Blasi & Sandra Romagnosi - 15-23 Fraud, specialization, and efficiency in peer review
by J A Garcia & Rosa Rodriguez-Sanchez & J Fdez-Valdivia - 24-48 A Research Pathway Model for evaluating the implementation of practice-based research: The case of self-management health innovations
by Wilke van Beest & Wouter P C Boon & Daan Andriessen & Harald Pol & Gerrita van der Veen & Ellen H M Moors - 49-60 Evaluation of rice research: An alternate method to capture outcomes
by Parshuram Samal & Biswajit Mondal & Nitiprasad N Jambhulkar & Onkar N Singh & Ramlakhan Verma & Sushant K Dash & Anup K Das & Himanshu Pathak - 61-79 Using the catastrophe theory to discover transformative research topics
by Haiyun Xu & Jos Winnink & Huawei Wu & Hongshen Pang & Chao Wang - 80-92 Research evaluations for an energy transition? Insights from a review of Swedish research evaluation reports
by Sofie Sandin & Mats Benner - 93-103 The Corona-Eye: Exploring the risks of COVID-19 on fair assessments of impact for REF2021
by Gemma E Derrick & Julie Bayley - 104-117 Do peers share the same criteria for assessing grant applications?
by Sven E Hug & Michael Ochsner - 118-131 Measuring societal impact of research—Developing and validating an impact instrument for occupational health and safety
by Ole Henning Sørensen & Jakob Bjørner & Andreas Holtermann & Johnny Dyreborg & Jorid Birkelund Sørli & Jesper Kristiansen & Steffen Bohni Nielsen - 132-144 Beyond bean counting: Is the policy effective for the innovation efficiency of wind power industry in China?
by Zihao Jiang & Jiarong Shi & Zhiying Liu & Lei Gong - 145-158 Capabilities for transdisciplinary research
by Cian O’Donovan & Aleksandra (Ola) Michalec & Joshua R Moon - 159-172 Documenting development of interdisciplinary collaboration among researchers by visualizing connections
by Linden E Higgins & Julia M Smith
2021, Volume 30, Issue 4
- 421-430 Researcher experiences in practice-based interdisciplinary research
[Imagining Autism: Feasibility and Impact of a Drama-Based Intervention on the Social Communicative and Imaginative Behaviour of Children with Autism]
by Jennifer Leigh & Nicole Brown - 431-442 A formative approach to the evaluation of Transformative Innovation Policies
[The Need for Reflexive Evaluation Approaches in Development Cooperation]
by Jordi Molas-Gallart & Alejandra Boni & Sandro Giachi & Johan Schot - 443-457 Exploring research impact models: A systematic scoping review
[AsseCssment of the Impact of a Clinical and Health Services Research Call in Catalonia]
by Maryam Razmgir & Sirous Panahi & Leila Ghalichi & Seyed Ali Javad Mousavi & Shahram Sedghi - 458-469 Looking for evidence of research impact and use: A qualitative study of an Australian research-policy system
[Public Social Policy Development and Implementation: A Case Study of the Ghana National Health Insurance Scheme]
by Robyn S. Newson & Lucie Rychetnik & Lesley King & Andrew J. Milat & Adrian E. Bauman - 470-483 Profile of authors publishing in ‘predatory’ journals and causal factors behind their decision: A systematic review
[Understanding of Medical Students about Predatory Journals: A Comparative Study from KSA and New Zealand]
by Sefika Mertkan & Gulen Onurkan Aliusta & Nilgun Suphi - 484-499 Systematizing societal effects of transdisciplinary research
[‚Wirkungen in Der Partizipativen Gesundheitsforschung: Eine Einordnung in Die Diskurse Zum Forschungsimpact]
by Martina Schäfer & Matthias Bergmann & Lena Theiler - 500-513 Self-evaluating participatory research projects: A content validation of the InSPIRES online impact evaluation tool
[Content Validity and Reliability of Single Items or Questionnaires]
by Florence Gignac & Anne-Sophie Gresle & Valeria Santoro Lamelas & Montserrat Yepes-Baldó & Leonardo de la Torre & Maria-Jesus Pinazo & the InSPIRES Consortium - 514-528 The different responses of universities to introduction of performance-based research funding
[How Incentives Trickle down: Local Use of a National Bibliometric Indicator System]
by Giovanni Abramo & Ciriaco Andrea D’Angelo - 529-539 It takes two to tango: Examining productive interactions in urban research collaboration
[Generating Research Questions through Problematization]
by Helka Kalliomäki & Sampo Ruoppila & Jenni Airaksinen - 540-551 Teachers conceptualizing and developing assessment for skill development: Trialing a maker assessment framework
[A Brief History of Inquiry: From Dewey to Standards]
by Jennifer Lock & Sandra Becker & Petrea Redmond - 552-562 Being a female academic under neoliberal evaluation: A systematic review
[I Want to Be Both but Is That Possible?”: Communicating Mother-Scholar Uncertainty during Doctoral Candidacy]
by Javier Mula-Flacón & Cristina Cruz-González & Jesús Domingo Segovia & Carmen Lucena Rodríguez - 563-571 Evidence of research mastery: How applicants argue the feasibility of their research projects
[Concepts of originality in the natural science, medical, and engineering disciplines: An analysis of research proposals, Science, Technology]
by Eva Barlösius & Kristina Blem
2021, Volume 30, Issue 3
- 231-239 No time for that now! Qualitative changes in manuscript peer review during the Covid-19 pandemic
[COVID-19 Medical Papers Have Fewer Women First Authors than Expected]
by Serge P J M Horbach - 240-255 Does government support of a few leading universities have a broader impact on the higher education system? Evaluation of the Russian University Excellence Initiative
[The Costs and Benefits of World-Class Universities]
by Andrey Lovakov & Anna Panova & Ivan Sterligov & Maria Yudkevich - 256-268 On the relationship between interdisciplinarity and impact: Distinct effects on academic and broader impact
[A Comparison of Two Approaches for Measuring Interdisciplinary Research Output: The Disciplinary Diversity of Authors vs the Disciplinary Diversity of the Reference List]
by Lin Zhang & Beibei Sun & Lidan Jiang & Ying Huang - 269-289 SSH researchers make an impact differently. Looking at public research from the perspective of users
[ISRIA Statement. Ten Point Guidelines for an Effective Process of Research Impact Assessment]
by Andrea Bonaccorsi & Filippo Chiarello & Gualtiero Fantoni - 290-313 Estimating the effects of public subsidies on the performance of supported enterprises across firm sizes
[Implementing Matching Estimators for Average Treatment Effects in Stata]
by Ondřej Dvouletý & Ivana Blažková & Oto Potluka - 314-322 An exploration of referees’ comments published in open peer review journals: The characteristics of review language and the association between review scrutiny and citations
[Peer Review for Journals: Evidence on Quality Control, Fairness, and Innovation]
by Dietmar Wolfram & Peiling Wang & Fuad Abuzahra - 323-335 The production of scientific and societal value in research evaluation: a review of societal impact assessment methods
[Systems Thinking, Knowledge and Action: Towards Better Models and Methods]
by Jorrit P Smit & Laurens K Hessels - 336-348 The systemic approach as an instrument to evaluate higher education systems: Opportunities and challenges
[Benchmarking Universities’ Efficiency Indicators in the Presence of Internal Heterogeneity]
by Juan Aparicio & Dorys Yaneth Rodríguez & Jon Mikel Zabala-Iturriagagoitia - 349-360 Does reviewing experience reduce disagreement in proposals evaluation? Insights from Marie Skłodowska-Curie and COST Actions
[Peer Review of Grant Applications: Criteria Used and Qualitative Study of Reviewer Practices]
by Marco Seeber & Jef Vlegels & Elwin Reimink & Ana Marušić & David G Pina - 361-369 How far does an emphasis on stakeholder engagement and co-production in research present a threat to academic identity and autonomy? A prospective study across five European countries
[Systems Thinking, Knowledge and Action: Towards Better Models and Methods]
by Annette Boaz & Robert Borst & Maarten Kok & Alison O’Shea - 370-381 ‘Scaling’ the academia: Perspectives of academics on the impact of their practices
[Comparing University Rankings’]
by Yasar Kondakci & Merve Zayim-Kurtay & Sevgi Kaya-Kasikci & Hanife Hilal Senay & Busra Kulakoglu - 382-392 Say my name, say my name: Academic authorship conventions between editorial policies and disciplinary practices
[Rethinking Authorship in the Era of Collaborative Research]
by Felicitas Hesselmann & Cornelia Schendzielorz & Nikita Sorgatz - 393-404 Research and the real world: Analyzing the short- and long-term impact of knowledge transfer
[ISRIA Statement: Ten-Point Guidelines for an Effective Process of Research Impact Assessment]
by Katherine Caves & Sarah Lueling - 405-419 Journal citation reports and the definition of a predatory journal: The case of the Multidisciplinary Digital Publishing Institute (MDPI)
[Plagiarism and Predatory Journals: A Threat to Scientific Integrity]
by M Ángeles Oviedo-García - 420-420 Expression of concern: Journal citation reports and the definition of a predatory journal: The case of the Multidisciplinary Digital Publishing Institute (MDPI)
by M Ángeles Oviedo-García
2021, Volume 30, Issue 2
- 141-153 The use of an impact framework to evaluate the impact of research on policy and practice: Screening questionnaires for intellectual disability
by Karen McKenzie & Aja Murray & George Murray & Rachel Martin - 154-168 Understanding and evaluating the impact of integrated problem-oriented research programmes: Concepts and considerations
by Brian M Belcher & Karl Hughes - 169-178 Gathering evidence of impact from research support services: Examining impact in the context of the Centre for Environmental Data Analysis
by Poppy Townsend & Clare Wilkinson - 179-190 Understanding collaborative interactions in relation to research impact in social sciences and humanities: A meta-ethnography
by Alexis Dewaele & Kristof Vandael & Stefan Meysman & Ann Buysse - 191-200 Transformative academic institutions: An experimental framework for understanding regional impacts of research
by María José Aranguren & Patricia Canto-Farachala & James R Wilson - 201-214 The program and policy change framework: A new tool to measure research use in low- and middle-income countries
by Karen Fowle & Brent Wells & Melissa Day & Anjali Kumar & Cameron Bess & Brian Bingham & Annica Wayman - 215-229 Proposed methodology for measuring the effectiveness of policies designed to further research
by Núria Bautista-Puig & Luis Moreno Lorente & Elías Sanz-Casado
2021, Volume 30, Issue 1
- 1-12 What are the social and scientific benefits of participating at academic conferences? Insights from a survey among doctoral students and postdocs in Germany
[Postdoctoral Researchers: Roles, Functions and Career Prospects]
by Kalle Hauss - 13-25 The effect of facilitating interdisciplinary cooperation on the research productivity of university research teams: The moderating role of government assistance
[Defining Interdisciplinary Research: Conclusions from a Critical Review of the Literature]
by Aihua Chen & Xiaoting Wang - 26-38 Evaluating socially engaged climate research: Scientists’ visions of a climate resilient U.S. Southwest
[A How-to Guide for Coproduction of Actionable Science]
by Gigi Owen - 39-50 Transdisciplinary research outcomes based on the Transdisciplinary Research on Energetics and Cancer II initiative experience
[Addressing Social Determinants of Health and Health Inequalities]
by Sarah D Hohl & Sarah Knerr & Sarah Gehlert & Marian L Neuhouser & Shirley A A Beresford & Joseph M Unger & Paul A Fishman & Beti Thompson - 51-56 Quantifying the contributions technicians make to research
[‘How Can We Ensure Visibility and Diversity in Research Contributions? How the Contributor Role Taxonomy (CRediT) is Helping the Shift From Authorship to Contributorship’]
by Clare McLaren & Alan Dent - 57-72 Mirror, mirror on the wall: is economics the fairest of them all? An investigation into the social sciences and humanities in Vietnam
[Cash Bonuses for Peer-Reviewed Papers Go Global]
by Quan-Hoang Vuong & Anh-Tuan Bui & Viet-Phuong La & Minh-Hoang Nguyen & Hung-Hiep Pham & Thanh-Hang Pham & Thi-Hanh Vu & Thu-Trang Vuong & Manh-Toan Ho - 73-89 Transforming science and society? Methodological lessons from and for transformation research
[Shifting Power Relations in Sustainability Transitions: A Multi-Actor Perspective]
by Katharina Hölscher & Julia M Wittmayer & Martin Hirschnitz-Garbers & Alfred Olfert & Jörg Walther & Georg Schiller & Benjamin Brunnow - 90-101 Lessons from mixed-method evaluations—An example from labor market research
[Instrumental Variables and the Search for Identification: From Supply and Demand to Natural Experiments]
by Christopher Osiander - 102-111 Science rules! A qualitative study of scientists’ approaches to grant lottery
[The Secret to Germany’s Scientific Excellence]
by Axel Philipps - 112-126 The role of metrics in peer assessments
[How Incentives Trickle down: Local Use of a National Bibliometric Indicator System]
by Liv Langfeldt & Ingvild Reymert & Dag W Aksnes - 127-140 Interdisciplinary knowledge combinations and emerging technological topics: Implications for reducing uncertainties in research evaluation
[Blade Runner Economics: Will Innovation Lead the Economic Recovery?]
by Seokbeom Kwon & Jan Youtie & Alan L Porter
2020, Volume 29, Issue 3
- 231-244 Determinants of quality of research environment: An assessment of the environment submissions in the UK’s Research Excellence Framework in 2014
by Mehmet Pinar & Emre Unlu - 245-262 Fast growth of the number of proceedings papers in atypical fields in the Czech Republic is a likely consequence of the national performance-based research funding system
by Jiri Vanecek & Ondrej Pecha - 263-274 Millennial researchers in a metric-driven scholarly world: An international study
by David Nicholas & Eti Herman & Hamid R Jamali & Abdullah Abrizah & Cherifa Boukacem-Zeghmouri & Jie Xu & Blanca Rodríguez-Bravo & Anthony Watkinson & Tatiana Polezhaeva & Marzena Świgon - 275-288 Changing research on research evaluation: A critical literature review to revisit the agenda
by Duncan A Thomas & Maria Nedeva & Mayra M Tirado & Merle Jacob - 289-299 How to select the best: Selection procedures of innovation agencies
by Peter Biegelbauer & Thomas Palfinger & Sabine Mayer - 300-315 DARE to be different? A novel approach for analysing diversity in collaborative research projects
by Frédérique Bone & Michael M Hopkins & Ismael Ràfols & Jordi Molas-Gallart & Puay Tang & Gail Davey & Antony M Carr - 316-326 Unravelling the panel contribution upon peer review evaluation of numerous, unstructured and highly interdisciplinary research proposals
by Theodoros Baimpos & Nils Dittel & Roumen Borissov - 327-351 What effects does international mobility have on scientists’ careers? A systematic review
by Nicolai Netz & Svenja Hampel & Valeria Aman - 352-353 A superb example of policy evaluation
by Diana Hicks
2020, Volume 29, Issue 2
- 121-134 Tax incentives for R&D: supporting innovative scale-ups?
by Jessica Mitchell & Giuseppina Testa & Miguel Sanchez Martinez & Paul N Cunningham & Katarzyna Szkuta - 135-149 Introducing and testing an advanced quantitative methodological approach for the evaluation of research centers: a case study on sustainability science
by Omar Kassab & Rüdiger Mutz & Hans-Dieter Daniel - 150-157 Should we fund research randomly? An epistemological criticism of the lottery model as an alternative to peer review for the funding of science
by Baptiste Bedessem - 158-170 A participatory method to assess the contribution of agricultural research to societal changes in developing countries
by Guy Faure & Genowefa Blundo-Canto & Agathe Devaux-Spatarakis & Jean Louis Le Guerroué & Syndhia Mathé & Ludovic Temple & Aurélie Toillier & Bernard Triomphe & Etienne Hainzelin - 171-190 The role of Egyptian State Awards in changing researchers’ performance in the science and technology sector
by Bahaa Ibrahim - 191-202 Playing the fields: Theorizing research impact and its assessment
by Kate Williams - 203-214 The field-specific citation and usage patterns of book literature in the Book Citation Index
by Pei-Shan Chi - 215-230 Like-for-like bibliometric substitutes for peer review: Advantages and limits of indicators calculated from the ep index
by Alonso Rodríguez-Navarro & Ricardo Brito
2020, Volume 29, Issue 1
- 1-3 Assessing societal impact of SSH in an engaging world: focus on productive interaction, creative pathways and enhanced visibility of SSH research
by Jack Spaapen & Gunnar Sivertsen - 4-21 Methods for mapping the impact of social sciences and humanities—A literature review
by David Budtz Pedersen & Jonas Følsgaard Grønvad & Rolf Hvidtfeldt - 22-33 Who benefits from ex ante societal impact evaluation in the European funding arena? A cross-country comparison of societal impact capacity in the social sciences and humanities
by Stefan P L de Jong & Reetta Muhonen - 34-47 From productive interactions to impact pathways: Understanding the key dimensions in developing SSH research societal impact
by Reetta Muhonen & Paul Benneworth & Julia Olmos-Peñuela - 48-65 Conceptualizing the societal impact of research in terms of elements of logic models: a survey of researchers in sub-Saharan Africa
by Nelius Boshoff & Stefan P L de Jong - 66-70 Normal versus extraordinary societal impact: how to understand, evaluate, and improve research activities in their relations to society?
by Gunnar Sivertsen & Ingeborg Meijer - 71-76 Capacities, capabilities, and the societal impact of the humanities
by Eiríkur Smári Sigurðarson - 77-86 Efficiency evaluation of S&T resource allocation using an accurate quantification of the time-lag effect and relation effect: a case study of Chinese research institutes
by Weizhen Yue & Jun Gao & Weilan Suo - 87-99 Performing under ‘the baton of administrative power’? Chinese academics’ responses to incentives for international publications
by Xin Xu - 100-119 It is not all about performance: Importance of the funding formula in the allocation of performance-based research funding in England
by Mehmet Pinar
2019, Volume 28, Issue 4
- 295-303 Scholarly understanding, mediating artefacts and the social impact of research in the educational sciences
by Terhi Esko & Reijo Miettinen - 304-312 Money, morale, and motivation: a study of the Output-Based Research Support Scheme in University College Dublin
by Lai Ma - 313-325 Measuring scientific impact of fisheries and aquaculture research-for-development projects in South East Asia and the Pacific
by Kiros Hiruy & Ray Murphy & Tom Lewis & William T White & Steven W Purcell - 326-343 Developing an evaluation framework for university-driven technology-based, innovation for inclusive development (UTI4ID) projects
by L Botha & S S Grobbelaar & W G Bam - 344-354 The balancing role of evaluation mechanisms in organizational governance—The case of publicly funded research institutions
by Junwen Luo & Gonzalo Ordóñez-Matamoros & Stefan Kuhlmann - 355-369 Improving access to finance for young innovative enterprises with growth potential: Evidence of impact of R&D grant schemes on firms' outputs
by Giuseppina Testa & Katarzyna Szkuta & Paul N Cunningham - 370-382 European Research Council: excellence and leadership over time from a gender perspective
by Núria Bautista-Puig & Carlos García-Zorita & Elba Mauleón - 383-393 Do we need a book citation index for research evaluation?
by Yves Gingras & Mahdi Khelfaoui - 394-404 Using mixed methods to map vaguely defined research areas
by Lise Degn & Niels Mejlgaard & Jesper Wiborg Schneider
2019, Volume 28, Issue 2
- 1-1 Retraction: A response to Hansson and Polk (2018) “Assessing the impact of transdisciplinary research: The usefulness of relevance, credibility, and legitimacy for understanding the link between process and impact”
by Brian M Belcher & Luisa F Ramirez & Rachel Davel & Rachel Claus - 109-122 Government programs for university–industry partnerships: Logics, design, and implications for academic science
by Emina Veletanlić & Creso Sá - 123-135 Making a difference in the real world? A meta-analysis of the quality of use-oriented research using the Research Quality Plus approach
by Robert K D McLean & Kunal Sen - 136-144 Building a culture of impact in an international agricultural research organization: Process and reflective learning
by Genowefa Blundo-Canto & Bernard Triomphe & Guy Faure & Danielle Barret & Aurelle de Romemont & Etienne Hainzelin - 145-157 Creating research impact through the productive interactions of an individual: an example from South African research on maritime piracy
by Nelius Boshoff & Mpho Sefatsa - 158-168 How is gender being addressed in the international development evaluation literature? A meta-evaluation
by Steven Lam & Warren Dodd & Jane Whynot & Kelly Skinner - 169-181 Field patterns of scientometric indicators use for presenting research portfolio for assessment
by Emanuel Kulczycki - 182-195 The impact of Ph.D. funding on time to Ph.D. completion
by Hugo Horta & Mattia Cattaneo & Michele Meoli - 196-201 A response to Hansson and Polk (2018) “Assessing the impact of transdisciplinary research: The usefulness of relevance, credibility, and legitimacy for understanding the link between process and impact”
by Brian M Belcher & Luisa F Ramirez & Rachel Davel & Rachel Claus - 202-205 Comments to Belcher et al. 2018’s critique of Hansson and Polk 2018
by Stina Hansson & Merritt Polk - 206-208 Evaluation of research in social sciences and humanities
by Thomas Heinze & Arlette Jappe
2019, Volume 28, Issue 1
- 1-1 Introduction to special section: Keynotes from STI 2017
by Diana Hicks - 2-6 Les indicateurs sont morts, vive les indicateurs! Towards a political economy of S&T indicators: A critical overview of the past 35 years
by Rémi Barré - 7-22 S&T indicators in the wild: Contextualization and participation for responsible metrics
by Ismael Ràfols - 23-36 Multi/inter/transdisciplinary assessment: A systemic framework proposal to evaluate graduate courses and research teams
by Talita Moreira de Oliveira & Livio Amaral & Roberto Carlos dos Santos Pacheco - 37-50 Formative, embedded evaluation to strengthen interdisciplinary team science: Results of a 4-year, mixed methods, multi-country case study
by Susan Roelofs & Nancy Edwards & Sarah Viehbeck & Cody Anderson - 51-62 Challenge-led interdisciplinary research in practice: Program design, early career research, and a dialogic approach to building unlikely collaborations
by Chris Gibson & Tamantha Stutchbury & Victoria Ikutegbe & Nicole Michielin - 63-72 Referees or sponsors? The role of evaluators in the promotion of research scientists in a public research organization
by Miriam Glennie & Michael O’Donnell & Michelle Brown & John Benson - 73-83 Does counting change what is counted? Potential for paradigm change through performance metrics
by Ann Rudinow Sætnan & Gunhild Tøndel & Bente Rasmussen - 84-93 The missing link: How university managers mediate the impact of a performance-based research funding system
by Jonas Krog Lind - 94-107 Understanding the use and usability of research evaluation studies1,2
by Katrin Milzow & Anke Reinhardt & Sten Söderberg & Klaus ZinöckerDeceased
2018, Volume 27, Issue 4
- 285-286 Introduction: Measuring the impact of arts and humanities research in Europe
by Claire Donovan & Magnus Gulbrandsen - 287-297 Humanities of transformation: From crisis and critique towards the emerging integrative humanities
by Sverker Sörlin - 298-308 A review of literature on evaluating the scientific, social and political impact of social sciences and humanities research
by Emanuela Reale & Dragana Avramov & Kubra Canhial & Claire Donovan & Ramon Flecha & Poul Holm & Charles Larkin & Benedetto Lepori & Judith Mosoni-Fried & Esther Oliver & Emilia Primeri & Lidia Puigvert & Andrea Scharnhorst & Andràs Schubert & Marta Soler & Sàndor Soòs & Teresa Sordé & Charles Travis & René Van Horik - 310-322 Comprehensiveness of national bibliographic databases for social sciences and humanities: Findings from a European survey
by Linda Sīle & Janne Pölönen & Gunnar Sivertsen & Raf Guns & Tim C E Engels & Pavel Arefiev & Marta Dušková & Lotte Faurbæk & András Holl & Emanuel Kulczycki & Bojan Macan & Gustaf Nelhans & Michal Petr & Marjeta Pisk & Sándor Soós & Jadranka Stojanovski & Ari Stone & Jaroslav Šušol & Ruth Teitelbaum - 323-334 Evaluation of research in the arts: Evidence from Poland
by Kamila Lewandowska & Paweł Mirosław Stano - 335-346 Procedures and criteria for evaluating academic legal publications: Results of a survey in Switzerland
by Martin Schmied & Karin Byland & Andreas Lienhard - 347-357 Continued publications by health science PhDs, 5 years post PhD-Defence
by Lorna Wildgaard & Kim Wildgaard - 358-366 The impact of academic events—A literature review
by Thomas Trøst Hansen & David Budtz Pedersen - 367-379 Tracking research performance before and after receiving the Cheung Kong Scholars award: A case study of recipients in 2005
by Xiaojuan Liu & Mengxia Yu & Dar-Zen Chen & Mu-Hsuan Huang - 380-387 An evaluation of the National Institutes of Health Early Stage Investigator policy: Using existing data to evaluate federal policy
by Rachael Walsh & Robert F Moore & Jamie Mihoko Doyle - 388-403 Defining typologies of universities through a DEA-MDS analysis: An institutional characterization for formative evaluation purposes
by Eva M de la Torre & Fernando Casani & Marti Sagarra