The big consequences of small biases: A simulation of peer review
Author
Abstract
Suggested Citation
DOI: 10.1016/j.respol.2015.01.006
Download full text from publisher
As the access to this document is restricted, you may want to search for a different version of it.
References listed on IDEAS
- Viner, Neil & Powell, Philip & Green, Rod, 2004. "Institutionalized biases in the award of research grants: a preliminary analysis revisiting the principle of accumulative advantage," Research Policy, Elsevier, vol. 33(3), pages 443-454, April.
- Bornmann, Lutz & Mutz, Rüdiger & Daniel, Hans-Dieter, 2007. "Gender differences in grant peer review: A meta-analysis," Journal of Informetrics, Elsevier, vol. 1(3), pages 226-238.
- In-Uck Park & Mike W. Peacey & Marcus R. Munafò, 2014. "Modelling the effects of subjective and objective decision making in scientific peer review," Nature, Nature, vol. 506(7486), pages 93-96, February.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
Cited by:
- Eliseo Reategui & Alause Pires & Michel Carniato & Sergio Roberto Kieling Franco, 2020. "Evaluation of Brazilian research output in education: confronting international and national contexts," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 427-444, October.
- Thomas Feliciani & Junwen Luo & Lai Ma & Pablo Lucas & Flaminio Squazzoni & Ana Marušić & Kalpana Shankar, 2019. "A scoping review of simulation models of peer review," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 555-594, October.
- Simone Righi & Károly Takács, 2017.
"The miracle of peer review and development in science: an agent-based model,"
Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 587-607, October.
- Simone Righi & Karoly Takacs, 2016. "The Miracle of Peer Review and Development inScience: An Agent-Based Model," Center for the Analysis of Public Policies (CAPP) 0144, Universita di Modena e Reggio Emilia, Dipartimento di Economia "Marco Biagi".
- Kapeller, Jakob & Steinerberger, Stefan, 2016.
"Emergent phenomena in scientific publishing: A simulation exercise,"
Research Policy, Elsevier, vol. 45(10), pages 1945-1952.
- Jakob Kapeller & Stefan Steinerberger, 2017. "Emergent phenomena in scientific publishing: A simulation exercise," ICAE Working Papers 66, Johannes Kepler University, Institute for Comprehensive Analysis of the Economy.
- Michail Kovanis & Raphaël Porcher & Philippe Ravaud & Ludovic Trinquart, 2016. "Complex systems approach to scientific publication and peer-review system: development of an agent-based model calibrated with empirical journal data," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(2), pages 695-715, February.
- Dennis L Murray & Douglas Morris & Claude Lavoie & Peter R Leavitt & Hugh MacIsaac & Michael E J Masson & Marc-Andre Villard, 2016. "Bias in Research Grant Evaluation Has Dire Consequences for Small Universities," PLOS ONE, Public Library of Science, vol. 11(6), pages 1-19, June.
- Olgica Nedić & Aleksandar Dekanski, 2016. "Priority criteria in peer review of scientific articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(1), pages 15-26, April.
- Marco Cozzi, 2020.
"Public Funding of Research and Grant Proposals in the Social Sciences: Empirical Evidence from Canada,"
Department Discussion Papers
1809, Department of Economics, University of Victoria.
- Marco Cozzi, 2022. "Public Funding of Research and Grant Proposals in the Social Sciences: Empirical Evidence from Canada," Department Discussion Papers 2009, Department of Economics, University of Victoria.
- Lina M. Cortés & Andrés Mora-Valencia & Javier Perote, 2016.
"The productivity of top researchers: a semi-nonparametric approach,"
Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 891-915, November.
- Lina M. Cortés & Javier Perote & Andrés Mora-Valencia, 2016. "The productivity of top researchers: A semi-nonparametric approach," Documentos de Trabajo de Valor Público 14437, Universidad EAFIT.
- Marjolijn N. Wijnen & Jorg J. M. Massen & Mariska E. Kret, 2021. "Gender bias in the allocation of student grants," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 5477-5488, July.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Marjolijn N. Wijnen & Jorg J. M. Massen & Mariska E. Kret, 2021. "Gender bias in the allocation of student grants," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 5477-5488, July.
- Stefano Bianchini & Patrick Llerena & Sıla Öcalan-Özel & Emre Özel, 2022.
"Gender diversity of research consortia contributes to funding decisions in a multi-stage grant peer-review process,"
Palgrave Communications, Palgrave Macmillan, vol. 9(1), pages 1-10, December.
- Stefano Bianchini & Patrick Llerena & Sıla Öcalan-Özel & Emre Özel, 2022. "Gender diversity of research consortia contributes to funding decisions in a multi-stage grant peer-review process," Post-Print hal-03921706, HAL.
- Zhao, Zhi-Dan & Chen, Jiahao & Lu, Yichuan & Zhao, Na & Jiang, Dazhi & Wang, Bing-Hong, 2021. "Dynamic patterns of open review process," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 582(C).
- Emre Özel, 2024. "What is Gender Bias in Grant Peer review?," Working Papers halshs-03862027, HAL.
- Albert Banal-Estañol & Qianshuo Liu & Inés Macho-Stadler & David Pérez-Castrillo, 2021.
"Similar-to-me Effects in the Grant Application Process: Applicants, Panelists, and the Likelihood of Obtaining Funds,"
Working Papers
1289, Barcelona School of Economics.
- Albert Banal-Estañol & Qianshuo Liu & Inés Macho-Stadler & Pérez-Castrillo, 2021. "Similar-to-me effects in the grant application process: Applicants, panelists, and the likelihood of obtaining funds," Economics Working Papers 1801, Department of Economics and Business, Universitat Pompeu Fabra.
- Simen G. Enger & Fulvio Castellacci, 2016.
"Who gets Horizon 2020 research grants? Propensity to apply and probability to succeed in a two-step analysis,"
Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 1611-1638, December.
- Simen G. Enger & Fulvio Castellacci, 2016. "Who gets Horizon 2020 research grants? Propensity to apply and probability to succeed in a two-step analysis," Working Papers on Innovation Studies 20160225, Centre for Technology, Innovation and Culture, University of Oslo.
- Marco Cozzi, 2020.
"Public Funding of Research and Grant Proposals in the Social Sciences: Empirical Evidence from Canada,"
Department Discussion Papers
1809, Department of Economics, University of Victoria.
- Marco Cozzi, 2022. "Public Funding of Research and Grant Proposals in the Social Sciences: Empirical Evidence from Canada," Department Discussion Papers 2009, Department of Economics, University of Victoria.
- Banal-Estañol, Albert & Macho-Stadler, Inés & Pérez-Castrillo, David, 2019.
"Evaluation in research funding agencies: Are structurally diverse teams biased against?,"
Research Policy, Elsevier, vol. 48(7), pages 1823-1840.
- Albert Banal-Estañol & Inés Macho-Stadler & David Pérez-Castrillo, 2016. "Evaluation in Research Funding Agencies: Are Structurally Diverse Teams Biased Against?," Working Papers 890, Barcelona School of Economics.
- Amy Hinsley & William J Sutherland & Alison Johnston, 2017. "Men ask more questions than women at a scientific conference," PLOS ONE, Public Library of Science, vol. 12(10), pages 1-14, October.
- Chiara Franzoni & Paula Stephan & Reinhilde Veugelers, 2022.
"Funding Risky Research,"
Entrepreneurship and Innovation Policy and the Economy, University of Chicago Press, vol. 1(1), pages 103-133.
- Chiara Franzoni & Paula Stephan & Reinhilde Veugelers, 2021. "Funding Risky Research," NBER Chapters, in: Entrepreneurship and Innovation Policy and the Economy, volume 1, pages 103-133, National Bureau of Economic Research, Inc.
- Chiara Franzoni & Paula Stephan & Reinhilde Veugelers, 2021. "Funding Risky Research," NBER Working Papers 28905, National Bureau of Economic Research, Inc.
- Lin Zhang & Beibei Sun & Fei Shu & Ying Huang, 2022. "Comparing paper level classifications across different methods and systems: an investigation of Nature publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 7633-7651, December.
- Krawczyk, Michał & Smyk, Magdalena, 2016.
"Author׳s gender affects rating of academic articles: Evidence from an incentivized, deception-free laboratory experiment,"
European Economic Review, Elsevier, vol. 90(C), pages 326-335.
- Michał Krawczyk & Magdalena Smyk, 2014. "Author's gender affects the rating of academic articles: Evidence from an incentivized, deception-free laboratory experiment," Working Papers 2014-07, Faculty of Economic Sciences, University of Warsaw.
- Jonas Lindahl & Cristian Colliander & Rickard Danell, 2020. "Early career performance and its correlation with gender and publication output during doctoral education," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(1), pages 309-330, January.
- Lawson, Cornelia & Salter, Ammon, 2023. "Exploring the effect of overlapping institutional applications on panel decision-making," Research Policy, Elsevier, vol. 52(9).
- Michał Krawczyk & Magdalena Smyk, 2015.
"Gender, beauty and support networks in academia: evidence from a field experiment,"
Working Papers
2015-43, Faculty of Economic Sciences, University of Warsaw.
- Michal Krawczyk & Magdalena Smyk, 2015. "Gender, beauty and support networks in academia: Evidence from a field experiment," Natural Field Experiments 00697, The Field Experiments Website.
- Simen G. Enger, 2017. "Closed clubs: Cumulative advantages and participation in Horizon 2020," Working Papers on Innovation Studies 20170703, Centre for Technology, Innovation and Culture, University of Oslo.
- Albert Banal-Estañol & Ines Macho-Stadler & David Pérez-Castrillo, 2016.
"Key Success Drivers in Public Research Grants: Funding the Seeds of Radical Innovation in Academia?,"
CESifo Working Paper Series
5852, CESifo.
- Albert Banal-Estañol & Inés Macho-Stadler & David Pérez-Castrillo, 2016. "Key success drivers in public research grants: Funding the seeds of radical innovation in academia?," Economics Working Papers 1518, Department of Economics and Business, Universitat Pompeu Fabra.
- Shen, Hongquan & Cheng, Ying & Ju, Xiufang & Xie, Juan, 2022. "Rethinking the effect of inter-gender collaboration on research performance for scholars," Journal of Informetrics, Elsevier, vol. 16(4).
- Hartshorn, Jessica A. & Brockerhoff, Eckehard G. & Klapwijk, Maartje J. & Marzano, Mariella & Ganley, Rebecca J. & Darr, Molly N., 2023. "Attracting and retaining women in forest entomology and forest pathology," Forest Policy and Economics, Elsevier, vol. 154(C).
- Charles Ayoubi & Michele Pezzoni & Fabiana Visentin, 2021.
"Does It Pay to Do Novel Science? The Selectivity Patterns in Science Funding,"
Science and Public Policy, Oxford University Press, vol. 48(5), pages 635-648.
- Charles Ayoubi & Michele Pezzoni & Fabiana Visentin, 2019. "Does it Pay to Do Novel Science? The Selectivity Patterns in Science Funding," GREDEG Working Papers 2019-37, Groupe de REcherche en Droit, Economie, Gestion (GREDEG CNRS), Université Côte d'Azur, France.
- Ayoubi, Charles & Pezzoni, Michele & Visentin, Fabiana, 2019. "Does it pay to do novel science? The selectivity patterns in science funding," MERIT Working Papers 2019-037, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).
More about this item
Keywords
Bias; Discrete event simulation; Grant funding; Peer review;All these keywords.
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:respol:v:44:y:2015:i:6:p:1266-1270. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/respol .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.