IDEAS home Printed from https://ideas.repec.org/a/oup/rseval/v20y2011i3p239-246.html
   My bibliography  Save this article

Peer review and the ex ante assessment of societal impacts

Author

Listed:
  • J Britt Holbrook
  • Robert Frodeman

Abstract

Funding agencies and research councils around the world rely on peer review to assess the potential impacts of proposed research. This article compares the procedures of two major public science agencies — the US National Science Foundation and the European Commission's 7th Framework Programme — for evaluating ex ante the potential societal impact of research proposals. In this paper we survey the state of the art and discuss some of the conceptual questions that arise in using ex ante peer review to assess the societal impact of scientific research. Copyright , Beech Tree Publishing.

Suggested Citation

  • J Britt Holbrook & Robert Frodeman, 2011. "Peer review and the ex ante assessment of societal impacts," Research Evaluation, Oxford University Press, vol. 20(3), pages 239-246, September.
  • Handle: RePEc:oup:rseval:v:20:y:2011:i:3:p:239-246
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.3152/095820211X12941371876788
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. J. Britt Holbrook, 2017. "The future of the impact agenda depends on the revaluation of academic freedom," Palgrave Communications, Palgrave Macmillan, vol. 3(1), pages 1-9, December.
    2. Dusan Lesjak, 2019. "Measuring Impacts of Science and Research on the Society: Development, Issues and Solutions," Management, University of Primorska, Faculty of Management Koper, vol. 14(3), pages 219-236.
    3. Caitlin Drummond Otten & Baruch Fischhoff, 2022. "Assessing broader impacts of funded research: the US National Science Foundation v. Lamar Smith [What is Societal Impact of Research and How Can it Be Assessed? A Literature Survey]," Science and Public Policy, Oxford University Press, vol. 49(2), pages 313-323.
    4. Linton, Jonathan D., 2016. "Improving the Peer review process: Capturing more information and enabling high-risk/high-return research," Research Policy, Elsevier, vol. 45(9), pages 1936-1938.
    5. Esma J. Doğramacı & Giampiero Rossi-Fedele, 2021. "Predictors of societal and professional impact of orthodontic research. A multivariate, scientometric approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(11), pages 9223-9248, November.
    6. Michael Taylor, 2020. "An altmetric attention advantage for open access books in the humanities and social sciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2523-2543, December.
    7. Arnott, James C., 2021. "Pens and purse strings: Exploring the opportunities and limits to funding actionable sustainability science," Research Policy, Elsevier, vol. 50(10).
    8. Lutz Bornmann, 2013. "What is societal impact of research and how can it be assessed? a literature survey," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(2), pages 217-233, February.
    9. Richard R Snell, 2015. "Menage a Quoi? Optimal Number of Peer Reviewers," PLOS ONE, Public Library of Science, vol. 10(4), pages 1-14, April.
    10. Lai Ma & Rachael Agnew, 2022. "Deconstructing impact: A framework for impact evaluation in grant applications [Evidencing Impact from Art Research: Analysis of Impact Case Studies from the REF 2014]," Science and Public Policy, Oxford University Press, vol. 49(2), pages 289-301.
    11. Andrea Bonaccorsi & Filippo Chiarello & Gualtiero Fantoni, 2021. "Impact for whom? Mapping the users of public research with lexicon-based text mining," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1745-1774, February.
    12. Alessandro Margherita & Gianluca Elia & Claudio Petti, 2022. "What Is Quality in Research? Building a Framework of Design, Process and Impact Attributes and Evaluation Perspectives," Sustainability, MDPI, vol. 14(5), pages 1-18, March.
    13. Irwin Feller, 2013. "Peer review and expert panels as techniques for evaluating the quality of academic research," Chapters, in: Albert N. Link & Nicholas S. Vonortas (ed.), Handbook on the Theory and Practice of Program Evaluation, chapter 5, pages 115-142, Edward Elgar Publishing.
    14. Irwin Feller, 2022. "Assessing the societal impact of publicly funded research," The Journal of Technology Transfer, Springer, vol. 47(3), pages 632-650, June.
    15. Matteo Pedrini & Valentina Langella & Mario Alberto Battaglia & Paola Zaratin, 2018. "Assessing the health research’s social impact: a systematic review," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(3), pages 1227-1250, March.
    16. Marco Gatti, 2018. "The Impact of Management Accounting Research: An Analysis of the Past and a Look at the Future," International Journal of Business and Management, Canadian Center of Science and Education, vol. 13(5), pages 1-47, March.
    17. Lutz Bornmann & Werner Marx, 2014. "How should the societal impact of research be generated and measured? A proposal for a simple and practicable approach to allow interdisciplinary comparisons," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(1), pages 211-219, January.
    18. Alba Viana Lora & Marta Gemma Nel-lo Andreu, 2020. "Alternative Metrics for Assessing the Social Impact of Tourism Research," Sustainability, MDPI, vol. 12(10), pages 1-12, May.
    19. Dotti, Nicola Francesco & Walczyk, Julia, 2022. "What is the societal impact of university research? A policy-oriented review to map approaches, identify monitoring methods and success factors," Evaluation and Program Planning, Elsevier, vol. 95(C).
    20. Carole J. Lee & Cassidy R. Sugimoto & Guo Zhang & Blaise Cronin, 2013. "Bias in peer review," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(1), pages 2-17, January.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:oup:rseval:v:20:y:2011:i:3:p:239-246. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Oxford University Press (email available below). General contact details of provider: https://academic.oup.com/rev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.