IDEAS home Printed from https://ideas.repec.org/a/oup/rseval/v31y2022i4p423-428..html

Devices of evaluation: Institutionalization and impact—Introduction to the special issue

Author

Listed:
  • Julian Hamann
  • Frerk Blome
  • Anna Kosmützky

Abstract

This introduction outlines the analytical potential of the concept of ‘device’ that is key to the special issue ‘Devices of evaluation’. Evaluation relies not only on the human capacity to value, classify, compare, or judge, but also on social operators that affect evaluations in different ways. The notion of ‘devices’ puts the focus not on human actors but on things, tools, and instruments, on (infra-)structures and procedures, on assemblages and constellations which human actors either draw on when they attribute value or worth, or which have their own agentic capacity and facilitate or enforce evaluations themselves. We propose three perspectives through which a focus on devices can have analytical potential and thus contribute to the study of evaluation in academia: Devices facilitate and accomplish evaluation as trans-situational relays, they connect different forms of evaluation, and they enable, guide, and shape comparisons among very different valuation constellations and contexts. Broadening the focus in this way, the concept can improve our understanding of the non-human side of evaluation. The contributions to this special convey the idea that devices of evaluation are crucial for understanding the production, diffusion, and institutionalization of value and worth in academic contexts.

Suggested Citation

  • Julian Hamann & Frerk Blome & Anna Kosmützky, 2022. "Devices of evaluation: Institutionalization and impact—Introduction to the special issue," Research Evaluation, Oxford University Press, vol. 31(4), pages 423-428.
  • Handle: RePEc:oup:rseval:v:31:y:2022:i:4:p:423-428.
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1093/reseval/rvac047
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Michèle Lamont & Grégoire Mallard & Joshua Guetzkow, 2006. "Beyond blind faith: overcoming the obstacles to interdisciplinary evaluation," Research Evaluation, Oxford University Press, vol. 15(1), pages 43-55, April.
    2. Björn Hammarfelt & Alexander D. Rushforth, 2017. "Indicators as judgment devices: An empirical study of citizen bibliometrics in research evaluation," Research Evaluation, Oxford University Press, vol. 26(3), pages 169-180.
    3. Martin Reinhart, 2009. "Peer review of grant applications in biology and medicine. Reliability, fairness, and validity," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(3), pages 789-809, December.
    4. Lucien Karpik, 2010. "Valuing the Unique: The Economics of Singularities," Economics Books, Princeton University Press, edition 1, number 9215, December.
    5. Fabian Muniesa & Yuval Millo & Michel Callon, 2007. "An introduction to market devices," Post-Print halshs-00177928, HAL.
    6. Helena Francke & Björn Hammarfelt, 2022. "Competitive exposure and existential recognition: Visibility and legitimacy on academic social networking sites," Research Evaluation, Oxford University Press, vol. 31(4), pages 429-437.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gerhard Rainer, 2021. "Geographies of qualification in the global fine wine market," Environment and Planning A, , vol. 53(1), pages 95-112, February.
    2. Julian Hamann & Wolfgang Kaltenbrunner, 2022. "Biographical representation, from narrative to list: The evolution of curricula vitae in the humanities, 1950 to 2010," Research Evaluation, Oxford University Press, vol. 31(4), pages 438-451.
    3. Stephan Puehringer & Georg Wolfmayr, 2023. "Competitive Performativity of (Academic) Social Networks. The subjectivation of Competition on ResearchGate, Google Scholar and Twitter," ICAE Working Papers 150, Johannes Kepler University, Institute for Comprehensive Analysis of the Economy.
    4. Alessandro Margherita & Gianluca Elia & Claudio Petti, 2022. "What Is Quality in Research? Building a Framework of Design, Process and Impact Attributes and Evaluation Perspectives," Sustainability, MDPI, vol. 14(5), pages 1-18, March.
    5. Anne K. Krüger, 2020. "Quantification 2.0? Bibliometric Infrastructures in Academic Evaluation," Politics and Governance, Cogitatio Press, vol. 8(2), pages 58-67.
    6. Kornberger, Martin & Pflueger, Dane & Mouritsen, Jan, 2017. "Evaluative infrastructures: Accounting for platform organization," Accounting, Organizations and Society, Elsevier, vol. 60(C), pages 79-95.
    7. Tina Haisch & Max-Peter Menzel, 2019. "Temporary Markets in a Global Economy: An Example of Three Basel Art Fairs," PEGIS geo-disc-2019_14, Institute for Economic Geography and GIScience, Department of Socioeconomics, Vienna University of Economics and Business.
    8. El Hadi Caoui & Gérard Marty, 2023. "Random drawing in sequential auctions: investigating the role of a market device in timber sales," Review of Agricultural, Food and Environmental Studies, Springer, vol. 104(2), pages 101-122, June.
    9. Kornberger Martin & Pflueger Dane & Mouritsen Jan, 2017. "Evaluative infrastructures : Accounting for platform organization," Post-Print hal-02276737, HAL.
    10. Anne K. Krüger, 2020. "Quantification 2.0? Bibliometric Infrastructures in Academic Evaluation," Politics and Governance, Cogitatio Press, vol. 8(2), pages 58-67.
    11. David M. Waguespack & Robert Salomon, 2016. "Quality, Subjectivity, and Sustained Superior Performance at the Olympic Games," Management Science, INFORMS, vol. 62(1), pages 286-300, January.
    12. Tinglong Dai & Sridhar Tayur, 2022. "Designing AI‐augmented healthcare delivery systems for physician buy‐in and patient acceptance," Production and Operations Management, Production and Operations Management Society, vol. 31(12), pages 4443-4451, December.
    13. Juliana de Oliveira Becheri & Acsa Hosken Gusmão & Elisa Guimarães Cozadi & Paulo Henrique Montagnana Vicente Leme, 2023. "Instagram in the Modest Fashion Market: Analysis by the Perspective of Sociotechnical Structures," RAC - Revista de Administração Contemporânea (Journal of Contemporary Administration), ANPAD - Associação Nacional de Pós-Graduação e Pesquisa em Administração, vol. 27(Vol. 27 N), pages 220168-2201.
    14. Bear, Laura, 2020. "Speculations on infrastructure: from colonial public works to a postcolonial global asset class on the Indian Railways 1840-2017," LSE Research Online Documents on Economics 103445, London School of Economics and Political Science, LSE Library.
    15. Ramón A. Feenstra & Emilio Delgado López-Cózar, 2022. "Philosophers’ appraisals of bibliometric indicators and their use in evaluation: from recognition to knee-jerk rejection," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 2085-2103, April.
    16. Blanc, Antoine & Huault, Isabelle, 2014. "Against the digital revolution? Institutional maintenance and artefacts within the French recorded music industry," Technological Forecasting and Social Change, Elsevier, vol. 83(C), pages 10-23.
    17. Mariagiulia Mariani & François Casabianca & Claire Cerdan & Iuri Peri, 2021. "Protecting Food Cultural Biodiversity: From Theory to Practice. Challenging the Geographical Indications and the Slow Food Models," Sustainability, MDPI, vol. 13(9), pages 1-22, May.
    18. van den Besselaar, Peter & Sandström, Ulf, 2015. "Early career grants, performance, and careers: A study on predictive validity of grant decisions," Journal of Informetrics, Elsevier, vol. 9(4), pages 826-838.
    19. Thomas Wainwright, 2011. "Elite Knowledges: Framing Risk and the Geographies of Credit," Environment and Planning A, , vol. 43(3), pages 650-665, March.
    20. repec:oup:rseval:v:32:y:2024:i:2:p:213-227. is not listed on IDEAS
    21. Isabelle Bouty & Marie-Léandre Gomez & Carole Drucker-Godard, 2013. "Maintaining an Institution : The Institutional Work of Michelin in Haute Cuisine around the World," Working Papers hal-00782455, HAL.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:oup:rseval:v:31:y:2022:i:4:p:423-428.. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Oxford University Press (email available below). General contact details of provider: https://academic.oup.com/rev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.