IDEAS home Printed from https://ideas.repec.org/p/pdn/dispap/131.html
   My bibliography  Save this paper

Evaluators’ Consideration of Warmth and Competence in Verbal and Numerical Performance Assessments

Author

Listed:
  • Jana Kim Gutt

    (Paderborn University)

Abstract

When conducting performance appraisals, evaluators largely depend on their subjective perception. This makes performance appraisals particularly vulnerable to biases, especially along the lines of warmth and competence – the two primary dimensions of social judgment. Warmth reflects the ability to build and maintain social relationships, while competence refers to achieving goals and completing tasks. Although both dimensions have been extensively studied in the past, there is limited understanding of how they influence observation-based assessments, particularly in relation to the evaluation format and the impact of the rater and ratee gender. To address this gap, the study employs a laboratory experiment to investigate how warmth- and competence-related behaviors in a task setting translate into performance appraisals, namely numerical ratings, written comments, and spoken comments. The evaluation comments are converted into numerical ratings using a machine learning algorithm, which allows for comparison with the assigned numerical ratings. Findings reveal that the consideration of warmth and competence depends not only on the appraisal format but also on the rater (evaluator) and ratee (task-solver) gender. This study enhances the understanding of how evaluations differ across formats and examines the role of gender in shaping perceptions of warmth and competence.

Suggested Citation

  • Jana Kim Gutt, 2025. "Evaluators’ Consideration of Warmth and Competence in Verbal and Numerical Performance Assessments," Working Papers Dissertations 131, Paderborn University, Faculty of Business Administration and Economics.
  • Handle: RePEc:pdn:dispap:131
    as

    Download full text from publisher

    File URL: http://groups.uni-paderborn.de/wp-wiwi/RePEc/pdf/dispap/DP131.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Roberto Centeno & Ramón Hermoso & Maria Fasli, 2015. "On the inaccuracy of numerical ratings: dealing with biased opinions in social networks," Information Systems Frontiers, Springer, vol. 17(4), pages 809-825, August.
    2. Ko, S.J. & Judd, C.M. & Stapel, D.A., 2009. "Stereotyping based on voice in the presence of individuating information : Vocal femininity affects perceived competence but not warmth," Other publications TiSEM 2106002e-5b25-4802-b77f-6, Tilburg University, School of Economics and Management.
    3. Johannes Berger & Christine Harbring & Dirk Sliwka, 2013. "Performance Appraisals and the Impact of Forced Distribution--An Experimental Investigation," Management Science, INFORMS, vol. 59(1), pages 54-68, June.
    4. Roberto A. Weber & Colin F. Camerer, 2003. "Cultural Conflict and Merger Failure: An Experimental Approach," Management Science, INFORMS, vol. 49(4), pages 400-415, April.
    5. Christian Grund & Judith Przemeck, 2012. "Subjective performance appraisal and inequality aversion," Applied Economics, Taylor & Francis Journals, vol. 44(17), pages 2149-2155, June.
    6. Adler, Seymour & Campion, Michael & Colquitt, Alan & Grubb, Amy & Murphy, Kevin & Ollander-Krane, Rob & Pulakos, Elaine D., 2016. "Getting Rid of Performance Ratings: Genius or Folly? A Debate," Industrial and Organizational Psychology, Cambridge University Press, vol. 9(2), pages 219-252, June.
    7. repec:plo:pone00:0211890 is not listed on IDEAS
    8. Stefano Pagliaro & Marco Brambilla & Simona Sacchi & Manuela D’Angelo & Naomi Ellemers, 2013. "Initial Impressions Determine Behaviours: Morality Predicts the Willingness to Help Newcomers," Journal of Business Ethics, Springer, vol. 117(1), pages 37-44, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jana Kim Gutt & Kirsten Thommes & Miro Mehic, 2025. "Can Verbal Performance Appraisals and Machine Learning Models Improve the Accuracy of Performance Evaluations?," Working Papers Dissertations 132, Paderborn University, Faculty of Business Administration and Economics.
    2. Marchegiani, Lucia & Reggiani, Tommaso & Rizzolli, Matteo, 2016. "Loss averse agents and lenient supervisors in performance appraisal," Journal of Economic Behavior & Organization, Elsevier, vol. 131(PA), pages 183-197.
    3. Patrick Kampkötter & Dirk Sliwka, 2016. "The Complementary Use of Experiments and Field Data to Evaluate Management Practices: The Case of Subjective Performance Evaluations," Journal of Institutional and Theoretical Economics (JITE), Mohr Siebeck, Tübingen, vol. 172(2), pages 364-389, June.
    4. Anna Stankiewicz-Mróz, 2019. "Influence of Interlocking Directorates on Integration after the Acquisition of Warsaw Stock Exchange—Listed Companies," Sustainability, MDPI, vol. 11(24), pages 1-22, December.
    5. Hirota, Haruaki & Iwata, Kazuyuki & Tanaka, Kenta, 2022. "Is public official training effective at reducing costs? Evidence from survey data on Japanese municipal mergers," Economic Analysis and Policy, Elsevier, vol. 75(C), pages 145-158.
    6. Simon Gaechter & Chris Starmer & Fabio Tufano, 2022. "Measuring “group cohesion” to reveal the power of social relationships in team production," Discussion Papers 2022-12, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    7. Shi, Wei & Tang, Yinuo, 2015. "Cultural similarity as in-group favoritism: The impact of religious and ethnic similarities on alliance formation and announcement returns," Journal of Corporate Finance, Elsevier, vol. 34(C), pages 32-46.
    8. Kyriaki Papadopoulou, 2020. "Comparative Review Of Performance Measurement Methods Effectiveness," Economics and Management, Faculty of Economics, SOUTH-WEST UNIVERSITY "NEOFIT RILSKI", BLAGOEVGRAD, vol. 17(1), pages 127-139.
    9. Wilfred Amaldoss & Richard Staelin, 2010. "Cross-Function and Same-Function Alliances: How Does Alliance Structure Affect the Behavior of Partnering Firms?," Management Science, INFORMS, vol. 56(2), pages 302-317, February.
    10. Angelovski, Andrej & Brandts, Jordi & Sola, Carles, 2016. "Hiring and escalation bias in subjective performance evaluations: A laboratory experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 121(C), pages 114-129.
    11. Goldberg, Amir & Srivastava, Sameer B & Manian, Govind & Monroe, William & Potts, Christopher, 2016. "Fitting In or Standing Out? The Tradeoffs of Structural and Cultural Embeddedness," Institute for Research on Labor and Employment, Working Paper Series qt9bf631rg, Institute of Industrial Relations, UC Berkeley.
    12. Yifei Huang & Matt Shum & Xi Wu & Jason Zezhong Xiao, 2019. "Discovery of Bias and Strategic Behavior in Crowdsourced Performance Assessment," Papers 1908.01718, arXiv.org, revised Oct 2019.
    13. Robert S. Huckman & Bradley R. Staats, 2011. "Fluid Tasks and Fluid Teams: The Impact of Diversity in Experience and Team Familiarity on Team Performance," Manufacturing & Service Operations Management, INFORMS, vol. 13(3), pages 310-328, July.
    14. Luis Garicano & Luis Rayo, 2016. "Why Organizations Fail: Models and Cases," Journal of Economic Literature, American Economic Association, vol. 54(1), pages 137-192, March.
    15. Werner, Peter, 2024. "On common evaluation standards and the acceptance of wage inequality," Games and Economic Behavior, Elsevier, vol. 145(C), pages 137-156.
    16. Tommaso Agasisti & Aleksei Egorov & Margarita Maximova, 2020. "Do Merger Policies Increase University Efficiency? Evidence From A Fuzzy Regression Discontinuity Design," HSE Working papers WP BRP 226/EC/2020, National Research University Higher School of Economics.
    17. Mariassunta Giannetti & Yishay Yafeh, 2012. "Do Cultural Differences Between Contracting Parties Matter? Evidence from Syndicated Bank Loans," Management Science, INFORMS, vol. 58(2), pages 365-383, February.
    18. Dato, Simon & Feess, Eberhard & Nieken, Petra, 2024. "Lying in competitive environments: Identifying behavioral impacts," European Economic Review, Elsevier, vol. 170(C).
    19. Alexia Delfino & Miguel Espinosa, 2025. "Value Dissonance at Work," CESifo Working Paper Series 11690, CESifo.
    20. Kampkötter, Patrick & Sliwka, Dirk, 2011. "Differentiation and Performance: An Empirical Investigation on the Incentive Effects of Bonus Plans," IZA Discussion Papers 6070, Institute of Labor Economics (IZA).

    More about this item

    Keywords

    performance appraisal; evaluation formats; social judgment; machine learning; gender stereotypes; quantitative text analysis;
    All these keywords.

    JEL classification:

    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity
    • M51 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Personnel Economics - - - Firm Employment Decisions; Promotions
    • D91 - Microeconomics - - Micro-Based Behavioral Economics - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pdn:dispap:131. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: WP-WiWi-Info (email available below). General contact details of provider: https://edirc.repec.org/data/fwpadde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.