IDEAS home Printed from https://ideas.repec.org/p/ces/ceswps/_10957.html
   My bibliography  Save this paper

Interview Sequences and the Formation of Subjective Assessments

Author

Listed:
  • Jonas Radbruch
  • Amelie Schiprowski

Abstract

Interviewing is a decisive stage of most processes that match candidates to firms and organizations. This paper studies how and why a candidate’s interview outcome depends on the other candidates interviewed by the same evaluator. We use large-scale data from high-stakes admission and hiring processes, where candidates are quasi-randomly assigned to evaluators and time slots. We find that the individual assessment decreases as the quality of other candidates assigned to the same evaluator increases. The influence of the previous candidate stands out, leading to a negative autocorrelation in evaluators’ votes of up to 40% and distorting final admission and hiring decisions. Our findings are in line with a contrast effect model where evaluators form a benchmark through associative recall. We assess potential changes in the design of interview processes to mitigate contrasting against the previous candidate.

Suggested Citation

  • Jonas Radbruch & Amelie Schiprowski, 2024. "Interview Sequences and the Formation of Subjective Assessments," CESifo Working Paper Series 10957, CESifo.
  • Handle: RePEc:ces:ceswps:_10957
    as

    Download full text from publisher

    File URL: https://www.cesifo.org/DocDL/cesifo1_wp10957.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Mitchell Hoffman & Lisa B Kahn & Danielle Li, 2018. "Discretion in Hiring," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(2), pages 765-800.
    2. Pedro Bordalo & Nicola Gennaioli & Andrei Shleifer, 2019. "Memory and Reference Prices: An Application to Rental Choice," AEA Papers and Proceedings, American Economic Association, vol. 109, pages 572-576, May.
    3. Koen Jochmans, 2023. "Testing random assignment to peer groups," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(3), pages 321-333, April.
    4. David Card & Stefano DellaVigna & Patricia Funk & Nagore Iriberri, 2020. "Are Referees and Editors in Economics Gender Neutral?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 135(1), pages 269-327.
    5. Hassan Afrouzi & Spencer Y Kwon & Augustin Landier & Yueran Ma & David Thesmar, 2023. "Overreaction in Expectations: Evidence and Theory," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 138(3), pages 1713-1764.
    6. Altonji, Joseph G & Segal, Lewis M, 1996. "Small-Sample Bias in GMM Estimation of Covariance Structures," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(3), pages 353-366, July.
    7. Benjamin Enke & Frederik Schwerter & Florian Zimmermann, 2019. "Associative Memory and Belief Formation," CESifo Working Paper Series 7916, CESifo.
    8. Jonathan Guryan & Kory Kroft & Matthew J. Notowidigdo, 2009. "Peer Effects in the Workplace: Evidence from Random Groupings in Professional Golf Tournaments," American Economic Journal: Applied Economics, American Economic Association, vol. 1(4), pages 34-68, October.
    9. Pedro Bordalo & Nicola Gennaioli & Andrei Shleifer, 2020. "Memory, Attention, and Choice," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 135(3), pages 1399-1442.
    10. Uri Simonsohn & George Loewenstein, 2006. "Mistake #37: The Effect of Previously Encountered Prices on Current Housing Demand," Economic Journal, Royal Economic Society, vol. 116(508), pages 175-199, January.
    11. Nickell, Stephen J, 1981. "Biases in Dynamic Models with Fixed Effects," Econometrica, Econometric Society, vol. 49(6), pages 1417-1426, November.
    12. Neil Thakral & Linh T. Tô, 2021. "Daily Labor Supply and Adaptive Reference Points," American Economic Review, American Economic Association, vol. 111(8), pages 2417-2443, August.
    13. Daniel Chen & Tobias J. Moskowitz & Kelly Shue, 2016. "Decision-Making under the Gambler's Fallacy: Evidence from Asylum Judges, Loan Officers, and Baseball Umpires," NBER Working Papers 22026, National Bureau of Economic Research, Inc.
    14. Uri Simonsohn, 2006. "New Yorkers Commute More Everywhere: Contrast Effects in the Field," The Review of Economics and Statistics, MIT Press, vol. 88(1), pages 1-9, February.
    15. Ricardo Estrada, 2019. "Rules versus Discretion in Public Service: Teacher Hiring in Mexico," Journal of Labor Economics, University of Chicago Press, vol. 37(2), pages 545-579.
    16. Stefano Della & Jörg Heining & Johannes F Schmieder & Simon Trenkle, 2022. "Evidence on Job Search Models from a Survey of Unemployed Workers in Germany [Reference-Dependent Preferences: Evidence from Marathon Runners]," The Quarterly Journal of Economics, Oxford University Press, vol. 137(2), pages 1181-1232.
    17. Danielle Li & Lindsey R. Raymond & Peter Bergman, 2020. "Hiring as Exploration," NBER Working Papers 27736, National Bureau of Economic Research, Inc.
    18. David H. Autor & David Scarborough, 2008. "Does Job Testing Harm Minority Workers? Evidence from Retail Establishments," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 123(1), pages 219-277.
    19. John J. Horton, 2017. "The Effects of Algorithmic Labor Market Recommendations: Evidence from a Field Experiment," Journal of Labor Economics, University of Chicago Press, vol. 35(2), pages 345-385.
    20. Matthew Rabin, 2002. "Inference by Believers in the Law of Small Numbers," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(3), pages 775-816.
    21. Daniel L. Chen & Tobias J. Moskowitz & Kelly Shue, 2016. "Decision Making Under the Gambler’s Fallacy: Evidence from Asylum Judges, Loan Officers, and Baseball Umpires," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(3), pages 1181-1242.
    22. Sendhil Mullainathan, 2002. "A Memory-Based Model of Bounded Rationality," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(3), pages 735-774.
    23. Samuel M. Hartzmark & Kelly Shue, 2018. "A Tough Act to Follow: Contrast Effects in Financial Markets," Journal of Finance, American Finance Association, vol. 73(4), pages 1567-1613, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jonas Radbruch & Amelie Schiprowski, 2024. "Interview Sequences and the Formation of Subjective Assessments," Rationality and Competition Discussion Paper Series 497, CRC TRR 190 Rationality and Competition.
    2. Jonas Radbruch & Amelie Schiprowski, 2020. "Interview Sequences and the Formation of Subjective Assessments," ECONtribute Discussion Papers Series 045, University of Bonn and University of Cologne, Germany.
    3. Anna Bindler & Randi Hjalmarsson, 2019. "Path Dependency in Jury Decision Making," Journal of the European Economic Association, European Economic Association, vol. 17(6), pages 1971-2017.
    4. Samuel M. Hartzmark & Kelly Shue, 2017. "A Tough Act to Follow: Contrast Effects In Financial Markets," NBER Working Papers 23883, National Bureau of Economic Research, Inc.
    5. Gagnon-Bartsch, Tristan & Bushong, Benjamin, 2022. "Learning with misattribution of reference dependence," Journal of Economic Theory, Elsevier, vol. 203(C).
    6. Daniel J. Benjamin, 2018. "Errors in Probabilistic Reasoning and Judgment Biases," NBER Working Papers 25200, National Bureau of Economic Research, Inc.
    7. Moreira, Diana B. & Perez, Santiago, 2022. "Who Benefits from Meritocracy?," IZA Discussion Papers 15341, Institute of Labor Economics (IZA).
    8. Xie, Erhao, 2021. "Empirical properties and identification of adaptive learning models in behavioral game theory," Journal of Economic Behavior & Organization, Elsevier, vol. 191(C), pages 798-821.
    9. Hagenbach, Jeanne & Koessler, Frédéric, 2022. "Selective memory of a psychological agent," European Economic Review, Elsevier, vol. 142(C).
    10. He, Kevin, 2022. "Mislearning from censored data: The gambler's fallacy and other correlational mistakes in optimal-stopping problems," Theoretical Economics, Econometric Society, vol. 17(3), July.
    11. Brändle, Tobias & Grunau, Philipp & Haylock, Michael & Kampkötter, Patrick, 2020. "Recruitment strategies and match quality - New evidence from representative linked employer-employee data," University of Tübingen Working Papers in Business and Economics 134, University of Tuebingen, Faculty of Economics and Social Sciences, School of Business and Economics.
    12. Robert M. Lantis & Erik T. Nesson, 2019. "Hot Shots: An Analysis of the ‘Hot Hand’ in NBA Field Goal and Free Throw Shooting," NBER Working Papers 26510, National Bureau of Economic Research, Inc.
    13. Jon Kleinberg & Annie Liang & Sendhil Mullainathan, 2017. "The Theory is Predictive, but is it Complete? An Application to Human Perception of Randomness," PIER Working Paper Archive 17-025, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 09 Aug 2017.
    14. Qingxia Kong & Georg D. Granic & Nicolas S. Lambert & Chung Piaw Teo, 2020. "Judgment Error in Lottery Play: When the Hot Hand Meets the Gambler’s Fallacy," Management Science, INFORMS, vol. 66(2), pages 844-862, February.
    15. Claudine Desrieux & Romain Espinosa & Michael Visser, 2022. "Simultaneous Decision Making of Juries: Evidence From the Paris Labor Court," CIRED Working Papers hal-04104190, HAL.
    16. Daniel L. Chen & Tobias J. Moskowitz & Kelly Shue, 2016. "Decision Making Under the Gambler’s Fallacy: Evidence from Asylum Judges, Loan Officers, and Baseball Umpires," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(3), pages 1181-1242.
    17. Neszveda, G., 2019. "Essays on behavioral finance," Other publications TiSEM 05059039-5236-42a3-be1b-3, Tilburg University, School of Economics and Management.
    18. Markus M. Möbius & Muriel Niederle & Paul Niehaus & Tanya S. Rosenblat, 2022. "Managing Self-Confidence: Theory and Experimental Evidence," Management Science, INFORMS, vol. 68(11), pages 7793-7817, November.
    19. Pedro Bordalo & Nicola Gennaioli & Andrei Shleifer, 2020. "Memory, Attention, and Choice," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 135(3), pages 1399-1442.
    20. Abel, Martin & Burger, Rulof, 2023. "Unpacking Name-Based Race Discrimination," IZA Discussion Papers 16254, Institute of Labor Economics (IZA).

    More about this item

    Keywords

    interviews; hiring; contrast effect; memory;
    All these keywords.

    JEL classification:

    • D91 - Microeconomics - - Micro-Based Behavioral Economics - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making
    • J20 - Labor and Demographic Economics - - Demand and Supply of Labor - - - General
    • M51 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Personnel Economics - - - Firm Employment Decisions; Promotions

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ces:ceswps:_10957. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Klaus Wohlrabe (email available below). General contact details of provider: https://edirc.repec.org/data/cesifde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.