IDEAS home Printed from https://ideas.repec.org/p/ajk/ajkdps/045.html
   My bibliography  Save this paper

Interview Sequences and the Formation of Subjective Assessments

Author

Listed:
  • Jonas Radbruch

    (HU Berlin, Spandauer Straße 1, 10178 Berlin, Germany)

  • Amelie Schiprowski

    (University of Bonn, Adenauerallee 24-42, 53113 Bonn, Germany)

Abstract

Interviewing is a decisive stage of most processes that match candidates to firms and or-ganizations. This paper studies how and why a candidate’s interview outcome depends on the other candidates interviewed by the same evaluator. We use large-scale data from high-stakes admission and hiring processes, where candidates are quasi-randomly as-signed to evaluators and time slots. We find that the individual assessment decreases as the quality of other candidates assigned to the same evaluator increases. The influence of the previous candidate stands out, leading to a negative autocorrelation in evaluators’ votes of up to 40% and distorting final admission and hiring decisions. Our findings are in line with a contrast effect model where evaluators form a benchmark through associa-tive recall. We assess potential changes in the design of interview processes to mitigate contrasting against the previous candidate.

Suggested Citation

  • Jonas Radbruch & Amelie Schiprowski, 2020. "Interview Sequences and the Formation of Subjective Assessments," ECONtribute Discussion Papers Series 045, University of Bonn and University of Cologne, Germany.
  • Handle: RePEc:ajk:ajkdps:045
    as

    Download full text from publisher

    File URL: https://www.econtribute.de/RePEc/ajk/ajkdps/ECONtribute_045_2020.pdf
    File Function: Fourth version, 2024
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Mitchell Hoffman & Lisa B Kahn & Danielle Li, 2018. "Discretion in Hiring," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(2), pages 765-800.
    2. Pedro Bordalo & Nicola Gennaioli & Andrei Shleifer, 2019. "Memory and Reference Prices: An Application to Rental Choice," AEA Papers and Proceedings, American Economic Association, vol. 109, pages 572-576, May.
    3. Oyer, Paul & Schaefer, Scott, 2011. "Personnel Economics: Hiring and Incentives," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 20, pages 1769-1823, Elsevier.
    4. David Card & Stefano DellaVigna & Patricia Funk & Nagore Iriberri, 2020. "Are Referees and Editors in Economics Gender Neutral?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 135(1), pages 269-327.
    5. Stefano Della & Jörg Heining & Johannes F Schmieder & Simon Trenkle, 2023. "Evidence on Job Search Models from a Survey of Unemployed Workers in Germany," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 137(2), pages 1181-1232.
    6. Kory Kroft & Fabian Lange & Matthew J. Notowidigdo, 2013. "Duration Dependence and Labor Market Conditions: Evidence from a Field Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(3), pages 1123-1167.
    7. David Laibson, 2001. "A Cue-Theory of Consumption," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(1), pages 81-119.
    8. Altonji, Joseph G & Segal, Lewis M, 1996. "Small-Sample Bias in GMM Estimation of Covariance Structures," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(3), pages 353-366, July.
    9. Benjamin Enke & Frederik Schwerter & Florian Zimmermann, 2019. "Associative Memory and Belief Formation," CESifo Working Paper Series 7916, CESifo.
    10. Jonathan Guryan & Kory Kroft & Matthew J. Notowidigdo, 2009. "Peer Effects in the Workplace: Evidence from Random Groupings in Professional Golf Tournaments," American Economic Journal: Applied Economics, American Economic Association, vol. 1(4), pages 34-68, October.
    11. Nicola Gennaioli & Andrei Shleifer, 2010. "What Comes to Mind," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(4), pages 1399-1433.
    12. Sebastian Galiani & Juan Pantano, 2021. "Structural Models: Inception and Frontier," NBER Working Papers 28698, National Bureau of Economic Research, Inc.
    13. Victor A. Ginsburgh & Jan C. van Ours, 2003. "Expert Opinion and Compensation: Evidence from a Musical Competition," American Economic Review, American Economic Association, vol. 93(1), pages 289-296, March.
    14. Pedro Bordalo & Nicola Gennaioli & Andrei Shleifer, 2020. "Memory, Attention, and Choice," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 135(3), pages 1399-1442.
    15. Uri Simonsohn & George Loewenstein, 2006. "Mistake #37: The Effect of Previously Encountered Prices on Current Housing Demand," Economic Journal, Royal Economic Society, vol. 116(508), pages 175-199, January.
    16. Nickell, Stephen J, 1981. "Biases in Dynamic Models with Fixed Effects," Econometrica, Econometric Society, vol. 49(6), pages 1417-1426, November.
    17. Neil Thakral & Linh T. Tô, 2021. "Daily Labor Supply and Adaptive Reference Points," American Economic Review, American Economic Association, vol. 111(8), pages 2417-2443, August.
    18. Daniel Chen & Tobias J. Moskowitz & Kelly Shue, 2016. "Decision-Making under the Gambler's Fallacy: Evidence from Asylum Judges, Loan Officers, and Baseball Umpires," NBER Working Papers 22026, National Bureau of Economic Research, Inc.
    19. Uri Simonsohn, 2006. "New Yorkers Commute More Everywhere: Contrast Effects in the Field," The Review of Economics and Statistics, MIT Press, vol. 88(1), pages 1-9, February.
    20. Ricardo Estrada, 2019. "Rules versus Discretion in Public Service: Teacher Hiring in Mexico," Journal of Labor Economics, University of Chicago Press, vol. 37(2), pages 545-579.
    21. Marianne Bertrand & Sendhil Mullainathan, 2004. "Are Emily and Greg More Employable Than Lakisha and Jamal? A Field Experiment on Labor Market Discrimination," American Economic Review, American Economic Association, vol. 94(4), pages 991-1013, September.
    22. Danielle Li & Lindsey R. Raymond & Peter Bergman, 2020. "Hiring as Exploration," NBER Working Papers 27736, National Bureau of Economic Research, Inc.
    23. David H. Autor & David Scarborough, 2008. "Does Job Testing Harm Minority Workers? Evidence from Retail Establishments," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 123(1), pages 219-277.
    24. John J. Horton, 2017. "The Effects of Algorithmic Labor Market Recommendations: Evidence from a Field Experiment," Journal of Labor Economics, University of Chicago Press, vol. 35(2), pages 345-385.
    25. B. Douglas Bernheim & Antonio Rangel, 2004. "Addiction and Cue-Triggered Decision Processes," American Economic Review, American Economic Association, vol. 94(5), pages 1558-1590, December.
    26. Matthew Rabin, 2002. "Inference by Believers in the Law of Small Numbers," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(3), pages 775-816.
    27. Daniel L. Chen & Tobias J. Moskowitz & Kelly Shue, 2016. "Decision Making Under the Gambler’s Fallacy: Evidence from Asylum Judges, Loan Officers, and Baseball Umpires," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(3), pages 1181-1242.
    28. Danielle Li, 2017. "Expertise versus Bias in Evaluation: Evidence from the NIH," American Economic Journal: Applied Economics, American Economic Association, vol. 9(2), pages 60-92, April.
    29. Sendhil Mullainathan, 2002. "A Memory-Based Model of Bounded Rationality," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(3), pages 735-774.
    30. Samuel M. Hartzmark & Kelly Shue, 2018. "A Tough Act to Follow: Contrast Effects in Financial Markets," Journal of Finance, American Finance Association, vol. 73(4), pages 1567-1613, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jonas Radbruch & Amelie Schiprowski, 2024. "Interview Sequences and the Formation of Subjective Assessments," Rationality and Competition Discussion Paper Series 497, CRC TRR 190 Rationality and Competition.
    2. Jonas Radbruch & Amelie Schiprowski, 2024. "Interview Sequences and the Formation of Subjective Assessments," CESifo Working Paper Series 10957, CESifo.
    3. Anna Bindler & Randi Hjalmarsson, 2019. "Path Dependency in Jury Decision Making," Journal of the European Economic Association, European Economic Association, vol. 17(6), pages 1971-2017.
    4. Daniel J. Benjamin, 2018. "Errors in Probabilistic Reasoning and Judgment Biases," NBER Working Papers 25200, National Bureau of Economic Research, Inc.
    5. Samuel M. Hartzmark & Kelly Shue, 2017. "A Tough Act to Follow: Contrast Effects In Financial Markets," NBER Working Papers 23883, National Bureau of Economic Research, Inc.
    6. Pedro Bordalo & Nicola Gennaioli & Andrei Shleifer, 2020. "Memory, Attention, and Choice," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 135(3), pages 1399-1442.
    7. Diana Moreira & Santiago Pérez, 2022. "Who Benefits from Meritocracy?," NBER Working Papers 30113, National Bureau of Economic Research, Inc.
    8. Abebe, Girum & Caria, Stefano & Fafchamps, Marcel & Falco, Paolo & Franklin, Simon & Quinn, Simon & Shilpi, Forhad, 2017. "Matching firms and workers in a field experiment in Ethiopia," LSE Research Online Documents on Economics 86572, London School of Economics and Political Science, LSE Library.
    9. Hagenbach, Jeanne & Koessler, Frédéric, 2022. "Selective memory of a psychological agent," European Economic Review, Elsevier, vol. 142(C).
    10. Gagnon-Bartsch, Tristan & Bushong, Benjamin, 2022. "Learning with misattribution of reference dependence," Journal of Economic Theory, Elsevier, vol. 203(C).
    11. Brändle, Tobias & Grunau, Philipp & Haylock, Michael & Kampkötter, Patrick, 2020. "Recruitment strategies and match quality - New evidence from representative linked employer-employee data," University of Tübingen Working Papers in Business and Economics 134, University of Tuebingen, Faculty of Economics and Social Sciences, School of Business and Economics.
    12. Benjamin Enke & Frederik Schwerter & Florian Zimmermann, 2019. "Associative Memory and Belief Formation," CESifo Working Paper Series 7916, CESifo.
    13. Markus M. Möbius & Muriel Niederle & Paul Niehaus & Tanya S. Rosenblat, 2022. "Managing Self-Confidence: Theory and Experimental Evidence," Management Science, INFORMS, vol. 68(11), pages 7793-7817, November.
    14. Moshe A. Barach & John Horton, 2017. "How Do Employers Use Compensation History?: Evidence from a Field Experiment," CESifo Working Paper Series 6559, CESifo.
    15. Abel, Martin & Burger, Rulof, 2023. "Unpacking Name-Based Race Discrimination," IZA Discussion Papers 16254, Institute of Labor Economics (IZA).
    16. Alejandro Núnez Arroyo, 2018. "Information seeking with selective memory," Documentos CEDE 17131, Universidad de los Andes, Facultad de Economía, CEDE.
    17. Payzan-LeNestour, Elise & Pradier, Lionnel & Putniņš, Tālis J., 2023. "Biased risk perceptions: Evidence from the laboratory and financial markets," Journal of Banking & Finance, Elsevier, vol. 154(C).
    18. Jens Ludwig & Sendhil Mullainathan, 2021. "Fragile Algorithms and Fallible Decision-Makers: Lessons from the Justice System," Journal of Economic Perspectives, American Economic Association, vol. 35(4), pages 71-96, Fall.
    19. Amanda Agan & Sonja Starr, 2016. "Ban the Box, Criminal Records, and Statistical Discrimination: A Field Experiment," Working Papers 598, Princeton University, Department of Economics, Industrial Relations Section..
    20. Scott Duke Kominers & Xiaosheng Mu & Alexander Peysakhovich, 2019. "Paying for Attention: The Impact of Information Processing Costs on Bayesian Inference," Working Papers 2019-31, Princeton University. Economics Department..

    More about this item

    JEL classification:

    • D91 - Microeconomics - - Micro-Based Behavioral Economics - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making
    • J20 - Labor and Demographic Economics - - Demand and Supply of Labor - - - General
    • M51 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Personnel Economics - - - Firm Employment Decisions; Promotions

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ajk:ajkdps:045. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ECONtribute Office (email available below). General contact details of provider: https://www.econtribute.de .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.