IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/25800.html
   My bibliography  Save this paper

Incentivized Resume Rating: Eliciting Employer Preferences without Deception

Author

Listed:
  • Judd B. Kessler
  • Corinne Low
  • Colin Sullivan

Abstract

We introduce a new experimental paradigm to evaluate employer preferences, called Incentivized Resume Rating (IRR). Employers evaluate resumes they know to be hypothetical in order to be matched with real job seekers, preserving incentives while avoiding the deception necessary in audit studies. We deploy IRR with employers recruiting college seniors from a prestigious school, randomizing human capital characteristics and demographics of hypothetical candidates. We measure both employer preferences for candidates and employer beliefs about the likelihood candidates will accept job offers, avoiding a typical confound in audit studies. We discuss the costs, benefits, and future applications of this new methodology.

Suggested Citation

  • Judd B. Kessler & Corinne Low & Colin Sullivan, 2019. "Incentivized Resume Rating: Eliciting Employer Preferences without Deception," NBER Working Papers 25800, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:25800
    Note: ED LS PE
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w25800.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Rajeev Darolia & Cory Koedel & Paco Martorell & Katie Wilson & Francisco Perez‐Arce, 2015. "Do Employers Prefer Workers Who Attend For‐Profit Colleges? Evidence from a Field Experiment," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 34(4), pages 881-903, September.
    2. Lars J. Kirkeboen & Edwin Leuven & Magne Mogstad, 2016. "Editor's Choice Field of Study, Earnings, and Self-Selection," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(3), pages 1057-1111.
    3. Scott E. Carrell & Marianne E. Page & James E. West, 2010. "Sex and Science: How Professor Gender Perpetuates the Gender Gap," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(3), pages 1101-1144.
    4. David H. Autor & Susan N. Houseman, 2010. "Do Temporary-Help Jobs Improve Labor Market Outcomes for Low-Skilled Workers? Evidence from "Work First"," American Economic Journal: Applied Economics, American Economic Association, vol. 2(3), pages 96-128, July.
    5. Hanson, Andrew & Hawley, Zackary, 2011. "Do landlords discriminate in the rental housing market? Evidence from an internet field experiment in US cities," Journal of Urban Economics, Elsevier, vol. 70(2-3), pages 99-114, September.
    6. Andreas Ortmann & Ralph Hertwig, 2002. "The Costs of Deception: Evidence from Psychology," Experimental Economics, Springer;Economic Science Association, vol. 5(2), pages 111-131, October.
    7. Asaf Zussman, 2013. "Ethnic Discrimination: Lessons from the Israeli Online Market for Used Cars," Economic Journal, Royal Economic Society, vol. 123(11), pages 433-468, November.
    8. Gaddis, S. Michael, 2015. "Discrimination in the Credential Society: An Audit Study of Race and College Selectivity in the Labor Market," SocArXiv 6qjue, Center for Open Science.
    9. Stefan Eriksson & Dan-Olof Rooth, 2014. "Do Employers Use Unemployment as a Sorting Criterion When Hiring? Evidence from a Field Experiment," American Economic Review, American Economic Association, vol. 104(3), pages 1014-1039, March.
    10. J. Aislinn Bohren & Alex Imas & Michael Rosenberg, 2019. "The Dynamics of Discrimination: Theory and Evidence," American Economic Review, American Economic Association, vol. 109(10), pages 3395-3436, October.
    11. Vojtěch Bartoš & Michal Bauer & Julie Chytilová & Filip Matějka, 2016. "Attention Discrimination: Theory and Field Experiments with Monitoring Information Acquisition," American Economic Review, American Economic Association, vol. 106(6), pages 1437-1475, June.
    12. Henry S. Farber & Chris M. Herbst & Dan Silverman & Till von Wachter, 2018. "Whom Do Employers Want? The Role of Recent Employment and Unemployment Status and Age," NBER Working Papers 24605, National Bureau of Economic Research, Inc.
    13. Glenn W. Harrison & John A. List, 2004. "Field Experiments," Journal of Economic Literature, American Economic Association, vol. 42(4), pages 1009-1055, December.
    14. William Greene, 2004. "The behaviour of the maximum likelihood estimator of limited dependent variable models in the presence of fixed effects," Econometrics Journal, Royal Economic Society, vol. 7(1), pages 98-119, June.
    15. Marianne Bertrand & Dolly Chugh & Sendhil Mullainathan, 2005. "Implicit Discrimination," American Economic Review, American Economic Association, vol. 95(2), pages 94-98, May.
    16. Michael Ewens & Bryan Tomlin & Liang Choon Wang, 2014. "Statistical Discrimination or Prejudice? A Large Sample Field Experiment," The Review of Economics and Statistics, MIT Press, vol. 96(1), pages 119-134, March.
    17. David Neumark & Ian Burn & Patrick Button, 2019. "Is It Harder for Older Workers to Find Jobs? New and Improved Evidence from a Field Experiment," Journal of Political Economy, University of Chicago Press, vol. 127(2), pages 922-970.
    18. Kevin Lang & Jee-Yeon K. Lehmann, 2012. "Racial Discrimination in the Labor Market: Theory and Empirics," Journal of Economic Literature, American Economic Association, vol. 50(4), pages 959-1006, December.
    19. Riach Peter A & Rich Judith, 2006. "An Experimental Investigation of Sexual Discrimination in Hiring in the English Labor Market," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 5(2), pages 1-22, January.
    20. James J. Heckman, 1998. "Detecting Discrimination," Journal of Economic Perspectives, American Economic Association, vol. 12(2), pages 101-116, Spring.
    21. David Neumark, 2012. "Detecting Discrimination in Audit and Correspondence Studies," Journal of Human Resources, University of Wisconsin Press, vol. 47(4), pages 1128-1157.
    22. Henry S. Farber & Chris M. Herbst & Dan Silverman & Till von Wachter, 2018. "Whom Do Employers Want? The Role of Recent Employment and Unemployment Status and Age," Working Papers 619, Princeton University, Department of Economics, Industrial Relations Section..
    23. Daniel M. Butler & David E. Broockman, 2011. "Do Politicians Racially Discriminate Against Constituents? A Field Experiment on State Legislators," American Journal of Political Science, John Wiley & Sons, vol. 55(3), pages 463-477, July.
    24. Altonji, Joseph G. & Blank, Rebecca M., 1999. "Race and gender in the labor market," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 48, pages 3143-3259, Elsevier.
    25. David J. Deming & Noam Yuchtman & Amira Abulafi & Claudia Goldin & Lawrence F. Katz, 2016. "The Value of Postsecondary Credentials in the Labor Market: An Experimental Study," American Economic Review, American Economic Association, vol. 106(3), pages 778-806, March.
    26. Jonathan de Quidt & Johannes Haushofer & Christopher Roth, 2018. "Measuring and Bounding Experimenter Demand," American Economic Review, American Economic Association, vol. 108(11), pages 3266-3302, November.
    27. Kory Kroft & Fabian Lange & Matthew J. Notowidigdo, 2013. "Duration Dependence and Labor Market Conditions: Evidence from a Field Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(3), pages 1123-1167.
    28. repec:eee:labchp:v:3:y:1999:i:pc:p:3143-3259 is not listed on IDEAS
    29. John M. Nunley & Adam Pugh & Nicholas Romero & Richard Alan Seals, Jr., 2014. "Unemployment, Underemployment, and Employment Opportunities: Results from a Correspondence Audit of the Labor Market for College Graduates," Auburn Economics Working Paper Series auwp2014-04, Department of Economics, Auburn University.
    30. Claudia Goldin, 2014. "A Grand Gender Convergence: Its Last Chapter," American Economic Review, American Economic Association, vol. 104(4), pages 1091-1119, April.
    31. John M. Nunley & Adam Pugh & Nicholas Romero & R. Alan Seals, 2017. "The Effects of Unemployment and Underemployment on Employment Opportunities," ILR Review, Cornell University, ILR School, vol. 70(3), pages 642-669, May.
    32. Marianne Bertrand & Esther Duflo, 2016. "Field Experiments on Discrimination," NBER Working Papers 22014, National Bureau of Economic Research, Inc.
    33. Amanda Pallais, 2014. "Inefficient Hiring in Entry-Level Labor Markets," American Economic Review, American Economic Association, vol. 104(11), pages 3565-3599, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Judd Kessler & Corinne Low & Colin D. Sullivan, 2019. "Incentivized Resume Rating: Eliciting Employer Preferences without Deception," Working Papers 2019-039, Human Capital and Economic Opportunity Working Group.
    2. Gaddis, S. Michael, 2018. "An Introduction to Audit Studies in the Social Sciences," SocArXiv e5hfc, Center for Open Science.
    3. Button, Patrick & Walker, Brigham, 2020. "Employment discrimination against Indigenous Peoples in the United States: Evidence from a field experiment," Labour Economics, Elsevier, vol. 65(C).
    4. Chowdhury, Shyamal & Ooi, Evarn & Slonim, Robert, 2020. "Racial Discrimination and White First Name Adoption: Evidence from a Correspondence Study in the Australian Labour Market," IZA Discussion Papers 13208, Institute of Labor Economics (IZA).
    5. David Neumark, 2018. "Experimental Research on Labor Market Discrimination," Journal of Economic Literature, American Economic Association, vol. 56(3), pages 799-866, September.
    6. Marianne Bertrand & Esther Duflo, 2016. "Field Experiments on Discrimination," NBER Working Papers 22014, National Bureau of Economic Research, Inc.
    7. David Neumark, 2016. "Experimental Research on Labor Market Discrimination," NBER Working Papers 22022, National Bureau of Economic Research, Inc.
    8. Carlsson, Magnus & Eriksson, Stefan, 2019. "Age discrimination in hiring decisions: Evidence from a field experiment in the labor market," Labour Economics, Elsevier, vol. 59(C), pages 173-183.
    9. Nickolas Gagnon & Kristof Bosmans & Arno Riedl, 2020. "The Effect of Unfair Chances and Gender Discrimination on Labor Supply," CESifo Working Paper Series 8058, CESifo.
    10. Hinrichs, Peter, 2021. "What kind of teachers are schools looking for? Evidence from a randomized field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 186(C), pages 395-411.
    11. Marianne Bertrand & Esther Duflo, 2016. "Field Experiments on Discrimination," NBER Working Papers 22014, National Bureau of Economic Research, Inc.
    12. Rich, Judy, 2014. "What Do Field Experiments of Discrimination in Markets Tell Us? A Meta Analysis of Studies Conducted since 2000," IZA Discussion Papers 8584, Institute of Labor Economics (IZA).
    13. Soumitra Shukla, 2021. "Between College and That First Job: Designing and Evaluating Policies for Hiring Diversity," International Finance Discussion Papers 1331, Board of Governors of the Federal Reserve System (U.S.).
    14. Joanna N. Lahey & Douglas R. Oxley, 2021. "Discrimination at the Intersection of Age, Race, and Gender: Evidence from an Eye‐Tracking Experiment," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 40(4), pages 1083-1119, September.
    15. Ewens, Michael, 2022. "Race and Gender in Entrepreneurial Finance," SocArXiv djf8z, Center for Open Science.
    16. Ye Zhang, 2020. "Discrimination in the Venture Capital Industry: Evidence from Field Experiments," Papers 2010.16084, arXiv.org, revised Aug 2022.
    17. Stefan Eriksson & Per Johansson & Sophie Langenskiöld, 2017. "What is the right profile for getting a job? A stated choice experiment of the recruitment process," Empirical Economics, Springer, vol. 53(2), pages 803-826, September.
    18. Adermon, Adrian & Hensvik, Lena, 2022. "Gig-jobs: Stepping stones or dead ends?," Labour Economics, Elsevier, vol. 76(C).
    19. Valfort, Marie-Anne, 2020. "Anti-Muslim discrimination in France: Evidence from a field experiment," World Development, Elsevier, vol. 135(C).
    20. Baert, Stijn, 2017. "Hiring Discrimination: An Overview of (Almost) All Correspondence Experiments Since 2005," GLO Discussion Paper Series 61, Global Labor Organization (GLO).

    More about this item

    JEL classification:

    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity
    • J71 - Labor and Demographic Economics - - Labor Discrimination - - - Hiring and Firing

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:25800. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.