IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp14690.html
   My bibliography  Save this paper

Order Effects and Employment Decisions: Experimental Evidence from a Nationwide Program

Author

Listed:
  • Ajzenman, Nicolas

    (McGill University)

  • Elacqua, Gregory

    (Inter-American Development Bank)

  • Marotta, Luana

    (Inter-American Development Bank)

  • Olsen, Anne Sofie

    (Novo Nordisk)

Abstract

In this paper, we show that order effects operate in the context of high-stakes, real-world decisions: employment choices. We experimentally evaluate a nationwide program in Ecuador that changed the order of teaching vacancies on a job application platform in order to reduce teacher sorting (that is, lower-income students are more likely to attend schools with less qualified teachers). In the treatment arm, the platformshowed hard-tostaff schools (institutions typically located in more vulnerable areas that normally have greater difficulty attracting teachers) first, while in the control group teaching vacancies were displayed in alphabetical order. In both arms, hard-to-staff schools were labeled with an icon and identical information was given to teachers. We find that a teacher in the treatment arm was more likely to apply to hard-to-staff schools, to rank them as their highest priority, and to be assigned to a job vacancy in one of these schools. The effects were not driven by inattentive, altruistic, or less-qualified teachers. Instead, choice overload and fatigue seem to have played a role. The program has thus helped to reduce the unequal distribution of qualified teachers across schools of different socioeconomic backgrounds.

Suggested Citation

  • Ajzenman, Nicolas & Elacqua, Gregory & Marotta, Luana & Olsen, Anne Sofie, 2021. "Order Effects and Employment Decisions: Experimental Evidence from a Nationwide Program," IZA Discussion Papers 14690, Institute of Labor Economics (IZA).
  • Handle: RePEc:iza:izadps:dp14690
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp14690.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Steven G. Rivkin & Eric A. Hanushek & John F. Kain, 2005. "Teachers, Schools, and Academic Achievement," Econometrica, Econometric Society, vol. 73(2), pages 417-458, March.
    2. Thomas J. Kane & Douglas O. Staiger, 2008. "Estimating Teacher Impacts on Student Achievement: An Experimental Evaluation," NBER Working Papers 14607, National Bureau of Economic Research, Inc.
    3. Clotfelter, Charles & Glennie, Elizabeth & Ladd, Helen & Vigdor, Jacob, 2008. "Would higher salaries keep teachers in high-poverty schools? Evidence from a policy intervention in North Carolina," Journal of Public Economics, Elsevier, vol. 92(5-6), pages 1352-1370, June.
    4. Daniel Aaronson & Lisa Barrow & William Sander, 2007. "Teachers and Student Achievement in the Chicago Public High Schools," Journal of Labor Economics, University of Chicago Press, vol. 25(1), pages 95-135.
    5. Stefano DellaVigna, 2009. "Psychology and Economics: Evidence from the Field," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 315-372, June.
    6. M. Caridad Araujo & Pedro Carneiro & Yyannú Cruz-Aguayo & Norbert Schady, 2016. "Teacher Quality and Learning Outcomes in Kindergarten," The Quarterly Journal of Economics, Oxford University Press, vol. 131(3), pages 1415-1453.
    7. Pope, Devin G., 2009. "Reacting to rankings: Evidence from "America's Best Hospitals"," Journal of Health Economics, Elsevier, vol. 28(6), pages 1154-1165, December.
    8. Sass, Tim R. & Hannaway, Jane & Xu, Zeyu & Figlio, David N. & Feng, Li, 2012. "Value added of teachers in high-poverty schools and lower poverty schools," Journal of Urban Economics, Elsevier, vol. 72(2), pages 104-122.
    9. repec:mpr:mprres:7412 is not listed on IDEAS
    10. Armin Falk & Anke Becker & Thomas Dohmen & David Huffman & Uwe Sunde, 2023. "The Preference Survey Module: A Validated Instrument for Measuring Risk, Time, and Social Preferences," Management Science, INFORMS, vol. 69(4), pages 1935-1950, April.
    11. Nicolas Ajzenman & Ruben Durante, 2019. "Salience and Accountability: School Infrastructureand Last-Minute Electoral Punishment," School of Government Working Papers 201905, Universidad Torcuato Di Tella.
    12. Herbert A. Simon, 1955. "A Behavioral Model of Rational Choice," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 69(1), pages 99-118.
    13. Anindya Ghose & Panagiotis G. Ipeirotis & Beibei Li, 2014. "Examining the Impact of Ranking on Consumer Behavior and Search Engine Revenue," Management Science, INFORMS, vol. 60(7), pages 1632-1654, July.
    14. Dan Ariely & George Loewenstein & Drazen Prelec, 2003. ""Coherent Arbitrariness": Stable Demand Curves Without Stable Preferences," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(1), pages 73-106.
    15. Donald Boyd & Pamela Grossman & Hamilton Lankford & Susanna Loeb & James Wyckoff, 2006. "How Changes in Entry Requirements Alter the Teacher Workforce and Affect Student Achievement," Education Finance and Policy, MIT Press, vol. 1(2), pages 176-216, April.
    16. Ajzenman, Nicolás & Bertoni, Eleonora & Elacqua, Gregory & Marotta, Luana & Méndez, Carolina, 2020. "Altruism or Money?: Reducing Teacher Sorting Using Behavioral Strategies in Peru," IDB Publications (Working Papers) 10576, Inter-American Development Bank.
    17. Ned Augenblick & Scott Nicholson, 2016. "Ballot Position, Choice Fatigue, and Voter Behaviour," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 83(2), pages 460-480.
    18. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers II: Teacher Value-Added and Student Outcomes in Adulthood," American Economic Review, American Economic Association, vol. 104(9), pages 2633-2679, September.
    19. Donald Boyd & Hamilton Lankford & Susanna Loeb & James Wyckoff, 2005. "Explaining the Short Careers of High-Achieving Teachers in Schools with Low-Performing Students," American Economic Review, American Economic Association, vol. 95(2), pages 166-171, May.
    20. Torberg Falch, 2011. "Teacher Mobility Responses to Wage Changes: Evidence from a Quasi-natural Experiment," American Economic Review, American Economic Association, vol. 101(3), pages 460-465, May.
    21. Steven Glazerman & Ali Protik & Bing-ru Teh & Julie Bruch & Neil Seftor, "undated". "Moving High-Performing Teachers: Implementation of Transfer Incentives in Seven Districts," Mathematica Policy Research Reports 4e7e4fbcdda44b5fb91bc7933, Mathematica Policy Research.
    22. Emir Kamenica, 2008. "Contextual Inference in Markets: On the Informational Content of Product Lines," American Economic Review, American Economic Association, vol. 98(5), pages 2127-2149, December.
    23. Nicola Lacetera & Devin G. Pope & Justin R. Sydnor, 2012. "Heuristic Thinking and Limited Attention in the Car Market," American Economic Review, American Economic Association, vol. 102(5), pages 2206-2236, August.
    24. Gregory Elacqua & Diana Hincapie & Isabel Hincapie & Veronica Montalva, 2022. "Can Financial Incentives Help Disadvantaged Schools to Attract and Retain High‐Performing Teachers? Evidence from Chile," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 41(2), pages 603-631, March.
    25. Helen F. Ladd & Lucy C. Sorensen, 2017. "Returns to Teacher Experience: Student Achievement and Motivation in Middle School," Education Finance and Policy, MIT Press, vol. 12(2), pages 241-279, Spring.
    26. Ho, Daniel E. & Imai, Kosuke, 2006. "Randomization Inference With Natural Experiments: An Analysis of Ballot Effects in the 2003 California Recall Election," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 888-900, September.
    27. Jonathan Levav & Mark Heitmann & Andreas Herrmann & Sheena S. Iyengar, 2010. "Order in Product Customization Decisions: Evidence from Field Experiments," Journal of Political Economy, University of Chicago Press, vol. 118(2), pages 274-299, April.
    28. C. Kirabo Jackson, 2018. "What Do Test Scores Miss? The Importance of Teacher Effects on Non–Test Score Outcomes," Journal of Political Economy, University of Chicago Press, vol. 126(5), pages 2072-2107.
    29. Elacqua, Gregory & Marotta, Luana, 2020. "Is working one job better than many? Assessing the impact of multiple school jobs on teacher performance in Rio de Janeiro," Economics of Education Review, Elsevier, vol. 78(C).
    30. Emir Kamenica, 2012. "Behavioral Economics and Psychology of Incentives," Annual Review of Economics, Annual Reviews, vol. 4(1), pages 427-452, July.
    31. repec:mpr:mprres:7413 is not listed on IDEAS
    32. Brad M. Barber & Terrance Odean, 2008. "All That Glitters: The Effect of Attention and News on the Buying Behavior of Individual and Institutional Investors," The Review of Financial Studies, Society for Financial Studies, vol. 21(2), pages 785-818, April.
    33. C. Kirabo Jackson, 2009. "Student Demographics, Teacher Sorting, and Teacher Quality: Evidence from the End of School Desegregation," Journal of Labor Economics, University of Chicago Press, vol. 27(2), pages 213-256, April.
    34. Steven Dieterle & Cassandra M. Guarino & Mark D. Reckase & Jeffrey M. Wooldridge, 2015. "How do Principals Assign Students to Teachers? Finding Evidence in Administrative Data and the Implications for Value Added," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 34(1), pages 32-58, January.
    35. M. Caridad Araujo & Pedro Carneiro & Yyannú Cruz-Aguayo & Norbert Schady, 2016. "Teacher Quality and Learning Outcomes in Kindergarten," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(3), pages 1415-1453.
    36. Yuval Salant, 2011. "Procedural Analysis of Choice Rules with Applications to Bounded Rationality," American Economic Review, American Economic Association, vol. 101(2), pages 724-748, April.
    37. Li Feng & Tim R. Sass, 2018. "The Impact of Incentives to Recruit and Retain Teachers in “Hard†to†Staff†Subjects," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 37(1), pages 112-135, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Elacqua, Gregory & Gómez, Leidy & Krussig, Thomas & Marotta, Luana & Méndez, Carolina & Neilson, Christopher, 2022. "The Potential of Smart Matching Platforms in Teacher Assignment: The Case of Ecuador," IDB Publications (Working Papers) 12483, Inter-American Development Bank.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ajzenman, Nicolás & Bertoni, Eleonora & Elacqua, Gregory & Marotta, Luana & Méndez, Carolina, 2020. "Altruism or Money?: Reducing Teacher Sorting Using Behavioral Strategies in Peru," IDB Publications (Working Papers) 10576, Inter-American Development Bank.
    2. Elacqua, Gregory & Gómez, Leidy & Krussig, Thomas & Marotta, Luana & Méndez, Carolina & Neilson, Christopher, 2022. "The Potential of Smart Matching Platforms in Teacher Assignment: The Case of Ecuador," IDB Publications (Working Papers) 12483, Inter-American Development Bank.
    3. Andrew Agopsowicz & Chris Robinson & Ralph Stinebrickner & Todd Stinebrickner, 2020. "Careers and Mismatch for College Graduates: College and Noncollege Jobs," Journal of Human Resources, University of Wisconsin Press, vol. 55(4), pages 1194-1221.
    4. Jose Maria Cabrera & Dinand Webbink, 2020. "Do Higher Salaries Yield Better Teachers and Better Student Outcomes?," Journal of Human Resources, University of Wisconsin Press, vol. 55(4), pages 1222-1257.
    5. Hanushek, Eric A. & Rivkin, Steven G. & Schiman, Jeffrey C., 2016. "Dynamic effects of teacher turnover on the quality of instruction," Economics of Education Review, Elsevier, vol. 55(C), pages 132-148.
    6. Dinand Webbink & José María Cabrera, 2016. "Do higher salaries yield better teachers and better student outcomes?," Documentos de Trabajo/Working Papers 1604, Facultad de Ciencias Empresariales y Economia. Universidad de Montevideo..
    7. Elacqua, Gregory & Rosa, Leonardo, 2023. "Teacher transfers and the disruption of Teacher Staffing in the City of Sao Paulo," IDB Publications (Working Papers) 12702, Inter-American Development Bank.
    8. Li Feng & Tim R. Sass, 2017. "Teacher Quality and Teacher Mobility," Education Finance and Policy, MIT Press, vol. 12(3), pages 396-418, Summer.
    9. Michael Bates & Michael Dinerstein & Andrew C. Johnston & Isaac Sorkin, 2022. "Teacher Labor Market Equilibrium and Student Achievement," CESifo Working Paper Series 9551, CESifo.
    10. Matteo Bobba & Tim Ederer & Gianmarco León-Ciliotta & Christopher A. Neilson & Marco Nieddu, 2021. "Teacher compensation and structural inequality: Evidence from centralized teacher school choice in Perú," Economics Working Papers 1788, Department of Economics and Business, Universitat Pompeu Fabra.
    11. Hermann, Zoltán & Horváth, Hedvig, 2022. "Tanári eredményesség és tanár-diák összepárosítás az általános iskolákban. Empirikus mintázatok három magyarországi tankerület adatai alapján [Teacher effectiveness and teacher-student matching in ," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(11), pages 1377-1406.
    12. Gershenson, Seth, 2021. "Identifying and Producing Effective Teachers," IZA Discussion Papers 14096, Institute of Labor Economics (IZA).
    13. Thijssen, Maximiliaan W.P. & Rege, Mari & Solheim, Oddny J., 2022. "Teacher relationship skills and student learning," Economics of Education Review, Elsevier, vol. 89(C).
    14. Marc Steeg & Sander Gerritsen, 2016. "Teacher Evaluations and Pupil Achievement Gains: Evidence from Classroom Observations," De Economist, Springer, vol. 164(4), pages 419-443, December.
    15. Cowan, James & Goldhaber, Dan, 2018. "Do bonuses affect teacher staffing and student achievement in high poverty schools? Evidence from an incentive for national board certified teachers in Washington State," Economics of Education Review, Elsevier, vol. 65(C), pages 138-152.
    16. Lee Crawfurd & Caine Rolleston, 2020. "Long‐run effects of teachers in developing countries," Review of Development Economics, Wiley Blackwell, vol. 24(4), pages 1279-1299, November.
    17. Matthew A. Kraft & John P. Papay & Olivia L. Chi, 2020. "Teacher Skill Development: Evidence from Performance Ratings by Principals," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(2), pages 315-347, March.
    18. Stephen Machin & Sandra McNally & Martina Viarengo, 2018. "Changing How Literacy Is Taught: Evidence on Synthetic Phonics," American Economic Journal: Economic Policy, American Economic Association, vol. 10(2), pages 217-241, May.
    19. Canales, Andrea & Maldonado, Luis, 2018. "Teacher quality and student achievement in Chile: Linking teachers' contribution and observable characteristics," International Journal of Educational Development, Elsevier, vol. 60(C), pages 33-50.
    20. Gregory Elacqua & Diana Hincapie & Isabel Hincapie & Veronica Montalva, 2022. "Can Financial Incentives Help Disadvantaged Schools to Attract and Retain High‐Performing Teachers? Evidence from Chile," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 41(2), pages 603-631, March.

    More about this item

    Keywords

    order effects; teacher sorting; satisficing;
    All these keywords.

    JEL classification:

    • I24 - Health, Education, and Welfare - - Education - - - Education and Inequality
    • D91 - Microeconomics - - Micro-Based Behavioral Economics - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making
    • I25 - Health, Education, and Welfare - - Education - - - Education and Economic Development

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp14690. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.