IDEAS home Printed from https://ideas.repec.org/p/zbw/i4rdps/141.html
   My bibliography  Save this paper

Job Market Stars

Author

Listed:
  • Brodeur, Abel
  • Kattan, Lamis
  • Musumeci, Marco

Abstract

Graduating economics PhDs face intense competition when seeking faculty or research positions at universities and research institutions. We examine the relationship between statistically significant results, arguably used as indicators of research quality in a competitive academic market, and academic hiring outcomes. We start by investigating the determinants of academic success by analyzing 604 job market papers (JMPs) from 2018-2019 to 2020- 2021. We then turn to the practice of p-hacking focusing on 150 empirical JMPs. We find evidence that marginally significant results in JMPs are associated with higher academic placement likelihoods. During the COVID-19 pandemic, a tighter job market strengthened this relationship without altering the p-hacking behavior of PhD candidates, suggesting that our results reflect a recruitment bias by academic employers. We also find evidence of publication bias, suggesting that recruiters may use statistical significance to gauge candidates' potential for future publications, thus influencing recruitment decisions. Overall, our findings provide insights into the dynamics of the academic job market and the factors influencing career trajectories in academia.

Suggested Citation

  • Brodeur, Abel & Kattan, Lamis & Musumeci, Marco, 2024. "Job Market Stars," I4R Discussion Paper Series 141, The Institute for Replication (I4R).
    • Handle: RePEc:zbw:i4rdps:141
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/301430/1/I4R-DP141.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Brooke Helppie McFall & Eric D. Parolin & Basit Zafar, 2024. "Career Expectations and Outcomes: Evidence (on Gender Gaps) from the Economics Job Market," NBER Working Papers 32446, National Bureau of Economic Research, Inc.
    2. Tomáš Havránek, 2015. "Measuring Intertemporal Substitution: The Importance Of Method Choices And Selective Reporting," Journal of the European Economic Association, European Economic Association, vol. 13(6), pages 1180-1204, December.
    3. Paul Oyer, 2006. "Initial Labor Market Conditions and Long-Term Outcomes for Economists," Journal of Economic Perspectives, American Economic Association, vol. 20(3), pages 143-160, Summer.
    4. Nicole Fortin & Thomas Lemieux & Marit Rehavi, 2021. "Gender Differences in Fields of Specialization and Placement Outcomes among PhDs in Economics," AEA Papers and Proceedings, American Economic Association, vol. 111, pages 74-79, May.
    5. Jeffrey Grogger & Gordon H. Hanson, 2015. "Attracting Talent: Location Choices of Foreign-Born PhDs in the United States," Journal of Labor Economics, University of Chicago Press, vol. 33(S1), pages 5-38.
    6. Gerber, Alan & Malhotra, Neil, 2008. "Do Statistical Reporting Standards Affect What Is Published? Publication Bias in Two Leading Political Science Journals," Quarterly Journal of Political Science, now publishers, vol. 3(3), pages 313-326, October.
    7. Andrés García-Suaza & Jesús Otero & Rainer Winkelmann, 2020. "Predicting early career productivity of PhD economists: Does advisor-match matter?," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(1), pages 429-449, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Roman Horvath & Ali Elminejad & Tomas Havranek, 2020. "Publication and Identification Biases in Measuring the Intertemporal Substitution of Labor Supply," Working Papers IES 2020/32, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised Sep 2020.
    2. Tomas Havranek & Zuzana Irsova & Lubica Laslopova & Olesia Zeynalova, 2020. "Skilled and Unskilled Labor Are Less Substitutable than Commonly Thought," Working Papers IES 2020/29, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised Sep 2020.
    3. Havranek, Tomas & Irsova, Zuzana & Laslopova, Lubica & Zeynalova, Olesia, 2020. "The Elasticity of Substitution between Skilled and Unskilled Labor: A Meta-Analysis," MPRA Paper 102598, University Library of Munich, Germany.
    4. Brodeur, Abel & Cook, Nikolai & Heyes, Anthony, 2018. "Methods Matter: P-Hacking and Causal Inference in Economics," IZA Discussion Papers 11796, Institute of Labor Economics (IZA).
    5. Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2016. "Star Wars: The Empirics Strike Back," American Economic Journal: Applied Economics, American Economic Association, vol. 8(1), pages 1-32, January.
    6. Bajzík, Josef & Havranek, Tomas & Irsova, Zuzana & Novak, Jiri, 2023. "Does Shareholder Activism Create Value? A Meta-Analysis," CEPR Discussion Papers 18233, C.E.P.R. Discussion Papers.
    7. Dominika Ehrenbergerova & Josef Bajzik & Tomas Havranek, 2023. "When Does Monetary Policy Sway House Prices? A Meta-Analysis," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 71(2), pages 538-573, June.
    8. Brodeur, Abel & Cook, Nikolai & Hartley, Jonathan & Heyes, Anthony, 2022. "Do Pre-Registration and Pre-analysis Plans Reduce p-Hacking and Publication Bias?," MetaArXiv uxf39, Center for Open Science.
    9. Jindrich Matousek & Tomas Havranek & Zuzana Irsova, 2022. "Individual discount rates: a meta-analysis of experimental evidence," Experimental Economics, Springer;Economic Science Association, vol. 25(1), pages 318-358, February.
    10. Abel Brodeur & Nikolai Cook & Carina Neisser, 2024. "p-Hacking, Data type and Data-Sharing Policy," The Economic Journal, Royal Economic Society, vol. 134(659), pages 985-1018.
    11. Ali Elminejad & Tomas Havranek & Roman Horvath & Zuzana Irsova, 2023. "Intertemporal Substitution in Labor Supply: A Meta-Analysis," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 51, pages 1095-1113, December.
    12. Abel Brodeur & Nikolai M. Cook & Jonathan S. Hartley & Anthony Heyes, 2024. "Do Preregistration and Preanalysis Plans Reduce p-Hacking and Publication Bias? Evidence from 15,992 Test Statistics and Suggestions for Improvement," Journal of Political Economy Microeconomics, University of Chicago Press, vol. 2(3), pages 527-561.
    13. Abel Brodeur & Nikolai Cook & Anthony Heyes, 2020. "Methods Matter: p-Hacking and Publication Bias in Causal Analysis in Economics," American Economic Review, American Economic Association, vol. 110(11), pages 3634-3660, November.
    14. Sebastian Gechert & Tomas Havranek & Zuzana Irsova & Dominika Kolcunova, 2022. "Measuring Capital-Labor Substitution: The Importance of Method Choices and Publication Bias," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 45, pages 55-82, July.
    15. Furukawa, Chishio, 2019. "Publication Bias under Aggregation Frictions: Theory, Evidence, and a New Correction Method," EconStor Preprints 194798, ZBW - Leibniz Information Centre for Economics.
    16. Volker Grossmann & Johannes Schünemann & Holger Strulik, 2024. "Fair Pension Policies with Occupation-Specific Ageing," The Economic Journal, Royal Economic Society, vol. 134(663), pages 2835-2875.
    17. Giacomo De Giorgi & Michele Pellizzari & William Gui Woolston, 2012. "Class Size And Class Heterogeneity," Journal of the European Economic Association, European Economic Association, vol. 10(4), pages 795-830, August.
    18. Grossmann, Volker & Larin, Benjamin & Löfflad, Hans Torben & Steger, Thomas, 2021. "Distributional consequences of surging housing rents," Journal of Economic Theory, Elsevier, vol. 196(C).
    19. Matthew Rognlie & Andrei Shleifer & Alp Simsek, 2018. "Investment Hangover and the Great Recession," American Economic Journal: Macroeconomics, American Economic Association, vol. 10(2), pages 113-153, April.
    20. Julie L. Hotchkiss & Robert E. Moore, 2022. "Some Like it Hot: Assessing Longer-Term Labor Market Benefits from a High-Pressure Economy," International Journal of Central Banking, International Journal of Central Banking, vol. 18(2), pages 193-243, June.

    More about this item

    Keywords

    Academic job market; p-Hacking; Publication bias; Research credibility;
    All these keywords.

    JEL classification:

    • B41 - Schools of Economic Thought and Methodology - - Economic Methodology - - - Economic Methodology
    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C40 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - General
    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:i4rdps:141. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://www.i4replication.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.