IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/5460.html
   My bibliography  Save this paper

A Citation-Based Test for Discrimination at Economics and Finance Journals

Author

Listed:
  • Scott Smart
  • Joel Waldfogel

Abstract

Discrimination is notoriously difficult to document. Convincing tests for discrimination require good measures of the legitimate determinants of the outcome of interest, for example wages and productivity. While few contexts provide data adequate to the task of measuring discrimination, copious bibliographic data on the impact of academic research make possible tests of discrimination in the editorial process. This study develops a test for possible bias þ with respect to author gender, prestige of author's institution, article content (theory vs. empiricism), and whether the author has ties to the editor þ using a new approach based on an analysis of citations. We treat citations as a measure of article quality and ask whether papers by certain groups receive systematically different numbers of citations. The key to our approach is the observation that editors do not simply accept or reject papers. For accepted papers, editors determine articles' order within journal issue and length based on their quality assessments. We show that these 'editorial treatment' decisions are highly correlated with citations. Thus, we infer bias against a particular group of authors if their published articles have more citations, conditional editorial treatment, than other articles. Surprisingly, we document systematic editorial bias in favor of authors located outside of top institutions.

Suggested Citation

  • Scott Smart & Joel Waldfogel, 1996. "A Citation-Based Test for Discrimination at Economics and Finance Journals," NBER Working Papers 5460, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:5460
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w5460.pdf
    Download Restriction: no

    References listed on IDEAS

    as
    1. Becker, Gary S, 1993. "Nobel Lecture: The Economic Way of Looking at Behavior," Journal of Political Economy, University of Chicago Press, vol. 101(3), pages 385-409, June.
    2. Judith K. Hellerstein & David Neumark, 1995. "Are Earnings Profiles Steeper Than Productivity Profiles? Evidence from Israeli Firm-Level Data," Journal of Human Resources, University of Wisconsin Press, vol. 30(1), pages 89-112.
    3. Ferguson, Michael F & Peters, Stephen R, 1995. " What Constitutes Evidence of Discrimination in Lending?," Journal of Finance, American Finance Association, vol. 50(2), pages 739-748, June.
    4. Laband, David N & Piette, Michael J, 1994. "Favoritism versus Search for Good Papers: Empirical Evidence Regarding the Behavior of Journal Editors," Journal of Political Economy, University of Chicago Press, vol. 102(1), pages 194-203, February.
    5. Lawrence M. Kahn, 1991. "Discrimination in Professional Sports: A Survey of the Literature," ILR Review, Cornell University, ILR School, vol. 44(3), pages 395-418, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. S. Stremersch & I. Verniers & C. Verhoef, 2006. "The Quest for Citations: Drivers of Article Impact," Working Papers of Faculty of Economics and Business Administration, Ghent University, Belgium 06/422, Ghent University, Faculty of Economics and Business Administration.
    2. John Knowles & Nicola Persico & Petra Todd, 2001. "Racial Bias in Motor Vehicle Searches: Theory and Evidence," Journal of Political Economy, University of Chicago Press, vol. 109(1), pages 203-232, February.
    3. repec:spr:scient:v:84:y:2010:i:1:d:10.1007_s11192-009-0087-x is not listed on IDEAS
    4. repec:spr:scient:v:50:y:2001:i:3:d:10.1023_a:1010510831718 is not listed on IDEAS
    5. Frances Woolley, 2005. "The Citation Impact Of Feminist Economics," Feminist Economics, Taylor & Francis Journals, vol. 11(3), pages 85-106.
    6. Tim Simcoe & David Waguespack & Lee Fleming, 2008. "What's in a (Missing) Name? Status and Signaling in Open Standards Development," Working Papers 08-31, NET Institute, revised Oct 2008.
    7. Andrew J. Oswald, 2010. "A suggested method for the measurement of world-leading research (illustrated with data on economics)," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(1), pages 99-113, July.
    8. Dragan Ilić, 2013. "Marginally discriminated: the role of outcome tests in European jurisdiction," European Journal of Law and Economics, Springer, vol. 36(2), pages 271-294, October.
    9. Philip R P Coelho & James E McClure & Peter J Reilly, 2014. "An Investigation of Editorial Favoritism in the AER," Eastern Economic Journal, Palgrave Macmillan;Eastern Economic Association, vol. 40(2), pages 274-281, March.
    10. repec:aea:jeclit:v:56:y:2018:i:1:p:115-56 is not listed on IDEAS
    11. Tom Coupé & Victor Ginsburgh & Abdul Noury, 2010. "Are leading papers of better quality? Evidence from a natural experiment," Oxford Economic Papers, Oxford University Press, vol. 62(1), pages 1-11, January.
    12. Hendrik P. van Dalen & Kene Henkens, 2000. "What makes a Scientific Article influential?," Tinbergen Institute Discussion Papers 00-032/1, Tinbergen Institute.
    13. Daniel S. Hamermesh, 2015. "Citations in Economics: Measurement, Uses and Impacts," NBER Working Papers 21754, National Bureau of Economic Research, Inc.
    14. Oswald, Andrew J., 2008. "Can We Test for Bias in Scientific Peer-Review?," IZA Discussion Papers 3665, Institute for the Study of Labor (IZA).
    15. Michel E. Philip, 2004. "Doctrines économiques, législation et discrimination.... Mais de quelle discrimination parlons nous ?," Innovations, De Boeck Université, vol. 20(2), pages 179-192.
    16. Arjo Klamer & Hendrik van Dalen, 2001. "Attention and the art of scientific publishing," Journal of Economic Methodology, Taylor & Francis Journals, vol. 9(3), pages 289-315.
    17. repec:eee:crpeac:v:51:y:2018:i:c:p:24-46 is not listed on IDEAS
    18. Oswald, Andrew J., 2009. "World-Leading Research and its Measurement," The Warwick Economics Research Paper Series (TWERPS) 887, University of Warwick, Department of Economics.
    19. Oswald, Andrew J., 2015. "The Objective Measurement of World-Leading Research," IZA Discussion Papers 8829, Institute for the Study of Labor (IZA).

    More about this item

    JEL classification:

    • J71 - Labor and Demographic Economics - - Labor Discrimination - - - Hiring and Firing
    • K31 - Law and Economics - - Other Substantive Areas of Law - - - Labor Law

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:5460. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: () or (Joanne Lustig). General contact details of provider: http://edirc.repec.org/data/nberrus.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.