IDEAS home Printed from https://ideas.repec.org/p/grt/wpegrt/2014-14.html
   My bibliography  Save this paper

Dominance relations and ranking when quantity and quality both matter: Applications to US universities and econ. departments worldwide

Author

Listed:
  • Nicolas CARAYOL
  • Agenor LAHATTE

Abstract

In this article, we propose to extend the concept of stochastic dominance, extensively used in decision theory and social choice, to the comparison of composite outcomes, both the quality and quantity of which do matter. Unanimity of judgment among new classes of functions is also studied. We introduce and characterize axiomatically a new index, called Importance, which allows us to rank institutions on clear grounds using the information contained in any set of available unanimous bilateral comparisons (an incomplete tournament). This theory is applied to the ranking of U.S. research universities taking into account both the volume of publications and their impact. We also compare and rank academic departments in economics taking both the size of the department and the prestige of its members into account.

Suggested Citation

  • Nicolas CARAYOL & Agenor LAHATTE, 2014. "Dominance relations and ranking when quantity and quality both matter: Applications to US universities and econ. departments worldwide," Cahiers du GREThA (2007-2019) 2014-14, Groupe de Recherche en Economie Théorique et Appliquée (GREThA).
    • Handle: RePEc:grt:wpegrt:2014-14
    as

    Download full text from publisher

    File URL: http://cahiersdugretha.u-bordeaux.fr/2014/2014-14.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. ,, 2014. "A ranking method based on handicaps," Theoretical Economics, Econometric Society, vol. 9(3), September.
    2. Lubrano, Michel & Protopopescu, Camelia, 2004. "Density inference for ranking European research systems in the field of economics," Journal of Econometrics, Elsevier, vol. 123(2), pages 345-369, December.
    3. Stephen Bazen & Patrick Moyes, 2012. "Elitism and stochastic dominance," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 39(1), pages 207-251, June.
    4. Michel Lubrano & Luc Bauwens & Alan Kirman & Camelia Protopopescu, 2003. "Ranking Economics Departments in Europe: A Statistical Approach," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1367-1401, December.
    5. Pierre-Philippe Combes & Laurent Linnemer, 2003. "Where are the Economists Who Publish? Publication Concentration and Rankings in Europe Based on Cumulative Publications," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1250-1308, December.
    6. Glenn Ellison, 2002. "Evolving Standards for Academic Publishing: A q-r Theory," Journal of Political Economy, University of Chicago Press, vol. 110(5), pages 994-1034, October.
    7. Nicolas Carayol & Ghislaine Filliatreau & Agenor Lahatte, 2015. "Impact, dominance et classements des universités," Revue économique, Presses de Sciences-Po, vol. 66(1), pages 173-194.
    8. Thierry Marchant, 2009. "An axiomatic characterization of the ranking based on the h-index and some other bibliometric rankings of authors," Scientometrics, Springer;Akadémiai Kiadó, vol. 80(2), pages 325-342, August.
    9. Atkinson, Anthony B., 1970. "On the measurement of inequality," Journal of Economic Theory, Elsevier, vol. 2(3), pages 244-263, September.
    10. Ignacio Palacios-Huerta & Oscar Volij, 2004. "The Measurement of Intellectual Influence," Econometrica, Econometric Society, vol. 72(3), pages 963-977, May.
    11. Richard P. Beilock & Leo C. Polopolus & Mario Correal, 1986. "Ranking of Agricultural Economics Departments by Citations," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 68(3), pages 595-604.
    12. G. Hanoch & H. Levy, 1969. "The Efficiency Analysis of Choices Involving Risk," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 36(3), pages 335-346.
    13. Scott, Loren C & Mitias, Peter M, 1996. "Trends in Rankings of Economics Departments in the U.S.: An Update," Economic Inquiry, Western Economic Association International, vol. 34(2), pages 378-400, April.
    14. Thomas R. Anderson & Robin K. S. Hankin & Peter D. Killworth, 2008. "Beyond the Durfee square: Enhancing the h-index to score total publication output," Scientometrics, Springer;Akadémiai Kiadó, vol. 76(3), pages 577-588, September.
    15. Rothschild, Michael & Stiglitz, Joseph E., 1970. "Increasing risk: I. A definition," Journal of Economic Theory, Elsevier, vol. 2(3), pages 225-243, September.
    16. C. Ramanujacharyulu, 1964. "Analysis of preferential experiments," Psychometrika, Springer;The Psychometric Society, vol. 29(3), pages 257-261, September.
    17. Woeginger, Gerhard J., 2008. "An axiomatic characterization of the Hirsch-index," Mathematical Social Sciences, Elsevier, vol. 56(2), pages 224-232, September.
    18. Richard Dusansky & Clayton J. Vernon, 1998. "Rankings of U.S. Economics Departments," Journal of Economic Perspectives, American Economic Association, vol. 12(1), pages 157-170, Winter.
    19. Nicolas Carayol & Ghislaine Filliatreau & Agenor Lahatte, 2012. "Reference classes: a tool for benchmarking universities’ research," Scientometrics, Springer;Akadémiai Kiadó, vol. 93(2), pages 351-371, November.
    20. Stigler, George J & Friedland, Claire, 1975. "The Citation Practices of Doctorates in Economics," Journal of Political Economy, University of Chicago Press, vol. 83(3), pages 477-507, June.
    21. Hadar, Josef & Russell, William R, 1969. "Rules for Ordering Uncertain Prospects," American Economic Review, American Economic Association, vol. 59(1), pages 25-34, March.
    22. Dasgupta, Partha & Sen, Amartya & Starrett, David, 1973. "Notes on the measurement of inequality," Journal of Economic Theory, Elsevier, vol. 6(2), pages 180-187, April.
    23. Sen, Amartya, 1973. "On Economic Inequality," OUP Catalogue, Oxford University Press, number 9780198281931.
    24. Leo Katz, 1953. "A new status index derived from sociometric analysis," Psychometrika, Springer;The Psychometric Society, vol. 18(1), pages 39-43, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Albarrán, Pedro & Herrero, Carmen & Ruiz-Castillo, Javier & Villar, Antonio, 2017. "The Herrero-Villar approach to citation impact," Journal of Informetrics, Elsevier, vol. 11(2), pages 625-640.
    2. Bonaccorsi, Andrea & Cicero, Tindaro, 2016. "Nondeterministic ranking of university departments," Journal of Informetrics, Elsevier, vol. 10(1), pages 224-237.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nicolas CARAYOL & Agenor LAHATTE, 2011. "Dominance relations when both quantity and quality matter, and applications to the\r\ncomparison of US research universities and worldwide top departments in economics," Cahiers du GREThA (2007-2019) 2011-22, Groupe de Recherche en Economie Théorique et Appliquée (GREThA).
    2. Robert F. Mulligan, 2024. "Publication trends in political economy scholarship 2011–2020," Constitutional Political Economy, Springer, vol. 35(2), pages 200-302, June.
    3. Stephen Bazen & Patrick Moyes, 2012. "Elitism and stochastic dominance," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 39(1), pages 207-251, June.
    4. Sarkar, Sandip & Dash, Bharatee Bhusana, 2023. "On the measurement of electoral volatility," Mathematical Social Sciences, Elsevier, vol. 126(C), pages 119-128.
    5. Francesco Andreoli & Claudio Zoli, 2020. "From unidimensional to multidimensional inequality: a review," METRON, Springer;Sapienza Università di Roma, vol. 78(1), pages 5-42, April.
    6. Rubin Saposnik, 1981. "Rank-dominance in income distributions," Public Choice, Springer, vol. 36(1), pages 147-151, January.
    7. Marc Dubois, 2022. "Dominance criteria on grids for measuring competitive balance in sports leagues," Post-Print hal-04692979, HAL.
    8. Christian Kleiber & Walter Kraemer, 2000. "Efficiency, Equity, and Generalized Lorenz Dominance," CESifo Working Paper Series 343, CESifo.
    9. Antonin Macé, 2023. "The Limits of Citation Counts," Working Papers halshs-01630095, HAL.
    10. Magdalou, Brice, 2021. "A model of social welfare improving transfers," Journal of Economic Theory, Elsevier, vol. 196(C).
    11. Nicolas Gravel & Patrick Moyes, 2013. "Utilitarianism or welfarism: does it make a difference?," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 40(2), pages 529-551, February.
    12. Tombazos, Christis G., 2005. "A revisionist perspective of European research in economics," European Economic Review, Elsevier, vol. 49(2), pages 251-277, February.
    13. Dubois, Marc, 2022. "Dominance criteria on grids for measuring competitive balance in sports leagues," Mathematical Social Sciences, Elsevier, vol. 115(C), pages 1-10.
    14. Kaplanski, Guy & Kroll, Yoram, 2002. "VaR Risk Measures versus Traditional Risk Measures: an Analysis and Survey," MPRA Paper 80070, University Library of Munich, Germany.
    15. Bouyssou, Denis & Marchant, Thierry, 2011. "Bibliometric rankings of journals based on Impact Factors: An axiomatic approach," Journal of Informetrics, Elsevier, vol. 5(1), pages 75-86.
    16. L'aszl'o Csat'o, 2019. "Journal ranking should depend on the level of aggregation," Papers 1904.06300, arXiv.org, revised Sep 2019.
    17. James B. Davies & Martin G. Kocher & Matthias Sutter, 2008. "Economics research in Canada: a long-run assessment of journal publications," Canadian Journal of Economics, Canadian Economics Association, vol. 41(1), pages 22-45, February.
    18. Günther G. Schulze & Susanne Warning & Christian Wiermann, 2008. "Zeitschriftenrankings für die Wirtschaftswissenschaften – Konstruktion eines umfassenden Metaindexes," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 9(3), pages 286-305, August.
    19. Fabio Maccheroni & Pietro Muliere & Claudio Zoli, 2005. "Inverse stochastic orders and generalized Gini functionals," Metron - International Journal of Statistics, Dipartimento di Statistica, Probabilità e Statistiche Applicate - University of Rome, vol. 0(3), pages 529-559.
    20. Rabah Amir & Malgorzata Knauff, 2008. "Ranking Economics Departments Worldwide on the Basis of PhD Placement," The Review of Economics and Statistics, MIT Press, vol. 90(1), pages 185-190, August.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • D63 - Microeconomics - - Welfare Economics - - - Equity, Justice, Inequality, and Other Normative Criteria and Measurement
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:grt:wpegrt:2014-14. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Ernest Miguelez (email available below). General contact details of provider: https://edirc.repec.org/data/ifredfr.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.