IDEAS home Printed from https://ideas.repec.org/p/grt/wpegrt/2014-14.html
   My bibliography  Save this paper

Dominance relations and ranking when quantity and quality both matter: Applications to US universities and econ. departments worldwide

Author

Listed:
  • Nicolas CARAYOL
  • Agenor LAHATTE

Abstract

In this article, we propose to extend the concept of stochastic dominance, extensively used in decision theory and social choice, to the comparison of composite outcomes, both the quality and quantity of which do matter. Unanimity of judgment among new classes of functions is also studied. We introduce and characterize axiomatically a new index, called Importance, which allows us to rank institutions on clear grounds using the information contained in any set of available unanimous bilateral comparisons (an incomplete tournament). This theory is applied to the ranking of U.S. research universities taking into account both the volume of publications and their impact. We also compare and rank academic departments in economics taking both the size of the department and the prestige of its members into account.

Suggested Citation

  • Nicolas CARAYOL & Agenor LAHATTE, 2014. "Dominance relations and ranking when quantity and quality both matter: Applications to US universities and econ. departments worldwide," Cahiers du GREThA (2007-2019) 2014-14, Groupe de Recherche en Economie Théorique et Appliquée (GREThA).
    • Handle: RePEc:grt:wpegrt:2014-14
    as

    Download full text from publisher

    File URL: http://cahiersdugretha.u-bordeaux.fr/2014/2014-14.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. ,, 2014. "A ranking method based on handicaps," Theoretical Economics, Econometric Society, vol. 9(3), September.
    2. Ignacio Palacios-Huerta & Oscar Volij, 2004. "The Measurement of Intellectual Influence," Econometrica, Econometric Society, vol. 72(3), pages 963-977, May.
    3. Richard P. Beilock & Leo C. Polopolus & Mario Correal, 1986. "Ranking of Agricultural Economics Departments by Citations," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 68(3), pages 595-604.
    4. G. Hanoch & H. Levy, 1969. "The Efficiency Analysis of Choices Involving Risk," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 36(3), pages 335-346.
    5. Scott, Loren C & Mitias, Peter M, 1996. "Trends in Rankings of Economics Departments in the U.S.: An Update," Economic Inquiry, Western Economic Association International, vol. 34(2), pages 378-400, April.
    6. Stephen Bazen & Patrick Moyes, 2012. "Elitism and stochastic dominance," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 39(1), pages 207-251, June.
    7. Stigler, George J & Friedland, Claire, 1975. "The Citation Practices of Doctorates in Economics," Journal of Political Economy, University of Chicago Press, vol. 83(3), pages 477-507, June.
    8. Lubrano, Michel & Protopopescu, Camelia, 2004. "Density inference for ranking European research systems in the field of economics," Journal of Econometrics, Elsevier, vol. 123(2), pages 345-369, December.
    9. Nicolas Carayol & Ghislaine Filliatreau & Agenor Lahatte, 2012. "Reference classes: a tool for benchmarking universities’ research," Scientometrics, Springer;Akadémiai Kiadó, vol. 93(2), pages 351-371, November.
    10. Nicolas Carayol & Ghislaine Filliatreau & Agenor Lahatte, 2015. "Impact, dominance et classements des universités," Revue économique, Presses de Sciences-Po, vol. 66(1), pages 173-194.
    11. Hadar, Josef & Russell, William R, 1969. "Rules for Ordering Uncertain Prospects," American Economic Review, American Economic Association, vol. 59(1), pages 25-34, March.
    12. Woeginger, Gerhard J., 2008. "An axiomatic characterization of the Hirsch-index," Mathematical Social Sciences, Elsevier, vol. 56(2), pages 224-232, September.
    13. Dasgupta, Partha & Sen, Amartya & Starrett, David, 1973. "Notes on the measurement of inequality," Journal of Economic Theory, Elsevier, vol. 6(2), pages 180-187, April.
    14. Michel Lubrano & Luc Bauwens & Alan Kirman & Camelia Protopopescu, 2003. "Ranking Economics Departments in Europe: A Statistical Approach," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1367-1401, December.
    15. Richard Dusansky & Clayton J. Vernon, 1998. "Rankings of U.S. Economics Departments," Journal of Economic Perspectives, American Economic Association, vol. 12(1), pages 157-170, Winter.
    16. Sen, Amartya, 1973. "On Economic Inequality," OUP Catalogue, Oxford University Press, number 9780198281931, Decembrie.
    17. Glenn Ellison, 2002. "Evolving Standards for Academic Publishing: A q-r Theory," Journal of Political Economy, University of Chicago Press, vol. 110(5), pages 994-1034, October.
    18. Thomas R. Anderson & Robin K. S. Hankin & Peter D. Killworth, 2008. "Beyond the Durfee square: Enhancing the h-index to score total publication output," Scientometrics, Springer;Akadémiai Kiadó, vol. 76(3), pages 577-588, September.
    19. Rothschild, Michael & Stiglitz, Joseph E., 1970. "Increasing risk: I. A definition," Journal of Economic Theory, Elsevier, vol. 2(3), pages 225-243, September.
    20. Pierre-Philippe Combes & Laurent Linnemer, 2003. "Where are the Economists Who Publish? Publication Concentration and Rankings in Europe Based on Cumulative Publications," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1250-1308, December.
    21. Thierry Marchant, 2009. "An axiomatic characterization of the ranking based on the h-index and some other bibliometric rankings of authors," Scientometrics, Springer;Akadémiai Kiadó, vol. 80(2), pages 325-342, August.
    22. Atkinson, Anthony B., 1970. "On the measurement of inequality," Journal of Economic Theory, Elsevier, vol. 2(3), pages 244-263, September.
    23. Leo Katz, 1953. "A new status index derived from sociometric analysis," Psychometrika, Springer;The Psychometric Society, vol. 18(1), pages 39-43, March.
    24. C. Ramanujacharyulu, 1964. "Analysis of preferential experiments," Psychometrika, Springer;The Psychometric Society, vol. 29(3), pages 257-261, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Albarrán, Pedro & Herrero, Carmen & Ruiz-Castillo, Javier & Villar, Antonio, 2017. "The Herrero-Villar approach to citation impact," Journal of Informetrics, Elsevier, vol. 11(2), pages 625-640.
    2. Bonaccorsi, Andrea & Cicero, Tindaro, 2016. "Nondeterministic ranking of university departments," Journal of Informetrics, Elsevier, vol. 10(1), pages 224-237.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nicolas CARAYOL & Agenor LAHATTE, 2011. "Dominance relations when both quantity and quality matter, and applications to the\r\ncomparison of US research universities and worldwide top departments in economics," Cahiers du GREThA (2007-2019) 2011-22, Groupe de Recherche en Economie Théorique et Appliquée (GREThA).
    2. Stephen Bazen & Patrick Moyes, 2012. "Elitism and stochastic dominance," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 39(1), pages 207-251, June.
    3. Francesco Andreoli & Claudio Zoli, 2020. "From unidimensional to multidimensional inequality: a review," METRON, Springer;Sapienza Università di Roma, vol. 78(1), pages 5-42, April.
    4. Rubin Saposnik, 1981. "Rank-dominance in income distributions," Public Choice, Springer, vol. 36(1), pages 147-151, January.
    5. James B. Davies & Martin G. Kocher & Matthias Sutter, 2008. "Economics research in Canada: a long‐run assessment of journal publications," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 41(1), pages 22-45, February.
    6. Csató, László, 2019. "Journal ranking should depend on the level of aggregation," Journal of Informetrics, Elsevier, vol. 13(4).
    7. Magdalou, Brice, 2021. "A model of social welfare improving transfers," Journal of Economic Theory, Elsevier, vol. 196(C).
    8. Nicolas Gravel & Patrick Moyes, 2013. "Utilitarianism or welfarism: does it make a difference?," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 40(2), pages 529-551, February.
    9. Salant, Stephen W. & Shaffer, Greg, 2002. "Using Lorenz curves to represent firm heterogeneity in Cournot games," MPRA Paper 21876, University Library of Munich, Germany.
    10. Christian Kleiber & Walter Kraemer, 2000. "Efficiency, Equity, and Generalized Lorenz Dominance," CESifo Working Paper Series 343, CESifo.
    11. Antonin Macé, 2023. "The Limits of Citation Counts," Working Papers halshs-01630095, HAL.
    12. Tombazos, Christis G., 2005. "A revisionist perspective of European research in economics," European Economic Review, Elsevier, vol. 49(2), pages 251-277, February.
    13. Breitmeyer, Carsten & Hakenes, Hendrik & Pfingsten, Andreas, 2004. "From poverty measurement to the measurement of downside risk," Mathematical Social Sciences, Elsevier, vol. 47(3), pages 327-348, May.
    14. Dubois, Marc, 2022. "Dominance criteria on grids for measuring competitive balance in sports leagues," Mathematical Social Sciences, Elsevier, vol. 115(C), pages 1-10.
    15. Palacios-Huerta, Ignacio & Volij, Oscar, 2014. "Axiomatic measures of intellectual influence," International Journal of Industrial Organization, Elsevier, vol. 34(C), pages 85-90.
    16. Albarrán, Pedro & Ortuño, Ignacio & Ruiz-Castillo, Javier, 2011. "The measurement of low- and high-impact in citation distributions: Technical results," Journal of Informetrics, Elsevier, vol. 5(1), pages 48-63.
    17. Kaplanski, Guy & Kroll, Yoram, 2002. "VaR Risk Measures versus Traditional Risk Measures: an Analysis and Survey," MPRA Paper 80070, University Library of Munich, Germany.
    18. Levy, Moshe, 2009. "Almost Stochastic Dominance and stocks for the long run," European Journal of Operational Research, Elsevier, vol. 194(1), pages 250-257, April.
    19. Bouyssou, Denis & Marchant, Thierry, 2011. "Bibliometric rankings of journals based on Impact Factors: An axiomatic approach," Journal of Informetrics, Elsevier, vol. 5(1), pages 75-86.
    20. Coes, Donald V., 2008. "Income distribution trends in Brazil and China: Evaluating absolute and relative economic growth," The Quarterly Review of Economics and Finance, Elsevier, vol. 48(2), pages 359-369, May.

    More about this item

    Keywords

    Stochastic Dominance; Ranking; Tournaments; Axiomatics; Citations.;
    All these keywords.

    JEL classification:

    • D63 - Microeconomics - - Welfare Economics - - - Equity, Justice, Inequality, and Other Normative Criteria and Measurement
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:grt:wpegrt:2014-14. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Ernest Miguelez (email available below). General contact details of provider: https://edirc.repec.org/data/ifredfr.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.