IDEAS home Printed from https://ideas.repec.org/a/sae/jospec/v7y2006i4p359-373.html
   My bibliography  Save this article

Robust Rankings of Multidimensional Performances

Author

Listed:
  • Laurens Cherchye

    (University of Leuven)

  • Frederic Vermeulen

    (Tilburg University)

Abstract

There is a general interest in ranking performances (e.g., in sports or policy) that essentially implies aggregating several performance dimensions. The usual approach considers a “cardinal†linear weighting of the different single-dimensional performance indicators. The authors present an alternative approach, which merely requires “ordinal†information regarding the importance of the different performance dimensions. It is argued that this approach is robust with respect to alternative specifications of the (possibly nonlinear) underlying performance aggregation function. An application to Tour de France racing cyclists (in the period 1953-2004) illustrates the approach. The authors find that Eddy Merckx, Bernard Hinault, and Lance Armstrong (robustly) dominate almost all other racing cyclists in the sample, although they do not dominate each other. A net-dominance metric ranks Bernard Hinault on the first place in the sample; Eddy Merckx and Lance Armstrong follow very closely ex-aequo on the second place.

Suggested Citation

  • Laurens Cherchye & Frederic Vermeulen, 2006. "Robust Rankings of Multidimensional Performances," Journal of Sports Economics, , vol. 7(4), pages 359-373, November.
  • Handle: RePEc:sae:jospec:v:7:y:2006:i:4:p:359-373
    DOI: 10.1177/1527002505275092
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/1527002505275092
    Download Restriction: no

    File URL: https://libkey.io/10.1177/1527002505275092?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Kalaitzidakis, P. & Mamuneas, T.P. & Stengos, T., 2003. "Rankings of Academic Journals and Institutions," Working Papers 2003-8, University of Guelph, Department of Economics and Finance.
    2. S Lozano & G Villa & F Guerrero & P Cortés, 2002. "Measuring the performance of nations at the Summer Olympics using data envelopment analysis," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 53(5), pages 501-511, May.
    3. Pantelis Kalaitzidakis & Theofanis P. Mamuneas & Thanasis Stengos, 2003. "Rankings of Academic Journals and Institutions in Economics," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1346-1366, December.
    4. Laurens Cherchye & & Timo Kuosmanen, 2002. "Benchmarking Sustainable Development: A Synthetic Meta-index Approach," Others 0210001, University Library of Munich, Germany, revised 04 Dec 2002.
    5. Anthony B. Atkinson & François Bourguignon, 1987. "Income Distribution and Differences in Needs," Palgrave Macmillan Books, in: George R. Feiwel (ed.), Arrow and the Foundations of the Theory of Economic Policy, chapter 12, pages 350-370, Palgrave Macmillan.
    6. Michel Lubrano & Luc Bauwens & Alan Kirman & Camelia Protopopescu, 2003. "Ranking Economics Departments in Europe: A Statistical Approach," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1367-1401, December.
    7. Laurens Cherchye & Wim Moesen & Tom Van Puyenbroeck, 2004. "Legitimately Diverse, yet Comparable: On Synthesizing Social Inclusion Performance in the EU," Journal of Common Market Studies, Wiley Blackwell, vol. 42(5), pages 919-955, December.
    8. Laurens Cherchye, 2001. "Using data envelopment analysis to assess macroeconomic policy performance," Applied Economics, Taylor & Francis Journals, vol. 33(3), pages 407-416.
    9. Karl W. Einolf, 2004. "Is Winning Everything?," Journal of Sports Economics, , vol. 5(2), pages 127-151, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jan Ours & Frederic Vermeulen, 2007. "Ranking Dutch Economists," De Economist, Springer, vol. 155(4), pages 469-487, December.
    2. Biresh K Sahoo & Ramadhar Singh & Bineet Mishra & Krithiga Sankaran, 2015. "Research Productivity in Management Schools of India: A Directional Benefit-of-Doubt Model Analysis," Working Papers id:7139, eSocialSciences.
    3. Wittkowski Knut M. & Song Tingting & Anderson Kent & Daniels John E., 2008. "U-Scores for Multivariate Data in Sports," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 4(3), pages 1-24, July.
    4. Scott Beaulier & Robert Elder, 2011. "Using ‘‘Dominetrics’’ to Impose Greater Discipline on Performance Rankings," Journal of Sports Economics, , vol. 12(1), pages 55-80, February.
    5. Marco Diana & Tingting Song & Knut Wittkowski, 2009. "Studying travel-related individual assessments and desires by combining hierarchically structured ordinal variables," Transportation, Springer, vol. 36(2), pages 187-206, March.
    6. Geys, Benny & Moesen, Wim, 2008. "Measuring local government technical (in)efficiency: An application and comparison of FDH, DEA and econometric approaches," Discussion Papers, Research Unit: Market Processes and Governance SP II 2008-21, WZB Berlin Social Science Center.
    7. Sahoo, Biresh K. & Singh, Ramadhar & Mishra, Bineet & Sankaran, Krithiga, 2017. "Research productivity in management schools of India during 1968-2015: A directional benefit-of-doubt model analysis," Omega, Elsevier, vol. 66(PA), pages 118-139.
    8. David Van Bulck & Arthur Vande Weghe & Dries Goossens, 2023. "Result-based talent identification in road cycling: discovering the next Eddy Merckx," Annals of Operations Research, Springer, vol. 325(1), pages 539-556, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Laurens Cherchye & Frederic Vermeulen, 2004. "Robust rankings of multi-dimensional performances: An application to Tour de France racing cyclists," Public Economics Working Paper Series wptourf, Katholieke Universiteit Leuven, Centrum voor Economische Studiën, Working Group Public Economics.
    2. Justus Haucap & Michael Mödl, 2013. "Zum Verhältnis von Spitzenforschung und Politikberatung: Eine empirische Analyse vor dem Hintergrund des Ökonomenstreits," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 14(3-4), pages 346-378, August.
    3. Pedro Albarrán & Raquel Carrasco & Javier Ruiz-Castillo, 2017. "Are Migrants More Productive Than Stayers? Some Evidence From A Set Of Highly Productive Academic Economists," Economic Inquiry, Western Economic Association International, vol. 55(3), pages 1308-1323, July.
    4. Hendrik P. van Dalen, 2019. "Values of Economists Matter in the Art and Science of Economics," Kyklos, Wiley Blackwell, vol. 72(3), pages 472-499, August.
    5. Serrao, Amilcar, 2008. "Measuring Eco-efficiency of Agricultural Activity in European Countries: A Malmquist Index Analysis," 2008 Annual Meeting, July 27-29, 2008, Orlando, Florida 6152, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    6. Baltagi, Badi H., 2007. "Worldwide Econometrics Rankings: 1989–2005," Econometric Theory, Cambridge University Press, vol. 23(5), pages 952-1012, October.
    7. Jang C. Jin, 2009. "Asian University Rankings in International and Development Economics: An Application of Zipf's Law," Review of International Economics, Wiley Blackwell, vol. 17(1), pages 137-143, February.
    8. Justus Haucap, 2020. "Wirtschaftswissenschaftliche Politikberatung in Deutschland: Stärken, Schwächen, Optimierungspotenzial," Springer Books, in: Dirk Loerwald (ed.), Ökonomische Erkenntnisse verständlich vermitteln, pages 45-78, Springer.
    9. Tombazos, Christis G., 2005. "A revisionist perspective of European research in economics," European Economic Review, Elsevier, vol. 49(2), pages 251-277, February.
    10. Püttmann, Vitus & Thomsen, Stephan L. & Trunzer, Johannes, 2020. "Zur Relevanz von Ausstattungsunterschieden für Forschungsleistungsvergleiche: Ein Diskussionsbeitrag für die Wirtschaftswissenschaften in Deutschland," Hannover Economic Papers (HEP) dp-679, Leibniz Universität Hannover, Wirtschaftswissenschaftliche Fakultät, revised Mar 2021.
    11. Stephen Bazen & Patrick Moyes, 2012. "Elitism and stochastic dominance," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 39(1), pages 207-251, June.
    12. Launov, Andrey & Graber, Michael & Wälde, Klaus, 2007. "How to get tenured (in Germany, in Economics)," W.E.P. - Würzburg Economic Papers 75, University of Würzburg, Department of Economics.
    13. Ruiz-Castillo, Javier, 2006. "La investigación en economía en España durante los años 90 : una revisión de la literatura," DE - Documentos de Trabajo. Economía. DE de060201, Universidad Carlos III de Madrid. Departamento de Economía.
    14. Stelios Katranidis & Theodore Panagiotidis & Costas Zontanos, 2014. "An Evaluation Of The Greek Universities’ Economics Departments," Bulletin of Economic Research, Wiley Blackwell, vol. 66(2), pages 173-182, April.
    15. Raquel Carrasco & Javier Ruiz-Castillo, 2014. "The Evolution Of The Scientific Productivity Of Highly Productive Economists," Economic Inquiry, Western Economic Association International, vol. 52(1), pages 1-16, January.
    16. Frank Neri & Joan R. Rodgers, 2013. "Eagles and Turkeys: Human Capital Externalities, Departmental Co-authorship and Research Productivity," Australian Economic Papers, Wiley Blackwell, vol. 52(3-4), pages 171-189, December.
    17. Javier Ruiz-Castillo, 2008. "Economics research in Spain during the 1990s: a literature review," Spanish Economic Review, Springer;Spanish Economic Association, vol. 10(3), pages 221-249, September.
    18. Ofer H. Azar & David M. Brock, 2008. "A Citation‐Based Ranking of Strategic Management Journals," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 17(3), pages 781-802, September.
    19. James B. Davies & Martin G. Kocher & Matthias Sutter, 2008. "Economics research in Canada: a long-run assessment of journal publications," Canadian Journal of Economics, Canadian Economics Association, vol. 41(1), pages 22-45, February.
    20. Raquel Carrasco & Javier Ruiz-Castillo, 2019. "Spatial mobility in elite academic institutions in economics: the case of Spain," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 10(2), pages 141-172, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jospec:v:7:y:2006:i:4:p:359-373. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.