IDEAS home Printed from https://ideas.repec.org/p/tky/fseres/2009cf660.html
   My bibliography  Save this paper

On the Robustness of Alternative Rankings Methodologies For Australian and New Zealand Economics Departments

Author

Listed:
  • Joseph Macri

    (Department of Economics, Macquarie University)

  • Michael McAleer

    (Econometric Institute, Erasmus School of Economics, Erasmus University Rotterdam and Tinbergen Institute and Center for International Research on the Japanese Economy (CIRJE), Faculty of Economics, University of Tokyo)

  • Dipendra Sinha

    (College of Management, Ritsumeikan Asia Pacific University and Institute of Economic Growth, and Department of Economics, Macquarie University)

Abstract

Just as friendly arguments based on an ignorance of facts eventually led to the creation of the definitive Guinness Book of World Records, any argument about university rankings has seemingly been a problem without a solution. To state the obvious, alternative rankings methodologies can and do lead to different rankings. This paper evaluates the robustness of rankings of Australian and New Zealand economics teaching departments for 1988-2002 and 1996-2002 using alternative rankings methodologies, and compares the results with the rankings obtained by Macri and Sinha (2006). In the overall mean rankings for both 1988- 2006 and 1996-2002, the University of Melbourne is ranked first, followed by UWA and ANU.

Suggested Citation

  • Joseph Macri & Michael McAleer & Dipendra Sinha, 2009. "On the Robustness of Alternative Rankings Methodologies For Australian and New Zealand Economics Departments," CIRJE F-Series CIRJE-F-660, CIRJE, Faculty of Economics, University of Tokyo.
    • Handle: RePEc:tky:fseres:2009cf660
    as

    Download full text from publisher

    File URL: http://www.cirje.e.u-tokyo.ac.jp/research/dp/2009/2009cf660.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ian King, 2002. "Quality versus quantity: Ranking research records of economics departments in New Zealand," New Zealand Economic Papers, Taylor & Francis Journals, vol. 36(1), pages 97-112.
    2. repec:bla:ecorec:v:71:y:1995:i:212:p:8-17 is not listed on IDEAS
    3. Jerry G. Thursby, 2000. "What Do We Say about Ourselves and What Does It Mean? Yet Another Look at Economics Department Research," Journal of Economic Literature, American Economic Association, vol. 38(2), pages 383-404, June.
    4. Richard Dusansky & Clayton J. Vernon, 1998. "Rankings of U.S. Economics Departments," Journal of Economic Perspectives, American Economic Association, vol. 12(1), pages 157-170, Winter.
    5. Kalaitzidakis, Pantelis & Mamuneas, Theofanis P. & Stengos, Thanasis, 1999. "European economics: An analysis based on publications in the core journals," European Economic Review, Elsevier, vol. 43(4-6), pages 1150-1168, April.
    6. Joseph Macri & Dipendra Sinha, 2004. "Rankings of Economists in Teaching Economics Departments in Australia, 1988-2000," Economics Bulletin, AccessEcon, vol. 1(4), pages 1-19.
    7. Joseph Macri & Dipendra Sinha, 2006. "Rankings Methodology for International Comparisons of Institutions and Individuals: an Application to Economics in Australia and New Zealand," Journal of Economic Surveys, Wiley Blackwell, vol. 20(1), pages 111-156, February.
    8. Tom Coupé, 2003. "Revealed Performances: Worldwide Rankings of Economists and Economics Departments, 1990-2000," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1309-1345, December.
    9. Bairam, Erkin I, 1994. "Institutional Affiliation of Contributors to Top Economic Journals, 1985-1990: Communication," Journal of Economic Literature, American Economic Association, vol. 32(2), pages 674-679, June.
    10. Kalaitzidakis, P. & Mamuneas, T.P. & Stengos, T., 2003. "Rankings of Academic Journals and Institutions," Working Papers 2003-8, University of Guelph, Department of Economics and Finance.
    11. Graves, Philip E & Marchand, James R & Thompson, Randal, 1982. "Economics Departmental Rankings: Research Incentives, Constraints, and Efficiency," American Economic Review, American Economic Association, vol. 72(5), pages 1131-1141, December.
    12. Laband, David N & Piette, Michael J, 1994. "The Relative Impacts of Economics Journals: 1970-1990," Journal of Economic Literature, American Economic Association, vol. 32(2), pages 640-666, June.
    13. Liebowitz, S J & Palmer, J P, 1984. "Assessing the Relative Impacts of Economic Journals," Journal of Economic Literature, American Economic Association, vol. 22(1), pages 77-88, March.
    14. Pantelis Kalaitzidakis & Theofanis P. Mamuneas & Thanasis Stengos, 2003. "Rankings of Academic Journals and Institutions in Economics," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1346-1366, December.
    15. John Gibson, 2000. "Research productivity in New Zealand university economics departments: Comment and update," New Zealand Economic Papers, Taylor & Francis Journals, vol. 34(1), pages 73-87.
    16. Michael McAleer, 2005. "The ten commandments for ranking university quality," Journal of Economic Surveys, Wiley Blackwell, vol. 19(4), pages 649-653, September.
    17. Michael E. Conroy & Richard Dusansky, 1995. "The Productivity of Economics Departments in the U.S.: Publications in the Core Journals," Journal of Economic Literature, American Economic Association, vol. 33(4), pages 1966-1971, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. David L. Anderson & John Tressler, 2009. "The Excellence in Research for Australia Scheme: An Evaluation of the Draft Journal Weights for Economics," Working Papers in Economics 09/07, University of Waikato.
    2. David L. Anderson & John Tressler, 2009. "The ‘Excellence in Research for Australia’ Scheme: A Test Drive of Draft Journal Weights with New Zealand Data," Agenda - A Journal of Policy Analysis and Reform, Australian National University, College of Business and Economics, School of Economics, vol. 16(4), pages 7-24.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Joseph Macri & Dipendra Sinha, 2006. "Rankings Methodology for International Comparisons of Institutions and Individuals: an Application to Economics in Australia and New Zealand," Journal of Economic Surveys, Wiley Blackwell, vol. 20(1), pages 111-156, February.
    2. Joseph Macri & Michael McAleer & Dipendra Sinha, 2010. "On the robustness of alternative rankings methodologies: Australian and New Zealand economics departments, 1988 to 2002," Applied Economics, Taylor & Francis Journals, vol. 42(10), pages 1257-1268.
    3. Konstantinos Chatzimichael & Pantelis Kalaitzidakis & Vangelis Tzouvelekas, 2017. "Measuring the publishing productivity of economics departments in Europe," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(2), pages 889-908, November.
    4. David Anderson & John Tressler, 2008. "Research output in New Zealand economics departments 2000-2006: A stock approach," New Zealand Economic Papers, Taylor & Francis Journals, vol. 42(2), pages 155-189.
    5. Baltagi, Badi H., 2007. "Worldwide Econometrics Rankings: 1989–2005," Econometric Theory, Cambridge University Press, vol. 23(5), pages 952-1012, October.
    6. Martin Gregor, 2006. "Hodnocení ekonomických pracovišť a ekonomů: Koho, proč, čím a jak [A survey of rankings of economic departments: Global, american, european and national]," Politická ekonomie, Prague University of Economics and Business, vol. 2006(3), pages 394-414.
    7. Seiler, Christian & Wohlrabe, Klaus, 2012. "Ranking economists on the basis of many indicators: An alternative approach using RePEc data," Journal of Informetrics, Elsevier, vol. 6(3), pages 389-402.
    8. David L. Anderson & John Tressler, 2009. "The Excellence in Research for Australia Scheme: An Evaluation of the Draft Journal Weights for Economics," Working Papers in Economics 09/07, University of Waikato.
    9. David L. Anderson & John Tressler, 2008. "Research Output in New Zealand Economics Department 2000-2006," Working Papers in Economics 08/05, University of Waikato.
    10. Frank Neri & Joan R. Rodgers, 2006. "Ranking Australian Economics Departments by Research Productivity," The Economic Record, The Economic Society of Australia, vol. 82(s1), pages 74-84, September.
    11. Melody Lo & M. C. Sunny Wong & Franklin G. Mixon, 2008. "Ranking Economics Journals, Economics Departments, and Economists Using Teaching‐Focused Research Productivity," Southern Economic Journal, John Wiley & Sons, vol. 74(3), pages 894-906, January.
    12. David L. Anderson & John Tressler, 2017. "Researcher rank stability across alternative output measurement schemes in the context of a time limited research evaluation: the New Zealand case," Applied Economics, Taylor & Francis Journals, vol. 49(45), pages 4542-4553, September.
    13. James B. Davies & Martin G. Kocher & Matthias Sutter, 2008. "Economics research in Canada: a long-run assessment of journal publications," Canadian Journal of Economics, Canadian Economics Association, vol. 41(1), pages 22-45, February.
    14. Joseph Macri & Dipendra Sinha, 2010. "How much influence do economics professors have on rankings? The case of Australia and New Zealand," Applied Economics, Taylor & Francis Journals, vol. 42(12), pages 1559-1567.
    15. Vicente Royuela & Juan Carlos Duque & Raul Ramos, 2005. "Regional and Urban Research in Italy during the Nineties: Evidence from Publications in Nine Top International Journals," SCIENZE REGIONALI, FrancoAngeli Editore, vol. 2005(3).
    16. David L. Anderson & John Tressler, 2010. "The Merits of Using Citation-Based Journal Weighting Schemes to Measure Research Performance in Economics: The Case of New Zealand," Working Papers in Economics 10/03, University of Waikato.
    17. Jin, Jang C. & Hong, Jin-Heon, 2008. "East Asian rankings of economics departments," Journal of Asian Economics, Elsevier, vol. 19(1), pages 74-82, February.
    18. Robert F. Mulligan, 2024. "Publication trends in political economy scholarship 2011–2020," Constitutional Political Economy, Springer, vol. 35(2), pages 200-302, June.
    19. Issler, João Victor & Ferreira, Rachel Couto, 2003. "Avaliando pesquisadores e departamentos de economia no Brasil a partir de citações internacionais," FGV EPGE Economics Working Papers (Ensaios Economicos da EPGE) 500, EPGE Brazilian School of Economics and Finance - FGV EPGE (Brazil).
    20. Michael Bräuninger & Justus Haucap, 2003. "Reputation and Relevance of Economics Journals," Kyklos, Wiley Blackwell, vol. 56(2), pages 175-197, May.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tky:fseres:2009cf660. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CIRJE administrative office (email available below). General contact details of provider: https://edirc.repec.org/data/ritokjp.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.