IDEAS home Printed from https://ideas.repec.org/a/acb/agenda/v16y2009i4p7-24.html
   My bibliography  Save this article

The ‘Excellence in Research for Australia’ Scheme: A Test Drive of Draft Journal Weights with New Zealand Data

Author

Listed:
  • David L. Anderson
  • John Tressler

Abstract

The paper assesses the draft weighting system used by the Excellence in Research for Australia (ERA) scheme for measuring the output of refereed economics journal articles. It does so by using data from New Zealand’s economics departments to demonstrate how the rankings of departmental and individual researchers are affected by the use of ERA weights rather than alternative weights employed in the economics literature. It concludes that the draft version of the ERA scheme, as released in August 2008, rewards research quantity over research quality, as traditionally defined.

Suggested Citation

  • David L. Anderson & John Tressler, 2009. "The ‘Excellence in Research for Australia’ Scheme: A Test Drive of Draft Journal Weights with New Zealand Data," Agenda - A Journal of Policy Analysis and Reform, Australian National University, College of Business and Economics, School of Economics, vol. 16(4), pages 7-24.
    • Handle: RePEc:acb:agenda:v:16:y:2009:i:4:p:7-24
    as

    Download full text from publisher

    File URL: http://press-files.anu.edu.au/downloads/press/p88831/pdf/011.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Christian Zimmermann, 2013. "Academic Rankings with RePEc," Econometrics, MDPI, vol. 1(3), pages 1-32, December.
    2. Richard Pomfret & Liang Choon Wang, 2003. "Evaluating The Research Output Of Australian Universities' Economics Departments," Australian Economic Papers, Wiley Blackwell, vol. 42(4), pages 418-441, December.
    3. Ian King, 2002. "Quality versus quantity: Ranking research records of economics departments in New Zealand," New Zealand Economic Papers, Taylor & Francis Journals, vol. 36(1), pages 97-112.
    4. Harris, G T, 1990. "Research Output in Australian University Economics Departments: An Update for 1984-88," Australian Economic Papers, Wiley Blackwell, vol. 29(55), pages 249-259, December.
    5. Towe, Jack B & Wright, Donald J, 1995. "Research Published by Australian Economics and Econometrics Departments: 1988-93," The Economic Record, The Economic Society of Australia, vol. 71(212), pages 8-17, March.
    6. David L. Anderson & John Tressler, 2008. "Research Output in New Zealand Economics Department 2000-2006," Working Papers in Economics 08/05, University of Waikato.
    7. Joan R. Rodgers & Abbas Valadkhani, 2006. "A Multidimensional Ranking of Australian Economics Departments," The Economic Record, The Economic Society of Australia, vol. 82(256), pages 30-43, March.
    8. Joseph Macri & Dipendra Sinha, 2010. "How much influence do economics professors have on rankings? The case of Australia and New Zealand," Applied Economics, Taylor & Francis Journals, vol. 42(12), pages 1559-1567.
    9. Kodrzycki Yolanda K. & Yu Pingkang, 2006. "New Approaches to Ranking Economics Journals," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 5(1), pages 1-44, August.
    10. Joseph Macri & Michael McAleer & Dipendra Sinha, 2010. "On the robustness of alternative rankings methodologies: Australian and New Zealand economics departments, 1988 to 2002," Applied Economics, Taylor & Francis Journals, vol. 42(10), pages 1257-1268.
    11. Joseph Macri & Michael McAleer & Dipendra Sinha, 2009. "On the Robustness of Alternative Rankings Methodologies For Australian and New Zealand Economics Departments," CIRJE F-Series CIRJE-F-660, CIRJE, Faculty of Economics, University of Tokyo.
    12. Joseph Macri & Dipendra Sinha, 2006. "Rankings Methodology for International Comparisons of Institutions and Individuals: an Application to Economics in Australia and New Zealand," Journal of Economic Surveys, Wiley Blackwell, vol. 20(1), pages 111-156, February.
    13. Liebowitz, S J & Palmer, J P, 1984. "Assessing the Relative Impacts of Economic Journals," Journal of Economic Literature, American Economic Association, vol. 22(1), pages 77-88, March.
    14. Kalaitzidakis, P. & Mamuneas, T.P. & Stengos, T., 2003. "Rankings of Academic Journals and Institutions," Working Papers 2003-8, University of Guelph, Department of Economics and Finance.
    15. Frank Neri & Joan R. Rodgers, 2006. "Ranking Australian Economics Departments by Research Productivity," The Economic Record, The Economic Society of Australia, vol. 82(s1), pages 74-84, September.
    16. Abbott, M. & Doucouliagos, C., 2003. "The efficiency of Australian universities: a data envelopment analysis," Economics of Education Review, Elsevier, vol. 22(1), pages 89-97, February.
    17. Yolanda Kodrzycki & Pingkang David Yu, 2005. "New approaches to ranking economics journals," Working Papers 05-12, Federal Reserve Bank of Boston.
    18. David Anderson & John Tressler, 2008. "Research output in New Zealand economics departments 2000-2006: A stock approach," New Zealand Economic Papers, Taylor & Francis Journals, vol. 42(2), pages 155-189.
    19. Kalaitzidakis, Pantelis & Mamuneas, Theofanis P. & Stengos, Thanasis, 1999. "European economics: An analysis based on publications in the core journals," European Economic Review, Elsevier, vol. 43(4-6), pages 1150-1168, April.
    20. Joan R. Rodgers & Frank Neri, 2007. "Research Productivity Of Australian Academic Economists: Human‐Capital And Fixed Effects," Australian Economic Papers, Wiley Blackwell, vol. 46(1), pages 67-87, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. David L. Anderson & John Tressler, 2010. "The Merits of Using Citation-Based Journal Weighting Schemes to Measure Research Performance in Economics: The Case of New Zealand," Working Papers in Economics 10/03, University of Waikato.
    2. Vanclay, Jerome K., 2011. "An evaluation of the Australian Research Council's journal ranking," Journal of Informetrics, Elsevier, vol. 5(2), pages 265-274.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. David L. Anderson & John Tressler, 2009. "The Excellence in Research for Australia Scheme: An Evaluation of the Draft Journal Weights for Economics," Working Papers in Economics 09/07, University of Waikato.
    2. David Anderson & John Tressler, 2008. "Research output in New Zealand economics departments 2000-2006: A stock approach," New Zealand Economic Papers, Taylor & Francis Journals, vol. 42(2), pages 155-189.
    3. David L. Anderson & John Tressler, 2017. "Researcher rank stability across alternative output measurement schemes in the context of a time limited research evaluation: the New Zealand case," Applied Economics, Taylor & Francis Journals, vol. 49(45), pages 4542-4553, September.
    4. David L. Anderson & John Tressler, 2008. "Research Output in New Zealand Economics Department 2000-2006," Working Papers in Economics 08/05, University of Waikato.
    5. Joseph Macri & Dipendra Sinha, 2006. "Rankings Methodology for International Comparisons of Institutions and Individuals: an Application to Economics in Australia and New Zealand," Journal of Economic Surveys, Wiley Blackwell, vol. 20(1), pages 111-156, February.
    6. Joseph Macri & Michael McAleer & Dipendra Sinha, 2010. "On the robustness of alternative rankings methodologies: Australian and New Zealand economics departments, 1988 to 2002," Applied Economics, Taylor & Francis Journals, vol. 42(10), pages 1257-1268.
    7. David L. Anderson & John Tressler, 2013. "The Relevance of the “h-” and “g-” Index to Economics in the Context of A Nation-Wide Research Evaluation Scheme: The New Zealand Case," Economic Papers, The Economic Society of Australia, vol. 32(1), pages 81-94, March.
    8. Joseph Macri & Michael McAleer & Dipendra Sinha, 2009. "On the Robustness of Alternative Rankings Methodologies For Australian and New Zealand Economics Departments," CIRJE F-Series CIRJE-F-660, CIRJE, Faculty of Economics, University of Tokyo.
    9. Frank Neri & Joan Rodgers, 2012. "Human capital externalities, departmental co-authorship and research productivity," Economics Working Papers wp12-05, School of Economics, University of Wollongong, NSW, Australia.
    10. Seiler, Christian & Wohlrabe, Klaus, 2012. "Ranking economists on the basis of many indicators: An alternative approach using RePEc data," Journal of Informetrics, Elsevier, vol. 6(3), pages 389-402.
    11. David L. Anderson & John Tressler, 2011. "Ranking Economics Departments In Terms Of Residual Productivity: New Zealand Economics Departments, 2000–2006," Australian Economic Papers, Wiley Blackwell, vol. 50(4), pages 157-168, December.
    12. Joan R. Rodgers & Abbas Valadkhani, 2006. "A Multidimensional Ranking of Australian Economics Departments," The Economic Record, The Economic Society of Australia, vol. 82(256), pages 30-43, March.
    13. Frank Neri & Joan R. Rodgers, 2006. "Ranking Australian Economics Departments by Research Productivity," The Economic Record, The Economic Society of Australia, vol. 82(s1), pages 74-84, September.
    14. José Alberto Molina & Alfredo Ferrer & David Iñiguez & Alejandro Rivero & Gonzalo Ruiz & Alfonso Tarancón, 2020. "Network analysis to measure academic performance in economics," Empirical Economics, Springer, vol. 58(3), pages 995-1018, March.
    15. ÇOKGEZEN , Murat, 2013. "Publication performance of economists and economics departments in Turkey (2006–2011): An Update and Comparison," Regional and Sectoral Economic Studies, Euro-American Association of Economic Development, vol. 13(3), pages 95-106.
    16. David L. Anderson & John Tresler, 2008. "An Analysis of New Zealand Economists' Research Output 2000-2006," Working Papers in Economics 08/20, University of Waikato, revised 31 Dec 2008.
    17. Giannias Dimitris A. & Sfakianaki Eleni, 2012. "University Rankings of Different Academic Positions for the Present and the Future: The Case of Greek Departments of Economics," Scientific Annals of Economics and Business, Sciendo, vol. 59(2), pages 43-66, December.
    18. repec:ebl:ecbull:v:1:y:2004:i:4:p:1-19 is not listed on IDEAS
    19. Baltagi, Badi H., 2007. "Worldwide Econometrics Rankings: 1989–2005," Econometric Theory, Cambridge University Press, vol. 23(5), pages 952-1012, October.
    20. Yihui Lan & Kenneth W. Clements & Zong Ken Chai, 2023. "How Productive Are Economics and Finance PhDs?," Australian Economic Review, The University of Melbourne, Melbourne Institute of Applied Economic and Social Research, vol. 56(4), pages 442-461, December.
    21. Lutz Bornmann & Alexander Butz & Klaus Wohlrabe, 2018. "What are the top five journals in economics? A new meta-ranking," Applied Economics, Taylor & Francis Journals, vol. 50(6), pages 659-675, February.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:acb:agenda:v:16:y:2009:i:4:p:7-24. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/feanuau.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.