IDEAS home Printed from https://ideas.repec.org/a/wly/accper/v9y2010i3p217-235.html
   My bibliography  Save this article

Aggregating Incomplete Lists of Journal Rankings: An Application to Academic Accounting Journals

Author

Listed:
  • WADE D. COOK
  • TAL RAVIV
  • ALAN J. RICHARDSON

Abstract

We introduce a branch‐and‐cut algorithm to aggregate published journal rankings based on subsets of the accounting literature in order to create a consensus ranking. The aggregate ranking allows specialist and regional journals, which may only be ranked in a limited number of studies, to be placed with respect to each other and with respect to the generalist journals that are usually included in ranking studies. The approach we develop is a significant advance over ad hoc approaches to aggregating journal rankings that have appeared in the literature and may provide a theoretically sound and replicable basis for further exploration of the concept of journal quality and the stability of journal rankings over time and ranking methods. Compilation de listes incomplètes de revues: une application aux revues comptables spécialisées Résumé Les auteurs ont recours à un algorithme de séparation et coupes pour agréger les classements de revues, à partir de sous‐ensembles de publications comptables, en vue de créer une classification consensuelle. La classification agrégée permet d’ordonner les revues spécialisées et régionales, qui ne sont classées que dans un nombre limité d’études, les unes par rapport aux autres ainsi que par rapport aux revues non spécialisées qui figurent habituellement dans les études de classification. La méthode élaborée par les auteurs est sensiblement supérieure aux méthodes ponctuelles de compilation des classements de revues proposées dans la documentation et peut servir debase théorique solide et renouvelable pour une exploration plus approfondie des notions de qualité des revues et de stabilité des classements dans le temps et selon les méthodes de classification.

Suggested Citation

  • Wade D. Cook & Tal Raviv & Alan J. Richardson, 2010. "Aggregating Incomplete Lists of Journal Rankings: An Application to Academic Accounting Journals," Accounting Perspectives, John Wiley & Sons, vol. 9(3), pages 217-235, September.
    • Handle: RePEc:wly:accper:v:9:y:2010:i:3:p:217-235
    DOI: 10.1111/j.1911-3838.2010.00011.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/j.1911-3838.2010.00011.x
    Download Restriction: no
    File URL: https://libkey.io/10.1111/j.1911-3838.2010.00011.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Apostolos Ballas & Vasilis Theoharakis, 2003. "Exploring Diversity in Accounting through Faculty Journal Perceptions," Contemporary Accounting Research, John Wiley & Sons, vol. 20(4), pages 619-644, December.
    2. Craig W. Kirkwood & Rakesh K. Sarin, 1985. "Ranking with Partial Information: A Method and an Application," Operations Research, INFORMS, vol. 33(1), pages 38-48, February.
    3. Wade D. Cook & Lawrence M. Seiford, 1978. "Priority Ranking and Consensus Formation," Management Science, INFORMS, vol. 24(16), pages 1721-1732, December.
    4. Golany, B. & Kress, M., 1993. "A multicriteria evaluation of methods for obtaining weights from ratio-scale matrices," European Journal of Operational Research, Elsevier, vol. 69(2), pages 210-220, September.
    5. Iqbal Ali & Wade D. Cook & Moshe Kress, 1986. "On the Minimum Violations Ranking of a Tournament," Management Science, INFORMS, vol. 32(6), pages 660-672, June.
    6. Brown, Lawrence D, 2003. "Ranking Journals Using Social Science Research Network Downloads," Review of Quantitative Finance and Accounting, Springer, vol. 20(3), pages 291-307, May.
    7. Vivien Beattie & Elizabeth Davie, 2006. "Theoretical studies of the historical development of the accounting discipline: A review and evidence," Accounting History Review, Taylor & Francis Journals, vol. 16(1), pages 1-25.
    8. Lawrence D. Brown & Ronald J. Huefner, 1994. "The Familiarity with and Perceived Quality of Accounting Journals: Views of Senior Accounting Faculty in Leading U.S. MBA Programs," Contemporary Accounting Research, John Wiley & Sons, vol. 11(1), pages 223-250, June.
    9. Roubens, Marc, 1982. "Preference relations on actions and criteria in multicriteria decision making," European Journal of Operational Research, Elsevier, vol. 10(1), pages 51-55, May.
    10. Vivien Beattie & Alan Goodacre, 2006. "A new method for ranking academic journals in accounting and finance," Accounting and Business Research, Taylor & Francis Journals, vol. 36(2), pages 65-91.
    11. Lowe, Alan & Locke, Joanne, 2005. "Perceptions of journal quality and research paradigm: results of a web-based survey of British accounting academics," Accounting, Organizations and Society, Elsevier, vol. 30(1), pages 81-98, January.
    12. Joanne Locke & Alan Lowe, 2002. "Problematising the construction of journal quality: an engagement with the mainstream," Accounting Forum, Taylor & Francis Journals, vol. 26(1), pages 45-71, March.
    13. Bonner, Sarah E. & Hesford, James W. & Van der Stede, Wim A. & Young, S. Mark, 2006. "The most influential journals in academic accounting," Accounting, Organizations and Society, Elsevier, vol. 31(7), pages 663-685, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Francisco Salas-Molina & Filippo Bistaffa & Juan A. Rodriguez-Aguilar, 2024. "A General Approach for Computing a Consensus in Group Decision Making That Integrates Multiple Ethical Principles," Papers 2401.07818, arXiv.org, revised Mar 2024.
    2. George Emm Halkos & Nickolaos G. Tzeremes, 2011. "Measuring economic journals’ citation efficiency: a data envelopment analysis approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(3), pages 979-1001, September.
    3. Christine Wiedman, 2020. "Rewarding Collaborative Research: Role Congruity Bias and the Gender Pay Gap in Academe," Journal of Business Ethics, Springer, vol. 167(4), pages 793-807, December.
    4. Rosenthal, Edward C. & Weiss, Howard J., 2017. "A data envelopment analysis approach for ranking journals," Omega, Elsevier, vol. 70(C), pages 135-147.
    5. Akbari, Sina & Escobedo, Adolfo R., 2023. "Beyond kemeny rank aggregation: A parameterizable-penalty framework for robust ranking aggregation with ties," Omega, Elsevier, vol. 119(C).
    6. Yeawon Yoo & Adolfo R. Escobedo, 2021. "A New Binary Programming Formulation and Social Choice Property for Kemeny Rank Aggregation," Decision Analysis, INFORMS, vol. 18(4), pages 296-320, December.
    7. Wohlrabe, Klaus & Friedrich, Elisabeth, 2016. "Ordinal ranking aggregation in bibliometric analysis," MPRA Paper 69144, University Library of Munich, Germany.
    8. Lior Rokach, 2012. "Applying the Publication Power Approach to Artificial Intelligence Journals," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(6), pages 1270-1277, June.
    9. Tüselmann, Heinz & Sinkovics, Rudolf R. & Pishchulov, Grigory, 2016. "Revisiting the standing of international business journals in the competitive landscape," Journal of World Business, Elsevier, vol. 51(4), pages 487-498.
    10. S. Douglas Beets & Andrea S. Kelton & Bruce R. Lewis, 2015. "An assessment of accounting journal quality based on departmental lists," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 315-332, January.
    11. Christoph Pelger & Markus Grottke, 2017. "Research diversity in accounting doctoral education: survey results from the German-speaking countries," Business Research, Springer;German Academic Association for Business Research, vol. 10(2), pages 307-336, October.
    12. Salas-Molina, Francisco & Bistaffa, Filippo & Rodríguez-Aguilar, Juan A., 2023. "A general approach for computing a consensus in group decision making that integrates multiple ethical principles," Socio-Economic Planning Sciences, Elsevier, vol. 89(C).
    13. Laura Vana & Ronald Hochreiter & Kurt Hornik, 2016. "Computing a journal meta-ranking using paired comparisons and adaptive lasso estimators," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(1), pages 229-251, January.
    14. Merridee l. Bujaki & Bruce J. Mcconomy, 2017. "Productivity in Top‐10 Academic Accounting Journals by Researchers at Canadian Universities at the Start of the 21st Century," Accounting Perspectives, John Wiley & Sons, vol. 16(4), pages 269-313, December.
    15. Subochev, Andrey & Aleskerov, Fuad & Pislyakov, Vladimir, 2018. "Ranking journals using social choice theory methods: A novel approach in bibliometrics," Journal of Informetrics, Elsevier, vol. 12(2), pages 416-429.
    16. Tüselmann, Heinz & Sinkovics, Rudolf R. & Pishchulov, Grigory, 2015. "Towards a consolidation of worldwide journal rankings – A classification using random forests and aggregate rating via data envelopment analysis," Omega, Elsevier, vol. 51(C), pages 11-23.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. S. Douglas Beets & Andrea S. Kelton & Bruce R. Lewis, 2015. "An assessment of accounting journal quality based on departmental lists," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 315-332, January.
    2. Hussain, Simon, 2010. "Accounting journals and the ABS quality ratings," The British Accounting Review, Elsevier, vol. 42(1), pages 1-16.
    3. Rosenstreich, Daniela & Wooliscroft, Ben, 2009. "Measuring the impact of accounting journals using Google Scholar and the g-index," The British Accounting Review, Elsevier, vol. 41(4), pages 227-239.
    4. Chan, Kam C. & Chan, Kam C. & Seow, Gim S. & Tam, Kinsun, 2009. "Ranking accounting journals using dissertation citation analysis: A research note," Accounting, Organizations and Society, Elsevier, vol. 34(6-7), pages 875-885, August.
    5. Geert Campenhout & Tom Caneghem & Steve Uytbergen, 2008. "A comparison of overall and sub-area journal influence: The case of the accounting literature," Scientometrics, Springer;Akadémiai Kiadó, vol. 77(1), pages 61-90, October.
    6. Bernard Raffournier & Alain Schatt, 2010. "Is European Accounting Research Fairly Reflected in Academic Journals? An Investigation of Possible Non-mainstream and Language Barrier Biases," European Accounting Review, Taylor & Francis Journals, vol. 19(1), pages 161-190.
    7. Konstantinos Eleftheriou & Patroklos Patsoulis & Michael Polemis, 2023. "Convergence among academic journals in accounting: a note," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(2), pages 1055-1069, February.
    8. Kam C. Chan & Kartono Liano, 2009. "Threshold citation analysis of influential articles, journals, institutions and researchers in accounting," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 49(1), pages 59-74, March.
    9. Wai Ching Poon & Gareth D. Leeves, 2017. "Is there gender gap unequivocally? Evidence from research output 1958–2008," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(3), pages 1687-1701, June.
    10. Lowe, Alan & Locke, Joanne, 2006. "Constructing an ‘efficient frontier’ of accounting journal quality," The British Accounting Review, Elsevier, vol. 38(3), pages 321-341.
    11. Christoph Endenich & Rouven Trapp, 2016. "Cooperation for Publication? An Analysis of Co-authorship Patterns in Leading Accounting Journals," European Accounting Review, Taylor & Francis Journals, vol. 25(3), pages 613-633, September.
    12. Vivien Beattie & Alan Goodacre, 2006. "A new method for ranking academic journals in accounting and finance," Accounting and Business Research, Taylor & Francis Journals, vol. 36(2), pages 65-91.
    13. Geert Van Campenhout & Tom Van Caneghem, 2010. "Article Contribution and Subsequent Citation Rates: Evidence from European Accounting Review," European Accounting Review, Taylor & Francis Journals, vol. 19(4), pages 837-855.
    14. Bonner, Sarah E. & Hesford, James W. & Van der Stede, Wim A. & Young, S. Mark, 2006. "The most influential journals in academic accounting," Accounting, Organizations and Society, Elsevier, vol. 31(7), pages 663-685, October.
    15. Williams, Paul F. & Jenkins, J. Gregory & Ingraham, Laura, 2006. "The winnowing away of behavioral accounting research in the US: The process for anointing academic elites," Accounting, Organizations and Society, Elsevier, vol. 31(8), pages 783-818, November.
    16. Christoph Pelger & Markus Grottke, 2017. "Research diversity in accounting doctoral education: survey results from the German-speaking countries," Business Research, Springer;German Academic Association for Business Research, vol. 10(2), pages 307-336, October.
    17. Brown, Rhoda & Jones, Michael, 2015. "Mapping and exploring the topography of contemporary financial accounting research," The British Accounting Review, Elsevier, vol. 47(3), pages 237-261.
    18. Cook, Wade D., 2006. "Distance-based and ad hoc consensus models in ordinal preference ranking," European Journal of Operational Research, Elsevier, vol. 172(2), pages 369-385, July.
    19. Wakefield, Robin, 2008. "Networks of accounting research: A citation-based structural and network analysis," The British Accounting Review, Elsevier, vol. 40(3), pages 228-244.
    20. Thomas Lange, 2006. "The Imprecise Science of Evaluating Scholarly Performance," Evaluation Review, , vol. 30(4), pages 505-532, August.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:accper:v:9:y:2010:i:3:p:217-235. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1111/(ISSN)1911-3838 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.