IDEAS home Printed from https://ideas.repec.org/a/eee/jbrese/v67y2014i5p998-1006.html
   My bibliography  Save this article

How to derive consensus among various marketing journal rankings?

Author

Listed:
  • Theuβl, Stefan
  • Reutterer, Thomas
  • Hornik, Kurt

Abstract

Despite the increasing popularity of journal rankings to evaluate the quality of research contributions, the individual rankings for journals that ranked below the top tier of publications usually feature only modest agreement. Attempts to merge rankings into meta-rankings suffer from some methodological issues, such as mixed measurement scales and incomplete data. This paper addresses the issue of how to construct suitable aggregates of individual journal rankings, using an optimization-based consensus ranking approach. The authors apply the proposed method to a subset of marketing-related journals from a list of collected journal rankings. Next, the paper studies the stability of the derived consensus solution, and the degeneration effects that occur when excluding journals and/or rankings. Finally, the authors investigate the similarities/dissimilarities of the consensus with a naive meta-ranking and with individual rankings. The results show that, even though journals are not uniformly ranked, one may derive a consensus ranking with considerably high agreement with the individual rankings.

Suggested Citation

  • Theuβl, Stefan & Reutterer, Thomas & Hornik, Kurt, 2014. "How to derive consensus among various marketing journal rankings?," Journal of Business Research, Elsevier, vol. 67(5), pages 998-1006.
  • Handle: RePEc:eee:jbrese:v:67:y:2014:i:5:p:998-1006
    DOI: 10.1016/j.jbusres.2013.08.006
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0148296313003032
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jbusres.2013.08.006?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bancroft, Diccon R. E. & Gopinath, C. & Kovacs, Agnes M. & Rejto, Lidia K., 1999. "A new methodology for aggregating tables: Summarizing journal quality data," Journal of Business Venturing, Elsevier, vol. 14(3), pages 311-319, May.
    2. Ofer H. Azar & David M. Brock, 2008. "A Citation‐Based Ranking of Strategic Management Journals," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 17(3), pages 781-802, September.
    3. Frank L DuBois & David Reeb, 2000. "Ranking the International Business Journals," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 31(4), pages 689-704, December.
    4. Cook, Wade D., 2006. "Distance-based and ad hoc consensus models in ordinal preference ranking," European Journal of Operational Research, Elsevier, vol. 172(2), pages 369-385, July.
    5. Pieters, R. & Baumgartner, H. & Vermunt, J.K. & Bijmolt, T.H.A., 1999. "Importance and similarity in the evolving citation network of the International Journal of Research in Marketing," Other publications TiSEM e2c16930-bf58-49ae-8cc9-f, Tilburg University, School of Economics and Management.
    6. de Leeuw, Jan & Mair, Patrick, 2009. "Multidimensional Scaling Using Majorization: SMACOF in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 31(i03).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ruturaj Baber & Yogesh Upadhyay & Prerana Baber & Rahul Pratap Singh Kaurav, 2023. "Three Decades of Consumer Ethnocentrism Research: A Bibliometric Analysis," Business Perspectives and Research, , vol. 11(1), pages 137-158, January.
    2. Rishikesh Bhaiswar & N. Meenakshi & Deepak Chawla, 2021. "Evolution of Electronic Word of Mouth: A Systematic Literature Review Using Bibliometric Analysis of 20 Years (2000–2020)," FIIB Business Review, , vol. 10(3), pages 215-231, September.
    3. Chris Wagner, 2020. "Deducing a state-of-the-art presentation of the Eclectic Paradigm from four decades of development: a systematic literature review," Management Review Quarterly, Springer, vol. 70(1), pages 51-96, February.
    4. Tüselmann, Heinz & Sinkovics, Rudolf R. & Pishchulov, Grigory, 2016. "Revisiting the standing of international business journals in the competitive landscape," Journal of World Business, Elsevier, vol. 51(4), pages 487-498.
    5. Gianfranco Ennas & Battista Biggio & Maria Chiara Di Guardo, 2015. "Data-driven journal meta-ranking in business and management," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(3), pages 1911-1929, December.
    6. Zahoor, Nadia & Al-Tabbaa, Omar, 2020. "Inter-organizational collaboration and SMEs’ innovation: A systematic review and future research directions," Scandinavian Journal of Management, Elsevier, vol. 36(2).
    7. Laura Vana & Ronald Hochreiter & Kurt Hornik, 2016. "Computing a journal meta-ranking using paired comparisons and adaptive lasso estimators," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(1), pages 229-251, January.
    8. Tüselmann, Heinz & Sinkovics, Rudolf R. & Pishchulov, Grigory, 2015. "Towards a consolidation of worldwide journal rankings – A classification using random forests and aggregate rating via data envelopment analysis," Omega, Elsevier, vol. 51(C), pages 11-23.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tüselmann, Heinz & Sinkovics, Rudolf R. & Pishchulov, Grigory, 2015. "Towards a consolidation of worldwide journal rankings – A classification using random forests and aggregate rating via data envelopment analysis," Omega, Elsevier, vol. 51(C), pages 11-23.
    2. Jessica Petersen & Fabian Hattke & Rick Vogel, 2017. "Editorial governance and journal impact: a study of management and business journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(3), pages 1593-1614, September.
    3. Yadong Luo & Huan Zhang & Juan Bu, 2019. "Developed country MNEs investing in developing economies: Progress and prospect," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 50(4), pages 633-667, June.
    4. Pantelis Kalaitzidakis & Theofanis P. Mamuneas & Thanasis Stengos, 2011. "An updated ranking of academic journals in economics," Canadian Journal of Economics, Canadian Economics Association, vol. 44(4), pages 1525-1538, November.
    5. Franceschini, Fiorenzo & Maisano, Domenico, 2015. "Checking the consistency of the solution in ordinal semi-democratic decision-making problems," Omega, Elsevier, vol. 57(PB), pages 188-195.
    6. Guercini, Simone & Milanesi, Matilde, 2020. "Heuristics in international business: A systematic literature review and directions for future research," Journal of International Management, Elsevier, vol. 26(4).
    7. González-Arteaga, T. & Alcantud, J.C.R. & de Andrés Calle, R., 2016. "A cardinal dissensus measure based on the Mahalanobis distance," European Journal of Operational Research, Elsevier, vol. 251(2), pages 575-585.
    8. Geert Campenhout & Tom Caneghem & Steve Uytbergen, 2008. "A comparison of overall and sub-area journal influence: The case of the accounting literature," Scientometrics, Springer;Akadémiai Kiadó, vol. 77(1), pages 61-90, October.
    9. Funk, Patrick & Davis, Alex & Vaishnav, Parth & Dewitt, Barry & Fuchs, Erica, 2020. "Individual inconsistency and aggregate rationality: Overcoming inconsistencies in expert judgment at the technical frontier," Technological Forecasting and Social Change, Elsevier, vol. 155(C).
    10. Qomaruddin Muhammad & Pratiwi Ratih Nur & Sarwono Sarwono, 2017. "Strategic on Management Scientific Publication of Student Journal in Higher Education (a Case Study)," HOLISTICA – Journal of Business and Public Administration, Sciendo, vol. 8(3), pages 41-54, December.
    11. Michael J. Greenacre & Patrick J. F. Groenen, 2016. "Weighted Euclidean Biplots," Journal of Classification, Springer;The Classification Society, vol. 33(3), pages 442-459, October.
    12. Yeawon Yoo & Adolfo R. Escobedo, 2021. "A New Binary Programming Formulation and Social Choice Property for Kemeny Rank Aggregation," Decision Analysis, INFORMS, vol. 18(4), pages 296-320, December.
    13. Freixas, Josep & Kurz, Sascha, 2013. "The golden number and Fibonacci sequences in the design of voting structures," European Journal of Operational Research, Elsevier, vol. 226(2), pages 246-257.
    14. Fujun Hou, 2015. "A Consensus Gap Indicator and Its Application to Group Decision Making," Group Decision and Negotiation, Springer, vol. 24(3), pages 415-428, May.
    15. Gilbert Kofi Adarkwah & Tine Petersen Malonæs, 2022. "Firm-specific advantages: a comprehensive review with a focus on emerging markets," Asia Pacific Journal of Management, Springer, vol. 39(2), pages 539-585, June.
    16. Walesiak Marek & Dudek Andrzej, 2017. "Selecting the Optimal Multidimensional Scaling Procedure for Metric Data With R Environment," Statistics in Transition New Series, Polish Statistical Association, vol. 18(3), pages 521-540, September.
    17. J Mingers, 2008. "Exploring the dynamics of journal citations: Modelling with s-curves," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(8), pages 1013-1025, August.
    18. Naveen Kumar Jain & Tanvi Kothari & Vikas Kumar, 2016. "Location Choice Research: Proposing New Agenda," Management International Review, Springer, vol. 56(3), pages 303-324, June.
    19. Frederic S. Lee & Bruce C. Cronin & Scott McConnell & Erik Dean, 2010. "Research Quality Rankings of Heterodox Economic Journals in a Contested Discipline," American Journal of Economics and Sociology, Wiley Blackwell, vol. 69(5), pages 1409-1452, November.
    20. Stremersch, S. & Verniers, I.W.J. & Verhoef, P.C., 2006. "The Quest for Citations: Drivers of Article Impact," ERIM Report Series Research in Management ERS-2006-061-MKT, Erasmus Research Institute of Management (ERIM), ERIM is the joint research institute of the Rotterdam School of Management, Erasmus University and the Erasmus School of Economics (ESE) at Erasmus University Rotterdam.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jbrese:v:67:y:2014:i:5:p:998-1006. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jbusres .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.