IDEAS home Printed from https://ideas.repec.org/a/eee/jomega/v30y2002i2p109-126.html
   My bibliography  Save this article

Journal characteristics, rankings and social acculturation in operations management

Author

Listed:
  • Vastag, Gyula
  • Montabon, Frank

Abstract

Over the past 15 yr, there have been several attempts in operations management to rate journals, authors and schools based on their research productivity and quality. While many of these have been very helpful in generating a relative ranking of productivity and prestige, these analyses seem incomplete in many ways. Most notably, they neglected the fact that these rankings are loaded with value judgments acquired in the process of academic acculturation on one hand and that they did not provide basic information about the journals on the other. This paper argues that the rankings reflect the milieu in which they were conceived and calls for "usage-based" measures as more appropriate ways of measuring a publication's impact through influencing and changing the thinking and actions of researchers, students and practitioners. Specifically, this article has three objectives. First, it fills an information gap by giving the characteristics of 28 journals in the broadly-defined field of operations management. Second, the article summarizes the strengths and weaknesses of the approaches taken to rank journals. Third, this article shows some factors of social acculturation (acquired either through education or working in different environments) in the journal evaluation process. The empirical part of the paper is based on analyzing referencing practices of these journals, surveying senior editors, analyzing reading lists of doctoral programs at major research universities, and contacting university and corporate libraries, and consulting companies.

Suggested Citation

  • Vastag, Gyula & Montabon, Frank, 2002. "Journal characteristics, rankings and social acculturation in operations management," Omega, Elsevier, vol. 30(2), pages 109-126, April.
  • Handle: RePEc:eee:jomega:v:30:y:2002:i:2:p:109-126
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305-0483(01)00061-5
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jones, M. J. & Brinn, T. & Pendlebury, M., 1996. "Journal evaluation methodologies: A balanced response," Omega, Elsevier, vol. 24(5), pages 607-612, October.
    2. Michael H. Rothkopf, 1996. "Editorial: Which Universities Contribute to the Practice Literature? The First Interfaces Ranking," Interfaces, INFORMS, vol. 26(2), pages 16-21, April.
    3. Richard Ormerod & Ioannis Kiossis, 1997. "OR/MS Publications: Extension of the Analysis of U.S. Flagship Journals to the United Kingdom," Operations Research, INFORMS, vol. 45(2), pages 178-187, April.
    4. Michael H. Rothkopf, 1997. "Editorial: Which Universities Contribute to the Practice Literature? The Second Interfaces Ranking," Interfaces, INFORMS, vol. 27(4), pages 19-22, August.
    5. Ian I. Mitroff & Frederick Betz & Louis R. Pondy & Francisco Sagasti, 1974. "On Managing Science in the Systems Age: Two Schemas for the Study of Science as a Whole Systems Phenomenon," Interfaces, INFORMS, vol. 4(3), pages 46-58, May.
    6. Doyle, John R., 1999. "Evaluating OR/MS research," Omega, Elsevier, vol. 27(3), pages 403-405, June.
    7. Uma G. Gupta, 1997. "Using Citation Analysis to Explore the Intellectual Base, Knowledge Dissemination, and Research Impact of Interfaces (1970–1992)," Interfaces, INFORMS, vol. 27(2), pages 85-101, April.
    8. Graeme Hirst, 1978. "Discipline impact factors: A method for determining core journal lists," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 29(4), pages 171-172, July.
    9. J. Scott Armstrong, 1980. "Unintelligible Management Research and Academic Prestige," Interfaces, INFORMS, vol. 10(2), pages 80-86, April.
    10. Clive Beed & Cara Beed, 1996. "Measuring the Quality of Academic Journals: The Case of Economics," Journal of Post Keynesian Economics, Taylor & Francis Journals, vol. 18(3), pages 369-396, March.
    11. Mitchell, George, 1996. "Judging research quality and journals: A call for debate," Omega, Elsevier, vol. 24(5), pages 613-613, October.
    12. Reisman, Arnold & Kirschnick, Frank A., 2000. "A role for content analysis in research on MS/OR research literature," Omega, Elsevier, vol. 28(2), pages 247-248, April.
    13. Barbara Pierce & Garnet Garven, 1995. "Publishing International Business Research: A Survey of Leading Journals," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 26(1), pages 69-89, March.
    14. Ormerod, R. J., 2000. "Is content analysis either practical or desirable for research evaluation?," Omega, Elsevier, vol. 28(2), pages 241-245, April.
    15. Brinn, Tony & Jones, Michael John & Pendlebury, Maurice, 2000. "Measuring research quality: peer review 1, citation indices 0," Omega, Elsevier, vol. 28(2), pages 237-239, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Iszan Hana Kaharudin & Mohammad Syuhaimi Ab-Rahman & Roslan Abd-Shukor & Azamin Zaharim & Mohd Jailani Mohd Nor & Ahmad Kamal Ariffin Mohd Ihsan & Shahrom Md Zain & Afiq Hipni & Kamisah Osman & Ruszym, 2022. "How Does Supervision Technique Affect Research? Towards Sustainable Performance: Publications and Students from Pure and Social Sciences," Sustainability, MDPI, vol. 14(9), pages 1-18, May.
    2. Olavarrieta, Sergio, 2016. "Utilizando avaliações de especialistas para classificar 45 publicações latinoamericanas de negócios," RAE - Revista de Administração de Empresas, FGV-EAESP Escola de Administração de Empresas de São Paulo (Brazil), vol. 56(3), May.
    3. Pontille, David & Torny, Didier, 2010. "Revues qui comptent, revues qu’on compte :produire des classements en économie et gestion," Revue de la Régulation - Capitalisme, institutions, pouvoirs, Association Recherche et Régulation, vol. 8.
    4. Thomas Lange, 2006. "The Imprecise Science of Evaluating Scholarly Performance," Evaluation Review, , vol. 30(4), pages 505-532, August.
    5. Alfaro, José A. & Álvarez, María José & Montes, María J., 2002. "Lagging behind versus advancing too fast? identifying gaps research in supply chain," DEE - Working Papers. Business Economics. WB wb021409, Universidad Carlos III de Madrid. Departamento de Economía de la Empresa.
    6. Biehl, Markus & Kim, Henry & Wade, Michael, 2006. "Relationships among the academic business disciplines: a multi-method citation analysis," Omega, Elsevier, vol. 34(4), pages 359-371, August.
    7. Geert Campenhout & Tom Caneghem & Steve Uytbergen, 2008. "A comparison of overall and sub-area journal influence: The case of the accounting literature," Scientometrics, Springer;Akadémiai Kiadó, vol. 77(1), pages 61-90, October.
    8. Giasolli, Robert & Groen, Dr. Aard & Haak, Robert & Pieck, Martin, 2021. "Identifying Management of Technology and innovation (MOT) and Technology Entrepreneurship (TE) centers of excellence," Technological Forecasting and Social Change, Elsevier, vol. 173(C).
    9. Yi-Ching Liaw & Te-Yi Chan & Chin-Yuan Fan & Cheng-Hsin Chiang, 2014. "Can the technological impact of academic journals be evaluated? The practice of non-patent reference (NPR) analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 17-37, October.
    10. Holsapple, Clyde W. & Lee-Post, Anita, 2010. "Behavior-based analysis of knowledge dissemination channels in operations management," Omega, Elsevier, vol. 38(3-4), pages 167-178, June.
    11. Steven M. Shugan, 2003. "Editorial: Journal Rankings: Save the Outlets for Your Research," Marketing Science, INFORMS, vol. 22(4), pages 437-441.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ormerod, R. J., 2000. "Is content analysis either practical or desirable for research evaluation?," Omega, Elsevier, vol. 28(2), pages 241-245, April.
    2. Donohue, Joan M. & Fox, Jeremy B., 2000. "A multi-method evaluation of journals in the decision and management sciences by US academics," Omega, Elsevier, vol. 28(1), pages 17-36, February.
    3. Iszan Hana Kaharudin & Mohammad Syuhaimi Ab-Rahman & Roslan Abd-Shukor & Azamin Zaharim & Mohd Jailani Mohd Nor & Ahmad Kamal Ariffin Mohd Ihsan & Shahrom Md Zain & Afiq Hipni & Kamisah Osman & Ruszym, 2022. "How Does Supervision Technique Affect Research? Towards Sustainable Performance: Publications and Students from Pure and Social Sciences," Sustainability, MDPI, vol. 14(9), pages 1-18, May.
    4. Geert Campenhout & Tom Caneghem & Steve Uytbergen, 2008. "A comparison of overall and sub-area journal influence: The case of the accounting literature," Scientometrics, Springer;Akadémiai Kiadó, vol. 77(1), pages 61-90, October.
    5. Michael F. Gorman, 2016. "Editorial: The 11th Rothkopf Rankings: 28 Years of Tracking Applied Research in Academia," Interfaces, INFORMS, vol. 46(3), pages 264-276, June.
    6. Michael F. Gorman, 2019. "Editorial: The 12th Rothkopf Rankings," Interfaces, INFORMS, vol. 49(4), pages 295-303, July.
    7. R J Ormerod, 2010. "Research contribution: Citation and content analysis," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 61(4), pages 705-707, April.
    8. Ronald D. Fricker, 2012. "Editorial: The First Rothkopf Rankings of Nonacademic Organizations," Interfaces, INFORMS, vol. 42(6), pages 585-590, December.
    9. Holsapple, Clyde W. & Lee-Post, Anita, 2010. "Behavior-based analysis of knowledge dissemination channels in operations management," Omega, Elsevier, vol. 38(3-4), pages 167-178, June.
    10. Michael H. Rothkopf, 2007. "Editorial: The Seventh Interfaces Ranking of Universities' Contributions to the Practice Literature," Interfaces, INFORMS, vol. 37(6), pages 566-569, December.
    11. Michael H. Rothkopf, 2005. "Editorial: The Sixth Interfaces Ranking of Universities’ Contributions to the Practice Literature," Interfaces, INFORMS, vol. 35(5), pages 425-428, October.
    12. Rosenstreich, Daniela & Wooliscroft, Ben, 2009. "Measuring the impact of accounting journals using Google Scholar and the g-index," The British Accounting Review, Elsevier, vol. 41(4), pages 227-239.
    13. Ronald D. Fricker, 2009. "Editorial: The Eighth Rothkopf Rankings of Universities' Contributions to the INFORMS Practice Literature," Interfaces, INFORMS, vol. 39(6), pages 533-539, December.
    14. Ronald D. Fricker, 2011. "Editorial: The Ninth Rothkopf Rankings of Universities' Contributions to the INFORMS Practice Literature," Interfaces, INFORMS, vol. 41(6), pages 590-598, December.
    15. Meltem Denizel & Behlul Usdiken & Deniz Tuncalp, 2003. "Drift or Shift? Continuity, Change, and International Variation in Knowledge Production in OR/MS," Operations Research, INFORMS, vol. 51(5), pages 711-720, October.
    16. Chiang Kao, 2009. "The authorship and country spread of Operation Research journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 78(3), pages 397-407, March.
    17. Alejandro Avenburg & John Gerring & Jason Seawright, 2023. "How do social scientists reach causal inferences? A study of reception," Quality & Quantity: International Journal of Methodology, Springer, vol. 57(1), pages 257-275, February.
    18. Justus Haucap & Johannes Muck, 2015. "What drives the relevance and reputation of economics journals? An update from a survey among economists," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(3), pages 849-877, June.
    19. Gwendolyn L. Kolfschoten & Mariëlle Hengst-Bruggeling & Gert-Jan Vreede, 2007. "Issues in the Design of Facilitated Collaboration Processes," Group Decision and Negotiation, Springer, vol. 16(4), pages 347-361, July.
    20. Kübra Mert, 2020. "Türk Yazınında Uluslararası İşletmecilik: 1990-2019 Yıllarına Dair Bir İçerik Analizi," Istanbul Management Journal, Istanbul University Business School, vol. 0(89), pages 97-132, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jomega:v:30:y:2002:i:2:p:109-126. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/375/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.