IDEAS home Printed from https://ideas.repec.org/a/ods/journl/v7y2018i1p24-37.html
   My bibliography  Save this article

Efficiency vs Effectiveness: Alternative Metrics for Research Performance

Author

Listed:
  • Anatoliy G. Goncharuk

    () (International Humanitarian University, Ukraine)

Abstract

This paper raised the problem of adequacy of the current performance metrics for a research. The author has looked at this problem from the publisher perspective, and tried answer the question how effective the publications are and how to adequately evaluate their performance. He reviewed the advantages and disadvantages of the existing metrics and concluded that the evaluation of research performance is a complex task which cannot adequately be expressed by a single index. The author developed the metrics applying a non-parametric technique DEA that calculates the relative efficiency on a relatively small number of publicly available data. The bidimensional tool for research (publication) performance analysis – "Efficiency-Effectiveness" matrix is suggested. The practicality of suggested metrics is demonstrated on a case of the Journal of Applied Management and Investments (JAMI). It helped to find the root causes of the low efficiency and low effectiveness of most of the articles of JAMI. Among them: a language variety, restricted access for readers to some volumes (issues), non-indexation in the leading international scientific databases, and practical orientation of many publications that usually are not high-cited. The identified problems should be the reasons for revising the editorial policy aimed at increasing the efficiency and effectiveness of the journal's publications. The author concluded that suggested metrics can’t find all problems of the publisher (journal), but they can allocate a group of problematic publications that burden it. The results of this study should be useful for publisher and chief editors of the research journals that want to improve the editorial policy and to increase the efficiency and quality of the publications (issues).

Suggested Citation

  • Anatoliy G. Goncharuk, 2018. "Efficiency vs Effectiveness: Alternative Metrics for Research Performance," Journal of Applied Management and Investments, Department of Business Administration and Corporate Security, International Humanitarian University, vol. 7(1), pages 24-37, February.
  • Handle: RePEc:ods:journl:v:7:y:2018:i:1:p:24-37
    as

    Download full text from publisher

    File URL: http://www.jami.org.ua/Papers/JAMI_7_1_2018_24-37.pdf
    Download Restriction: no

    References listed on IDEAS

    as
    1. Anatoliy G. Goncharuk, 2012. "What investments are most effective during the financial crisis?," Journal of Applied Management and Investments, Department of Business Administration and Corporate Security, International Humanitarian University, vol. 1(1), pages 5-7.
    2. Jon H. Hanf & Victoria Marquardt, 2012. "Armenian Wine Business And Its Interplay With Foreign Influence," Journal of Applied Management and Investments, Department of Business Administration and Corporate Security, International Humanitarian University, vol. 1(4), pages 406-417.
    3. Anatoliy G. Goncharuk, 2016. "Evaluating the Efficiency of Higher Education," Journal of Applied Management and Investments, Department of Business Administration and Corporate Security, International Humanitarian University, vol. 5(2), pages 82-91, May.
    4. repec:spr:scient:v:69:y:2006:i:1:d:10.1007_s11192-006-0144-7 is not listed on IDEAS
    5. Lampe, Hannes W. & Hilgers, Dennis, 2015. "Trajectories of efficiency measurement: A bibliometric analysis of DEA and SFA," European Journal of Operational Research, Elsevier, vol. 240(1), pages 1-21.
    6. Jon H. Hanf, 2014. "Literature Survey on New Participative Pricing Mechanisms for Wine Tastings," Journal of Applied Management and Investments, Department of Business Administration and Corporate Security, International Humanitarian University, vol. 3(4), pages 201-213.
    7. Anatoliy G. Goncharuk, 2017. "Socioeconomic Criteria of Healthcare Efficiency: An International Comparison," Journal of Applied Management and Investments, Department of Business Administration and Corporate Security, International Humanitarian University, vol. 6(2), pages 89-95, May.
    8. Anatoliy G. Goncharuk, 2014. "Measuring Enterprise Performance to Achieve Managerial Goals," Journal of Applied Management and Investments, Department of Business Administration and Corporate Security, International Humanitarian University, vol. 3(1), pages 8-14.
    9. Jon H. Hanf & Taras Gagalyuk & Erik Schweickert, 2013. "Problems of Goal Alignment for German Wine Cooperatives," Journal of Applied Management and Investments, Department of Business Administration and Corporate Security, International Humanitarian University, vol. 2(4), pages 244-252.
    10. Costas, Rodrigo & Bordons, María, 2007. "The h-index: Advantages, limitations and its relation with other bibliometric indicators at the micro level," Journal of Informetrics, Elsevier, vol. 1(3), pages 193-203.
    11. Anatoliy G. Goncharuk, 2016. "Banking Sector Challenges in Research," Journal of Applied Management and Investments, Department of Business Administration and Corporate Security, International Humanitarian University, vol. 5(1), pages 34-39, February.
    12. Natalia O. Lazareva, 2015. "Evaluating the Efficiency of Wineries in Ukraine: A Three-Criteria Approach," Journal of Applied Management and Investments, Department of Business Administration and Corporate Security, International Humanitarian University, vol. 4(4), pages 239-242, November.
    13. Sushma Vegesna & Mihir Dash, 2014. "Efficiency of Public and Private Sector Banks in India," Journal of Applied Management and Investments, Department of Business Administration and Corporate Security, International Humanitarian University, vol. 3(3), pages 183-187.
    14. Mihir Dash, 2013. "A Study of the Impact of Asset-Liability Management on the Profitability of Banks in India," Journal of Applied Management and Investments, Department of Business Administration and Corporate Security, International Humanitarian University, vol. 2(4), pages 230-234.
    15. Narasinha Sawaikar, 2014. "Samsung Smartphones and Core Competency," Journal of Applied Management and Investments, Department of Business Administration and Corporate Security, International Humanitarian University, vol. 3(4), pages 251-256.
    16. Alonso, S. & Cabrerizo, F.J. & Herrera-Viedma, E. & Herrera, F., 2009. "h-Index: A review focused in its variants, computation and standardization for different scientific fields," Journal of Informetrics, Elsevier, vol. 3(4), pages 273-289.
    17. Manoj Kumar & Madhu Anand, 2013. "Assessing Financial Health Of A Firm Using Altman’S Original And Revised Z-Score Models: A Case Of Kingfisher Airlines Ltd (India)," Journal of Applied Management and Investments, Department of Business Administration and Corporate Security, International Humanitarian University, vol. 2(1), pages 36-48.
    18. Kumbhakar,Subal C. & Lovell,C. A. Knox, 2003. "Stochastic Frontier Analysis," Cambridge Books, Cambridge University Press, number 9780521666633, April.
    19. Anatoliy G. Goncharuk, 2013. "About The Influence Of High Gas Price On An Efficiency," Journal of Applied Management and Investments, Department of Business Administration and Corporate Security, International Humanitarian University, vol. 2(1), pages 58-67.
    Full references (including those not matched with items on IDEAS)

    More about this item

    Keywords

    research journal; publications; performance; efficiency; effectiveness;

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • L82 - Industrial Organization - - Industry Studies: Services - - - Entertainment; Media
    • O32 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Management of Technological Innovation and R&D

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ods:journl:v:7:y:2018:i:1:p:24-37. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Anatoliy G. Goncharuk) or (Candi Patterson) or (Katrina Wingle). General contact details of provider: http://edirc.repec.org/data/dmonaua.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.