IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v99y2014i3d10.1007_s11192-014-1258-y.html
   My bibliography  Save this article

On the quality evaluation of scientific entities in Poland supported by consistency-driven pairwise comparisons method

Author

Listed:
  • Waldemar W. Koczkodaj

    (Laurentian University)

  • Konrad Kułakowski

    (AGH University of Science and Technology)

  • Antoni Ligęza

    (AGH University of Science and Technology)

Abstract

Comparison, rating, and ranking of alternative solutions, in case of multicriteria evaluations, have been an eternal focus of operations research and optimization theory. There exist numerous approaches at practical solving the multicriteria ranking problem. The recent focus of interest in this domain was the event of parametric evaluation of research entities in Poland. The principal methodology was based on pairwise comparisons. For each single comparison, four criteria have been used. One of the controversial points of the assumed approach was that the weights of these criteria were arbitrary. The main focus of this study is to put forward a theoretically justified way of extracting weights from the opinions of domain experts. Theoretical bases for the whole procedure are based on a survey and its experimental results. Discussion and comparison of the two resulting sets of weights and the computed inconsistency indicator are discussed.

Suggested Citation

  • Waldemar W. Koczkodaj & Konrad Kułakowski & Antoni Ligęza, 2014. "On the quality evaluation of scientific entities in Poland supported by consistency-driven pairwise comparisons method," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(3), pages 911-926, June.
    • Handle: RePEc:spr:scient:v:99:y:2014:i:3:d:10.1007_s11192-014-1258-y
    DOI: 10.1007/s11192-014-1258-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-014-1258-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-014-1258-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Dong, Yucheng & Xu, Yinfeng & Li, Hongyi & Dai, Min, 2008. "A comparative study of the numerical scales and the prioritization methods in AHP," European Journal of Operational Research, Elsevier, vol. 186(1), pages 229-242, April.
    2. P Ji & R Jiang, 2003. "Scale transitivity in the AHP," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 54(8), pages 896-905, August.
    3. Thomas L. Saaty, 2005. "The Analytic Hierarchy and Analytic Network Processes for the Measurement of Intangible Criteria and for Decision-Making," International Series in Operations Research & Management Science, in: Multiple Criteria Decision Analysis: State of the Art Surveys, chapter 0, pages 345-405, Springer.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Dejan Pajić, 2015. "Globalization of the social sciences in Eastern Europe: genuine breakthrough or a slippery slope of the research evaluation practice?," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 2131-2150, March.
    2. Matteo Brunelli & Michele Fedrizzi, 2019. "A general formulation for some inconsistency indices of pairwise comparisons," Annals of Operations Research, Springer, vol. 274(1), pages 155-169, March.
    3. Matteo Brunelli, 2017. "Studying a set of properties of inconsistency indices for pairwise comparisons," Annals of Operations Research, Springer, vol. 248(1), pages 143-161, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dong, Yucheng & Hong, Wei-Chiang & Xu, Yinfeng & Yu, Shui, 2013. "Numerical scales generated individually for analytic hierarchy process," European Journal of Operational Research, Elsevier, vol. 229(3), pages 654-662.
    2. Styliani Karamountzou & Dimitra G. Vagiona, 2023. "Suitability and Sustainability Assessment of Existing Onshore Wind Farms in Greece," Sustainability, MDPI, vol. 15(3), pages 1-21, January.
    3. Angilella, Silvia & Giarlotta, Alfio, 2009. "Implementations of PACMAN," European Journal of Operational Research, Elsevier, vol. 194(2), pages 474-495, April.
    4. Mukherjee, Krishnendu, 2014. "Analytic hierarchy process and technique for order preference by similarity to ideal solution: a bibliometric analysis from past, present and future of AHP and TOPSIS," MPRA Paper 59887, University Library of Munich, Germany.
    5. Angilella, Silvia & Greco, Salvatore & Matarazzo, Benedetto, 2010. "Non-additive robust ordinal regression: A multiple criteria decision model based on the Choquet integral," European Journal of Operational Research, Elsevier, vol. 201(1), pages 277-288, February.
    6. Hassan, Mohammad Nurul & Hawas, Yaser E. & Ahmed, Kamran, 2013. "A multi-dimensional framework for evaluating the transit service performance," Transportation Research Part A: Policy and Practice, Elsevier, vol. 50(C), pages 47-61.
    7. Greco, Salvatore & Mousseau, Vincent & Slowinski, Roman, 2008. "Ordinal regression revisited: Multiple criteria ranking using a set of additive value functions," European Journal of Operational Research, Elsevier, vol. 191(2), pages 416-436, December.
    8. József Temesi, 2011. "Pairwise comparison matrices and the error-free property of the decision maker," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 19(2), pages 239-249, June.
    9. Thomas L. Saaty & Daji Ergu, 2015. "When is a Decision-Making Method Trustworthy? Criteria for Evaluating Multi-Criteria Decision-Making Methods," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 14(06), pages 1171-1187, November.
    10. Hatami-Marbini, Adel & Tavana, Madjid, 2011. "An extension of the Electre I method for group decision-making under a fuzzy environment," Omega, Elsevier, vol. 39(4), pages 373-386, August.
    11. Salvatore Corrente & Michael Doumpos & Salvatore Greco & Roman Słowiński & Constantin Zopounidis, 2017. "Multiple criteria hierarchy process for sorting problems based on ordinal regression with additive value functions," Annals of Operations Research, Springer, vol. 251(1), pages 117-139, April.
    12. Abhishek Majumdar & Tapas Debnath & Arpita Biswas & Sandeep K. Sood & Krishna Lal Baishnab, 0. "An Energy Efficient e-Healthcare Framework Supported by Novel EO-μGA (Extremal Optimization Tuned Micro-Genetic Algorithm)," Information Systems Frontiers, Springer, vol. 0, pages 1-18.
    13. Stefan Hajkowicz & Kerry Collins, 2007. "A Review of Multiple Criteria Analysis for Water Resource Planning and Management," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 21(9), pages 1553-1566, September.
    14. Konrad Kułakowski & Katarzyna Grobler-Dębska & Jarosław Wąs, 2015. "Heuristic rating estimation: geometric approach," Journal of Global Optimization, Springer, vol. 62(3), pages 529-543, July.
    15. Schneider, Frank, 2008. "Multiple criteria decision making in application layer networks," Bayreuth Reports on Information Systems Management 36, University of Bayreuth, Chair of Information Systems Management.
    16. Ardalan Bafahm & Minghe Sun, 2019. "Some Conflicting Results in the Analytic Hierarchy Process," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 18(02), pages 465-486, March.
    17. Jiang, R. & Chen, Zhigao, 2020. "A standard-based approach for multi-criteria performance evaluation of engineered systems," Reliability Engineering and System Safety, Elsevier, vol. 202(C).
    18. Eric L. Sevigny & Michaela Saisana, 2016. "Measuring Interstate Variations in the Consequences of Illegal Drugs: A Composite Indicator Approach," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 128(2), pages 501-529, September.
    19. Figueira, José Rui & Greco, Salvatore & Roy, Bernard, 2009. "ELECTRE methods with interaction between criteria: An extension of the concordance index," European Journal of Operational Research, Elsevier, vol. 199(2), pages 478-495, December.
    20. Dong Cheng & Faxin Cheng & Zhili Zhou & Juan Wang, 2017. "Group prioritisation with unknown expert weights in incomplete linguistic context," International Journal of Systems Science, Taylor & Francis Journals, vol. 48(12), pages 2633-2643, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:99:y:2014:i:3:d:10.1007_s11192-014-1258-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.