IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v124y2020i2d10.1007_s11192-020-03489-3.html
   My bibliography  Save this article

Assessing and predicting the quality of research master’s theses: an application of scientometrics

Author

Listed:
  • Zheng Xie

    (National University of Defense Technology)

  • Yanwu Li

    (National University of Defense Technology)

  • Zhemin Li

    (National University of Defense Technology)

Abstract

The educational quality of research master’s degree can be in part reflected by the examiner score of the thesis. This study focuses on finding positive predictors of this score with the aim of developing assessment and prediction methods for the educational quality of postgraduates. This study is based on regression analysis of the characteristics extracted from publications and references involving 1038 research master’s theses written at three universities in China. The analysis indicates that for a thesis, the number and the integrated impact factor of its references in Science Citation Index Expanded (SCIE) journals are significantly positive predictors of having publications in such journals. Additionally, the number and the integrated impact factor of a thesis’ representative publications, defined as the publications authored by the master’s student as a first author or second author with tutors in lead position, in SCIE journals, are significantly positive predictors of its examiner score. Based on these predictors, a range of indicators is provided to assess thesis quality, to measure the contributions of disciplines to postgraduate education, to predict postgraduates’ research outcomes, and to provide benchmarks regarding the quality and quantity of their reading work.

Suggested Citation

  • Zheng Xie & Yanwu Li & Zhemin Li, 2020. "Assessing and predicting the quality of research master’s theses: an application of scientometrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(2), pages 953-972, August.
    • Handle: RePEc:spr:scient:v:124:y:2020:i:2:d:10.1007_s11192-020-03489-3
    DOI: 10.1007/s11192-020-03489-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-020-03489-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-020-03489-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Michael H. MacRoberts & Barbara R. MacRoberts, 2018. "The mismeasure of science: Citation analysis," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 69(3), pages 474-482, March.
    2. Denis Bouyssou & Thierry Marchant, 2011. "Ranking scientists and departments in a consistent manner," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(9), pages 1761-1769, September.
    3. Bouyssou, Denis & Marchant, Thierry, 2011. "Bibliometric rankings of journals based on Impact Factors: An axiomatic approach," Journal of Informetrics, Elsevier, vol. 5(1), pages 75-86.
    4. Helmut A. Abt, 2000. "Do Important Papers Produce High Citation Counts?," Scientometrics, Springer;Akadémiai Kiadó, vol. 48(1), pages 65-70, June.
    5. R E de Bruin & A Kint & M Luwel & H F Moed, 1993. "A study of research evaluation and planning: the University of Ghent," Research Evaluation, Oxford University Press, vol. 3(1), pages 25-41, April.
    6. Loet Leydesdorff & Lutz Bornmann, 2011. "Integrated impact indicators compared with impact factors: An alternative research design with policy implications," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(11), pages 2133-2146, November.
    7. Xie, Zheng, 2020. "Predicting the number of coauthors for researchers: A learning model," Journal of Informetrics, Elsevier, vol. 14(2).
    8. A. Fernández-Cano & A. Bueno, 1999. "Synthesizing scientometric paterns in Spanish educational research," Scientometrics, Springer;Akadémiai Kiadó, vol. 46(2), pages 349-367, October.
    9. Chang-Ping Hu & Ji-Ming Hu & Sheng-Li Deng & Yong Liu, 2013. "A co-word analysis of library and information science in China," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(2), pages 369-382, November.
    10. Michael H. MacRoberts & Barbara R. MacRoberts, 1989. "Problems of citation analysis: A critical review," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 40(5), pages 342-349, September.
    11. Cynthia Lisée & Vincent Larivière & Éric Archambault, 2008. "Conference proceedings as a source of scientific information: A bibliometric analysis," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 59(11), pages 1776-1784, September.
    12. Qian-Jin Zong & Hong-Zhou Shen & Qin-Jian Yuan & Xiao-Wei Hu & Zhi-Ping Hou & Shun-Guo Deng, 2013. "Doctoral dissertations of Library and Information Science in China: A co-word analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(2), pages 781-799, February.
    13. Nils T. Hagen, 2010. "Deconstructing doctoral dissertations: how many papers does it take to make a PhD?," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(2), pages 567-579, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Xie, Zheng, 2020. "Predicting publication productivity for researchers: A piecewise Poisson model," Journal of Informetrics, Elsevier, vol. 14(3).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Juan A Crespo & Ignacio Ortuño-Ortín & Javier Ruiz-Castillo, 2012. "The Citation Merit of Scientific Publications," PLOS ONE, Public Library of Science, vol. 7(11), pages 1-9, November.
    2. Рубинштейн Александр Яковлевич, "undated". "Ранжирование Российских Экономических Журналов: Научный Метод Или «Игра В Цыфирь»? [Ran Ranking of Russian Economic Journals: The Scientific Method or “Numbers Game”?]," Working papers a:pru175:ye:2016:1, Institute of Economics.
    3. Albarrán, Pedro & Herrero, Carmen & Ruiz-Castillo, Javier & Villar, Antonio, 2017. "The Herrero-Villar approach to citation impact," Journal of Informetrics, Elsevier, vol. 11(2), pages 625-640.
    4. Hao Wang & Sanhong Deng & Xinning Su, 2016. "A study on construction and analysis of discipline knowledge structure of Chinese LIS based on CSSCI," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 1725-1759, December.
    5. Sung Kim & Derek Hansen & Richard Helps, 2018. "Computing research in the academy: insights from theses and dissertations," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(1), pages 135-158, January.
    6. Jia-Yen Huang & Rong-Chang Chen, 2019. "Exploring the intellectual structure of cloud patents using non-exhaustive overlaps," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 739-769, November.
    7. Rousseau, Ronald & García-Zorita, Carlos & Sanz-Casado, Elias, 2013. "The h-bubble," Journal of Informetrics, Elsevier, vol. 7(2), pages 294-300.
    8. Bouyssou, Denis & Marchant, Thierry, 2014. "An axiomatic approach to bibliometric rankings and indices," Journal of Informetrics, Elsevier, vol. 8(3), pages 449-477.
    9. María de la Cruz del Río-Rama & Claudia Patricia Maldonado-Erazo & José Álvarez-García & Amador Durán-Sánchez, 2020. "Cultural and Natural Resources in Tourism Island: Bibliometric Mapping," Sustainability, MDPI, vol. 12(2), pages 1-26, January.
    10. Alexey Lyutov & Yilmaz Uygun & Marc-Thorsten Hütt, 2021. "Machine learning misclassification of academic publications reveals non-trivial interdependencies of scientific disciplines," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1173-1186, February.
    11. Claudia Patricia Maldonado-Erazo & José Álvarez-García & María de la Cruz del Río-Rama & Amador Durán-Sánchez, 2021. "Scientific Mapping on the Impact of Climate Change on Cultural and Natural Heritage: A Systematic Scientometric Analysis," Land, MDPI, vol. 10(1), pages 1-19, January.
    12. Abramo, Giovanni, 2018. "Revisiting the scientometric conceptualization of impact and its measurement," Journal of Informetrics, Elsevier, vol. 12(3), pages 590-597.
    13. Aleskerov, F. & Badgaeva, D. & Pislyakov, V. & Sterligov, I. & Shvydun, S., 2016. "An Importance of Russian and International Economic Journals: a Network Approach," Journal of the New Economic Association, New Economic Association, vol. 30(2), pages 193-205.
    14. Guo Chen & Lu Xiao & Chang-ping Hu & Xue-qin Zhao, 2015. "Identifying the research focus of Library and Information Science institutions in China with institution-specific keywords," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(2), pages 707-724, May.
    15. Jiang, Hanchen & Qiang, Maoshan & Lin, Peng, 2016. "A topic modeling based bibliometric exploration of hydropower research," Renewable and Sustainable Energy Reviews, Elsevier, vol. 57(C), pages 226-237.
    16. Antonio Abatemarco & Roberto Dell’Anno, 2013. "Certainty equivalent citation: generalized classes of citation indexes," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(1), pages 263-271, January.
    17. Noriyuki Morichika & Sotaro Shibayama, 2016. "Use of dissertation data in science policy research," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(1), pages 221-241, July.
    18. Seyedmohammadreza Hosseini & Hamed Baziyad & Rasoul Norouzi & Sheida Jabbedari Khiabani & Győző Gidófalvi & Amir Albadvi & Abbas Alimohammadi & Seyedehsan Seyedabrishami, 2021. "Mapping the intellectual structure of GIS-T field (2008–2019): a dynamic co-word analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 2667-2688, April.
    19. Bei-Ni Yan & Tian-Shyug Lee & Tsung-Pei Lee, 2015. "Analysis of research papers on E-commerce (2000–2013): based on a text mining approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(1), pages 403-417, October.
    20. Ronald Rousseau, 2012. "Updating the journal impact factor or total overhaul?," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 413-417, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:124:y:2020:i:2:d:10.1007_s11192-020-03489-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.