IDEAS home Printed from https://ideas.repec.org/a/eee/infome/v3y2009i2p102-123.html
   My bibliography  Save this article

Automatic evaluation of digital libraries with 5SQual

Author

Listed:
  • Moreira, Bárbara L.
  • Gonçalves, Marcos André
  • Laender, Alberto H.F.
  • Fox, Edward A.

Abstract

Digital libraries (DLs) are complex information systems which can present changes in their structure, content, and services. These complexities and dynamics make system maintenance a non-trivial task, since it requires periodical evaluation of the different DL components. Generally, these evaluations are customized per system and are performed only when problems occur and administrator intervention is required. This work aims to change the situation. We present 5SQual, a tool which provides ways to perform automatic and configurable evaluations of some of the most important DL components, among them, digital objects, metadata, and services. The tool implements diverse numeric indicators that are associated with eight quality dimensions described in the 5S quality model. Its generic architecture was developed to be applicable to various DLs and scenarios. In sum, the main contributions of this work include: (i) the design and implementation of 5SQual, a tool that validates a theoretical DL quality model; (ii) the demonstration of the applicability of the tool in several usage scenarios; and (iii) the evaluation (with usability specialists) of its graphical interface specially designed to guide the configuration of 5SQual evaluations. We also present the results of interviews conducted with administrators of real DLs regarding their expectations and opinions about 5SQual.

Suggested Citation

  • Moreira, Bárbara L. & Gonçalves, Marcos André & Laender, Alberto H.F. & Fox, Edward A., 2009. "Automatic evaluation of digital libraries with 5SQual," Journal of Informetrics, Elsevier, vol. 3(2), pages 102-123.
    • Handle: RePEc:eee:infome:v:3:y:2009:i:2:p:102-123
    DOI: 10.1016/j.joi.2008.12.003
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1751157708000734
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.joi.2008.12.003?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. M. M. Kessler, 1963. "Bibliographic coupling between scientific papers," American Documentation, Wiley Blackwell, vol. 14(1), pages 10-25, January.
    2. Henry Small, 1973. "Co‐citation in the scientific literature: A new measure of the relationship between two documents," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 24(4), pages 265-269, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Piñeiro-Chousa, Juan & López-Cabarcos, M. Ángeles & Romero-Castro, Noelia María & Pérez-Pico, Ada María, 2020. "Innovation, entrepreneurship and knowledge in the business scientific field: Mapping the research front," Journal of Business Research, Elsevier, vol. 115(C), pages 475-485.
    2. Guan-Can Yang & Gang Li & Chun-Ya Li & Yun-Hua Zhao & Jing Zhang & Tong Liu & Dar-Zen Chen & Mu-Hsuan Huang, 2015. "Using the comprehensive patent citation network (CPC) to evaluate patent value," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(3), pages 1319-1346, December.
    3. Rey-Long Liu, 2017. "A new bibliographic coupling measure with descriptive capability," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 915-935, February.
    4. Lilian Cervo Cabrera & Carlos Eduardo Caldarelli & Marcia Regina Gabardo Camara, 2020. "Mapping collaboration in international coffee certification research," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2597-2618, September.
    5. Gangan Prathap & Somenath Mukherjee, 2020. "Letter to the Editor: Comments on the paper of Batagelj—on fractional approach to analysis of linked networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2717-2722, September.
    6. Chris W. Belter, 2013. "A bibliometric analysis of NOAA’s Office of Ocean Exploration and Research," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(2), pages 629-644, May.
    7. Ding, Ying, 2011. "Community detection: Topological vs. topical," Journal of Informetrics, Elsevier, vol. 5(4), pages 498-514.
    8. Ignacio Rodríguez-Rodríguez & José-Víctor Rodríguez & Niloofar Shirvanizadeh & Andrés Ortiz & Domingo-Javier Pardo-Quiles, 2021. "Applications of Artificial Intelligence, Machine Learning, Big Data and the Internet of Things to the COVID-19 Pandemic: A Scientometric Review Using Text Mining," IJERPH, MDPI, vol. 18(16), pages 1-29, August.
    9. Manta Eduard Mihai & Davidescu Adriana Ana Maria & Geambasu Maria Cristina & Florescu Margareta Stela, 2023. "Exploring the research area of direct taxation. An empirical analysis based on bibliometric analysis results," Management & Marketing, Sciendo, vol. 18(s1), pages 355-383, December.
    10. Leslier Valenzuela-Fernández & Manuel Escobar-Farfán, 2022. "Zero-Waste Management and Sustainable Consumption: A Comprehensive Bibliometric Mapping Analysis," Sustainability, MDPI, vol. 14(23), pages 1-24, December.
    11. Yu-Wei Chang & Mu-Hsuan Huang & Chiao-Wen Lin, 2015. "Evolution of research subjects in library and information science based on keyword, bibliographical coupling, and co-citation analyses," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(3), pages 2071-2087, December.
    12. Raymundo das Neves Machado & Benjamín Vargas-Quesada & Jacqueline Leta, 2016. "Intellectual structure in stem cell research: exploring Brazilian scientific articles from 2001 to 2010," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(2), pages 525-537, February.
    13. Shiau, Wen-Lung & Dwivedi, Yogesh K. & Yang, Han Suan, 2017. "Co-citation and cluster analyses of extant literature on social networks," International Journal of Information Management, Elsevier, vol. 37(5), pages 390-399.
    14. Osmo Kuusi & Martin Meyer, 2007. "Anticipating technological breakthroughs: Using bibliographic coupling to explore the nanotubes paradigm," Scientometrics, Springer;Akadémiai Kiadó, vol. 70(3), pages 759-777, March.
    15. Ying Huang & Wolfgang Glänzel & Lin Zhang, 2021. "Tracing the development of mapping knowledge domains," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 6201-6224, July.
    16. Tandon, Anushree & Kaur, Puneet & Mäntymäki, Matti & Dhir, Amandeep, 2021. "Blockchain applications in management: A bibliometric analysis and literature review," Technological Forecasting and Social Change, Elsevier, vol. 166(C).
    17. Masaki Eto, 2013. "Evaluations of context-based co-citation searching," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(2), pages 651-673, February.
    18. Xianwen Wang & Xi Zhang & Shenmeng Xu, 2011. "Patent co-citation networks of Fortune 500 companies," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(3), pages 761-770, September.
    19. Jun-Ping Qiu & Ke Dong & Hou-Qiang Yu, 2014. "Comparative study on structure and correlation among author co-occurrence networks in bibliometrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 1345-1360, November.
    20. Marianna Mauro & Monica Giancotti & Giovanna Talarico, 2017. "Mapping the field: A bibliometric analysis of accountability literature in healthcare," MECOSAN, FrancoAngeli Editore, vol. 2017(101), pages 7-30.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:infome:v:3:y:2009:i:2:p:102-123. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joi .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.