IDEAS home Printed from https://ideas.repec.org/a/eee/techno/v146y2025ics0166497225001099.html

Measuring the success of business intelligence and analytics systems: A literature review

Author

Listed:
  • Ul Ain, Noor
  • DeLone, William H.
  • Vaia, Giovanni

Abstract

Technology-based solutions such as business intelligence and analytics (BI&A) systems have become indispensable for organizations due to their ability to support decision-making. Recent developments in big data availability and more powerful analytical tools have increased the potential value of BI&A systems. However, academic and practitioner-oriented research suggests that the potential success of BI&A systems has not yet been fully realized by most organizations. Existing studies have attempted to evaluate the effectiveness and success of BI&A systems by proposing various success measures. However, these studies have generated inconsistent results, limiting the ability to compare and generalize the findings. Therefore, this study takes a step forward by proposing an updated, comprehensive, and consolidated set of success measures for this unique class of information systems. Using a systematic literature review approach, this study examined and synthesized BI&A systems success measures across 173 past studies using the DeLone & McLean IS success framework. Findings revealed success measures such as ease of use, information accuracy, and financial performance that are consistently applied to the measurement of BI&A systems, and importantly, other recommended measures such as system features, presentation format, and decision-making performance that are uniquely important to BI&A systems but infrequently applied. Finally, a comprehensive set of BI&A success measures is proposed for future empirical research studies and practitioner use.

Suggested Citation

  • Ul Ain, Noor & DeLone, William H. & Vaia, Giovanni, 2025. "Measuring the success of business intelligence and analytics systems: A literature review," Technovation, Elsevier, vol. 146(C).
    • Handle: RePEc:eee:techno:v:146:y:2025:i:c:s0166497225001099
    DOI: 10.1016/j.technovation.2025.103277
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0166497225001099
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.technovation.2025.103277?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. NoorUl Ain & Giovanni Vaia & William Delone & Mehwish Waheed, 2019. "Two decades of research on business intelligence system adoption, utilization and success – A systematic literature review," Post-Print hal-03882087, HAL.
    2. Sang M. Lee & Soongoo Hong & Pairin Katerattanakul, 2004. "Impact Of Data Warehousing On Organizational Performance Of Retailing Firms," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 3(01), pages 61-79.
    3. Acheampong Owusu, 2017. "Business intelligence systems and bank performance in Ghana: The balanced scorecard approach," Cogent Business & Management, Taylor & Francis Journals, vol. 4(1), pages 1364056-136, January.
    4. Jon Hartwick & Henri Barki, 1994. "Explaining the Role of User Participation in Information System Use," Management Science, INFORMS, vol. 40(4), pages 440-465, April.
    5. Andrew Burton-Jones & Detmar W. Straub, 2006. "Reconceptualizing System Usage: An Approach and Empirical Test," Information Systems Research, INFORMS, vol. 17(3), pages 228-246, September.
    6. Xixi Li & J. J. Po-An Hsieh & Arun Rai, 2013. "Motivational Differences Across Post-Acceptance Information System Usage Behaviors: An Investigation in the Business Intelligence Systems Context," Information Systems Research, INFORMS, vol. 24(3), pages 659-682, September.
    7. Justy, Théo & Pellegrin-Boucher, Estelle & Lescop, Denis & Granata, Julien & Gupta, Shivam, 2023. "On the edge of Big Data: Drivers and barriers to data analytics adoption in SMEs," Technovation, Elsevier, vol. 127(C).
    8. Nam, Dalwoo & Lee, Junyeong & Lee, Heeseok, 2019. "Business analytics adoption process: An innovation diffusion perspective," International Journal of Information Management, Elsevier, vol. 49(C), pages 411-423.
    9. Mathias Eggert & Jens Alberts, 2020. "Frontiers of business intelligence and analytics 3.0: a taxonomy-based literature review and research agenda," Business Research, Springer;German Academic Association for Business Research, vol. 13(2), pages 685-739, July.
    10. Oliver Kohnke & Tim Robin Wolf & Karsten Mueller, 2011. "Managing user acceptance: an empirical investigation in the context of business intelligence standard software," International Journal of Information Systems and Change Management, Inderscience Enterprises Ltd, vol. 5(4), pages 269-290.
    11. Olabode, Oluwaseun E. & Boso, Nathaniel & Hultman, Magnus & Leonidou, Constantinos N., 2022. "Big data analytics capability and market performance: The roles of disruptive business models and competitive intensity," Journal of Business Research, Elsevier, vol. 139(C), pages 1218-1230.
    12. William H. DeLone & Ephraim R. McLean, 1992. "Information Systems Success: The Quest for the Dependent Variable," Information Systems Research, INFORMS, vol. 3(1), pages 60-95, March.
    13. Bernhard Wieder & Maria-Luise Ossimitz & Peter Chamoni, 2012. "The Impact of Business Intelligence Tools on Performance: A User Satisfaction Paradox?," International Journal of Business and Economic Sciences Applied Research (IJBESAR), Democritus University of Thrace (DUTH), Kavala Campus, Greece, vol. 5(3), pages 7-32, December.
    14. Stacie Petter & William DeLone & Ephraim McLean, 2008. "Measuring information systems success: models, dimensions, measures, and interrelationships," European Journal of Information Systems, Taylor & Francis Journals, vol. 17(3), pages 236-263, June.
    15. Rikhardsson, Pall & Yigitbasioglu, Ogan, 2018. "Business intelligence & analytics in management accounting research: Status and future focus," International Journal of Accounting Information Systems, Elsevier, vol. 29(C), pages 37-58.
    16. Mehwish Waheed & Jane Klobas & NoorUl Ain, 2021. "Unveiling knowledge quality, researcher satisfaction, learning, and loyalty: a model of academic social media success," Post-Print hal-03875013, HAL.
    17. Maurizio Massaro & John Dumay & James Guthrie, 2016. "On the shoulders of giants: undertaking a structured literature review in accounting," Accounting, Auditing & Accountability Journal, Emerald Group Publishing Limited, vol. 29(5), pages 767-801, June.
    18. repec:aae:journl:v:18:y:2022:i:2:p:69-104 is not listed on IDEAS
    19. repec:eme:aaaj00:aaaj-01-2015-1939 is not listed on IDEAS
    20. Soongoo Hong & Pairin Katerattanakul & Suk-Ki Hong & Qing Cao, 2006. "Usage And Perceived Impact Of Data Warehouses: A Study In Korean Financial Companies," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 5(02), pages 297-315.
    21. Patrucco, Andrea S. & Marzi, Giacomo & Trabucchi, Daniel, 2023. "The role of absorptive capacity and big data analytics in strategic purchasing and supply chain management decisions," Technovation, Elsevier, vol. 126(C).
    22. Banafo Akrong, Godwin & Yunfei, Shao & Owusu, Ebenezer, 2022. "Development and validation of an improved DeLone-McLean IS success model - application to the evaluation of a tax administration ERP," International Journal of Accounting Information Systems, Elsevier, vol. 47(C).
    23. Jaklič, Jurij & Grublješič, Tanja & Popovič, Aleš, 2018. "The role of compatibility in predicting business intelligence and analytics use intentions," International Journal of Information Management, Elsevier, vol. 43(C), pages 305-318.
    24. Maurizio Massaro & John Dumay & James Guthrie, 2016. "On the shoulders of giants: undertaking a structured literature review in accounting," Accounting, Auditing & Accountability Journal, Emerald Group Publishing Limited, vol. 29(5), pages 767-801, June.
    25. Cheng, Cong & Zhong, Huihui & Cao, Liebing, 2020. "Facilitating speed of internationalization: The roles of business intelligence and organizational agility," Journal of Business Research, Elsevier, vol. 110(C), pages 95-103.
    26. Foshay, Neil & Kuziemsky, Craig, 2014. "Towards an implementation framework for business intelligence in healthcare," International Journal of Information Management, Elsevier, vol. 34(1), pages 20-27.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Henri Barki & Ryad Titah & Céline Boffo, 2007. "Information System Use--Related Activity: An Expanded Behavioral Conceptualization of Individual-Level Information System Use," Information Systems Research, INFORMS, vol. 18(2), pages 173-192, June.
    2. Sun, Jonghak & Teng, James T.C., 2017. "The construct of information systems use benefits: Theoretical explication of its underlying dimensions and the development of a measurement scale," International Journal of Information Management, Elsevier, vol. 37(5), pages 400-416.
    3. Hamood Mohammed Al-Hattami & Faozi A. Almaqtari, 2023. "What determines digital accounting systems’ continuance intention? An empirical investigation in SMEs," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 10(1), pages 1-13, December.
    4. Lysann Gebauer & Michael Marcin Gierczak & Matthias Söllner & Jan Marco Leimeister, 2015. "Einflussfaktoren auf die Nutzung von Cloud-Speicherdiensten," Schmalenbach Journal of Business Research, Springer, vol. 67(3), pages 367-407, September.
    5. Hou, Chung-Kuang, 2012. "Examining the effect of user satisfaction on system usage and individual performance with business intelligence systems: An empirical study of Taiwan's electronics industry," International Journal of Information Management, Elsevier, vol. 32(6), pages 560-573.
    6. Lanzalonga Federico & Chmet Federico & Petrolo Basilio & Brescia Valerio, 2023. "Exploring Diversity Management to Avoid Social Washing and Pinkwashing: Using Bibliometric Analysis to Shape Future Research Directions," Journal of Intercultural Management, Sciendo, vol. 15(1), pages 41-65, March.
    7. A. Pronti & S. Mancinelli & M. Mazzanti & L. Crudeli, 2025. "The ‘Good Farmer’ concept and the diffusion of innovations in rural Africa," Economia Politica: Journal of Analytical and Institutional Economics, Springer;Fondazione Edison, vol. 42(1), pages 191-222, April.
    8. Del Vecchio, Pasquale & Secundo, Giustina & Garzoni, Antonello, 2023. "Phygital technologies and environments for breakthrough innovation in customers' and citizens' journey. A critical literature review and future agenda," Technological Forecasting and Social Change, Elsevier, vol. 189(C).
    9. Alshehri, Abdullah, 2025. "When the recipe is more important than the ingredients, understanding factors affecting customer loyalty in unmanned convenience store using fsQCA," Journal of Retailing and Consumer Services, Elsevier, vol. 82(C).
    10. Mohammed Adel Elzahaby, 2023. "Corporate narrative disclosure practices in the Middle East and North Africa (MENA) region: a systematic literature review," International Journal of Disclosure and Governance, Palgrave Macmillan, vol. 20(3), pages 296-315, September.
    11. Surajit Bag & Muhammad Sabbir Rahman & Susmi Routray & Santosh Kumar Shrivastav & Soni Agrawal, 2024. "Exploring the potential of blockchain‐enabled smart contracts for achieving net‐zero emissions: An empirical study," Business Strategy and the Environment, Wiley Blackwell, vol. 33(5), pages 3965-3985, July.
    12. Viswanath Venkatesh & Tracy Ann Sykes, 2013. "Digital Divide Initiative Success in Developing Countries: A Longitudinal Field Study in a Village in India," Information Systems Research, INFORMS, vol. 24(2), pages 239-260, June.
    13. Giustina Secundo & Claudia Spilotro & Johanna Gast & Vincenzo Corvello, 2025. "The transformative power of artificial intelligence within innovation ecosystems: a review and a conceptual framework," Review of Managerial Science, Springer, vol. 19(9), pages 2697-2728, September.
    14. repec:dau:papers:123456789/7962 is not listed on IDEAS
    15. Reinking, Jeff & Arnold, Vicky & Sutton, Steve G., 2020. "Synthesizing enterprise data through digital dashboards to strategically align performance: Why do operational managers use dashboards?," International Journal of Accounting Information Systems, Elsevier, vol. 37(C).
    16. Walaa Wahid ElKelish*, 2023. "Accounting for Corporate Human Rights: Literature Review and Future Insights," Australian Accounting Review, CPA Australia, vol. 33(2), pages 203-226, June.
    17. Paolo Pietro Biancone & Silvana Secinaro & Valerio Brescia & Davide Calandra, 2024. "Which direction for stakeholder capitalism? Approaches and reporting towards POP accounting," Sustainable Development, John Wiley & Sons, Ltd., vol. 32(6), pages 6579-6594, December.
    18. Jani Merikivi & Antti Salovaara & Matti Mäntymäki & Lilong Zhang, 2018. "On the way to understanding binge watching behavior: the over-estimated role of involvement," Electronic Markets, Springer;IIM University of St. Gallen, vol. 28(1), pages 111-122, February.
    19. Secinaro, Silvana & Lanzalonga, Federico & Oppioli, Michele & de Nuccio, Elbano, 2025. "The effects of disruptive technologies on accountability in fintech industry: Using bibliometric analysis to develop a research agenda," Research in International Business and Finance, Elsevier, vol. 76(C).
    20. Hanzhang Zhan & Bon‐Gang Hwang & Pramesh Krishnankutty, 2025. "Embracing digital transformation for sustainable development: Barriers to adopting digital twin in asset management within Singapore's energy and chemicals industry," Sustainable Development, John Wiley & Sons, Ltd., vol. 33(2), pages 2864-2887, April.
    21. Assunta Di Vaio & Anum Zaffar & Meghna Chhabra & Stefano Coronella, 2025. "Poverty Alleviation Through Accounting and Partnerships: A Systematic Review and Future Research Directions," Sustainable Development, John Wiley & Sons, Ltd., vol. 33(4), pages 5621-5641, August.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:techno:v:146:y:2025:i:c:s0166497225001099. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.sciencedirect.com/science/journal/01664972 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.