IDEAS home Printed from https://ideas.repec.org/a/pal/jmarka/v13y2025i2d10.1057_s41270-024-00290-6.html
   My bibliography  Save this article

What postpones degree completion? Discovering key predictors of undergraduate degree completion through explainable artificial intelligence (XAI)

Author

Listed:
  • Burak Cankaya

    (Embry-Riddle Aeronautical University)

  • Robin Roberts

    (Embry-Riddle Aeronautical University)

  • Stephanie Douglas

    (Embry-Riddle Aeronautical University)

  • Rachel Vigness

    (Embry-Riddle Aeronautical University)

  • Asil Oztekin

    (University of Massachusetts Lowell)

Abstract

The timing of degree completion for students taking post-secondary courses has been a constant source of angst for administrators wanting the best outcomes for their students. Most methods for predicting student degree completion extensions are completed by analog methods using human effort to analyze data. The majority of data analysis reporting of degree completion extension variables and impacts has, for decades, been done manually. Administrators primarily forecast the factors based on their expertise and intuition to evaluate implications and repercussions. The variables are large, varied, and situational to each individual and complex. We used machine learning (automated processes using predictive algorithms) to predict undergraduate extensions for at least 2 years beyond a standard 4 years to complete a bachelor's degree. The study builds a machine learning-based education understanding XAI model (ED-XAI) to examine students’ dependent and independent variables and accurately predict/explain degree extension. The study utilized Random Forest, Support Vector Machines, and Deep Learning Machine learning algorithms. XAI used Information Fusion, SHapley Additive exPlanations (SHAP), and Local Interpretable Model-Agnostic Explanations (LIME) models to explain the findings of the Machine Learning models. The ED-XAI model explained multiple scenarios and discovered variables influencing students’ degree completion linked to their status and funding source. The Random Forest model gave supreme predictive results with 89.1% Mean ROC, 71.6% Overall Precision, 86% Overall Recall, and 71.6% In-class Precision. The educational information system introduced in this study has significant implications for accurate variables reporting and impacts on degree extensions leading to successful degree completions minimally reported in higher education marketing analytics research.

Suggested Citation

  • Burak Cankaya & Robin Roberts & Stephanie Douglas & Rachel Vigness & Asil Oztekin, 2025. "What postpones degree completion? Discovering key predictors of undergraduate degree completion through explainable artificial intelligence (XAI)," Journal of Marketing Analytics, Palgrave Macmillan, vol. 13(2), pages 514-536, June.
  • Handle: RePEc:pal:jmarka:v:13:y:2025:i:2:d:10.1057_s41270-024-00290-6
    DOI: 10.1057/s41270-024-00290-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1057/s41270-024-00290-6
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1057/s41270-024-00290-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Georgios Marinakos & Sophia Daskalaki, 2017. "Imbalanced customer classification for bank direct marketing," Journal of Marketing Analytics, Palgrave Macmillan, vol. 5(1), pages 14-30, March.
    2. Samir Poudel & Rajendra Paudyal & Burak Cankaya & Naomi Sterlingsdottir & Marissa Murphy & Shital Pandey & Jorge Vargas & Khem Poudel, 2023. "Cryptocurrency price and volatility predictions with machine learning," Journal of Marketing Analytics, Palgrave Macmillan, vol. 11(4), pages 642-660, December.
    3. Clare L. Comm & Dennis F. X. Mathaisel, 2018. "The use of analytics to market the sustainability of “Unique” products," Journal of Marketing Analytics, Palgrave Macmillan, vol. 6(4), pages 150-156, December.
    4. Marco Vriens & Nathan Bosch & Chad Vidden & Jason Talwar, 2022. "Prediction and profitability in market segmentation typing tools," Journal of Marketing Analytics, Palgrave Macmillan, vol. 10(4), pages 360-389, December.
    5. Terry T. Ishitani, 2006. "Studying Attrition and Degree Completion Behavior among First-Generation College Students in the United States," The Journal of Higher Education, Taylor & Francis Journals, vol. 77(5), pages 861-885, September.
    6. Germann, Frank & Lilien, Gary L. & Rangaswamy, Arvind, 2013. "Performance implications of deploying marketing analytics," International Journal of Research in Marketing, Elsevier, vol. 30(2), pages 114-128.
    7. Matthew D. Vollrath & Salvador G. Villegas, 2022. "Avoiding digital marketing analytics myopia: revisiting the customer decision journey as a strategic marketing framework," Journal of Marketing Analytics, Palgrave Macmillan, vol. 10(2), pages 106-113, June.
    8. Mathieu Alemany Oliver & Jean-Sébastien Vayre, 2015. "Big data and the future of knowledge production in marketing research: Ethics, digital traces, and abductive reasoning," Post-Print hal-03289835, HAL.
    9. Wesley Marcos Almeida & Claudimar Pereira Veiga, 2023. "Does demand forecasting matter to retailing?," Journal of Marketing Analytics, Palgrave Macmillan, vol. 11(2), pages 219-232, June.
    10. Dawn Iacobucci & Maria Petrescu & Anjala Krishen & Michael Bendixen, 2019. "The state of marketing analytics in research and practice," Journal of Marketing Analytics, Palgrave Macmillan, vol. 7(3), pages 152-181, September.
    11. Shivaji Alaparthi & Manit Mishra, 2021. "BERT: a sentiment analysis odyssey," Journal of Marketing Analytics, Palgrave Macmillan, vol. 9(2), pages 118-126, June.
    12. Cankaya, Burak & Topuz, Kazim & Delen, Dursun & Glassman, Aaron, 2023. "Evidence-based managerial decision-making with machine learning: The case of Bayesian inference in aviation incidents," Omega, Elsevier, vol. 120(C).
    13. Valentin Kuleto & Milena Ilić & Mihail Dumangiu & Marko Ranković & Oliva M. D. Martins & Dan Păun & Larisa Mihoreanu, 2021. "Exploring Opportunities and Challenges of Artificial Intelligence and Machine Learning in Higher Education Institutions," Sustainability, MDPI, vol. 13(18), pages 1-16, September.
    14. Piotr Tarka & Elżbieta Jędrych, 2023. "Toward an exploratory framework of determinants of marketing research effectiveness in business organizations," Journal of Marketing Analytics, Palgrave Macmillan, vol. 11(3), pages 503-522, September.
    15. Fernandes, Eduardo & Holanda, Maristela & Victorino, Marcio & Borges, Vinicius & Carvalho, Rommel & Erven, Gustavo Van, 2019. "Educational data mining: Predictive analysis of academic performance of public school students in the capital of Brazil," Journal of Business Research, Elsevier, vol. 94(C), pages 335-343.
    16. Anjala S. Krishen & Maria Petrescu, 2019. "Data-driven decision making: implementing analytics to transform academic culture," Journal of Marketing Analytics, Palgrave Macmillan, vol. 7(2), pages 51-53, June.
    17. Chandrasekhar Valluri & Sudhakar Raju & Vivek H. Patil, 2022. "Customer determinants of used auto loan churn: comparing predictive performance using machine learning techniques," Journal of Marketing Analytics, Palgrave Macmillan, vol. 10(3), pages 279-296, September.
    18. Samir Poudel & Rajendra Paudyal & Burak Cankaya & Naomi Sterlingsdottir & Marissa Murphy & Shital Pandey & Jorge Vargas & Khem Poudel, 2023. "Correction to: Cryptocurrency price and volatility predictions with machine learning," Journal of Marketing Analytics, Palgrave Macmillan, vol. 11(4), pages 661-661, December.
    19. Alberto Lopez & Eva Guerra & Beatriz Gonzalez & Sergio Madero, 2020. "Consumer sentiments toward brands: the interaction effect between brand personality and sentiments on electronic word of mouth," Journal of Marketing Analytics, Palgrave Macmillan, vol. 8(4), pages 203-223, December.
    20. Sevim, Cuneyt & Oztekin, Asil & Bali, Ozkan & Gumus, Serkan & Guresen, Erkam, 2014. "Developing an early warning system to predict currency crises," European Journal of Operational Research, Elsevier, vol. 237(3), pages 1095-1104.
    21. Graefe, Andreas & Armstrong, J. Scott & Jones, Randall J. & Cuzán, Alfred G., 2014. "Combining forecasts: An application to elections," International Journal of Forecasting, Elsevier, vol. 30(1), pages 43-54.
    22. Dora Simões & Joana Nogueira, 2022. "Learning about the customer for improving customer retention proposal of an analytical framework," Journal of Marketing Analytics, Palgrave Macmillan, vol. 10(1), pages 50-63, March.
    23. Chung, Jae Young & Lee, Sunbok, 2019. "Dropout early warning systems for high school students using machine learning," Children and Youth Services Review, Elsevier, vol. 96(C), pages 346-353.
    24. Andrea Saltelli, 2002. "Sensitivity Analysis for Importance Assessment," Risk Analysis, John Wiley & Sons, vol. 22(3), pages 579-590, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Maria Petrescu & Anjala S. Krishen, 2023. "Mapping 2022 in Journal of Marketing Analytics: what lies ahead?," Journal of Marketing Analytics, Palgrave Macmillan, vol. 11(1), pages 1-4, March.
    2. Kizilaslan, Recep & Freund, Steven & Iseri, Ali, 2016. "A data analytic approach to forecasting daily stock returns in an emerging marketAuthor-Name: Oztekin, Asil," European Journal of Operational Research, Elsevier, vol. 253(3), pages 697-710.
    3. Shimi Naurin Ahmad & Michel Laroche, 2023. "Extracting marketing information from product reviews: a comparative study of latent semantic analysis and probabilistic latent semantic analysis," Journal of Marketing Analytics, Palgrave Macmillan, vol. 11(4), pages 662-676, December.
    4. Imran Bashir Dar & Muhammad Bashir Khan & Abdul Zahid Khan & Bahaudin G. Mujtaba, 2021. "A qualitative analysis of the marketing analytics literature: where would ethical issues and legality rank?," Journal of Marketing Analytics, Palgrave Macmillan, vol. 9(3), pages 242-261, September.
    5. Zhenning Xu & Colin Vail & Amarpreet S. Kohli & Saeed Tajdini, 2021. "Understanding changes in a brand’s core positioning and customer engagement: a sentiment analysis of a brand-owned Facebook site," Journal of Marketing Analytics, Palgrave Macmillan, vol. 9(1), pages 3-16, March.
    6. Asil Oztekin, 2018. "Information fusion-based meta-classification predictive modeling for ETF performance," Information Systems Frontiers, Springer, vol. 20(2), pages 223-238, April.
    7. Maria Petrescu & Anjala S. Krishen, 2021. "Focusing on the quality and performance implications of marketing analytics," Journal of Marketing Analytics, Palgrave Macmillan, vol. 9(3), pages 155-156, September.
    8. Agag, Gomaa & Shehawy, Yasser Moustafa & Almoraish, Ahmed & Eid, Riyad & Chaib Lababdi, Houyem & Gherissi Labben, Thouraya & Abdo, Said Shabban, 2024. "Understanding the relationship between marketing analytics, customer agility, and customer satisfaction: A longitudinal perspective," Journal of Retailing and Consumer Services, Elsevier, vol. 77(C).
    9. Joyce de Souza Zanirato Maia & Ana Paula Arantes Bueno & Joao Ricardo Sato, 2023. "Applications of Artificial Intelligence Models in Educational Analytics and Decision Making: A Systematic Review," World, MDPI, vol. 4(2), pages 1-26, May.
    10. Rebecca Dingus & Hulda G. Black & Nicole A. Flink, 2024. "Analytics for all marketing majors: sparking interest in the uninterested," Journal of Marketing Analytics, Palgrave Macmillan, vol. 12(2), pages 126-141, June.
    11. José-Ramón Segarra-Moliner & Miguel-Ángel Moliner-Tena, 2024. "Engaging in customer citizenship behaviours to predict customer lifetime value," Journal of Marketing Analytics, Palgrave Macmillan, vol. 12(2), pages 307-320, June.
    12. Anjala S. Krishen & Maria Petrescu, 2022. "Is all academic service distributed equally?," Journal of Marketing Analytics, Palgrave Macmillan, vol. 10(4), pages 297-298, December.
    13. Gül Yazıcı & Tuğçe Ozansoy Çadırcı, 2024. "Creating meaningful insights from customer reviews: a methodological comparison of topic modeling algorithms and their use in marketing research," Journal of Marketing Analytics, Palgrave Macmillan, vol. 12(4), pages 865-887, December.
    14. Asil Oztekin, 0. "Information fusion-based meta-classification predictive modeling for ETF performance," Information Systems Frontiers, Springer, vol. 0, pages 1-16.
    15. Murtaza Nasir & Nichalin Summerfield & Ali Dag & Asil Oztekin, 2020. "A service analytic approach to studying patient no-shows," Service Business, Springer;Pan-Pacific Business Association, vol. 14(2), pages 287-313, June.
    16. Christopher Gerling & Stefan Lessmann, 2024. "Leveraging AI and NLP for Bank Marketing: A Systematic Review and Gap Analysis," Papers 2411.14463, arXiv.org.
    17. Zecong Ma & Sergio Palacios, 2021. "Image-mining: exploring the impact of video content on the success of crowdfunding," Journal of Marketing Analytics, Palgrave Macmillan, vol. 9(4), pages 265-285, December.
    18. Morazes, Jennifer Lynne, 2016. "Educational background, high school stress, and academic success," Children and Youth Services Review, Elsevier, vol. 69(C), pages 201-209.
    19. Makam, Vaishno Devi & Millossovich, Pietro & Tsanakas, Andreas, 2021. "Sensitivity analysis with χ2-divergences," Insurance: Mathematics and Economics, Elsevier, vol. 100(C), pages 372-383.
    20. S. Cucurachi & E. Borgonovo & R. Heijungs, 2016. "A Protocol for the Global Sensitivity Analysis of Impact Assessment Models in Life Cycle Assessment," Risk Analysis, John Wiley & Sons, vol. 36(2), pages 357-377, February.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pal:jmarka:v:13:y:2025:i:2:d:10.1057_s41270-024-00290-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.palgrave-journals.com/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.