IDEAS home Printed from https://ideas.repec.org/a/eee/jbrese/v204y2026ics0148296325006654.html

Developing judgement for business: an AI-based model of independent management learning

Author

Listed:
  • Johnson, Mark
  • Maitland, Elizabeth
  • Sofka, Wolfgang

Abstract

The rapid acceleration in the sophistication, visibility and accessibility of machine learning and artificial intelligence (AI) technologies presents opportunities and challenges for management learning and education. We focus on two key elements: (i) weaknesses in current AI approaches in management learning and education; and (ii) the challenges of providing timely, personalized and reliable feedback that is particularly central to experiential learning designs. We propose a novel, ranking-based explainable AI approach that uses Adaptive Comparative Judgment (ACJ) theory and Gaussian statistical distributions that can be tailored to deliver structured self-directed and formal learning. We show how combining generative AI, our comparative judgment AI and dynamic simulations creates learning designs based on frequent, tailored, reliable and dialogue driven individualized feedback on management decisions, that builds deep skills in self-reflection and judgment.

Suggested Citation

  • Johnson, Mark & Maitland, Elizabeth & Sofka, Wolfgang, 2026. "Developing judgement for business: an AI-based model of independent management learning," Journal of Business Research, Elsevier, vol. 204(C).
    • Handle: RePEc:eee:jbrese:v:204:y:2026:i:c:s0148296325006654
    DOI: 10.1016/j.jbusres.2025.115842
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0148296325006654
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jbusres.2025.115842?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Alan Sangster & Greg Stoner & Barbara Flood, 2020. "Insights into accounting education in a COVID-19 world," Accounting Education, Taylor & Francis Journals, vol. 29(5), pages 431-562, September.
    2. Anseel, Frederik & Lievens, Filip & Schollaert, Eveline, 2009. "Reflection as a strategy to enhance task performance after feedback," Organizational Behavior and Human Decision Processes, Elsevier, vol. 110(1), pages 23-35, September.
    3. Berkeley J. Dietvorst & Joseph P. Simmons & Cade Massey, 2018. "Overcoming Algorithm Aversion: People Will Use Imperfect Algorithms If They Can (Even Slightly) Modify Them," Management Science, INFORMS, vol. 64(3), pages 1155-1170, March.
    4. Ryan Allen & Prithwiraj (Raj) Choudhury, 2022. "Algorithm-Augmented Work and Domain Experience: The Countervailing Forces of Ability and Aversion," Organization Science, INFORMS, vol. 33(1), pages 149-169, January.
    5. Foss, Nicolai J. & Mazzelli, Ambra, 2025. "Bringing managers and management back into strategy: Interfaces and dynamic managerial capabilities," Journal of Business Research, Elsevier, vol. 186(C).
    6. Jenna E. Myers & Katherine C. Kellogg, 2022. "State Actor Orchestration for Achieving Workforce Development at Scale: Evidence from Four US States," ILR Review, Cornell University, ILR School, vol. 75(1), pages 28-55, January.
    7. Katherine C. Kellogg & Jenna E. Myers & Lindsay Gainer & Sara J. Singer, 2021. "Moving Violations: Pairing an Illegitimate Learning Hierarchy with Trainee Status Mobility for Acquiring New Skills When Traditional Expertise Erodes," Organization Science, INFORMS, vol. 32(1), pages 181-209, January.
    8. van Giffen, Benjamin & Herhausen, Dennis & Fahse, Tobias, 2022. "Overcoming the pitfalls and perils of algorithms: A classification of machine learning biases and mitigation methods," Journal of Business Research, Elsevier, vol. 144(C), pages 93-106.
    9. Elizabeth Maitland & André Sammartino, 2015. "Decision making and uncertainty: The role of heuristics and experience in assessing a politically hazardous environment," Strategic Management Journal, Wiley Blackwell, vol. 36(10), pages 1554-1578, October.
    10. Tamer Boyacı & Caner Canyakmaz & Francis de Véricourt, 2024. "Human and Machine: The Impact of Machine Input on Decision Making Under Cognitive Limitations," Management Science, INFORMS, vol. 70(2), pages 1258-1275, February.
    11. Nada R. Sanders & Karl B. Manrodt, 2003. "Forecasting Software in Practice: Use, Satisfaction, and Performance," Interfaces, INFORMS, vol. 33(5), pages 90-93, October.
    12. M J Read & J S Edwards & A E Gear, 2000. "Group preference aggregation rules: The results of a comparative analysis with in situ data," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 51(5), pages 557-563, May.
    13. Eryarsoy, Enes & Kilic, Huseyin Selcuk & Zaim, Selim & Doszhanova, Marzhan, 2022. "Assessing IoT challenges in supply chain: A comparative study before and during- COVID-19 using interval valued neutrosophic analytical hierarchy process," Journal of Business Research, Elsevier, vol. 147(C), pages 108-123.
    14. Qingjun Li & Shuliang Zhao, 2023. "The Impact of Digital Economy Development on Industrial Restructuring: Evidence from China," Sustainability, MDPI, vol. 15(14), pages 1-19, July.
    15. Pando-Garcia, Julián & Periañez-Cañadillas, Iñaki & Charterina, Jon, 2016. "Business simulation games with and without supervision: An analysis based on the TAM model," Journal of Business Research, Elsevier, vol. 69(5), pages 1731-1736.
    16. Fabrizio Dell'Acqua & Charles Ayoubi & Hila Lifshitz & Raffaella Sadun & Ethan Mollick & Lilach Mollick & Yi Han & Jeff Goldman & Hari Nair & Stewart Taub & Karim Lakhani, 2025. "The Cybernetic Teammate: A Field Experiment on Generative AI Reshaping Teamwork and Expertise," NBER Working Papers 33641, National Bureau of Economic Research, Inc.
    17. Herbert A. Simon, 1991. "Bounded Rationality and Organizational Learning," Organization Science, INFORMS, vol. 2(1), pages 125-134, February.
    18. Robert Fildes & Paul Goodwin, 2007. "Good and Bad Judgment in Forecasting: Lessons from Four Companies," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 8, pages 5-10, Fall.
    19. Kao, Ling-Jing & Chiu, Chih-Chou & Lin, Hung-Tse & Hung, Yun-Wei & Lu, Cheng-Chin, 2024. "Unveiling the dimensions of digital transformation: A comprehensive taxonomy and assessment model for business," Journal of Business Research, Elsevier, vol. 176(C).
    20. Giovanni Gavetti, 2012. "PERSPECTIVE—Toward a Behavioral Theory of Strategy," Organization Science, INFORMS, vol. 23(1), pages 267-285, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sebastian Krakowski & Darek Haftor & Johannes Luger & Natallia Pashkevich & Sebastian Raisch, 2026. "Human-Centered Artificial Intelligence: A Field Experiment," Management Science, INFORMS, vol. 72(1), pages 57-72, January.
    2. Michael Vössing & Niklas Kühl & Matteo Lind & Gerhard Satzger, 2022. "Designing Transparency for Effective Human-AI Collaboration," Information Systems Frontiers, Springer, vol. 24(3), pages 877-895, June.
    3. Eldor, Liat & Hodor, Michal & Cappelli, Peter, 2023. "The limits of psychological safety: Nonlinear relationships with performance," Organizational Behavior and Human Decision Processes, Elsevier, vol. 177(C).
    4. Niittymies, Aleksi, 2020. "Heuristic decision-making in firm internationalization: The influence of context-specific experience," International Business Review, Elsevier, vol. 29(6).
    5. Fildes, Robert & Goodwin, Paul, 2021. "Stability in the inefficient use of forecasting systems: A case study in a supply chain company," International Journal of Forecasting, Elsevier, vol. 37(2), pages 1031-1046.
    6. Fabrizio Dell’Acqua & Edward McFowland & Ethan Mollick & Hila Lifshitz & Katherine C. Kellogg & Saran Rajendran & Lisa Krayer & François Candelon & Karim R. Lakhani, 2026. "Navigating the Jagged Technological Frontier: Field Experimental Evidence of the Effects of Artificial Intelligence on Knowledge Worker Productivity and Quality," Organization Science, INFORMS, vol. 37(2), pages 403-423, March.
    7. Sroginis, Anna & Fildes, Robert & Kourentzes, Nikolaos, 2023. "Use of contextual and model-based information in adjusting promotional forecasts," European Journal of Operational Research, Elsevier, vol. 307(3), pages 1177-1191.
    8. Jiamin Yin & Kee Yuan Ngiam & Sharon Swee-Lin Tan & Hock Hai Teo, 2025. "Designing AI-Based Work Processes: How the Timing of AI Advice Affects Diagnostic Decision Making," Management Science, INFORMS, vol. 71(11), pages 9361-9383, November.
    9. Clare Snyder & Samantha Keppler & Stephen Leider, 2026. "Algorithm Reliance: Fast and Slow," Management Science, INFORMS, vol. 72(1), pages 368-385, January.
    10. Jörg Papenkordt & Johannes Dahlke & Nicolas Neef & Sarah Zabel, 2025. "Exploring the impact of AI on team collaboration dynamics in creative decision-making," Working Papers Dissertations 146, Paderborn University, Faculty of Business Administration and Economics.
    11. Goudarz Azar & Rian Drogendijk, 2019. "Ex-post Performance Implications of Divergence of Managers’ Perceptions of ‘Distance’ From ‘Reality’ in International Business," Management International Review, Springer, vol. 59(1), pages 67-92, February.
    12. Ryan Allen & Prithwiraj (Raj) Choudhury, 2022. "Algorithm-Augmented Work and Domain Experience: The Countervailing Forces of Ability and Aversion," Organization Science, INFORMS, vol. 33(1), pages 149-169, January.
    13. Ang, Siah Hwee & Benischke, Mirko H. & Hooi, Andrea Wai-Leng, 2018. "Frequency of international expansion through high control market expansion modes and interlocked directorships," Journal of World Business, Elsevier, vol. 53(4), pages 493-503.
    14. Theocharis, Zoe & Harvey, Nigel, 2019. "When does more mean worse? Accuracy of judgmental forecasting is nonlinearly related to length of data series," Omega, Elsevier, vol. 87(C), pages 10-19.
    15. Khosrowabadi, Naghmeh & Hoberg, Kai & Lee, Yun Shin, 2025. "Guiding supervisors in artificial intelligence-enabled forecasting: Understanding the impacts of salience and detail on decision-making," International Journal of Forecasting, Elsevier, vol. 41(2), pages 716-732.
    16. Hassan, Reda & Nguyen, Nhien & Finserås, Stine Rasdal & Adde, Lars & Strümke, Inga & Støen, Ragnhild, 2025. "Unlocking the black box: Enhancing human-AI collaboration in high-stakes healthcare scenarios through explainable AI," Technological Forecasting and Social Change, Elsevier, vol. 219(C).
    17. Maxime C. Cohen & Tinglong Dai & Georgia Perakis & Narendra Agrawal & Gad Allon & Robert N. Boute & Gérard P. Cachon & Zhe Chen & Morris Cohen & Rares Cristian & Vinayak Deshpande & Francis de Véricou, 2026. "OM Forum—Supply Chain Management in the AI Era: A Vision Statement from the Operations Management Community," Manufacturing & Service Operations Management, INFORMS, vol. 28(3), pages 687-705, May.
    18. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    19. Ben Greiner & Philipp Grünwald & Thomas Lindner & Georg Lintner & Martin Wiernsperger, 2026. "Incentives, Framing, and Reliance on Algorithmic Advice: An Experimental Study," Management Science, INFORMS, vol. 72(1), pages 302-322, January.
    20. Marta Serra-Garcia & Uri Gneezy, 2025. "Improving Human Deception Detection Using Algorithmic Feedback," Management Science, INFORMS, vol. 71(12), pages 10289-10307, December.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jbrese:v:204:y:2026:i:c:s0148296325006654. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jbusres .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.