IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2508.05491.html
   My bibliography  Save this paper

Deconstructing the Crystal Ball: From Ad-Hoc Prediction to Principled Startup Evaluation with the SAISE Framework

Author

Listed:
  • Seyed Mohammad Ali Jafari
  • Ali Mobini Dehkordi
  • Ehsan Chitsaz
  • Yadollah Yaghoobzadeh

Abstract

The integration of Artificial Intelligence (AI) into startup evaluation represents a significant technological shift, yet the academic research underpinning this transition remains methodologically fragmented. Existing studies often employ ad-hoc approaches, leading to a body of work with inconsistent definitions of success, atheoretical features, and a lack of rigorous validation. This fragmentation severely limits the comparability, reliability, and practical utility of current predictive models. To address this critical gap, this paper presents a comprehensive systematic literature review of 57 empirical studies. We deconstruct the current state-of-the-art by systematically mapping the features, algorithms, data sources, and evaluation practices that define the AI-driven startup prediction landscape. Our synthesis reveals a field defined by a central paradox: a strong convergence on a common toolkit -- venture databases and tree-based ensembles -- but a stark divergence in methodological rigor. We identify four foundational weaknesses: a fragmented definition of "success," a divide between theory-informed and data-driven feature engineering, a chasm between common and best-practice model validation, and a nascent approach to data ethics and explainability. In response to these findings, our primary contribution is the proposal of the Systematic AI-driven Startup Evaluation (SAISE) Framework. This novel, five-stage prescriptive roadmap is designed to guide researchers from ad-hoc prediction toward principled evaluation. By mandating a coherent, end-to-end methodology that emphasizes stage-aware problem definition, theory-informed data synthesis, principled feature engineering, rigorous validation, and risk-aware interpretation, the SAISE framework provides a new standard for conducting more comparable, robust, and practically relevant research in this rapidly maturing domain

Suggested Citation

  • Seyed Mohammad Ali Jafari & Ali Mobini Dehkordi & Ehsan Chitsaz & Yadollah Yaghoobzadeh, 2025. "Deconstructing the Crystal Ball: From Ad-Hoc Prediction to Principled Startup Evaluation with the SAISE Framework," Papers 2508.05491, arXiv.org.
  • Handle: RePEc:arx:papers:2508.05491
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2508.05491
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Marco Guerzoni & Consuelo R. Nava & Massimiliano Nuccio, 2021. "Start-ups survival through a crisis. Combining machine learning with econometrics to measure innovation," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 30(5), pages 468-493, July.
    2. Shepherd, Dean A. & Majchrzak, Ann, 2022. "Machines augmenting entrepreneurs: Opportunities (and threats) at the Nexus of artificial intelligence and entrepreneurship," Journal of Business Venturing, Elsevier, vol. 37(4).
    3. Jarrahi, Mohammad Hossein, 2018. "Artificial intelligence and the future of work: Human-AI symbiosis in organizational decision making," Business Horizons, Elsevier, vol. 61(4), pages 577-586.
    4. Kim, Jongwoo & Kim, Hongil & Geum, Youngjung, 2023. "How to succeed in the market? Predicting startup success using a machine learning approach," Technological Forecasting and Social Change, Elsevier, vol. 193(C).
    5. Li, Yisheng & Zadehnoori, Iman & Jowhar, Ahmad & Wise, Sean & Laplume, Andre & Zihayat, Morteza, 2024. "Learning from Yesterday: Predicting early-stage startup success for accelerators through content and cohort dynamics," Journal of Business Venturing Insights, Elsevier, vol. 22(C).
    6. Schade, Philipp & Schuhmacher, Monika C., 2023. "Predicting entrepreneurial activity using machine learning," Journal of Business Venturing Insights, Elsevier, vol. 19(C).
    7. Mona Razaghzadeh Bidgoli & Iman Raeesi Vanani & Mehdi Goodarzi, 2024. "Predicting the success of startups using a machine learning approach," Journal of Innovation and Entrepreneurship, Springer, vol. 13(1), pages 1-27, December.
    8. Sabahi, Sima & Parast, Mahour Mellat, 2020. "The impact of entrepreneurship orientation on project performance: A machine learning approach," International Journal of Production Economics, Elsevier, vol. 226(C).
    9. Manuel Chaves-Maza & Eugenio M. Fedriani, 2022. "Defining entrepreneurial success to improve guidance services: a study with a comprehensive database from Andalusia," Journal of Innovation and Entrepreneurship, Springer, vol. 11(1), pages 1-26, December.
    10. Yang Liu & Qingguo Zeng & Bobo Li & Lili Ma & Joaquín Ordieres‐Meré, 2022. "Anticipating financial distress of high‐tech startups in the European Union: A machine learning approach for imbalanced samples," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(6), pages 1131-1155, September.
    11. Antretter, Torben & Blohm, Ivo & Grichnik, Dietmar & Wincent, Joakim, 2019. "Predicting new venture survival: A Twitter-based machine learning approach to measuring online legitimacy," Journal of Business Venturing Insights, Elsevier, vol. 11(C), pages 1-1.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Li, Yisheng & Zadehnoori, Iman & Jowhar, Ahmad & Wise, Sean & Laplume, Andre & Zihayat, Morteza, 2024. "Learning from Yesterday: Predicting early-stage startup success for accelerators through content and cohort dynamics," Journal of Business Venturing Insights, Elsevier, vol. 22(C).
    2. Seyed Mohammad Ali Jafari & Ali Mobini Dehkordi & Ehsan Chitsaz & Yadollah Yaghoobzadeh, 2025. "What Matters Most? A Quantitative Meta-Analysis of AI-Based Predictors for Startup Success," Papers 2507.09675, arXiv.org.
    3. Jose Ramon Saura & Rita Bužinskienė, 2025. "Behavioral economics, artificial intelligence and entrepreneurship: an updated framework for management," International Entrepreneurship and Management Journal, Springer, vol. 21(1), pages 1-33, December.
    4. Schade, Philipp & Schuhmacher, Monika C., 2023. "Predicting entrepreneurial activity using machine learning," Journal of Business Venturing Insights, Elsevier, vol. 19(C).
    5. Yngve Dahle & Kevin Reuther & Martin Steinert & Magne Supphellen, 2023. "Towards a systemic entrepreneurship activity model," International Entrepreneurship and Management Journal, Springer, vol. 19(4), pages 1583-1610, December.
    6. Davide Consoli & Francesco Lelli & Sandro Montresor & Francois Perruchas & Francesco Rentocchini, 2025. "Moneytalks. the role of (spatial and digital) proximity in the VC financing of green start-ups," Papers in Evolutionary Economic Geography (PEEG) 2521, Utrecht University, Department of Human Geography and Spatial Planning, Group Economic Geography, revised Jul 2025.
    7. Graham, Byron & Bonner, Karen, 2024. "The role of institutions in early-stage entrepreneurship: An explainable artificial intelligence approach," Journal of Business Research, Elsevier, vol. 175(C).
    8. Adelaida Ojeda-Beltrán & Andrés Solano-Barliza & Wilson Arrubla-Hoyos & Danny Daniel Ortega & Dora Cama-Pinto & Juan Antonio Holgado-Terriza & Miguel Damas & Gilberto Toscano-Vanegas & Alejandro Cama-, 2023. "Characterisation of Youth Entrepreneurship in Medellín-Colombia Using Machine Learning," Sustainability, MDPI, vol. 15(13), pages 1-19, June.
    9. Robertson, Jeandri & Ferreira, Caitlin & Botha, Elsamari & Oosthuizen, Kim, 2024. "Game changers: A generative AI prompt protocol to enhance human-AI knowledge co-construction," Business Horizons, Elsevier, vol. 67(5), pages 499-510.
    10. Praveen Puram & Soumya Roy & Deepak Srivastav & Anand Gurumurthy, 2023. "Understanding the effect of contextual factors and decision making on team performance in Twenty20 cricket: an interpretable machine learning approach," Annals of Operations Research, Springer, vol. 325(1), pages 261-288, June.
    11. Siliang Tong & Nan Jia & Xueming Luo & Zheng Fang, 2021. "The Janus face of artificial intelligence feedback: Deployment versus disclosure effects on employee performance," Strategic Management Journal, Wiley Blackwell, vol. 42(9), pages 1600-1631, September.
    12. Shanyu Lin & Esra Sipahi Döngül & Serdar Vural Uygun & Mutlu Başaran Öztürk & Dinh Tran Ngoc Huy & Pham Van Tuan, 2022. "Exploring the Relationship between Abusive Management, Self-Efficacy and Organizational Performance in the Context of Human–Machine Interaction Technology and Artificial Intelligence with the Effect o," Sustainability, MDPI, vol. 14(4), pages 1-22, February.
    13. Michael Vössing & Niklas Kühl & Matteo Lind & Gerhard Satzger, 2022. "Designing Transparency for Effective Human-AI Collaboration," Information Systems Frontiers, Springer, vol. 24(3), pages 877-895, June.
    14. Borba, Rafael Lucas & de Paula Ferreira, Iuri Emmanuel & Bertucci Ramos, Paulo Henrique, 2024. "Addressing discriminatory bias in artificial intelligence systems operated by companies: An analysis of end-user perspectives," Technovation, Elsevier, vol. 138(C).
    15. Yang Shen, 2024. "Future jobs: analyzing the impact of artificial intelligence on employment and its mechanisms," Economic Change and Restructuring, Springer, vol. 57(2), pages 1-33, April.
    16. Watson, Graeme J. & Desouza, Kevin C. & Ribiere, Vincent M. & Lindič, Jaka, 2021. "Will AI ever sit at the C-suite table? The future of senior leadership," Business Horizons, Elsevier, vol. 64(4), pages 465-474.
    17. Ivanov, Stanislav & Webster, Craig, 2024. "Automated decision-making: Hoteliers’ perceptions," Technology in Society, Elsevier, vol. 76(C).
    18. Shaker Mahmood Mayo, 2023. "Restrictions, Challenges and Opportunities for AI and ML," International Journal of Innovations in Science & Technology, 50sea, vol. 5(2), pages 121-132, June.
    19. Achy, Lahcen, 2025. "Repenser la Gestion des Connaissances à l’ère de l’IA Limites cognitives, tensions éthiques et enjeux organisationnels [Rethinking Knowledge Management in the AI Era: Cognitive Boundaries, Ethical ," MPRA Paper 125311, University Library of Munich, Germany.
    20. Sudhanshu Joshi & Manu Sharma & Rashmi Prava Das & Joanna Rosak-Szyrocka & Justyna Żywiołek & Kamalakanta Muduli & Mukesh Prasad, 2022. "Modeling Conceptual Framework for Implementing Barriers of AI in Public Healthcare for Improving Operational Excellence: Experiences from Developing Countries," Sustainability, MDPI, vol. 14(18), pages 1-23, September.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2508.05491. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.