IDEAS home Printed from https://ideas.repec.org/a/sae/entthe/v46y2022i6p1685-1716.html

Standards for Evaluating Impact in Entrepreneurship Education Research: Using a Descriptive Validity Framework to Enhance Methodological Rigor and Transparency

Author

Listed:
  • Soohyun Yi
  • Nathalie Duval-Couetil

Abstract

Given calls for more rigorous research able to measure the impact of entrepreneurship education, this study proposes guidelines for enhancing methodological and reporting practices. First, drawing on prior research syntheses, we developed a descriptive validity framework that outlines key elements for rigorous evaluation research. Second, we use this framework to examine 61 quantitative, university-based entrepreneurship education impact studies to identify and describe methodological and reporting practices that are most prevalent. The result is a set of Impact Evaluation Research Standards for entrepreneurship educators and scholars wishing to improve education evaluation research.

Suggested Citation

  • Soohyun Yi & Nathalie Duval-Couetil, 2022. "Standards for Evaluating Impact in Entrepreneurship Education Research: Using a Descriptive Validity Framework to Enhance Methodological Rigor and Transparency," Entrepreneurship Theory and Practice, , vol. 46(6), pages 1685-1716, November.
    • Handle: RePEc:sae:entthe:v:46:y:2022:i:6:p:1685-1716
    DOI: 10.1177/10422587211018184
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/10422587211018184
    Download Restriction: no
    File URL: https://libkey.io/10.1177/10422587211018184?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Kenneth F Schulz & Douglas G Altman & David Moher & for the CONSORT Group, 2010. "CONSORT 2010 Statement: Updated Guidelines for Reporting Parallel Group Randomised Trials," PLOS Medicine, Public Library of Science, vol. 7(3), pages 1-7, March.
    2. von Graevenitz, Georg & Harhoff, Dietmar & Weber, Richard, 2010. "The effects of entrepreneurship education," Journal of Economic Behavior & Organization, Elsevier, vol. 76(1), pages 90-112, October.
    3. David P. Farrington, 2003. "Methodological Quality Standards for Evaluation Research," The ANNALS of the American Academy of Political and Social Science, , vol. 587(1), pages 49-68, May.
    4. John A. List & Azeem M. Shaikh & Yang Xu, 2019. "Multiple hypothesis testing in experimental economics," Experimental Economics, Springer;Economic Science Association, vol. 22(4), pages 773-793, December.
    5. Fiet, James O., 2001. "The theoretical side of teaching entrepreneurship," Journal of Business Venturing, Elsevier, vol. 16(1), pages 1-24, January.
    6. Dugassa Tessema Gerba, 2012. "Impact of entrepreneurship education on entrepreneurial intentions of business and engineering students in Ethiopia," African Journal of Economic and Management Studies, Emerald Group Publishing Limited, vol. 3(2), pages 258-277, September.
    7. Elert, Niklas & Andersson, Fredrik W. & Wennberg, Karl, 2015. "The impact of entrepreneurship education in high school on long-term entrepreneurial performance," Journal of Economic Behavior & Organization, Elsevier, vol. 111(C), pages 209-223.
    8. Alaref, Jumana & Brodmann, Stefanie & Premand, Patrick, 2020. "The medium-term impact of entrepreneurship education on labor market outcomes: Experimental evidence from university graduates in Tunisia," Labour Economics, Elsevier, vol. 62(C).
    9. Ghulam Nabi & Francisco Linan & Alain Fayolle & Norris F. Krueger & Andreas Walmsley, 2017. "The impact of entrepreneurship education in higher education : A systematic review and research agenda," Post-Print hal-02276714, HAL.
    10. A. Fayolle & B. Gailly, 2015. "The Impact of Entrepreneurship Education on Entrepreneurial Attitudes and Intention: Hysteresis and Persistence," Post-Print halshs-00785012, HAL.
    11. Oosterbeek, Hessel & van Praag, Mirjam & Ijsselstein, Auke, 2010. "The impact of entrepreneurship education on entrepreneurship skills and motivation," European Economic Review, Elsevier, vol. 54(3), pages 442-454, April.
    12. Wenhong Chen & Justin Tan, 2009. "Understanding Transnational Entrepreneurship Through a Network Lens: Theoretical and Methodological Considerations," Entrepreneurship Theory and Practice, , vol. 33(5), pages 1079-1091, September.
    13. Heidi M. Neck & Patricia G. Greene, 2011. "Entrepreneurship Education: Known Worlds and New Frontiers," Journal of Small Business Management, Taylor & Francis Journals, vol. 49(1), pages 55-70, January.
    14. Wiklund, Johan & Nikolaev, Boris & Shir, Nadav & Foo, Maw-Der & Bradley, Steve, 2019. "Entrepreneurship and well-being: Past, present, and future," Journal of Business Venturing, Elsevier, vol. 34(4), pages 579-588.
    15. Premand, Patrick & Brodmann, Stefanie & Almeida, Rita & Grun, Rebekka & Barouni, Mahdi, 2016. "Entrepreneurship Education and Entry into Self-Employment Among University Graduates," World Development, Elsevier, vol. 77(C), pages 311-327.
    16. Lars Kolvereid, 1996. "Organizational Employment versus Self-Employment: Reasons for Career Choice Intentions," Entrepreneurship Theory and Practice, , vol. 20(3), pages 23-31, April.
    17. Thursby, Jerry & Fuller, Anne W. & Thursby, Marie, 2009. "US faculty patenting: Inside and outside the university," Research Policy, Elsevier, vol. 38(1), pages 14-25, February.
    18. Dugassa Tessema Gerba, 2012. "Impact of entrepreneurship education on entrepreneurial intentions of business and engineering students in Ethiopia," African Journal of Economic and Management Studies, Emerald Group Publishing Limited, vol. 3(2), pages 258-277, September.
    19. Martin, Bruce C. & McNally, Jeffrey J. & Kay, Michael J., 2013. "Examining the formation of human capital in entrepreneurship: A meta-analysis of entrepreneurship education outcomes," Journal of Business Venturing, Elsevier, vol. 28(2), pages 211-224.
    20. Gielnik, Michael M. & Uy, Marilyn A. & Funken, Rebecca & Bischoff, Kim Marie, 2017. "Boosting and sustaining passion: A long-term perspective on the effects of entrepreneurship training," Journal of Business Venturing, Elsevier, vol. 32(3), pages 334-353.
    21. repec:hal:journl:hal-02313409 is not listed on IDEAS
    22. Alain Fayolle & B. Gailly & N. Lassas-Clerc, 2006. "Effect and Counter-effect of Entrepreneurship Education and Social Context on Student's Intentions," Post-Print halshs-00133047, HAL.
    23. Alain Fayolle & Benoit Gailly, 2015. "The Impact of Entrepreneurship Education on Entrepreneurial Attitudes and Intention: Hysteresis and Persistence," Journal of Small Business Management, Taylor & Francis Journals, vol. 53(1), pages 75-93, January.
    24. Grégoire, Denis A. & Binder, Julia K. & Rauch, Andreas, 2019. "Navigating the validity tradeoffs of entrepreneurship research experiments: A systematic review and best-practice suggestions," Journal of Business Venturing, Elsevier, vol. 34(2), pages 284-310.
    25. Alain Fayolle & B. Gailly & N. Lassas-Clerc, 2006. "Assessing the Impact of Entrepreneurship Education Programmes: A New Methodology," Post-Print halshs-00133044, HAL.
    26. Souitaris, Vangelis & Zerbinati, Stefania & Al-Laham, Andreas, 2007. "Do entrepreneurship programmes raise entrepreneurial intention of science and engineering students? The effect of learning, inspiration and resources," Journal of Business Venturing, Elsevier, vol. 22(4), pages 566-591, July.
    27. Alain Fayolle & Benoît Gailly, 2015. "The Impact of Entrepreneurship Education on Entrepreneurial Attitudes and Intention : Hysteresis and Persistence," Post-Print hal-02312771, HAL.
    28. Michael Fretschner & Susanne Weber, 2013. "Measuring and Understanding the Effects of Entrepreneurial Awareness Education," Journal of Small Business Management, Taylor & Francis Journals, vol. 51(3), pages 410-428, July.
    29. Saeid Karimi & Harm J. A. Biemans & Thomas Lans & Mohammad Chizari & Martin Mulder, 2016. "The Impact of Entrepreneurship Education: A Study of Iranian Students' Entrepreneurial Intentions and Opportunity Identification," Journal of Small Business Management, Taylor & Francis Journals, vol. 54(1), pages 187-209, January.
    30. Elaine C. Rideout & Denis O. Gray, 2013. "Does Entrepreneurship Education Really Work? A Review and Methodological Critique of the Empirical Literature on the Effects of University‐Based Entrepreneurship Education," Journal of Small Business Management, Taylor & Francis Journals, vol. 51(3), pages 329-351, July.
    31. Panagiotis Piperopoulos & Dimo Dimov, 2015. "Burst Bubbles or Build Steam? Entrepreneurship Education, Entrepreneurial Self‐Efficacy, and Entrepreneurial Intentions," Journal of Small Business Management, Taylor & Francis Journals, vol. 53(4), pages 970-985, October.
    32. Alain Fayolle & Benoît Gailly & Narjisse Lassas-Clerc, 2006. "Assessing the impact of entrepreneurship education programmes: a new methodology," Post-Print hal-02311772, HAL.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mariacarmela Passarelli & Giuseppe Bongiorno, 2025. "Is it the time to reshape entrepreneurship education? State-of-the-art and further perspectives," International Entrepreneurship and Management Journal, Springer, vol. 21(1), pages 1-35, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Juan-José Nájera-Sánchez & Cristina Pérez-Pérez & Thais González-Torres, 2023. "Exploring the knowledge structure of entrepreneurship education and entrepreneurial intention," International Entrepreneurship and Management Journal, Springer, vol. 19(2), pages 563-597, June.
    2. Bohlayer, Carina & Gielnik, Michael M., 2023. "(S)training experiences: Toward understanding decreases in entrepreneurial self-efficacy during action-oriented entrepreneurship training," Journal of Business Venturing, Elsevier, vol. 38(1).
    3. Anabela Dinis, 2024. "The impact of entrepreneurship education on students’ desirability and intentions to pursue an entrepreneurial career: a study in general and vocational secondary schools of Cabo Verde," Journal of Innovation and Entrepreneurship, Springer, vol. 13(1), pages 1-27, December.
    4. Laura Padilla-Angulo & René Díaz-Pichardo & Antonio Luis Leal-Rodríguez, 2023. "Are different entrepreneurship-promotion activities equally effective? an analysis by academic year and gender," International Entrepreneurship and Management Journal, Springer, vol. 19(1), pages 1-25, March.
    5. Mariacarmela Passarelli & Giuseppe Bongiorno, 2025. "Is it the time to reshape entrepreneurship education? State-of-the-art and further perspectives," International Entrepreneurship and Management Journal, Springer, vol. 21(1), pages 1-35, December.
    6. Michela Loi & Maria Chiara Di Guardo, 2015. "A Start-Up Generation Approach For Teaching Entrepreneurship: An Overview Of Affective Learning Results," Journal of Developmental Entrepreneurship (JDE), World Scientific Publishing Co. Pte. Ltd., vol. 20(04), pages 1-16, December.
    7. Izaias Martins & Juan Pablo P. Perez & Diana Osorio & Jorge Mesa, 2023. "Serious Games in Entrepreneurship Education: A Learner Satisfaction and Theory of Planned Behaviour Approaches," Journal of Entrepreneurship and Innovation in Emerging Economies, Entrepreneurship Development Institute of India, vol. 32(1), pages 157-181, March.
    8. Gayoung Kim & Dohyeon Kim & Woo Jin Lee & Sunyoung Joung, 2020. "The Effect of Youth Entrepreneurship Education Programs: Two Large-Scale Experimental Studies," SAGE Open, , vol. 10(3), pages 21582440209, September.
    9. Montserrat Entrialgo & Víctor Iglesias, 2016. "The moderating role of entrepreneurship education on the antecedents of entrepreneurial intention," International Entrepreneurship and Management Journal, Springer, vol. 12(4), pages 1209-1232, December.
    10. Takawira Munyaradzi Ndofirepi, 2022. "Entrepreneurship goal and implementation intentions formation: the role of higher education institutions and contexts," Journal of Innovation and Entrepreneurship, Springer, vol. 11(1), pages 1-22, December.
    11. Aya Sehmani & Sara Yassine, 2025. "Evolution of Entrepreneurship education research through bibliometric analysis," Post-Print hal-05270676, HAL.
    12. Gry Alsos & Gustav Hägg & Mats Lundqvist & Diamanto Politis & Martin Stockhaus & Karen Williams-Middleton & Kari Djupdal, 2023. "Graduates of venture creation programs – where do they apply their entrepreneurial competencies?," Small Business Economics, Springer, vol. 60(1), pages 133-155, January.
    13. Anderson R. Galvão & Carla S. Marques & Telma Mendes & Carolina Azevedo, 2025. "How Does Perceived University Support Boost Students’ Entrepreneurial Intentions?," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 16(3), pages 12698-12726, September.
    14. Eleonora Fiore & Giuliano Sansone & Emilio Paolucci, 2019. "Entrepreneurship Education in a Multidisciplinary Environment: Evidence from an Entrepreneurship Programme Held in Turin," Administrative Sciences, MDPI, vol. 9(1), pages 1-28, March.
    15. Maria-Ana Georgescu & Emilia Herman, 2020. "The Impact of the Family Background on Students’ Entrepreneurial Intentions: An Empirical Analysis," Sustainability, MDPI, vol. 12(11), pages 1-18, June.
    16. Francesco Ceresia, 2018. "The Role of Entrepreneurship Education in Fostering Entrepreneurial Intentions and Performances: A Review of 30 Years of Research," Revista Equidad y Desarrollo, Universidad de la Salle, issue 31, pages 47-66.
    17. Gil Pechuán Ignacio & Conesa García M. Pilar & Tejedor Miralles Enrique, 2024. "Impact of the sense of initiative and entrepreneurship competence on the entrepreneurial intention," International Entrepreneurship and Management Journal, Springer, vol. 20(4), pages 2515-2539, December.
    18. Natalie Brüne & Eva Lutz, 2020. "The effect of entrepreneurship education in schools on entrepreneurial outcomes: a systematic review," Management Review Quarterly, Springer, vol. 70(2), pages 275-305, May.
    19. Patricia P. Iglesias-Sánchez & Carmen Jambrino-Maldonado & Carlos de las Heras-Pedrosa, 2019. "Training Entrepreneurial Competences with Open Innovation Paradigm in Higher Education," Sustainability, MDPI, vol. 11(17), pages 1-23, August.
    20. Ángela González Moreno & Llanos López Muñoz & Rosario Pérez Morote, 2019. "The Role of Higher Education in Development of Entrepreneurial Competencies: Some Insights from Castilla-La Mancha University in Spain," Administrative Sciences, MDPI, vol. 9(1), pages 1-24, February.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:entthe:v:46:y:2022:i:6:p:1685-1716. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.