IDEAS home Printed from https://ideas.repec.org/a/spr/manrev/v73y2023i3d10.1007_s11301-022-00269-6.html
   My bibliography  Save this article

Replication studies in top management journals: An empirical investigation of prevalence, types, outcomes, and impact

Author

Listed:
  • Jörn H. Block

    (Trier University
    Erasmus University Rotterdam
    Witten Institute for Family Business, Witten/Herdecke University)

  • Christian Fisch

    (University of Luxembourg)

  • Narmeen Kanwal

    (Trier University)

  • Solvej Lorenzen

    (Witten Institute for Family Business, Witten/Herdecke University)

  • Anna Schulze

    (Trier University)

Abstract

Replication studies are important for the empirical research process. Yet, while there is an increased awareness of the need for replication in management research, it appears that such studies are rarely published in leading management journals. Importantly, we lack a comprehensive overview of replication studies in the top management journals that spans all sub-disciplines. Our systematic review closes this gap and provides an overview of the prevalence, types, outcomes, and impact of replication studies in management journals. We find that differences in the prevalence of replications between sub-disciplines exist and that most replications are wide replications. With regard to the replication outcome, our review shows that the share of non-confirming replications is low. Moreover, such replications are cited less often than confirming replications pointing towards a confirmation bias in management research. We discuss the implications of our results for authors, reviewers, and editors of management journals.

Suggested Citation

  • Jörn H. Block & Christian Fisch & Narmeen Kanwal & Solvej Lorenzen & Anna Schulze, 2023. "Replication studies in top management journals: An empirical investigation of prevalence, types, outcomes, and impact," Management Review Quarterly, Springer, vol. 73(3), pages 1109-1134, September.
    • Handle: RePEc:spr:manrev:v:73:y:2023:i:3:d:10.1007_s11301-022-00269-6
    DOI: 10.1007/s11301-022-00269-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11301-022-00269-6
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11301-022-00269-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Richard A. Bettis & Constance E. Helfat & J. Myles Shaver & Richard A. Bettis & Constance E. Helfat & J. Myles Shaver, 2016. "The necessity, logic, and forms of replication," Strategic Management Journal, Wiley Blackwell, vol. 37(11), pages 2193-2203, November.
    2. Shuonan Yuan & Marc Oliver Rieger & Nilüfer Caliskan, 2020. "Maxing out: the puzzling influence of past maximum returns on future asset prices in a cross-country analysis," Management Review Quarterly, Springer, vol. 70(4), pages 567-589, November.
    3. Paul M. Guest, 2021. "Risk Management in Financial Institutions: A Replication," Journal of Finance, American Finance Association, vol. 76(5), pages 2689-2707, October.
    4. Arthur, W Brian, 1989. "Competing Technologies, Increasing Returns, and Lock-In by Historical Events," Economic Journal, Royal Economic Society, vol. 99(394), pages 116-131, March.
    5. Anne-Wil Harzing, 2013. "A preliminary test of Google Scholar as a source for citation data: a longitudinal study of Nobel prize winners," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(3), pages 1057-1075, March.
    6. Ryan, James C. & A Tipu, Syed A., 2022. "Business and management research: Low instances of replication studies and a lack of author independence in replications," Research Policy, Elsevier, vol. 51(1).
    7. Herman Aguinis & Wayne F. Cascio & Ravi S. Ramani, 2017. "Science’s reproducibility and replicability crisis: International business is not immune," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 48(6), pages 653-663, August.
    8. Camerer, Colin & Dreber, Anna & Forsell, Eskil & Ho, Teck-Hua & Huber, Jurgen & Johannesson, Magnus & Kirchler, Michael & Almenberg, Johan & Altmejd, Adam & Chan, Taizan & Heikensten, Emma & Holzmeist, 2016. "Evaluating replicability of laboratory experiments in Economics," MPRA Paper 75461, University Library of Munich, Germany.
    9. Hubbard, Raymond & Vetter, Daniel E., 1996. "An empirical comparison of published replication research in accounting, economics, finance, management, and marketing," Journal of Business Research, Elsevier, vol. 35(2), pages 153-164, February.
    10. Hensel, Przemysław G., 2021. "Reproducibility and replicability crisis: How management compares to psychology and economics – A systematic review of literature," European Management Journal, Elsevier, vol. 39(5), pages 577-594.
    11. James R. Scotter, 2020. "Narcissism in CEO research: a review and replication of the archival approach," Management Review Quarterly, Springer, vol. 70(4), pages 629-674, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hensel, Przemysław G., 2021. "Reproducibility and replicability crisis: How management compares to psychology and economics – A systematic review of literature," European Management Journal, Elsevier, vol. 39(5), pages 577-594.
    2. Brinkerink, Jasper & De Massis, Alfredo & Kellermanns, Franz, 2022. "One finding is no finding: Toward a replication culture in family business research," Journal of Family Business Strategy, Elsevier, vol. 13(4).
    3. Hensel, Przemysław G., 2019. "Supporting replication research in management journals: Qualitative analysis of editorials published between 1970 and 2015," European Management Journal, Elsevier, vol. 37(1), pages 45-57.
    4. Wu, Tao & Delios, Andrew & Chen, Zhaowei & Wang, Xin, 2023. "Rethinking corruption in international business: An empirical review," Journal of World Business, Elsevier, vol. 58(2).
    5. G. Christopher Crawford & Vitaliy Skorodziyevskiy & Casey J. Frid & Thomas E. Nelson & Zahra Booyavi & Diana M. Hechavarria & Xuanye Li & Paul D. Reynolds & Ehsan Teymourian, 2022. "Advancing Entrepreneurship Theory Through Replication: A Case Study on Contemporary Methodological Challenges, Future Best Practices, and an Entreaty for Communality," Entrepreneurship Theory and Practice, , vol. 46(3), pages 779-799, May.
    6. Markku Maula & Wouter Stam, 2020. "Enhancing Rigor in Quantitative Entrepreneurship Research," Entrepreneurship Theory and Practice, , vol. 44(6), pages 1059-1090, November.
    7. Hardcopf, Rick & Liu, Gensheng (Jason) & Shah, Rachna, 2021. "Lean production and operational performance: The influence of organizational culture," International Journal of Production Economics, Elsevier, vol. 235(C).
    8. Francesco Debellis & Michele Pinelli & Marcel Hülsbeck & Anne Heider, 2023. "Ownership, governance, and internationalization in family firms: a replication and extension," Small Business Economics, Springer, vol. 61(4), pages 1437-1459, December.
    9. Dreber, Anna & Johannesson, Magnus, 2023. "A framework for evaluating reproducibility and replicability in economics," I4R Discussion Paper Series 38, The Institute for Replication (I4R).
    10. Luis Alfonso Dau & Grazia D. Santangelo & Arjen Witteloostuijn, 2022. "Replication studies in international business," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 53(2), pages 215-230, March.
    11. Sheen S. Levine & Mark Bernard & Rosemarie Nagel, 2018. "Strategic intelligence: The cognitive capability to anticipate competitor behaviour," Strategic Management Journal, Wiley Blackwell, vol. 39(2), pages 527-527, February.
    12. Athreye, Suma & Kathuria, Vinish & Martelli, Alessandro & Piscitello, Lucia, 2023. "Intellectual property rights and the international transfer of climate change mitigating technologies," Research Policy, Elsevier, vol. 52(9).
    13. Arzi Adbi & Devanshee Shukla, 2023. "Registration at founding and firm performance: Generalization and extension replication from global data," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 54(2), pages 365-384, March.
    14. Maria Minniti & William Bygrave, 2001. "A Dynamic Model of Entrepreneurial Learning," Entrepreneurship Theory and Practice, , vol. 25(3), pages 5-16, April.
    15. Rakesh Sambharya & Martina Musteen, 2014. "Institutional environment and entrepreneurship: An empirical study across countries," Journal of International Entrepreneurship, Springer, vol. 12(4), pages 314-330, December.
    16. Beomjin Choi & T. S. Raghu & Ajay Vinzé & Kevin J. Dooley, 2019. "Effectiveness of standards consortia: Social network perspectives," Information Systems Frontiers, Springer, vol. 21(2), pages 405-416, April.
    17. Zhang, Feng & Jiang, Guohua & Cantwell, John A., 2015. "Subsidiary exploration and the innovative performance of large multinational corporations," International Business Review, Elsevier, vol. 24(2), pages 224-234.
    18. Petersen, Alexander M. & Rotolo, Daniele & Leydesdorff, Loet, 2016. "A triple helix model of medical innovation: Supply, demand, and technological capabilities in terms of Medical Subject Headings," Research Policy, Elsevier, vol. 45(3), pages 666-681.
    19. Pascal Petit, 2010. "Innovation and Services: On Biases and Beyond," Chapters, in: Faïz Gallouj & Faridah Djellal (ed.), The Handbook of Innovation and Services, chapter 17, Edward Elgar Publishing.
    20. Yunyao Li & Yanji Ma, 2022. "Research on Industrial Innovation Efficiency and the Influencing Factors of the Old Industrial Base Based on the Lock-In Effect, a Case Study of Jilin Province, China," Sustainability, MDPI, vol. 14(19), pages 1-23, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:manrev:v:73:y:2023:i:3:d:10.1007_s11301-022-00269-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.