IDEAS home Printed from https://ideas.repec.org/a/eee/pacfin/v86y2024ics0927538x24002051.html
   My bibliography  Save this article

Understanding researchers' perceptions and experiences in finance research replication studies: A pre-registered report

Author

Listed:
  • Chai, Daniel
  • Ali, Searat
  • Brosnan, Mark
  • Hasso, Tim

Abstract

A fundamental principle of responsible scientific research is replication. Replication provides independent verification of previously reported findings and improves our understanding of observed phenomena by removing researcher bias, strengthening existing evidence and questioning past conclusions. Replication is an essential component of the self-correcting nature of science but, for too long the scientific community has overlooked the benefits of replication due to its perceived lack of novelty. However, a shift in attitudes has been making its way through various scientific disciplines, with finance now having its turn. In this study we survey the authors of Pacific-Basin Finance Journal replication studies to explore their motivations, experiences and seek their feedback on the specific process utilized by the journal to undertake the important task of facilitating the publication of replications.

Suggested Citation

  • Chai, Daniel & Ali, Searat & Brosnan, Mark & Hasso, Tim, 2024. "Understanding researchers' perceptions and experiences in finance research replication studies: A pre-registered report," Pacific-Basin Finance Journal, Elsevier, vol. 86(C).
    • Handle: RePEc:eee:pacfin:v:86:y:2024:i:c:s0927538x24002051
    DOI: 10.1016/j.pacfin.2024.102454
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0927538X24002051
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.pacfin.2024.102454?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Robert W. Faff & Tom Smith, 2015. "A simple template for pitching research," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 55(2), pages 311-336, June.
    2. Fišar, Miloš & Greiner, Ben & Huber, Christoph & Katok, Elena & Ozkes, Ali & Management Science Reproducibility Collaboration, 2023. "Reproducibility in Management Science," Department for Strategy and Innovation Working Paper Series 03/2023, WU Vienna University of Economics and Business.
    3. Daniel S. Hamermesh, 2007. "Viewpoint: Replication in economics," Canadian Journal of Economics, Canadian Economics Association, vol. 40(3), pages 715-733, August.
    4. Borthwick, James & Ali, Searat & Pan, Xiaofei, 2020. "Does policy uncertainty influence mergers and acquisitions activities in China? A replication study," Pacific-Basin Finance Journal, Elsevier, vol. 62(C).
    5. Welch, Ivo, 2019. "Reproducing, Extending, Updating, Replicating, Reexamining, and Reconciling," Critical Finance Review, now publishers, vol. 8(1-2), pages 301-304, December.
    6. Hamermesh, Daniel S., 2007. "Replication in Economics," IZA Discussion Papers 2760, Institute of Labor Economics (IZA).
    7. Campbell R. Harvey, 2017. "Presidential Address: The Scientific Outlook in Financial Economics," Journal of Finance, American Finance Association, vol. 72(4), pages 1399-1440, August.
    8. Chai, Daniel & Chiah, Mardy & Zhong, Angel, 2019. "Choosing factors: Australian evidence," Pacific-Basin Finance Journal, Elsevier, vol. 58(C).
    9. Uncles, Mark D. & Kwok, Simon, 2013. "Designing research with in-built differentiated replication," Journal of Business Research, Elsevier, vol. 66(9), pages 1398-1405.
    10. Dewald, William G & Thursby, Jerry G & Anderson, Richard G, 1986. "Replication in Empirical Economics: The Journal of Money, Credit and Banking Project," American Economic Review, American Economic Association, vol. 76(4), pages 587-603, September.
    11. Kewei Hou & Chen Xue & Lu Zhang, 2020. "Replicating Anomalies," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2019-2133.
    12. Pierre Berthon & Leyland Pitt & Michael Ewing & Christopher L. Carr, 2002. "Potential Research Space in MIS: A Framework for Envisioning and Evaluating Research Replication, Extension, and Generation," Information Systems Research, INFORMS, vol. 13(4), pages 416-427, December.
    13. Jan Ditzen & J. Paul Elhorst, 2022. "Introducing the Replication Studies section," Spatial Economic Analysis, Taylor & Francis Journals, vol. 17(1), pages 7-9, January.
    14. Luis Alfonso Dau & Grazia D. Santangelo & Arjen Witteloostuijn, 2022. "Replication studies in international business," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 53(2), pages 215-230, March.
    15. Ryan, James C. & A Tipu, Syed A., 2022. "Business and management research: Low instances of replication studies and a lack of author independence in replications," Research Policy, Elsevier, vol. 51(1).
    16. Monya Baker, 2016. "1,500 scientists lift the lid on reproducibility," Nature, Nature, vol. 533(7604), pages 452-454, May.
    17. Harvey, Campbell R., 2019. "Editorial: Replication in Financial Economics," Critical Finance Review, now publishers, vol. 8(1-2), pages 1-9, December.
    18. Luzi Hail & Mark Lang & Christian Leuz, 2020. "Reproducibility in Accounting Research: Views of the Research Community," Journal of Accounting Research, Wiley Blackwell, vol. 58(2), pages 519-543, May.
    19. Richard A. Bettis, 2012. "The search for asterisks: Compromised statistical tests and flawed theories," Strategic Management Journal, Wiley Blackwell, vol. 33(1), pages 108-113, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
    2. Fišar, Miloš & Greiner, Ben & Huber, Christoph & Katok, Elena & Ozkes, Ali & Collaboration, Management Science Reproducibility, 2023. "Reproducibility in Management Science," OSF Preprints mydzv_v1, Center for Open Science.
    3. Mueller-Langer, Frank & Fecher, Benedikt & Harhoff, Dietmar & Wagner, Gert G., 2019. "Replication studies in economics—How many and which papers are chosen for replication, and why?," Research Policy, Elsevier, vol. 48(1), pages 62-83.
    4. Fišar, Miloš & Greiner, Ben & Huber, Christoph & Katok, Elena & Ozkes, Ali & Management Science Reproducibility Collaboration, 2023. "Reproducibility in Management Science," Department for Strategy and Innovation Working Paper Series 03/2023, WU Vienna University of Economics and Business.
    5. Johnstone, David, 2022. "Accounting research and the significance test crisis," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 89(C).
    6. Hussinger, Katrin & Pellens, Maikel, 2019. "Guilt by association: How scientific misconduct harms prior collaborators," Research Policy, Elsevier, vol. 48(2), pages 516-530.
    7. Annette N. Brown & Drew B. Cameron & Benjamin D. K. Wood, 2014. "Quality evidence for policymaking: I'll believe it when I see the replication," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 6(3), pages 215-235, September.
    8. Nick Huntington‐Klein & Andreu Arenas & Emily Beam & Marco Bertoni & Jeffrey R. Bloem & Pralhad Burli & Naibin Chen & Paul Grieco & Godwin Ekpe & Todd Pugatch & Martin Saavedra & Yaniv Stopnitzky, 2021. "The influence of hidden researcher decisions in applied microeconomics," Economic Inquiry, Western Economic Association International, vol. 59(3), pages 944-960, July.
    9. Robert A. Moffitt, 2011. "Report of the Editor: American Economic Review (with Appendix by Philip J. Glandon)," American Economic Review, American Economic Association, vol. 101(3), pages 684-693, May.
    10. Hensel, Przemysław G., 2019. "Supporting replication research in management journals: Qualitative analysis of editorials published between 1970 and 2015," European Management Journal, Elsevier, vol. 37(1), pages 45-57.
    11. Vitor Azevedo & Christopher Hoegner, 2023. "Enhancing stock market anomalies with machine learning," Review of Quantitative Finance and Accounting, Springer, vol. 60(1), pages 195-230, January.
    12. Anna Dreber & Magnus Johannesson, 2025. "A framework for evaluating reproducibility and replicability in economics," Economic Inquiry, Western Economic Association International, vol. 63(2), pages 338-356, April.
    13. Mark J. McCabe & Frank Mueller-Langer, 2019. "Does Data Disclosure Increase Citations? Empirical Evidence from a Natural Experiment in Leading Economics Journals," JRC Working Papers on Digital Economy 2019-02, Joint Research Centre.
    14. Klaus Grobys, 2021. "When the blockchain does not block: on hackings and uncertainty in the cryptocurrency market," Quantitative Finance, Taylor & Francis Journals, vol. 21(8), pages 1267-1279, August.
    15. Fieberg, Christian & Günther, Steffen & Poddig, Thorsten & Zaremba, Adam, 2024. "Non-standard errors in the cryptocurrency world," International Review of Financial Analysis, Elsevier, vol. 92(C).
    16. Maren Duvendack & Richard Palmer-Jones & W. Robert Reed, 2017. "What Is Meant by "Replication" and Why Does It Encounter Resistance in Economics?," American Economic Review, American Economic Association, vol. 107(5), pages 46-51, May.
    17. Nicolas Vallois & Dorian Jullien, 2017. "Replication in experimental economics: A historical and quantitative approach focused on public good game experiments," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-01651080, HAL.
    18. Kiri, Bralind & Lacetera, Nicola & Zirulia, Lorenzo, 2018. "Above a swamp: A theory of high-quality scientific production," Research Policy, Elsevier, vol. 47(5), pages 827-839.
    19. Grobys, Klaus, 2021. "What do we know about the second moment of financial markets?," International Review of Financial Analysis, Elsevier, vol. 78(C).
    20. Andrew Y. Chen & Tom Zimmermann, 2022. "Publication Bias in Asset Pricing Research," Papers 2209.13623, arXiv.org, revised Sep 2023.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:pacfin:v:86:y:2024:i:c:s0927538x24002051. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/pacfin .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.