IDEAS home Printed from https://ideas.repec.org/p/ecl/ohidic/2019-21.html

Reusing Natural Experiments

Author

Listed:
  • Heath, Davidson

    (University of Utah David Eccles School of Business)

  • Ringgenberg, Matthew C.

    (University of Utah - Department of Finance)

  • Samadi, Mehrdad

    (Southern Methodist University (SMU) - Finance Department)

  • Werner, Ingrid M.

    (The Ohio State University - Fisher College of Business)

Abstract

Natural experiments are used in empirical research to make causal inferences. After a natural experiment is first used, other researchers often reuse the setting, examining different outcomes based on causal chain arguments. Using simulation evidence combined with two extensively studied natural experiments, business combination laws and the Regulation SHO pilot, we show that the repeated use of a natural experiment significantly increases the likelihood of false discoveries. To correct this, we propose multiple testing methods which account for dependence across tests and we show evidence of their efficacy.

Suggested Citation

  • Heath, Davidson & Ringgenberg, Matthew C. & Samadi, Mehrdad & Werner, Ingrid M., 2019. "Reusing Natural Experiments," Working Paper Series 2019-21, Ohio State University, Charles A. Dice Center for Research in Financial Economics.
    • Handle: RePEc:ecl:ohidic:2019-21
    as

    Download full text from publisher

    File URL: http://ssrn.com/abstract=3457525
    Download Restriction: no
    ---><---

    Other versions of this item:

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chad Brown & Paola Conconi & Aksel Erbahar & Lorenzo Trimarchi, 2020. "Trade Protection Along Supply Chains," Working Papers ECARES 2020-52, ULB -- Universite Libre de Bruxelles.
    2. Chen, Xiaoqi & Chih-Chieh Chris, Hsieh & Tsang, Albert & Xiang, Yi, 2022. "Cross-border enforcement of securities laws and dividend payouts," The British Accounting Review, Elsevier, vol. 54(6).
    3. Cumming, Douglas & Lu, Fanyu & Xu, Limin & Yu, Chia-Feng (Jeffrey), 2025. "Does stakeholder orientation mitigate shareholder-employee conflicts? Evidence from a quasi-natural experiment," Journal of Corporate Finance, Elsevier, vol. 91(C).
    4. Agarwal, Vikas & Cao, Sean Shun & Huang, Shawn & Kim, Min, 2025. "Incentive realignment: Mutual funds' influence on executive compensation contracts," CFR Working Papers 25-08, University of Cologne, Centre for Financial Research (CFR).
    5. Bui, Dien Giau & Hasan, Iftekhar & Lin, Chih-Yung & Nguyen, Hong Thoa, 2023. "Short-selling threats and bank risk-taking: Evidence from the financial crisis," Journal of Banking & Finance, Elsevier, vol. 150(C).
    6. Gong, Rong, 2020. "Short selling threat and corporate financing decisions," Journal of Banking & Finance, Elsevier, vol. 118(C).
    7. Chen, Jie & Su, Xunhua & Tian, Xuan & Xu, Bin, 2022. "Does customer-base structure influence managerial risk-taking incentives?," Journal of Financial Economics, Elsevier, vol. 143(1), pages 462-483.
    8. Merkley, Kenneth & Michaely, Roni & Pacelli, Joseph, 2020. "Cultural diversity on Wall Street: Evidence from consensus earnings forecasts," Journal of Accounting and Economics, Elsevier, vol. 70(1).
    9. Jacobs, Heiko & Lauber, Alexander & Müller, Sebastian, 2025. "Bearish bets and the press: On the relation between short interest and media tone," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 104(C).
    10. Lester, Rebecca & Olbert, Marcel, 2025. "Firms’ real and reporting responses to taxation: A review," Journal of Accounting and Economics, Elsevier, vol. 80(2).
    11. Liu, Zack & Winegar, Adam, 2025. "Economic magnitudes within reason," Journal of Corporate Finance, Elsevier, vol. 91(C).
    12. Guernsey, Scott & Sepe, Simone M. & Serfling, Matthew, 2022. "Blood in the water: The value of antitakeover provisions during market shocks," Journal of Financial Economics, Elsevier, vol. 143(3), pages 1070-1096.
    13. Aepli, Manuel & Kuhn, Andreas & Schweri, Jürg, 2021. "Culture, norms, and the provision of training by employers: Evidence from the Swiss language border," Labour Economics, Elsevier, vol. 73(C).
    14. Leuz, Christian, 2022. "Towards a design-based approach to accounting research," Journal of Accounting and Economics, Elsevier, vol. 74(2).
    15. Nicholas Guest & Jaewoo Kim, 2024. "The media response to a loss of analyst coverage," Review of Accounting Studies, Springer, vol. 29(4), pages 3752-3787, December.
    16. Jonathan Brogaard & Jing Pan, 2022. "Dark Pool Trading and Information Acquisition," The Review of Financial Studies, Society for Financial Studies, vol. 35(5), pages 2625-2666.
    17. Yun Ke & Kin Lo & Jinfei Sheng & Jenny Li Zhang, 2023. "Do investors affect financial analysts’ behavior? Evidence from short sellers," Financial Management, Financial Management Association International, vol. 52(1), pages 199-224, March.
    18. Di Maggio, Marco & Franzoni, Francesco & Massa, Massimo & Tubaldi, Roberto, 2024. "Strategic trading as a response to short sellers," Journal of Financial Markets, Elsevier, vol. 69(C).
    19. Fung, Hung-Gay & Li, Tongxia & Lu, Chun & Wen, Min-Ming, 2025. "The inevitable disclosure doctrine: A facade or a curse in the CEO labor market," Journal of Banking & Finance, Elsevier, vol. 179(C).
    20. Baixiao Liu & John J. McConnell & Andrew Schrowang, 2023. "The Effect of Short-Sale Restrictions on Corporate Managers," JRFM, MDPI, vol. 16(11), pages 1-23, November.
    21. Tianyu Cai & Lixiong Guo & Yongxian Tan, 2024. "Short seller monitoring and real earnings management," The Financial Review, Eastern Finance Association, vol. 59(1), pages 203-225, February.
    22. Matta, Rafael & Rocha, Sergio H. & Vaz, Paulo, 2025. "Short selling and product market competition," Journal of Banking & Finance, Elsevier, vol. 171(C).
    23. Nilabhra Bhattacharya & Theodore E. Christensen & Qunfeng Liao & Bo Ouyang, 2022. "Can short sellers constrain aggressive non-GAAP reporting?," Review of Accounting Studies, Springer, vol. 27(2), pages 391-440, June.

    More about this item

    JEL classification:

    • G1 - Financial Economics - - General Financial Markets
    • G10 - Financial Economics - - General Financial Markets - - - General (includes Measurement and Data)

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ecl:ohidic:2019-21. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/cdohsus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.