IDEAS home Printed from https://ideas.repec.org/a/wly/quante/v14y2023i1p37-70.html
   My bibliography  Save this article

Permutation‐based tests for discontinuities in event studies

Author

Listed:
  • Federico A. Bugni
  • Jia Li
  • Qiyuan Li

Abstract

We propose using a permutation test to detect discontinuities in an underlying economic model at a known cutoff point. Relative to the existing literature, we show that this test is well suited for event studies based on time‐series data. The test statistic measures the distance between the empirical distribution functions of observed data in two local subsamples on the two sides of the cutoff. Critical values are computed via a standard permutation algorithm. Under a high‐level condition that the observed data can be coupled by a collection of conditionally independent variables, we establish the asymptotic validity of the permutation test, allowing the sizes of the local subsamples to be either be fixed or grow to infinity. In the latter case, we also establish that the permutation test is consistent. We demonstrate that our high‐level condition can be verified in a broad range of problems in the infill asymptotic time‐series setting, which justifies using the permutation test to detect jumps in economic variables such as volatility, trading activity, and liquidity. These potential applications are illustrated in an empirical case study for selected FOMC announcements during the ongoing COVID‐19 pandemic.

Suggested Citation

  • Federico A. Bugni & Jia Li & Qiyuan Li, 2023. "Permutation‐based tests for discontinuities in event studies," Quantitative Economics, Econometric Society, vol. 14(1), pages 37-70, January.
  • Handle: RePEc:wly:quante:v:14:y:2023:i:1:p:37-70
    DOI: 10.3982/QE1775
    as

    Download full text from publisher

    File URL: https://doi.org/10.3982/QE1775
    Download Restriction: no

    File URL: https://libkey.io/10.3982/QE1775?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Lajos Horváth & Gregory Rice, 2014. "Extensions of some classical methods in change point analysis," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 23(2), pages 219-255, June.
    2. Ole E. Barndorff-Nielsen & Neil Shephard, 2006. "Econometrics of Testing for Jumps in Financial Economics Using Bipower Variation," The Journal of Financial Econometrics, Society for Financial Econometrics, vol. 4(1), pages 1-30.
    3. Ivan A. Canay & Vishal Kamat, 2017. "Approximate permutation tests and induced order statistics in the regression discontinuity design," CeMMAP working papers 21/17, Institute for Fiscal Studies.
    4. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    5. Davidson, James, 1994. "Stochastic Limit Theory: An Introduction for Econometricians," OUP Catalogue, Oxford University Press, number 9780198774037.
    6. Cyrus J. DiCiccio & Joseph P. Romano, 2017. "Robust Permutation Tests For Correlation And Regression Coefficients," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(519), pages 1211-1220, July.
    7. Antoch, Jaromír & Husková, Marie, 2001. "Permutation tests in change point analysis," Statistics & Probability Letters, Elsevier, vol. 53(1), pages 37-46, May.
    8. Jushan Bai & Pierre Perron, 1998. "Estimating and Testing Linear Models with Multiple Structural Changes," Econometrica, Econometric Society, vol. 66(1), pages 47-78, January.
    9. Andrews, Donald W K, 1993. "Tests for Parameter Instability and Structural Change with Unknown Change Point," Econometrica, Econometric Society, vol. 61(4), pages 821-856, July.
    10. Ivan A Canay & Vishal Kamat, 2018. "Approximate Permutation Tests and Induced Order Statistics in the Regression Discontinuity Design," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 85(3), pages 1577-1608.
    11. Victor Chernozhukov & Kaspar Wüthrich & Yinchu Zhu, 2018. "Exact and robust conformal inference methods for predictive machine learning with dependent data," CeMMAP working papers CWP16/18, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    12. Imbens, Guido W. & Lemieux, Thomas, 2008. "Regression discontinuity designs: A guide to practice," Journal of Econometrics, Elsevier, vol. 142(2), pages 615-635, February.
    13. Tim Bollerslev & Viktor Todorov, 2011. "Estimation of Jump Tails," Econometrica, Econometric Society, vol. 79(6), pages 1727-1783, November.
    14. Tim Bollerslev & Jia Li & Yuan Xue, 2018. "Volume, Volatility, and Public News Announcements," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 85(4), pages 2005-2041.
    15. Foster, Dean P & Nelson, Daniel B, 1996. "Continuous Record Asymptotics for Rolling Sample Variance Estimators," Econometrica, Econometric Society, vol. 64(1), pages 139-174, January.
    16. Burt S. Barnow & Matias D. Cattaneo & Rocío Titiunik & Gonzalo Vazquez‐Bare, 2017. "Comparing Inference Approaches for RD Designs: A Reexamination of the Effect of Head Start on Child Mortality," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 36(3), pages 643-681, June.
    17. Hahn, Jinyong & Todd, Petra & Van der Klaauw, Wilbert, 2001. "Identification and Estimation of Treatment Effects with a Regression-Discontinuity Design," Econometrica, Econometric Society, vol. 69(1), pages 201-209, January.
    18. Lajos Horváth & Gregory Rice, 2014. "Rejoinder on: Extensions of some classical methods in change point analysis," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 23(2), pages 287-290, June.
    19. Andersen, Torben G, 1996. "Return Volatility and Trading Volume: An Information Flow Interpretation of Stochastic Volatility," Journal of Finance, American Finance Association, vol. 51(1), pages 169-204, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Federico A. Bugni & Jia Li & Qiyuan Li, 2020. "Permutation-based tests for discontinuities in event studies," Papers 2007.09837, arXiv.org, revised Jul 2022.
    2. Bugni, Federico A. & Canay, Ivan A., 2021. "Testing continuity of a density via g-order statistics in the regression discontinuity design," Journal of Econometrics, Elsevier, vol. 221(1), pages 138-159.
    3. Matias D. Cattaneo & Rocío Titiunik, 2022. "Regression Discontinuity Designs," Annual Review of Economics, Annual Reviews, vol. 14(1), pages 821-851, August.
    4. Atı̇la Abdulkadı̇roğlu & Joshua D. Angrist & Yusuke Narita & Parag Pathak, 2022. "Breaking Ties: Regression Discontinuity Design Meets Market Design," Econometrica, Econometric Society, vol. 90(1), pages 117-151, January.
    5. Sebastian Calonico & Matias D Cattaneo & Max H Farrell, 2020. "Optimal bandwidth choice for robust bias-corrected inference in regression discontinuity designs [Econometric methods for program evaluation]," The Econometrics Journal, Royal Economic Society, vol. 23(2), pages 192-210.
    6. Sebastian Calonico & Matias D. Cattaneo & Max H. Farrell & Rocío Titiunik, 2019. "Regression Discontinuity Designs Using Covariates," The Review of Economics and Statistics, MIT Press, vol. 101(3), pages 442-451, July.
    7. Ari Hyytinen & Jaakko Meriläinen & Tuukka Saarimaa & Otto Toivanen & Janne Tukiainen, 2018. "When does regression discontinuity design work? Evidence from random election outcomes," Quantitative Economics, Econometric Society, vol. 9(2), pages 1019-1051, July.
    8. Crespo Cristian, 2020. "Beyond Manipulation: Administrative Sorting in Regression Discontinuity Designs," Journal of Causal Inference, De Gruyter, vol. 8(1), pages 164-181, January.
    9. Babii, Andrii & Kumar, Rohit, 2023. "Isotonic regression discontinuity designs," Journal of Econometrics, Elsevier, vol. 234(2), pages 371-393.
    10. Matias D. Cattaneo & Luke Keele & Rocío Titiunik & Gonzalo Vazquez-Bare, 2021. "Extrapolating Treatment Effects in Multi-Cutoff Regression Discontinuity Designs," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1941-1952, October.
    11. Yu, Ping & Phillips, Peter C.B., 2018. "Threshold regression with endogeneity," Journal of Econometrics, Elsevier, vol. 203(1), pages 50-68.
    12. Blaise Melly & Rafael Lalive, 2020. "Estimation, Inference, and Interpretation in the Regression Discontinuity Design," Diskussionsschriften dp2016, Universitaet Bern, Departement Volkswirtschaft.
    13. Kettlewell, Nathan & Siminski, Peter, 2020. "Optimal Model Selection in RDD and Related Settings Using Placebo Zones," IZA Discussion Papers 13639, Institute of Labor Economics (IZA).
    14. Yoichi Arai & Yu‐Chin Hsu & Toru Kitagawa & Ismael Mourifié & Yuanyuan Wan, 2022. "Testing identifying assumptions in fuzzy regression discontinuity designs," Quantitative Economics, Econometric Society, vol. 13(1), pages 1-28, January.
    15. Porter, Jack & Yu, Ping, 2015. "Regression discontinuity designs with unknown discontinuity points: Testing and estimation," Journal of Econometrics, Elsevier, vol. 189(1), pages 132-147.
    16. Donna Feir & Thomas Lemieux & Vadim Marmer, 2016. "Weak Identification in Fuzzy Regression Discontinuity Designs," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(2), pages 185-196, April.
    17. Crespo Cristian, 2020. "Beyond Manipulation: Administrative Sorting in Regression Discontinuity Designs," Journal of Causal Inference, De Gruyter, vol. 8(1), pages 164-181, January.
    18. SeungHoon Han & Hosung Sohn, 2023. "The short-term effects of fixed copayment policy on elderly health spending and service utilization: evidence from South Korea’s age-based policy using exact date of birth," International Journal of Health Economics and Management, Springer, vol. 23(2), pages 255-279, June.
    19. Masayuki Sawada & Takuya Ishihara & Daisuke Kurisu & Yasumasa Matsuda, 2024. "Local-Polynomial Estimation for Multivariate Regression Discontinuity Designs," Papers 2402.08941, arXiv.org.
    20. Horváth, Lajos & Rice, Gregory & Zhao, Yuqian, 2023. "Testing for changes in linear models using weighted residuals," Journal of Multivariate Analysis, Elsevier, vol. 198(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:quante:v:14:y:2023:i:1:p:37-70. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/essssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.