IDEAS home Printed from https://ideas.repec.org/a/wly/japmet/v40y2025i6p655-668.html

Prediction Intervals of Panel Data Approach for Programme Evaluation

Author

Listed:
  • Hongyi Jiang
  • Xingyu Li
  • Yan Shen
  • Qiankun Zhou

Abstract

We consider the inference on individual and time specific treatment effects on the treated within the framework of panel data approach for programme evaluation. We formulate the target problem as constructing prediction intervals for high‐dimensional linear regressions with weakly dependent data. Post‐LASSO OLS is used for estimation, while dependent wild bootstrap and simple residual bootstrap are used for the construction of prediction intervals. The proposed prediction intervals are proved to have asymptotic validity as the number of pretreatment times goes to infinity. In the proof, we also establish the model selection consistency of LASSO for dependent data and under bootstrap measure, which may be of independent interest. Monte Carlo experiments illustrate that our method outperforms existing methods in finite samples under a wide variety of data generating processes except nonstationary data. Two empirical applications are also provided.

Suggested Citation

  • Hongyi Jiang & Xingyu Li & Yan Shen & Qiankun Zhou, 2025. "Prediction Intervals of Panel Data Approach for Programme Evaluation," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 40(6), pages 655-668, September.
    • Handle: RePEc:wly:japmet:v:40:y:2025:i:6:p:655-668
    DOI: 10.1002/jae.3134
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/jae.3134
    Download Restriction: no
    File URL: https://libkey.io/10.1002/jae.3134?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Eli Ben-Michael & Avi Feller & Jesse Rothstein, 2021. "The Augmented Synthetic Control Method," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1789-1803, October.
    2. Kathleen T. Li, 2020. "Statistical Inference for Average Treatment Effects Estimated by Synthetic Control Methods," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(532), pages 2068-2083, December.
    3. Shao, Xiaofeng, 2010. "The Dependent Wild Bootstrap," Journal of the American Statistical Association, American Statistical Association, vol. 105(489), pages 218-235.
    4. Victor Chernozhukov & Kaspar Wüthrich & Yinchu Zhu, 2021. "An Exact and Robust Conformal Inference Method for Counterfactual and Synthetic Controls," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1849-1864, October.
    5. Jushan Bai & Serena Ng, 2021. "Matrix Completion, Counterfactuals, and Factor Analysis of Missing Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1746-1763, October.
    6. Alberto Abadie & Javier Gardeazabal, 2003. "The Economic Costs of Conflict: A Case Study of the Basque Country," American Economic Review, American Economic Association, vol. 93(1), pages 113-132, March.
    7. Xu, Yiqing, 2017. "Generalized Synthetic Control Method: Causal Inference with Interactive Fixed Effects Models," Political Analysis, Cambridge University Press, vol. 25(1), pages 57-76, January.
    8. Laurent Gobillon & Thierry Magnac, 2016. "Regional Policy Evaluation: Interactive Fixed Effects and Synthetic Controls," The Review of Economics and Statistics, MIT Press, vol. 98(3), pages 535-551, July.
    9. Matias D. Cattaneo & Yingjie Feng & Rocio Titiunik, 2021. "Prediction Intervals for Synthetic Control Methods," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1865-1880, October.
    10. Ricardo Masini & Marcelo C. Medeiros, 2021. "Counterfactual Analysis With Artificial Controls: Inference, High Dimensions, and Nonstationarity," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1773-1788, October.
    11. Shi, Zhentao & Huang, Jingyi, 2023. "Forward-selected panel data approach for program evaluation," Journal of Econometrics, Elsevier, vol. 234(2), pages 512-535.
    12. Jiafeng Chen, 2023. "Synthetic Control as Online Linear Regression," Econometrica, Econometric Society, vol. 91(2), pages 465-491, March.
    13. Susan Athey & Mohsen Bayati & Nikolay Doudchenko & Guido Imbens & Khashayar Khosravi, 2021. "Matrix Completion Methods for Causal Panel Data Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1716-1730, October.
    14. Javier Gardeazabal & Ainhoa Vega‐Bayo, 2017. "An Empirical Comparison Between the Synthetic Control Method and HSIAO et al.'s Panel Data Approach to Program Evaluation," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(5), pages 983-1002, August.
    15. Li, Kathleen T. & Bell, David R., 2017. "Estimation of average treatment effects with panel data: Asymptotic theory and implementation," Journal of Econometrics, Elsevier, vol. 197(1), pages 65-75.
    16. Chatterjee, A. & Lahiri, S. N., 2011. "Bootstrapping Lasso Estimators," Journal of the American Statistical Association, American Statistical Association, vol. 106(494), pages 608-625.
    17. Alberto Abadie, 2021. "Using Synthetic Controls: Feasibility, Data Requirements, and Methodological Aspects," Journal of Economic Literature, American Economic Association, vol. 59(2), pages 391-425, June.
    18. Jianqing Fan & Ricardo Masini & Marcelo C. Medeiros, 2022. "Do We Exploit all Information for Counterfactual Analysis? Benefits of Factor Models and Idiosyncratic Correction," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 117(538), pages 574-590, April.
    19. Abadie, Alberto & Diamond, Alexis & Hainmueller, Jens, 2010. "Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California’s Tobacco Control Program," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 493-505.
    20. Li, Xingyu & Shen, Yan & Zhou, Qiankun, 2024. "Confidence intervals of treatment effects in panel data models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 240(1).
    21. Fujiki, Hiroshi & Hsiao, Cheng, 2015. "Disentangling the effects of multiple treatments—Measuring the net economic impact of the 1995 great Hanshin-Awaji earthquake," Journal of Econometrics, Elsevier, vol. 186(1), pages 66-73.
    22. Cheng Hsiao & Qiankun Zhou, 2019. "Panel parametric, semiparametric, and nonparametric construction of counterfactuals," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(4), pages 463-481, June.
    23. Alberto Abadie & Jérémy L’Hour, 2021. "A Penalized Synthetic Control Estimator for Disaggregated Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1817-1834, October.
    24. Maxwell Kellogg & Magne Mogstad & Guillaume A. Pouliot & Alexander Torgovitsky, 2021. "Combining Matching and Synthetic Control to Tradeoff Biases From Extrapolation and Interpolation," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1804-1816, October.
    25. Eli Ben‐Michael & Avi Feller & Jesse Rothstein, 2022. "Synthetic controls with staggered adoption," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(2), pages 351-381, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Li, Xingyu & Shen, Yan & Zhou, Qiankun, 2024. "Confidence intervals of treatment effects in panel data models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 240(1).
    2. Taehyeon Koo & Zijian Guo, 2025. "Distributionally Robust Synthetic Control: Ensuring Robustness Against Highly Correlated Controls and Weight Shifts," Papers 2511.02632, arXiv.org, revised Jan 2026.
    3. David Gilchrist & Thomas Emery & Nuno Garoupa & Rok Spruk, 2023. "Synthetic Control Method: A tool for comparative case studies in economic history," Journal of Economic Surveys, Wiley Blackwell, vol. 37(2), pages 409-445, April.
    4. Zongwu Cai & Ying Fang & Ming Lin & Zixuan Wu, 2023. "A Quasi Synthetic Control Method for Nonlinear Models With High-Dimensional Covariates," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202305, University of Kansas, Department of Economics, revised Aug 2023.
    5. Rong J. B. Zhu, 2023. "Synthetic Regressing Control," Papers 2306.02584, arXiv.org, revised Jan 2026.
    6. Dennis Shen & Peng Ding & Jasjeet Sekhon & Bin Yu, 2022. "Same Root Different Leaves: Time Series and Cross-Sectional Methods in Panel Data," Papers 2207.14481, arXiv.org, revised Oct 2022.
    7. Zhentao Shi & Jin Xi & Haitian Xie, 2025. "A Synthetic Business Cycle Approach to Counterfactual Analysis with Nonstationary Macroeconomic Data," Papers 2505.22388, arXiv.org.
    8. Roberta Di Stefano & Giovanni Mellace, 2020. "The inclusive synthetic control method," Working Papers 21/20, Sapienza University of Rome, DISS.
    9. Dmitry Arkhangelsky & Guido Imbens, 2023. "Causal Models for Longitudinal and Panel Data: A Survey," Papers 2311.15458, arXiv.org, revised Jun 2024.
    10. Luis Costa & Vivek F. Farias & Patricio Foncea & Jingyuan (Donna) Gan & Ayush Garg & Ivo Rosa Montenegro & Kumarjit Pathak & Tianyi Peng & Dusan Popovic, 2023. "Generalized Synthetic Control for TestOps at ABI: Models, Algorithms, and Infrastructure," Interfaces, INFORMS, vol. 53(5), pages 336-349, September.
    11. Garoupa, Nuno & Spruk, Rok, 2025. "Populist constitutional backsliding and judicial independence: Evidence from Türkiye," International Review of Law and Economics, Elsevier, vol. 84(C).
    12. Chen, Qiang & Xiao, Zhijie & Yao, Qingsong, 2025. "Quantile control via random forest," Journal of Econometrics, Elsevier, vol. 249(PA).
    13. Michael Funke & Helery Tasane, 2025. "Regional economic impacts of the Øresund cross-border fixed link: Cui Bono?," Regional Studies, Taylor & Francis Journals, vol. 59(1), pages 2573115-257, December.
    14. Callaway, Brantly & Karami, Sonia, 2023. "Treatment effects in interactive fixed effects models with a small number of time periods," Journal of Econometrics, Elsevier, vol. 233(1), pages 184-208.
    15. Anish Agarwal & Devavrat Shah & Dennis Shen, 2026. "Synthetic Interventions: Extending Synthetic Controls to Multiple Treatments," Operations Research, INFORMS, vol. 74(2), pages 840-859, March.
    16. Matias D. Cattaneo & Yingjie Feng & Filippo Palomba & Rocio Titiunik, 2022. "scpi: Uncertainty Quantification for Synthetic Control Methods," Papers 2202.05984, arXiv.org, revised Oct 2022.
    17. Viviano, Davide & Bradic, Jelena, 2023. "Synthetic Learner: Model-free inference on treatments over time," Journal of Econometrics, Elsevier, vol. 234(2), pages 691-713.
    18. Andrii Melnychuk, 2024. "Synthetic Controls with spillover effects: A comparative study," Papers 2405.01645, arXiv.org.
    19. Tomasz Serwach, 2022. "The European Union and within-country income inequalities. The case of the New Member States," Working Papers hal-03548416, HAL.
    20. Joe Maganga Zonda & Chang-Ching Lin & Ming-Jen Chang, 2024. "On the economic costs of political instabilities: a tale of sub-Saharan Africa," Empirical Economics, Springer, vol. 66(1), pages 137-173, January.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:japmet:v:40:y:2025:i:6:p:655-668. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.interscience.wiley.com/jpages/0883-7252/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.