IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2609.13586.html

Synthetic Nearest Neighbors: Extending Synthetic Controls for Matrix Completion with Missing Not at Random Data

Author

Listed:
  • Anish Agarwal
  • Munther Dahleh
  • Devavrat Shah
  • Dennis Shen

Abstract

We develop a causal framework for matrix completion under missing not at random (MNAR) data. Drawing on synthetic controls from the econometric panel data literature, our approach relaxes two assumptions common in MNAR matrix completion: positivity and independence of observation indicators. Unlike traditional panel data models, which often require prescribed block-sparse geometries, our framework accommodates flexible, heterogeneous observation patterns through target-specific local information structures. We propose synthetic nearest neighbors (SNN), a local synthetic-controls-inspired estimator, and establish finite-sample entrywise error bounds and consistency for mean recovery under suitable conditions. We further derive asymptotic normality under heteroskedastic noise and develop feasible entrywise inference. To estimate entry-specific noise variances, we apply the same local principle to squared outcomes, obtaining consistency under bounded noise and asymptotic unbiasedness under general subgaussian noise. Simulation studies corroborate the theoretical findings across a range of missingness designs and observation patterns.

Suggested Citation

  • Anish Agarwal & Munther Dahleh & Devavrat Shah & Dennis Shen, 2026. "Synthetic Nearest Neighbors: Extending Synthetic Controls for Matrix Completion with Missing Not at Random Data," Papers 2609.13586, arXiv.org.
  • Handle: RePEc:arx:papers:2609.13586
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2609.13586
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Hugo Freeman & Martin Weidner, 2021. "Low-rank approximations of nonseparable panel models," The Econometrics Journal, Royal Economic Society, vol. 24(2), pages 40-77.
    2. Dennis Shen & Peng Ding & Jasjeet Sekhon & Bin Yu, 2023. "Same Root Different Leaves: Time Series and Cross‐Sectional Methods in Panel Data," Econometrica, Econometric Society, vol. 91(6), pages 2125-2154, November.
    3. Muhummad Amjad & Vishal Misra & Devavrat Shah & Dennis Shen, 2019. "mRSC: Multi-dimensional Robust Synthetic Control," Papers 1905.06400, arXiv.org, revised Sep 2019.
    4. Dennis Shen, 2026. "From Control to Treatment: Causal Forecasting Beyond the Observed Panel," Papers 2606.18512, arXiv.org, revised Aug 2026.
    5. Abadie, Alberto & Diamond, Alexis & Hainmueller, Jens, 2010. "Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California’s Tobacco Control Program," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 493-505.
    6. Imbens,Guido W. & Rubin,Donald B., 2015. "Causal Inference for Statistics, Social, and Biomedical Sciences," Cambridge Books, Cambridge University Press, number 9780521885881, June.
    7. Chamberlain, Gary & Rothschild, Michael, 1983. "Arbitrage, Factor Structure, and Mean-Variance Analysis on Large Asset Markets," Econometrica, Econometric Society, vol. 51(5), pages 1281-1304, September.
    8. Anish Agarwal & Devavrat Shah & Dennis Shen & Dogyoon Song, 2021. "On Robustness of Principal Component Regression," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1731-1745, October.
    9. Jushan Bai & Serena Ng, 2021. "Matrix Completion, Counterfactuals, and Factor Analysis of Missing Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1746-1763, October.
    10. Cahan, Ercument & Bai, Jushan & Ng, Serena, 2023. "Factor-based imputation of missing values and covariances in panel data of large dimensions," Journal of Econometrics, Elsevier, vol. 233(1), pages 113-131.
    11. Anish Agarwal & Munther Dahleh & Devavrat Shah & Dennis Shen, 2021. "Causal Matrix Completion," Papers 2109.15154, arXiv.org.
    12. Yuling Yan & Martin J. Wainwright, 2024. "Entrywise Inference for Missing Panel Data: A Simple and Instance-Optimal Approach," Papers 2401.13665, arXiv.org, revised Jul 2024.
    13. Lihua Lei & Brad Ross, 2023. "Estimating Counterfactual Matrix Means with Short Panel Data," Papers 2312.07520, arXiv.org, revised Dec 2025.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dennis Shen, 2026. "From Control to Treatment: Causal Forecasting Beyond the Observed Panel," Papers 2606.18512, arXiv.org, revised Aug 2026.
    2. Anish Agarwal & Devavrat Shah & Dennis Shen, 2026. "Synthetic Interventions: Extending Synthetic Controls to Multiple Treatments," Operations Research, INFORMS, vol. 74(2), pages 840-859, March.
    3. Anish Agarwal & Munther Dahleh & Devavrat Shah & Dennis Shen, 2021. "Causal Matrix Completion," Papers 2109.15154, arXiv.org.
    4. Dennis Shen & Peng Ding & Jasjeet Sekhon & Bin Yu, 2022. "Same Root Different Leaves: Time Series and Cross-Sectional Methods in Panel Data," Papers 2207.14481, arXiv.org, revised Oct 2022.
    5. Alberto Abadie & Anish Agarwal & Raaz Dwivedi & Abhin Shah, 2024. "Doubly Robust Inference in Causal Latent Factor Models," Papers 2402.11652, arXiv.org, revised Oct 2024.
    6. Anish Agarwal & Keegan Harris & Justin Whitehouse & Zhiwei Steven Wu, 2023. "Adaptive Principal Component Regression with Applications to Panel Data," Papers 2307.01357, arXiv.org, revised Aug 2024.
    7. Anish Agarwal & Sukjin Han & Dwaipayan Saha & Vasilis Syrgkanis & Haeyeon Yoon, 2026. "Synthetic Blips: Generalizing Synthetic Controls for Dynamic Treatment Effects," Bristol Economics Discussion Papers 26/834, School of Economics, University of Bristol, UK.
    8. Taehyeon Koo & Zijian Guo, 2025. "Synthetic Control with Weight Uncertainty: Robust Identification and Statistical Inference," Papers 2511.02632, arXiv.org, revised Aug 2026.
    9. Anish Agarwal & Sukjin Han & Dwaipayan Saha & Vasilis Syrgkanis & Haeyeon Yoon, 2022. "Synthetic Blips: Generalizing Synthetic Controls for Dynamic Treatment Effects," Papers 2210.11003, arXiv.org, revised Sep 2026.
    10. Zhentao Shi & Jin Xi & Haitian Xie, 2025. "A Synthetic Business Cycle Approach to Counterfactual Analysis with Nonstationary Macroeconomic Data," Papers 2505.22388, arXiv.org.
    11. Choi, Jungjun & Kwon, Hyukjun & Liao, Yuan, 2024. "Inference for low-rank completion without sample splitting with application to treatment effect estimation," Journal of Econometrics, Elsevier, vol. 240(1).
    12. Dmitry Arkhangelsky & Guido Imbens, 2023. "Causal Models for Longitudinal and Panel Data: A Survey," Papers 2311.15458, arXiv.org, revised Jun 2024.
    13. Ruei-Chi Lee, 2026. "Average Treatment Effect Localization: Projection Methods in Synthetic Control," Papers 2609.10617, arXiv.org.
    14. Retsef Levi & Elisabeth Paulson & Georgia Perakis & Emily Zhang, 2024. "Heterogeneous Treatment Effects in Panel Data," Papers 2406.05633, arXiv.org.
    15. Anish Agarwal & Devavrat Shah & Dennis Shen, 2020. "Synthetic Interventions," Papers 2006.07691, arXiv.org, revised Aug 2024.
    16. Roy Cerqueti & Raffaella Coppier & Alessandro Girardi & Marco Ventura, 2022. "The sooner the better: lives saved by the lockdown during the COVID-19 outbreak. The case of Italy," The Econometrics Journal, Royal Economic Society, vol. 25(1), pages 46-70.
    17. Luis Costa & Vivek F. Farias & Patricio Foncea & Jingyuan (Donna) Gan & Ayush Garg & Ivo Rosa Montenegro & Kumarjit Pathak & Tianyi Peng & Dusan Popovic, 2023. "Generalized Synthetic Control for TestOps at ABI: Models, Algorithms, and Infrastructure," Interfaces, INFORMS, vol. 53(5), pages 336-349, September.
    18. Bernardo García Bulle & Dennis Shen & Devavrat Shah & Anette E. Hosoi, 2022. "Public health implications of opening National Football League stadiums during the COVID-19 pandemic," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 119(14), pages 2114226119-, April.
    19. Jungjun Choi & Ming Yuan, 2023. "Matrix Completion When Missing Is Not at Random and Its Applications in Causal Panel Data Models," Papers 2308.02364, arXiv.org.
    20. Brown, Nicholas L. & Butts, Kyle, 2025. "Dynamic treatment effect estimation with interactive fixed effects and short panels," Journal of Econometrics, Elsevier, vol. 250(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2609.13586. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.