IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2605.18448.html

Fixed-order PCA: Theory for Overestimated Factor Models

Author

Listed:
  • Yuan Liao
  • Xin Tong
  • Wanjie Wang
  • Dacheng Xiu

Abstract

We develop asymptotic theory for principal component analysis (PCA) of a high-dimensional factor model in which the working dimension $R$ is fixed and only required to satisfy $R \ge r$, where $r$ is the true number of factors. Building on anisotropic local laws from random matrix theory, we show that the ``extra'' empirical eigencomponents beyond the $r$-th are asymptotically noise-governed, incoherent, and nearly orthogonal to the factor loadings. We introduce two rotations, an expanded $r\times R$ map $H'$ and a compressed $R\times r$ map $H^{+}$, and establish consistency of the estimated factors under both. As an application, we analyze a factor-augmented regression for treatment-effect inference and prove $\sqrt{T}$-asymptotic normality for every fixed $R \ge r$. These results provide a theoretical underpinning for the common empirical practice of adopting a conservative upper bound on the number of factors, and shift the analytical burden from consistent dimension selection to the milder requirement of bounding $r$ from above.

Suggested Citation

  • Yuan Liao & Xin Tong & Wanjie Wang & Dacheng Xiu, 2026. "Fixed-order PCA: Theory for Overestimated Factor Models," Papers 2605.18448, arXiv.org.
  • Handle: RePEc:arx:papers:2605.18448
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2605.18448
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jianqing Fan & Kunpeng Li & Yuan Liao, 2021. "Recent Developments in Factor Models and Applications in Econometric Learning," Annual Review of Financial Economics, Annual Reviews, vol. 13(1), pages 401-430, November.
    2. Hyungsik Roger Moon & Martin Weidner, 2015. "Linear Regression for Panel With Unknown Number of Factors as Interactive Fixed Effects," Econometrica, Econometric Society, vol. 83(4), pages 1543-1579, July.
    3. Freyaldenhoven, Simon, 2022. "Factor models with local factors — Determining the number of relevant factors," Journal of Econometrics, Elsevier, vol. 229(1), pages 80-102.
    4. Coe, Norma B. & Zamarro, Gema, 2011. "Retirement effects on health in Europe," Journal of Health Economics, Elsevier, vol. 30(1), pages 77-86, January.
    5. Y Hu & W Wang, 2024. "Network-adjusted covariates for community detection," Biometrika, Biometrika Trust, vol. 111(4), pages 1221-1240.
    6. Ahn, Seung C. & Lee, Young H. & Schmidt, Peter, 2013. "Panel data models with multiple time-varying individual effects," Journal of Econometrics, Elsevier, vol. 174(1), pages 1-14.
    7. Bonsang, Eric & Adam, Stéphane & Perelman, Sergio, 2012. "Does retirement affect cognitive functioning?," Journal of Health Economics, Elsevier, vol. 31(3), pages 490-501.
    8. Mazzonna, Fabrizio & Peracchi, Franco, 2012. "Ageing, cognitive abilities and retirement," European Economic Review, Elsevier, vol. 56(4), pages 691-710.
    9. Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2014. "Inference on Treatment Effects after Selection among High-Dimensional Controlsâ€," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(2), pages 608-650.
    10. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    11. Onatski, Alexei, 2012. "Asymptotics of the principal components estimator of large factor models with weakly influential factors," Journal of Econometrics, Elsevier, vol. 168(2), pages 244-258.
    12. Dhaval Dave & Inas Rashad & Jasmina Spasojevic, 2008. "The Effects of Retirement on Physical and Mental Health Outcomes," Southern Economic Journal, John Wiley & Sons, vol. 75(2), pages 497-523, August.
    13. Jianqing Fan & Yuan Liao, 2022. "Learning Latent Factors From Diversified Projections and Its Applications to Over-Estimated and Weak Factors," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 117(538), pages 909-924, April.
    14. Michael Insler, 2014. "The Health Consequences of Retirement," Journal of Human Resources, University of Wisconsin Press, vol. 49(1), pages 195-233.
    15. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
    16. Eric French & John Bailey Jones, 2011. "The Effects of Health Insurance and Self‐Insurance on Retirement Behavior," Econometrica, Econometric Society, vol. 79(3), pages 693-732, May.
    17. Bai, Jushan & Ng, Serena, 2023. "Approximate factor models with weaker loadings," Journal of Econometrics, Elsevier, vol. 235(2), pages 1893-1916.
    18. Dhaval Dave & R. Inas Rashad & Jasmina Spasojevic, 2008. "The Effects of Retirement on Physical and Mental Health Outcomes," Southern Economic Journal, Southern Economic Association, vol. 75(2), pages 497-523, October.
    19. Alexei Onatski, 2010. "Determining the Number of Factors from Empirical Distribution of Eigenvalues," The Review of Economics and Statistics, MIT Press, vol. 92(4), pages 1004-1016, November.
    20. Jushan Bai, 2003. "Inferential Theory for Factor Models of Large Dimensions," Econometrica, Econometric Society, vol. 71(1), pages 135-171, January.
    21. Seung C. Ahn & Alex R. Horenstein, 2013. "Eigenvalue Ratio Test for the Number of Factors," Econometrica, Econometric Society, vol. 81(3), pages 1203-1227, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Timothy B. Armstrong & Martin Weidner & Andrei Zeleneev, 2024. "Robust estimation and inference in panels with interactive fixed effects," CeMMAP working papers 28/24, Institute for Fiscal Studies.
    2. Wanbo Lu & Guanglin Huang & Kris Boudt, 2024. "Estimation of Non-Gaussian Factors Using Higher-order Multi-cumulants in Weak Factor Models," Working Papers of Faculty of Economics and Business Administration, Ghent University, Belgium 24/1085, Ghent University, Faculty of Economics and Business Administration.
    3. Pierre-Jean Messe & François-Charles Wolff, 2019. "Healthier when retiring earlier? Evidence from France," Applied Economics, Taylor & Francis Journals, vol. 51(47), pages 5122-5143, October.
    4. Mattia Filomena & Matteo Picchio, 2023. "Retirement and health outcomes in a meta‐analytical framework," Journal of Economic Surveys, Wiley Blackwell, vol. 37(4), pages 1120-1155, September.
    5. Leimer, Birgit & van Ewijk, Reyn, 2022. "No “honeymoon phase”: whose health benefits from retirement and when," Economics & Human Biology, Elsevier, vol. 47(C).
    6. Kuhn, Andreas & Staubli, Stefan & Wuellrich, Jean-Philippe & Zweimüller, Josef, 2020. "Fatal attraction? Extended unemployment benefits, labor force exits, and mortality," Journal of Public Economics, Elsevier, vol. 191(C).
    7. Bai, Jushan & Ng, Serena, 2023. "Approximate factor models with weaker loadings," Journal of Econometrics, Elsevier, vol. 235(2), pages 1893-1916.
    8. Shi, Wei & Lee, Lung-fei, 2017. "Spatial dynamic panel data models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 197(2), pages 323-347.
    9. Wei Shi & Lung-fei Lee, 2018. "The effects of gun control on crimes: a spatial interactive fixed effects approach," Empirical Economics, Springer, vol. 55(1), pages 233-263, August.
    10. Hong, Shengjie & Su, Liangjun & Jiang, Tao, 2023. "Profile GMM estimation of panel data models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 235(2), pages 927-948.
    11. Hiroyuki Motegi & Yoshinori Nishimura & Kazuyuki Terada, 2016. "Does Retirement Change Lifestyle Habits?," The Japanese Economic Review, Japanese Economic Association, vol. 67(2), pages 169-191, June.
    12. Duan, Junting & Pelger, Markus & Xiong, Ruoxuan, 2024. "Target PCA: Transfer learning large dimensional panel data," Journal of Econometrics, Elsevier, vol. 244(2).
    13. Stefano Giglio & Dacheng Xiu, 2017. "Inference on Risk Premia in the Presence of Omitted Factors," NBER Working Papers 23527, National Bureau of Economic Research, Inc.
    14. Peng, Bin & Su, Liangjun & Yan, Yayi, 2025. "A robust residual-based test for structural changes in factor models," Journal of Econometrics, Elsevier, vol. 251(C).
    15. Freeman, Hugo & Weidner, Martin, 2023. "Linear panel regressions with two-way unobserved heterogeneity," Journal of Econometrics, Elsevier, vol. 237(1).
    16. Christian Brownlees & Gu{dh}mundur Stef'an Gu{dh}mundsson & Yaping Wang, 2024. "Performance of Empirical Risk Minimization For Principal Component Regression," Papers 2409.03606, arXiv.org, revised Sep 2024.
    17. Mingjia XIE & Ting YIN & Emiko USUI & Yi ZHANG, 2025. "Health Effects of Retirement Policy Changes: Evidence from Japan," Discussion papers 25102, Research Institute of Economy, Trade and Industry (RIETI).
    18. Chen, Xi, 2022. "The impact of spousal and own retirement on health: Evidence from urban China," World Development, Elsevier, vol. 159(C).
    19. Eibich, Peter, 2015. "Understanding the Effect of Retirement on Health: Mechanisms and Heterogeneity," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 43, pages 1-12.
    20. Jie Wei & Yonghui Zhang, 2023. "Does Principal Component Analysis Preserve the Sparsity in Sparse Weak Factor Models?," Papers 2305.05934, arXiv.org, revised Nov 2024.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2605.18448. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.