IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2605.24514.html

Incremental SVD for Large-Scale Dynamic Matrices: Accuracy, Subspace Stability, Refresh Strategies, and Financial Factor-Based Risk Models

Author

Listed:
  • Stilyan Staykov

Abstract

Return panels, covariances, and large feature matrices evolve one observation or one entry at a time, yet downstream models require an up-to-date low-rank factorization $A_t \approx U_t \Sigma_t V_t^\top$ on every tick -- a regime where full SVD is prohibitive and existing alternatives sacrifice either singular vectors, singular values, or long-horizon stability. We present a practical, metric-driven study of Brand-style incremental SVD, built around a unified engine that handles row appends, column appends, rank-1 entry updates, and metrics tracking within a single framework, with two core contributions. For rank-1 entry updates, we derive an explicit projection-based rule $U'\Sigma'(V')^\top = P_U(\widehat{A} + \delta\,e_ie_j^\top)P_V$ that keeps rank fixed while discarding only the out-of-subspace remainder in a quantifiable way, turning Brand's rank-suppression heuristic into an operational scheme. We then treat refresh scheduling as a first-class design axis, systematically comparing periodic, error-threshold, angle-threshold, and adaptive-rank policies on the accuracy-latency frontier. A unified framework tracks error ratios, principal angles, explained variance, and per-update runtime on long synthetic streams and a multi-asset ETF factor model for covariance and portfolio-risk estimation. With a sensible rank and refresh cadence, incremental SVD matches full-SVD accuracy within a few percent at a fraction of the cost, scaling to high-frequency regimes where batch SVDs are infeasible.

Suggested Citation

  • Stilyan Staykov, 2026. "Incremental SVD for Large-Scale Dynamic Matrices: Accuracy, Subspace Stability, Refresh Strategies, and Financial Factor-Based Risk Models," Papers 2605.24514, arXiv.org.
  • Handle: RePEc:arx:papers:2605.24514
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2605.24514
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. De Nard, Gianluca & Engle, Robert F. & Ledoit, Olivier & Wolf, Michael, 2022. "Large dynamic covariance matrices: Enhancements based on intraday data," Journal of Banking & Finance, Elsevier, vol. 138(C).
    2. Engle, Robert, 2002. "Dynamic Conditional Correlation: A Simple Class of Multivariate Generalized Autoregressive Conditional Heteroskedasticity Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(3), pages 339-350, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jean-David Fermanian & Benjamin Poignard & Panos Xidonas, 2025. "Model-based vs. agnostic methods for the prediction of time-varying covariance matrices," Annals of Operations Research, Springer, vol. 346(1), pages 511-548, March.
    2. Honig, Igor & Kircher, Felix, 2025. "Large dynamic covariance matrices and portfolio selection with a heterogeneous autoregressive model," Journal of Banking & Finance, Elsevier, vol. 178(C).
    3. Fiszeder, Piotr & Fałdziński, Marcin & Molnár, Peter, 2023. "Attention to oil prices and its impact on the oil, gold and stock markets and their covariance," Energy Economics, Elsevier, vol. 120(C).
    4. Han, Chulwoo & Park, Frank C., 2022. "A geometric framework for covariance dynamics," Journal of Banking & Finance, Elsevier, vol. 134(C).
    5. Chunhachinda, Pornchai & de Boyrie, Maria E. & Pavlova, Ivelina, 2019. "Measuring the hedging effectiveness of commodities," Finance Research Letters, Elsevier, vol. 30(C), pages 201-207.
    6. Gerardo Manzo & Antonio Picca, 2020. "The Impact of Sovereign Shocks," Management Science, INFORMS, vol. 66(7), pages 3113-3132, July.
    7. Asai Manabu & So Mike K.P., 2015. "Long Memory and Asymmetry for Matrix-Exponential Dynamic Correlation Processes," Journal of Time Series Econometrics, De Gruyter, vol. 7(1), pages 69-94, January.
    8. Sensoy, Ahmet & Sobaci, Cihat, 2014. "Effects of volatility shocks on the dynamic linkages between exchange rate, interest rate and the stock market: The case of Turkey," Economic Modelling, Elsevier, vol. 43(C), pages 448-457.
    9. Da Fonseca José & Grasselli Martino & Ielpo Florian, 2014. "Estimating the Wishart Affine Stochastic Correlation Model using the empirical characteristic function," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 18(3), pages 253-289, May.
    10. Chen Tong & Peter Reinhard Hansen & Ilya Archakov, 2026. "Cluster GARCH," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 44(1), pages 148-161, January.
      • Chen Tong & Peter Reinhard Hansen & Ilya Archakov, 2024. "Cluster GARCH," Papers 2406.06860, arXiv.org.
    11. Kamel Helali & Thouraya Boujelbene Dammak, 2019. "Examining the Role of Structural Change in a Phillips Curve: Bivariate GARCH DCC Analysis," Economic Alternatives, University of National and World Economy, Sofia, Bulgaria, issue 3, pages 385-393, September.
    12. Tobias Fissler & Yannick Hoga, 2024. "How to Compare Copula Forecasts?," Papers 2410.04165, arXiv.org.
    13. Weidong Lin & Jose Olmo & Abderrahim Taamouti, 2025. "Portfolio Selection under Systemic Risk," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 57(4), pages 905-949, June.
    14. Hallin, Marc & La Vecchia, Davide, 2020. "A Simple R-estimation method for semiparametric duration models," Journal of Econometrics, Elsevier, vol. 218(2), pages 736-749.
    15. Berens, Tobias & Weiß, Gregor N.F. & Wied, Dominik, 2015. "Testing for structural breaks in correlations: Does it improve Value-at-Risk forecasting?," Journal of Empirical Finance, Elsevier, vol. 32(C), pages 135-152.
    16. Asai, Manabu & McAleer, Michael, 2015. "Leverage and feedback effects on multifactor Wishart stochastic volatility for option pricing," Journal of Econometrics, Elsevier, vol. 187(2), pages 436-446.
    17. NEIFAR, MALIKA & HarzAllah, AMIRA, 2025. "Integration, Contagion and Turmoils; Evidence from Emerging markets," MPRA Paper 123775, University Library of Munich, Germany, revised 25 Feb 2025.
    18. Muñoz, Mª Pilar & Márquez, María Dolores & Sánchez, Josep A., 2011. "Contagion between United States and european markets during the recent crises," MPRA Paper 35993, University Library of Munich, Germany.
    19. Prabheesh, K.P. & Anglingkusumo, Reza & Juhro, Solikin M., 2021. "The dynamics of global financial cycle and domestic economic cycles: Evidence from India and Indonesia," Economic Modelling, Elsevier, vol. 94(C), pages 831-842.
    20. Blasques, F. & Francq, Christian & Laurent, Sébastien, 2024. "Autoregressive conditional betas," Journal of Econometrics, Elsevier, vol. 238(2).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2605.24514. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.