IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2601.04608.html

Distributionally Robust Recovery of Omitted Factors from Forecast Residuals with Application to Interest Rate Risk Management

Author

Listed:
  • Jinjun Liu
  • Ming-Yen Cheng

Abstract

A forecasting model compresses its predictors into an estimate of a conditional mean, and the systematic structure that estimate omits survives in the second moment of its forecast errors. Accuracy comparisons do not measure this structure, and variance-based extraction does not recover the part of it that a given decision bears. In this paper, we propose a distributionally robust framework that recovers the omitted structure from the residuals of a fixed forecaster: a decision is made robust over a two-layer moment ambiguity set on the standardized residual cross-section, and the discovery statistic is the covariance forcing, the component of the decision's residual risk transverse to its exposure. We demonstrate that the forcing is invariant to shrinkage and to isotropic inflation of the covariance, so the recovered direction is a property of the residuals rather than of the regularization, the sense in which the recovery is ground truth. This is confirmed on monthly U.S. Treasury zero-coupon yields from 2006 to 2025, where the recovered factor is named by factor-adjusted robust selection against a panel of 111 macroeconomic, Treasury supply-and-demand, and financial indicators. From the residuals of the linear factor-augmented dynamic Nelson-Siegel benchmark the factor names as a leading business-cycle factor, anchored on the Conference Board leading index and certified by a block-permutation test; from those of the more accurate nonlinear random forest benchmark the same procedure selects the same real-activity family without certification. A neutralization test completes the evidence: removing the recovered factor from the deployed duration position leaves volatility essentially unchanged and worsens the tail, so the factor is a material systematic risk the position bears.

Suggested Citation

  • Jinjun Liu & Ming-Yen Cheng, 2026. "Distributionally Robust Recovery of Omitted Factors from Forecast Residuals with Application to Interest Rate Risk Management," Papers 2601.04608, arXiv.org, revised Jul 2026.
  • Handle: RePEc:arx:papers:2601.04608
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2601.04608
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Zou, Hui & Yang, Yuhong, 2004. "Combining time series models for forecasting," International Journal of Forecasting, Elsevier, vol. 20(1), pages 69-84.
    2. Ang, Andrew & Piazzesi, Monika, 2003. "A no-arbitrage vector autoregression of term structure dynamics with macroeconomic and latent variables," Journal of Monetary Economics, Elsevier, vol. 50(4), pages 745-787, May.
    3. Yang, Yuhong, 2004. "Combining Forecasting Procedures: Some Theoretical Results," Econometric Theory, Cambridge University Press, vol. 20(1), pages 176-222, February.
    4. Aiolfi, Marco & Timmermann, Allan, 2006. "Persistence in forecasting performance and conditional combination strategies," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 31-53.
    5. Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 4, pages 135-196, Elsevier.
    6. Nelson, Charles R & Siegel, Andrew F, 1987. "Parsimonious Modeling of Yield Curves," The Journal of Business, University of Chicago Press, vol. 60(4), pages 473-489, October.
    7. Capistrán, Carlos & Timmermann, Allan, 2009. "Forecast Combination With Entry and Exit of Experts," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 428-440.
    8. Bai, Jushan & Ng, Serena, 2006. "Evaluating latent and observed factors in macroeconomics and finance," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 507-537.
    9. Viet Anh Nguyen & Fan Zhang & Shanshan Wang & Jose Blanchet & Erick Delage & Yinyu Ye, 2021. "Robustifying Conditional Portfolio Decisions via Optimal Transport," Papers 2103.16451, arXiv.org, revised Apr 2024.
    10. Christopher Healy & Chengcheng Jia, 2023. "Monetary Policy since the Onset of the COVID-19 Pandemic: A Path-Dependent Interpretation," Economic Commentary, Federal Reserve Bank of Cleveland, vol. 2023(12), pages 1-8, July.
    11. Diebold, Francis X. & Li, Canlin, 2006. "Forecasting the term structure of government bond yields," Journal of Econometrics, Elsevier, vol. 130(2), pages 337-364, February.
    12. Stock J.H. & Watson M.W., 2002. "Forecasting Using Principal Components From a Large Number of Predictors," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1167-1179, December.
    13. Fernandes, Marcelo & Vieira, Fausto, 2019. "A dynamic Nelson–Siegel model with forward-looking macroeconomic factors for the yield curve in the US," Journal of Economic Dynamics and Control, Elsevier, vol. 106(C), pages 1-1.
    14. Norman R. Swanson & Weiqi Xiong, 2018. "Big data analytics in economics: What have we learned so far, and where should we go from here?," Canadian Journal of Economics, Canadian Economics Association, vol. 51(3), pages 695-746, August.
    15. Wang, Xiaoqian & Hyndman, Rob J. & Li, Feng & Kang, Yanfei, 2023. "Forecast combinations: An over 50-year review," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1518-1547.
    16. Pedro Henrique Melo Albuquerque & Yaohao Peng & João Pedro Fontoura da Silva, 2022. "Making the whole greater than the sum of its parts: A literature review of ensemble methods for financial time series forecasting," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(8), pages 1701-1724, December.
    17. Erick Delage & Yinyu Ye, 2010. "Distributionally Robust Optimization Under Moment Uncertainty with Application to Data-Driven Problems," Operations Research, INFORMS, vol. 58(3), pages 595-612, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Norman R. Swanson & Weiqi Xiong & Xiye Yang, 2020. "Predicting interest rates using shrinkage methods, real‐time diffusion indexes, and model combinations," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(5), pages 587-613, August.
    2. Caldeira, João F. & Moura, Guilherme V. & Santos, André A.P., 2016. "Predicting the yield curve using forecast combinations," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 79-98.
    3. Michiel De Pooter & Francesco Ravazzolo & Dick van Dijk, 2010. "Term structure forecasting using macro factors and forecast combination," International Finance Discussion Papers 993, Board of Governors of the Federal Reserve System (U.S.).
    4. Kim, Hyun Hak & Swanson, Norman R., 2018. "Mining big data using parsimonious factor, machine learning, variable selection and shrinkage methods," International Journal of Forecasting, Elsevier, vol. 34(2), pages 339-354.
    5. Eric Hillebrand & Huiyu Huang & Tae-Hwy Lee & Canlin Li, 2018. "Using the Entire Yield Curve in Forecasting Output and Inflation," Econometrics, MDPI, vol. 6(3), pages 1-27, August.
    6. Evangelos Salachas & Georgios P. Kouretas & Nikiforos T. Laopodis, 2024. "The term structure of interest rates and economic activity: Evidence from the COVID‐19 pandemic," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(4), pages 1018-1041, July.
    7. Monticini, Andrea & Ravazzolo, Francesco, 2014. "Forecasting the intraday market price of money," Journal of Empirical Finance, Elsevier, vol. 29(C), pages 304-315.
    8. Eo, Yunjong & Kang, Kyu Ho, 2020. "The effects of conventional and unconventional monetary policy on forecasting the yield curve," Journal of Economic Dynamics and Control, Elsevier, vol. 111(C).
    9. Moench, Emanuel, 2008. "Forecasting the yield curve in a data-rich environment: A no-arbitrage factor-augmented VAR approach," Journal of Econometrics, Elsevier, vol. 146(1), pages 26-43, September.
    10. Cheng, Gang & Yang, Yuhong, 2015. "Forecast combination with outlier protection," International Journal of Forecasting, Elsevier, vol. 31(2), pages 223-237.
    11. Elliott, Graham & Gargano, Antonio & Timmermann, Allan, 2015. "Complete subset regressions with large-dimensional sets of predictors," Journal of Economic Dynamics and Control, Elsevier, vol. 54(C), pages 86-110.
    12. Matsypura, Dmytro & Thompson, Ryan & Vasnev, Andrey L., 2018. "Optimal selection of expert forecasts with integer programming," Omega, Elsevier, vol. 78(C), pages 165-175.
    13. Caio Almeida & Kym Ardison & Daniela Kubudi & Axel Simonsen & José Vicente, 2018. "Forecasting Bond Yields with Segmented Term Structure Models," Journal of Financial Econometrics, Oxford University Press, vol. 16(1), pages 1-33.
    14. Chen, Jiazi & Hong, Zhiwu & Niu, Linlin, 2025. "Forecasting interest rates with shifting endpoints: The role of the functional demographic age distribution," International Journal of Forecasting, Elsevier, vol. 41(1), pages 153-174.
    15. Carriero, Andrea & Kapetanios, George & Marcellino, Massimiliano, 2012. "Forecasting government bond yields with large Bayesian vector autoregressions," Journal of Banking & Finance, Elsevier, vol. 36(7), pages 2026-2047.
    16. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.
    17. Bordignon, Silvano & Bunn, Derek W. & Lisi, Francesco & Nan, Fany, 2013. "Combining day-ahead forecasts for British electricity prices," Energy Economics, Elsevier, vol. 35(C), pages 88-103.
    18. Pedro Henrique Melo Albuquerque & Yaohao Peng & João Pedro Fontoura da Silva, 2022. "Making the whole greater than the sum of its parts: A literature review of ensemble methods for financial time series forecasting," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(8), pages 1701-1724, December.
    19. Fernandes, Marcelo & Vieira, Fausto, 2019. "A dynamic Nelson–Siegel model with forward-looking macroeconomic factors for the yield curve in the US," Journal of Economic Dynamics and Control, Elsevier, vol. 106(C), pages 1-1.
    20. De Pooter, Michiel & Ravazzolo, Francesco & van Dijk, Dick, 2006. "Predicting the term structure of interest rates incorporating parameter uncertainty, model uncertainty and macroeconomic information," MPRA Paper 2512, University Library of Munich, Germany, revised 03 Mar 2007.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2601.04608. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.