IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2605.30363.html

Enhancing Regime Shift Detection Using Unstructured Data: A Study on the Treasury Market

Author

Listed:
  • Mingxuan Yi
  • Vidal Mehra
  • Jing Chen
  • John Cartlidge

Abstract

Regime shifts in financial markets reorganise the joint dynamics of asset prices and macro variables, breaking any single-regime calibration. They are nonetheless difficult to detect reliably because the data signal is noisy and heavily multicollinear, while the contemporaneous text that announces them is unstructured. Standard regime shift detection methods rely solely on structured time-series data and ignore policy communications, even though these texts often signal shifts before they materialise in observed prices. We propose a text-enhanced regime shift detection pipeline that combines large language model (LLM) reasoning over central-bank communications with statistical validation on multivariate financial time series. The framework is detector-agnostic: text-proposed candidates are validated using a bootstrap likelihood-ratio test on a vector autoregression (VAR), while data-driven candidates from arbitrary regime detectors are ratified through a lenient LLM text check. We evaluate the framework on 2010-2024 FOMC minutes paired with a 14-variable U.S. Treasury and macroeconomic panel, using four interchangeable data-driven detectors. The proposed pipeline achieves F1 = 0.82 against a verified anchor list of monetary-policy regime shifts, with same-day modal detection latency and consistently stronger performance than pure data-driven baselines. The results demonstrate that combining unstructured policy text with statistical structural-break detection improves the robustness and interpretability of regime shift identification in financial markets.

Suggested Citation

  • Mingxuan Yi & Vidal Mehra & Jing Chen & John Cartlidge, 2026. "Enhancing Regime Shift Detection Using Unstructured Data: A Study on the Treasury Market," Papers 2605.30363, arXiv.org.
  • Handle: RePEc:arx:papers:2605.30363
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2605.30363
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. He, Zhiguo & Nagel, Stefan & Song, Zhaogang, 2022. "Treasury inconvenience yields during the COVID-19 crisis," Journal of Financial Economics, Elsevier, vol. 143(1), pages 57-79.
    2. John Y. Campbell & Carolin Pflueger & Luis M. Viceira, 2020. "Macroeconomic Drivers of Bond and Equity Risks," Journal of Political Economy, University of Chicago Press, vol. 128(8), pages 3148-3185.
    3. Christopher A. Sims & Tao Zha, 2006. "Were There Regime Switches in U.S. Monetary Policy?," American Economic Review, American Economic Association, vol. 96(1), pages 54-81, March.
    4. Shijie Wu & Ozan Irsoy & Steven Lu & Vadim Dabravolski & Mark Dredze & Sebastian Gehrmann & Prabhanjan Kambadur & David Rosenberg & Gideon Mann, 2023. "BloombergGPT: A Large Language Model for Finance," Papers 2303.17564, arXiv.org, revised Dec 2023.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pflueger, Carolin, 2025. "Back to the 1980s or not? The drivers of inflation and real risks in Treasury bonds," Journal of Financial Economics, Elsevier, vol. 167(C).
    2. Bekaert, Geert & Engstrom, Eric & Ermolov, Andrey, 2021. "Macro risks and the term structure of interest rates," Journal of Financial Economics, Elsevier, vol. 141(2), pages 479-504.
    3. Francesco Bianchi & Howard Kung & Mikhail Tirskikh, 2023. "The origins and effects of macroeconomic uncertainty," Quantitative Economics, Econometric Society, vol. 14(3), pages 855-896, July.
    4. Stevanovic Dalibor, 2016. "Common time variation of parameters in reduced-form macroeconomic models," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 20(2), pages 159-183, April.
    5. Mohammed-Khalil Ghali & Cecil Pang & Oscar Molina & Carlos Gershenson-Garcia & Daehan Won, 2025. "Forecasting Commodity Price Shocks Using Temporal and Semantic Fusion of Prices Signals and Agentic Generative AI Extracted Economic News," Papers 2508.06497, arXiv.org.
    6. Florian Huber & Josef Schreiner, 2023. "Are Phillips curves in CESEE still alive and well behaved?," Focus on European Economic Integration, Oesterreichische Nationalbank (Austrian Central Bank), issue Q3/23, pages 7-27.
    7. Barthélemy, Jean & Marx, Magali, 2017. "Solving endogenous regime switching models," Journal of Economic Dynamics and Control, Elsevier, vol. 77(C), pages 1-25.
    8. Galvão, Ana Beatriz, 2013. "Changes in predictive ability with mixed frequency data," International Journal of Forecasting, Elsevier, vol. 29(3), pages 395-410.
    9. Hollander, Hylton & Liu, Guangling, 2016. "Credit spread variability in the U.S. business cycle: The Great Moderation versus the Great Recession," Journal of Banking & Finance, Elsevier, vol. 67(C), pages 37-52.
    10. Jean-Baptiste Gossé & Cyriac Guillaumin, 2013. "L’apport de la représentation VAR de Christopher A. Sims à la science économique," L'Actualité Economique, Société Canadienne de Science Economique, vol. 89(4), pages 309-319.
    11. Jason Allen & Milena Wittwer, 2023. "Centralizing Over-the-Counter Markets?," Journal of Political Economy, University of Chicago Press, vol. 131(12), pages 3310-3351.
    12. Marfatia, Hardik A., 2015. "Monetary policy's time-varying impact on the US bond markets: Role of financial stress and risks," The North American Journal of Economics and Finance, Elsevier, vol. 34(C), pages 103-123.
    13. Zhengyang Jiang, 2024. "Exorbitant Privilege: A Safe-Asset View," CESifo Working Paper Series 11279, CESifo.
    14. Zsolt Darvas, 2013. "Monetary transmission in three central European economies: evidence from time-varying coefficient vector autoregressions," Empirica, Springer;Austrian Institute for Economic Research;Austrian Economic Association, vol. 40(2), pages 363-390, May.
    15. David Finck & Peter Tillmann, 2022. "The Role of Global and Domestic Shocks for Inflation Dynamics: Evidence from Asia," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 84(5), pages 1181-1208, October.
    16. Polito, Vito & Wickens, Michael, 2015. "Sovereign credit ratings in the European Union: A model-based fiscal analysis," European Economic Review, Elsevier, vol. 78(C), pages 220-247.
    17. Evangelos Salachas & Georgios P. Kouretas & Nikiforos T. Laopodis, 2024. "The term structure of interest rates and economic activity: Evidence from the COVID‐19 pandemic," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(4), pages 1018-1041, July.
    18. Ching-Nam Hang & Pei-Duo Yu & Roberto Morabito & Chee-Wei Tan, 2024. "Large Language Models Meet Next-Generation Networking Technologies: A Review," Future Internet, MDPI, vol. 16(10), pages 1-29, October.
    19. Robin Greenwood & Samuel Hanson & Dimitri Vayanos, 2024. "Supply and Demand and the Term Structure of Interest Rates," Annual Review of Financial Economics, Annual Reviews, vol. 16(1), pages 115-151, November.
    20. Riccardo Rebonato & Dherminder Kainth & Lionel Melin, 2025. "The Impact of Physical Climate Risk on the Valuation of Global Equity Assets," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 88(4), pages 857-894, April.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2605.30363. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.