IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2605.30363.html

Enhancing Regime Shift Detection Using Unstructured Data: A Study on the Treasury Market

Author

Listed:
  • Mingxuan Yi
  • Vidal Mehra
  • Jing Chen
  • John Cartlidge

Abstract

Regime shifts in financial markets reorganise the joint dynamics of asset prices and macro variables, breaking any single-regime calibration. They are nonetheless hard to identify: the data signal is noisy and heavily multicollinear, while the contemporaneous text that announces them is unstructured. Standard regime shift detection reads only the data panel and ignores this text, even though it typically signals the shift weeks before it materialises in observed prices. We address this with a text-enhanced pipeline that cross-validates the two signals. A large language model (LLM) proposes candidates from text, which a likelihood-ratio vector-autoregression (VAR) test validates on the panel. In parallel, any regime shift detector proposes data-side candidates that a second LLM call accepts via a permissive text check. Because the acceptance stage consumes a candidate set rather than an algorithm's internals, the data channel accepts any data-driven detector. We deploy the pipeline on the US Treasury market, pairing 2010-2024 FOMC minutes with a 14-variable Treasury / macro panel, with every method evaluated on this same panel. The pipeline reaches F1 = 0.82 and F2 = 0.86 against a verified anchor list of monetary-policy regime shifts (best with rolling PCMCI as the data channel), with same-day modal detection latency, and is detector-agnostic: any of four interchangeable data-driven detectors clears the strongest pure data-only baseline on both scores.

Suggested Citation

  • Mingxuan Yi & Vidal Mehra & Jing Chen & John Cartlidge, 2026. "Enhancing Regime Shift Detection Using Unstructured Data: A Study on the Treasury Market," Papers 2605.30363, arXiv.org, revised Aug 2026.
  • Handle: RePEc:arx:papers:2605.30363
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2605.30363
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. He, Zhiguo & Nagel, Stefan & Song, Zhaogang, 2022. "Treasury inconvenience yields during the COVID-19 crisis," Journal of Financial Economics, Elsevier, vol. 143(1), pages 57-79.
    2. John Y. Campbell & Carolin Pflueger & Luis M. Viceira, 2020. "Macroeconomic Drivers of Bond and Equity Risks," Journal of Political Economy, University of Chicago Press, vol. 128(8), pages 3148-3185.
    3. Christopher A. Sims & Tao Zha, 2006. "Were There Regime Switches in U.S. Monetary Policy?," American Economic Review, American Economic Association, vol. 96(1), pages 54-81, March.
    4. Shijie Wu & Ozan Irsoy & Steven Lu & Vadim Dabravolski & Mark Dredze & Sebastian Gehrmann & Prabhanjan Kambadur & David Rosenberg & Gideon Mann, 2023. "BloombergGPT: A Large Language Model for Finance," Papers 2303.17564, arXiv.org, revised Dec 2023.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pflueger, Carolin, 2025. "Back to the 1980s or not? The drivers of inflation and real risks in Treasury bonds," Journal of Financial Economics, Elsevier, vol. 167(C).
    2. Bekaert, Geert & Engstrom, Eric & Ermolov, Andrey, 2021. "Macro risks and the term structure of interest rates," Journal of Financial Economics, Elsevier, vol. 141(2), pages 479-504.
    3. Francesco Bianchi & Howard Kung & Mikhail Tirskikh, 2023. "The origins and effects of macroeconomic uncertainty," Quantitative Economics, Econometric Society, vol. 14(3), pages 855-896, July.
    4. Stevanovic Dalibor, 2016. "Common time variation of parameters in reduced-form macroeconomic models," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 20(2), pages 159-183, April.
    5. Mohammed-Khalil Ghali & Cecil Pang & Oscar Molina & Carlos Gershenson-Garcia & Daehan Won, 2025. "Forecasting Commodity Price Shocks Using Temporal and Semantic Fusion of Prices Signals and Agentic Generative AI Extracted Economic News," Papers 2508.06497, arXiv.org.
    6. Florian Huber & Josef Schreiner, 2023. "Are Phillips curves in CESEE still alive and well behaved?," Focus on European Economic Integration, Oesterreichische Nationalbank (Austrian Central Bank), issue Q3/23, pages 7-27.
    7. Barthélemy, Jean & Marx, Magali, 2017. "Solving endogenous regime switching models," Journal of Economic Dynamics and Control, Elsevier, vol. 77(C), pages 1-25.
    8. Galvão, Ana Beatriz, 2013. "Changes in predictive ability with mixed frequency data," International Journal of Forecasting, Elsevier, vol. 29(3), pages 395-410.
    9. Hollander, Hylton & Liu, Guangling, 2016. "Credit spread variability in the U.S. business cycle: The Great Moderation versus the Great Recession," Journal of Banking & Finance, Elsevier, vol. 67(C), pages 37-52.
    10. Jean-Baptiste Gossé & Cyriac Guillaumin, 2013. "L’apport de la représentation VAR de Christopher A. Sims à la science économique," L'Actualité Economique, Société Canadienne de Science Economique, vol. 89(4), pages 309-319.
    11. Jason Allen & Milena Wittwer, 2023. "Centralizing Over-the-Counter Markets?," Journal of Political Economy, University of Chicago Press, vol. 131(12), pages 3310-3351.
    12. Marfatia, Hardik A., 2015. "Monetary policy's time-varying impact on the US bond markets: Role of financial stress and risks," The North American Journal of Economics and Finance, Elsevier, vol. 34(C), pages 103-123.
    13. Zhengyang Jiang, 2024. "Exorbitant Privilege: A Safe-Asset View," CESifo Working Paper Series 11279, CESifo.
    14. Zsolt Darvas, 2013. "Monetary transmission in three central European economies: evidence from time-varying coefficient vector autoregressions," Empirica, Springer;Austrian Institute for Economic Research;Austrian Economic Association, vol. 40(2), pages 363-390, May.
    15. David Finck & Peter Tillmann, 2022. "The Role of Global and Domestic Shocks for Inflation Dynamics: Evidence from Asia," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 84(5), pages 1181-1208, October.
    16. Polito, Vito & Wickens, Michael, 2015. "Sovereign credit ratings in the European Union: A model-based fiscal analysis," European Economic Review, Elsevier, vol. 78(C), pages 220-247.
    17. Evangelos Salachas & Georgios P. Kouretas & Nikiforos T. Laopodis, 2024. "The term structure of interest rates and economic activity: Evidence from the COVID‐19 pandemic," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(4), pages 1018-1041, July.
    18. Ching-Nam Hang & Pei-Duo Yu & Roberto Morabito & Chee-Wei Tan, 2024. "Large Language Models Meet Next-Generation Networking Technologies: A Review," Future Internet, MDPI, vol. 16(10), pages 1-29, October.
    19. Robin Greenwood & Samuel Hanson & Dimitri Vayanos, 2024. "Supply and Demand and the Term Structure of Interest Rates," Annual Review of Financial Economics, Annual Reviews, vol. 16(1), pages 115-151, November.
    20. Riccardo Rebonato & Dherminder Kainth & Lionel Melin, 2025. "The Impact of Physical Climate Risk on the Valuation of Global Equity Assets," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 88(4), pages 857-894, April.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2605.30363. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.