IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2601.17527.html

Bridging Expectation Signals: LLM-Based Experiments and a Behavioral Kalman Filter Framework

Author

Listed:
  • Yu Wang
  • Xiangchen Liu

Abstract

As LLMs increasingly function as economic agents, the specific mechanisms LLMs use to update their belief with heterogeneous signals remain opaque. We design experiments and develop a Behavioral Kalman Filter framework to quantify how LLM-based agents update expectations, acting as households or firm CEOs, update expectations when presented with individual and aggregate signals. The results from experiments and model estimation reveal four consistent patterns: (1) agents' weighting of priors and signals deviates from unity; (2) both household and firm CEO agents place substantially larger weights on individual signals compared to aggregate signals; (3) we identify a significant and negative interaction between concurrent signals, implying that the presence of multiple information sources diminishes the marginal weight assigned to each individual signal; and (4) expectation formation patterns differ significantly between household and firm CEO agents. Finally, we demonstrate that LoRA fine-tuning mitigates, but does not fully eliminate, behavioral biases in LLM expectation formation.

Suggested Citation

  • Yu Wang & Xiangchen Liu, 2026. "Bridging Expectation Signals: LLM-Based Experiments and a Behavioral Kalman Filter Framework," Papers 2601.17527, arXiv.org.
  • Handle: RePEc:arx:papers:2601.17527
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2601.17527
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Bruine de Bruin, Wändi & van der Klaauw, Wilbert & Topa, Giorgio, 2011. "Expectations of inflation: The biasing effect of thoughts about specific prices," Journal of Economic Psychology, Elsevier, vol. 32(5), pages 834-845.
    2. Olivier Coibion & Yuriy Gorodnichenko & Saten Kumar, 2018. "How Do Firms Form Their Expectations? New Survey Evidence," American Economic Review, American Economic Association, vol. 108(9), pages 2671-2713, September.
    3. Lucas, Robert E, Jr, 1973. "Some International Evidence on Output-Inflation Tradeoffs," American Economic Review, American Economic Association, vol. 63(3), pages 326-334, June.
    4. Sims, Christopher A., 2003. "Implications of rational inattention," Journal of Monetary Economics, Elsevier, vol. 50(3), pages 665-690, April.
    5. N. Gregory Mankiw & Ricardo Reis, 2002. "Sticky Information versus Sticky Prices: A Proposal to Replace the New Keynesian Phillips Curve," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(4), pages 1295-1328.
    6. Olivier Coibion & Yuriy Gorodnichenko, 2012. "What Can Survey Forecasts Tell Us about Information Rigidities?," Journal of Political Economy, University of Chicago Press, vol. 120(1), pages 116-159.
    7. Olivier Coibion & Yuriy Gorodnichenko, 2015. "Information Rigidity and the Expectations Formation Process: A Simple Framework and New Facts," American Economic Review, American Economic Association, vol. 105(8), pages 2644-2678, August.
    8. Anton Korinek, 2023. "Generative AI for Economic Research: Use Cases and Implications for Economists," Journal of Economic Literature, American Economic Association, vol. 61(4), pages 1281-1317, December.
    9. De Bondt, Werner F M & Thaler, Richard, 1985. "Does the Stock Market Overreact?," Journal of Finance, American Finance Association, vol. 40(3), pages 793-805, July.
    10. George A. Akerlof & Rachel E. Kranton, 2000. "Economics and Identity," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 115(3), pages 715-753.
    11. Amos Tversky & Daniel Kahneman, 1991. "Loss Aversion in Riskless Choice: A Reference-Dependent Model," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 106(4), pages 1039-1061.
    12. John J. Horton & Apostolos Filippas & Benjamin S. Manning, 2023. "Large Language Models as Simulated Economic Agents: What Can We Learn from Homo Silicus?," NBER Working Papers 31122, National Bureau of Economic Research, Inc.
    13. Durbin, James & Koopman, Siem Jan, 2012. "Time Series Analysis by State Space Methods," OUP Catalogue, Oxford University Press, edition 2, number 9780199641178.
    14. Christopher D. Carroll, 2003. "Macroeconomic Expectations of Households and Professional Forecasters," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(1), pages 269-298.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ángelo Gutiérrez-Daza, 2024. "Business Cycles when Consumers Learn by Shopping," Working Papers 2024-12, Banco de México.
    2. Bartosz Maćkowiak & Filip Matějka & Mirko Wiederholt, 2023. "Rational Inattention: A Review," Journal of Economic Literature, American Economic Association, vol. 61(1), pages 226-273, March.
    3. Lena Dräger & Michael J. Lamla, 2024. "Consumers' macroeconomic expectations," Journal of Economic Surveys, Wiley Blackwell, vol. 38(2), pages 427-451, April.
    4. Angeletos, G.-M. & Lian, C., 2016. "Incomplete Information in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 1065-1240, Elsevier.
    5. Cornand, Camille & Hubert, Paul, 2022. "Information frictions across various types of inflation expectations," European Economic Review, Elsevier, vol. 146(C).
    6. Jeffrey Schafer, 2022. "Inflation Expectations and Their Formation: Working Paper 2022-03," Working Papers 57398, Congressional Budget Office.
    7. Florian Peters & Simas Kucinskas, 2018. "Measuring Biases in Expectation Formation," Tinbergen Institute Discussion Papers 18-058/IV, Tinbergen Institute.
    8. Giovanni Dosi & Mauro Napoletano & Andrea Roventini & Joseph E. Stiglitz & Tania Treibich, 2020. "Rational Heuristics? Expectations And Behaviors In Evolving Economies With Heterogeneous Interacting Agents," Economic Inquiry, Western Economic Association International, vol. 58(3), pages 1487-1516, July.
    9. Antonecchia, Gianluca, 2023. "Heterogeneous expectations, forecast accuracy and firms’ credit demand," European Economic Review, Elsevier, vol. 154(C).
    10. Vania Esady, 2022. "Real and nominal effects of monetary shocks under time-varying disagreement," Bank of England working papers 1007, Bank of England.
    11. Martin Geiger & Johann Scharler, 2021. "How Do People Interpret Macroeconomic Shocks? Evidence from U.S. Survey Data," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 53(4), pages 813-843, June.
    12. Conrad, Christian & Lahiri, Kajal, 2023. "Heterogeneous expectations among professional forecasters," ZEW Discussion Papers 23-062, ZEW - Leibniz Centre for European Economic Research.
    13. Jarko Fidrmuc & Christa Hainz & Werner Hölzl, 2018. "Individual Credit Market Experience and Perception of Aggregate Bank Lending. Evidence from a Firm Survey," WIFO Working Papers 574, WIFO.
    14. Chua, Chew Lian & Tsiaplias, Sarantis, 2024. "The influence of supermarket prices on consumer inflation expectations," Journal of Economic Behavior & Organization, Elsevier, vol. 219(C), pages 414-433.
    15. Benchimol, Jonathan & Bounader, Lahcen & Dotta, Mario, 2025. "Estimating Behavioral Inattention," Journal of Economic Behavior & Organization, Elsevier, vol. 236(C).
    16. Serafín Frache & Rodrigo Lluberas, 2017. "New information and inflation expectations among firms," Documentos de trabajo 2017013, Banco Central del Uruguay.
    17. Cornand, Camille & Hubert, Paul, 2020. "On the external validity of experimental inflation forecasts: A comparison with five categories of field expectations," Journal of Economic Dynamics and Control, Elsevier, vol. 110(C).
    18. Link, Sebastian & Peichl, Andreas & Roth, Christopher & Wohlfart, Johannes, 2023. "Information frictions among firms and households," Journal of Monetary Economics, Elsevier, vol. 135(C), pages 99-115.
    19. Christopher D. Carroll & Edmund Crawley & Jiri Slacalek & Kiichi Tokuoka & Matthew N. White, 2020. "Sticky Expectations and Consumption Dynamics," American Economic Journal: Macroeconomics, American Economic Association, vol. 12(3), pages 40-76, July.
    20. Kim, Insu & Kim, Young Se, 2019. "Inattentive agents and inflation forecast error dynamics: A Bayesian DSGE approach," Journal of Macroeconomics, Elsevier, vol. 62(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2601.17527. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.