IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2606.03457.html

Hybrid News Sentiment Engine: Real-Time Market Analysis via Adaptive Ensemble Learning on News-Price Pairs

Author

Listed:
  • Andreas Aigner

Abstract

We present a hybrid news sentiment engine that continuously learns market sentiment from paired news headlines and concurrent asset-price snapshots without requiring any neural network training or GPU compute. The system uses a three-way ensemble combining (1) a financial-domain lexicon (FinBERT-style keyword scoring), (2) an adaptive statistical TF-IDF cluster learner that organizes headlines into semantic neighborhoods and tracks their average realized price reactions, and (3) an auto-calibrating weighting mechanism that adjusts ensemble contributions based on each signal's historical correlation with actual price movements. The engine runs on a 3-hour polling cycle from the Tradeflags NewsFeed API, which provides 22 price-snapshot fields per news item spanning equity indices (ES, NQ, SPY, DJIA, NDX, IWM), commodities (CL), and cryptocurrencies (BTC, ETH). All processing occurs at sub-second latency on a CPU-only server at effectively zero marginal cost per analytic cycle. We compare our approach against established methods -- FinBERT, GPT-based scoring, VADER, and commercial sentiment APIs -- across dimensions of cost, latency, accuracy, and adaptability. Our statistical cluster learner, which adapts to changing market regimes without retraining, represents a novel contribution not found in existing sentiment systems.

Suggested Citation

  • Andreas Aigner, 2026. "Hybrid News Sentiment Engine: Real-Time Market Analysis via Adaptive Ensemble Learning on News-Price Pairs," Papers 2606.03457, arXiv.org.
    • Handle: RePEc:arx:papers:2606.03457
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2606.03457
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Fama, Eugene F, 1970. "Efficient Capital Markets: A Review of Theory and Empirical Work," Journal of Finance, American Finance Association, vol. 25(2), pages 383-417, May.
    2. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    3. Kemal Kirtac & Guido Germano, 2025. "Large language models in finance : what is financial sentiment?," Papers 2503.03612, arXiv.org, revised Mar 2025.
    4. Tim Loughran & Bill Mcdonald, 2011. "When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10‐Ks," Journal of Finance, American Finance Association, vol. 66(1), pages 35-65, February.
    5. Pekka Malo & Ankur Sinha & Pekka Korhonen & Jyrki Wallenius & Pyry Takala, 2014. "Good debt or bad debt: Detecting semantic orientations in economic texts," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(4), pages 782-796, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Moritz Scherrmann, 2023. "Multi-Label Topic Model for Financial Textual Data," Papers 2311.07598, arXiv.org.
    2. Gurdgiev, Constantin & O’Loughlin, Daniel, 2020. "Herding and anchoring in cryptocurrency markets: Investor reaction to fear and uncertainty," Journal of Behavioral and Experimental Finance, Elsevier, vol. 25(C).
    3. Bommes, Elisabeth & Chen, Cathy Yi-Hsuan & Härdle, Wolfgang Karl, 2018. "Textual Sentiment and Sector specific reaction," IRTG 1792 Discussion Papers 2018-043, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    4. Babolmorad, N. & Massoud, N., 2025. "Supervising Sentiment Models: Market Signals or Human Expertise?," Cambridge Working Papers in Economics 2577, Faculty of Economics, University of Cambridge.
    5. Christiane Goodfellow & Dirk Schiereck & Steffen Wippler, 2013. "Are behavioural finance equity funds a superior investment? A note on fund performance and market efficiency," Journal of Asset Management, Palgrave Macmillan, vol. 14(2), pages 111-119, April.
    6. Pieter Nel & Renee van Eyden, 2026. "From News to Noise: Does Media Sentiment Drive Stock Market Volatility?," Working Papers 202605, University of Pretoria, Department of Economics.
    7. Klodt, Henning & Lehment, Harmen (ed.), 2009. "The Crisis and Beyond," Kiel E-Books, Kiel Institute for the World Economy, number 60981.
    8. David Peón & Anxo Calvo, 2012. "Using Behavioral Economics to Analyze Credit Policies in the Banking Industry," European Research Studies Journal, European Research Studies Journal, vol. 0(3), pages 145-160.
    9. Jackson Barngetuny (PhD), 2025. "Behavioral Biases and Real Estate Bubble Formation in Kenya: A Behavioral Finance and Neuroeconomic Perspective," International Journal of Finance and Accounting, IPRJB, vol. 10(4), pages 54-79.
    10. Kirtac, Kemal & Germano, Guido, 2024. "Sentiment trading with large language models," Finance Research Letters, Elsevier, vol. 62(PB).
    11. Dilger, Alexander, 2022. "Der Zufall in den Wirtschaftswissenschaften," Discussion Papers of the Institute for Organisational Economics 5/2022, University of Münster, Institute for Organisational Economics.
    12. Alexander S. Sangare, 2005. "Efficience des marchés : un siècle après Bachelier," Revue d'Économie Financière, Programme National Persée, vol. 81(4), pages 107-132.
    13. Jing-Yi Chen & Ming-Hui Wang, 2023. "A Study on Real Estate Purchase Decisions," Sustainability, MDPI, vol. 15(6), pages 1-21, March.
    14. Ahmed Bouteska & Murad Harasheh, 2026. "Decoding the crypto crowd: how social media sentiment predicts Ethereum’s price," Journal of Asset Management, Palgrave Macmillan, vol. 27(1), pages 1-12, March.
    15. Chen, Cathy Yi-Hsuan & Fengler, Matthias R. & Härdle, Wolfgang Karl & Liu, Yanchu, 2022. "Media-expressed tone, option characteristics, and stock return predictability," Journal of Economic Dynamics and Control, Elsevier, vol. 134(C).
    16. Stephan Schulmeister, 2000. "Technical Analysis and Exchange Rate Dynamics," WIFO Studies, WIFO, number 25857.
    17. Diego Pitta Jesus & Elvira Helena Oliveira Medeiros & Lucas Lúcio Godeiro & Andressa Lemes Proque, 2025. "Forecasting Brazilian Stock Market Using Sentiment Indices from Textual Data, Chat-GPT-Based and Technical Indicators," Computational Economics, Springer;Society for Computational Economics, vol. 66(5), pages 3735-3780, November.
    18. Nguyen, Huan Huu & Ngo, Vu Minh & Pham, Luan Minh & Van Nguyen, Phuc, 2025. "Investor sentiment and market returns: A multi-horizon analysis," Research in International Business and Finance, Elsevier, vol. 74(C).
    19. Nabil Sifouh & Ismail Benslimane & Karim Ameziane, 2024. "A critical look at teaching and doing research in finance," Post-Print hal-04936832, HAL.
    20. Robin Maximilian Stetzka & Stefan Winter, 2023. "How rational is gambling?," Journal of Economic Surveys, Wiley Blackwell, vol. 37(4), pages 1432-1488, September.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2606.03457. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.