IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2606.17423.html

Martingale Doppelg\"anger-Eval: An Identification Framework for Auditing Candlestick Understanding in Vision-Language Models

Author

Listed:
  • Ziyao Wang

Abstract

We introduce Martingale Doppelg\"anger-Eval, a public shadow-market benchmark for auditing whether vision-language models (VLMs) use candlestick evidence rather than extrapolate past trends. The central difficulty is identification: on real market histories, chart evidence and trend are strongly coupled, so an observational score cannot determine whether a fluent technical-analysis narrative is grounded in local visual evidence. We prove this limitation formally: no evaluation functional computed from observational chart--label data can distinguish a grounded responder from a trend-shortcut responder under strong coupling, whereas matched evidence interventions separate the same responders at an exponential rate and trend--label swaps provide an independent shortcut stress test. The benchmark therefore evaluates frozen VLMs on rendered OHLCV charts under four controlled mechanisms: a martingale-null market, injected-alpha counterfactual pairs, trend-confounder swaps, and regime shifts. A structural behavioral model identifies null-market bias, trend sensitivity, evidence sensitivity, prompt/renderer fragility, and evidence faithfulness; the accompanying statistical toolkit provides minimum detectable effects, block-aware sequential testing for metered APIs, and an overlap-weighted artifact check. Across frozen commercial and open VLMs, the identified regression assigns large positive coefficients to past trend but evidence coefficients that are zero or opposite to the rule-implied sign. Matched-pair analyses show that models either ignore injected candlestick semantics or move opposite to the rule-implied direction conditional on responding. The benchmark isolates a failure mode that standard observational chart benchmarks cannot detect and gives a reusable audit template for time-series imagery with controllable label mechanisms.

Suggested Citation

  • Ziyao Wang, 2026. "Martingale Doppelg\"anger-Eval: An Identification Framework for Auditing Candlestick Understanding in Vision-Language Models," Papers 2606.17423, arXiv.org.
  • Handle: RePEc:arx:papers:2606.17423
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2606.17423
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Fama, Eugene F, 1970. "Efficient Capital Markets: A Review of Theory and Empirical Work," Journal of Finance, American Finance Association, vol. 25(2), pages 383-417, May.
    2. Richard K. Crump & V. Joseph Hotz & Guido W. Imbens & Oscar A. Mitnik, 2009. "Dealing with limited overlap in estimation of average treatment effects," Biometrika, Biometrika Trust, vol. 96(1), pages 187-199.
    3. Jonas Peters & Peter Bühlmann & Nicolai Meinshausen, 2016. "Causal inference by using invariant prediction: identification and confidence intervals," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(5), pages 947-1012, November.
    4. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    5. Brock, William & Lakonishok, Josef & LeBaron, Blake, 1992. "Simple Technical Trading Rules and the Stochastic Properties of Stock Returns," Journal of Finance, American Finance Association, vol. 47(5), pages 1731-1764, December.
    6. Fan Li & Kari Lock Morgan & Alan M. Zaslavsky, 2018. "Balancing Covariates via Propensity Score Weighting," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(521), pages 390-400, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Amilon, Henrik, 2008. "Estimation of an adaptive stock market model with heterogeneous agents," Journal of Empirical Finance, Elsevier, vol. 15(2), pages 342-362, March.
    2. Paul Handro & Bogdan Dima, 2024. "Analyzing Financial Markets Efficiency: Insights from a Bibliometric and Content Review," Journal of Financial Studies, Institute of Financial Studies, vol. 16(9), pages 119-175, May.
    3. Bong-Chan, Kho, 1996. "Time-varying risk premia, volatility, and technical trading rule profits: Evidence from foreign currency futures markets," Journal of Financial Economics, Elsevier, vol. 41(2), pages 249-290, June.
    4. Caporin, Massimiliano & Ranaldo, Angelo & Santucci de Magistris, Paolo, 2013. "On the predictability of stock prices: A case for high and low prices," Journal of Banking & Finance, Elsevier, vol. 37(12), pages 5132-5146.
    5. Plantinga, Andrew J. & Provencher, Bill, 2001. "Internal Consistency In Models Of Optimal Resource Use Under Uncertainty," 2001 Annual meeting, August 5-8, Chicago, IL 20712, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    6. Pieter Nel & Renee van Eyden, 2026. "From News to Noise: Does Media Sentiment Drive Stock Market Volatility?," Working Papers 202605, University of Pretoria, Department of Economics.
    7. Alagidede, Paul & Panagiotidis, Theodore, 2009. "Modelling stock returns in Africa's emerging equity markets," International Review of Financial Analysis, Elsevier, vol. 18(1-2), pages 1-11, March.
    8. Chia-Lin Chang & Jukka Ilomäki & Hannu Laurila & Michael McAleer, 2018. "Long Run Returns Predictability and Volatility with Moving Averages," Risks, MDPI, vol. 6(4), pages 1-18, September.
    9. Dhanya Jothimani & Ravi Shankar & Surendra S. Yadav, 2016. "Discrete Wavelet Transform-Based Prediction of Stock Index: A Study on National Stock Exchange Fifty Index," Papers 1605.07278, arXiv.org.
    10. Bell, Peter N, 2013. "New Testing Procedures to Assess Market Efficiency with Trading Rules," MPRA Paper 46701, University Library of Munich, Germany.
    11. Andrey Shternshis & Piero Mazzarisi & Stefano Marmi, 2022. "Efficiency of the Moscow Stock Exchange before 2022," Papers 2207.10476, arXiv.org, revised Jul 2022.
    12. Chia-Lin Chang & Shu-Han Hsu & Michael McAleer, 2018. "An Event Study Analysis of Political Events, Disasters, and Accidents for Chinese Tourists to Taiwan," Sustainability, MDPI, vol. 10(11), pages 1-77, November.
    13. Sallin, Aurelién, 2021. "Estimating returns to special education: combining machine learning and text analysis to address confounding," Economics Working Paper Series 2109, University of St. Gallen, School of Economics and Political Science.
    14. Yok-Yong Lee & M. H. Yahya & A. M. Bany-Ariffin & S. Aslam, 2018. "Leverage Effect and Switching of Market Efficiency Post Goods and Services Tax (GST) Imposition," International Business Research, Canadian Center of Science and Education, vol. 11(3), pages 162-178, March.
    15. Jiang, Yonghong & Nie, He & Ruan, Weihua, 2018. "Time-varying long-term memory in Bitcoin market," Finance Research Letters, Elsevier, vol. 25(C), pages 280-284.
    16. Bariviera, Aurelio F. & Font-Ferrer, Alejandro & Sorrosal-Forradellas, M. Teresa & Rosso, Osvaldo A., 2019. "An information theory perspective on the informational efficiency of gold price," The North American Journal of Economics and Finance, Elsevier, vol. 50(C).
    17. Alexander S. Sangare, 2005. "Efficience des marchés : un siècle après Bachelier," Revue d'Économie Financière, Programme National Persée, vol. 81(4), pages 107-132.
    18. Luna-Ramirez, Susana & Agudelo, Diego A., 2019. "¿Agrega Valor el Modelo Black-Litterman en Portafolios del Mercado Integrado Latinoamericano (MILA)? Evaluación Empírica 2008-2016 || Does the Black-Litterman Model Add Value in Portfolios of the Integrated Latin American Market (MILA)? Empirical Eva," Revista de Métodos Cuantitativos para la Economía y la Empresa = Journal of Quantitative Methods for Economics and Business Administration, Universidad Pablo de Olavide, Department of Quantitative Methods for Economics and Business Administration, vol. 27(1), pages 55-73, June.
    19. Alexandros E. Milionis & Evangelia Papanagiotou, 2008. "A Note on the Use of Moving Average Trading Rules to Test For Weak from Efficiency in Capital Markets," Working Papers 91, Bank of Greece.
    20. Dutta, Shantanu & Essaddam, Naceur & Kumar, Vinod & Saadi, Samir, 2017. "How does electronic trading affect efficiency of stock market and conditional volatility? Evidence from Toronto Stock Exchange," Research in International Business and Finance, Elsevier, vol. 39(PB), pages 867-877.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2606.17423. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.