IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2603.09219.html

AlgoXpert Alpha Research Framework. A Rigorous IS WFA OOS Protocol for Mitigating Overfitting in Quantitative Strategies

Author

Listed:
  • The Anh Pham
  • Bao Chan Nguyen
  • Nguyet Nguyen Thi

Abstract

Transitioning a strategy from backtest to live trading is a common failure point for quantitative systems due to parameter overfitting, selection bias, and sensitivity to regime changes. This paper presents the AlgoXpert Alpha Research Framework, a standardized protocol that evaluates strategies across three stages: In Sample (IS), which focuses on stable parameter regions instead of single optima; Walk Forward Analysis (WFA) using rolling windows and purge gaps to reduce information leakage, supported by majority pass and catastrophic veto rules; and Out of Sample (OOS) testing under strict parameter lock with no further tuning. The framework applies a defense in depth structure that includes structural safeguards such as cliff veto, execution controls such as spread and leverage guards, and equity protection mechanisms such as circuit breakers and a kill switch. A case study on USDJPY M5 intraday data demonstrates how to detect overfitting through performance decay and drawdown behavior across chronological stages. A post validation comparison of four alpha variants (v1 to v4) shows rank reversal when the objective changes from maximizing Sharpe to minimizing maximum drawdown, highlighting the trade off between risk adjusted performance and tail risk control.

Suggested Citation

  • The Anh Pham & Bao Chan Nguyen & Nguyet Nguyen Thi, 2026. "AlgoXpert Alpha Research Framework. A Rigorous IS WFA OOS Protocol for Mitigating Overfitting in Quantitative Strategies," Papers 2603.09219, arXiv.org.
  • Handle: RePEc:arx:papers:2603.09219
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2603.09219
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Whitney Newey & Kenneth West, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    2. Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ding, Jing & Jiang, Lei & Liu, Xiaohui & Peng, Liang, 2023. "Nonparametric tests for market timing ability using daily mutual fund returns," Journal of Economic Dynamics and Control, Elsevier, vol. 150(C).
    2. Todd E. Clark & Michael W. McCracken, 2010. "Averaging forecasts from VARs with uncertain instabilities," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 5-29, January.
    3. Sucarrat, Genaro, 2009. "Forecast Evaluation of Explanatory Models of Financial Variability," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy, vol. 3, pages 1-33.
    4. Aleksejs Krecetovs & Pasquale Della Corte, 2016. "Macro uncertainty and currency premia," 2016 Meeting Papers 624, Society for Economic Dynamics.
    5. Drechsel, Katja & Scheufele, Rolf, 2010. "Should We Trust in Leading Indicators? Evidence from the Recent Recession," IWH Discussion Papers 10/2010, Halle Institute for Economic Research (IWH).
    6. Corradi, Valentina & Fosten, Jack & Gutknecht, Daniel, 2024. "Predictive ability tests with possibly overlapping models," Journal of Econometrics, Elsevier, vol. 241(1).
    7. Hubert Dichtl, 2020. "Investing in the S&P 500 index: Can anything beat the buy‐and‐hold strategy?," Review of Financial Economics, John Wiley & Sons, vol. 38(2), pages 352-378, April.
    8. Harris, Richard D.F. & Nguyen, Anh, 2013. "Long memory conditional volatility and asset allocation," International Journal of Forecasting, Elsevier, vol. 29(2), pages 258-273.
    9. Ke Yang & Langnan Chen, 2014. "Realized Volatility Forecast: Structural Breaks, Long Memory, Asymmetry, and Day-of-the-Week Effect," International Review of Finance, International Review of Finance Ltd., vol. 14(3), pages 345-392, September.
    10. Dong, Wei & Nam, Deokwoo, 2013. "Exchange rates and individual good's price misalignment: Evidence of long-horizon predictability," Journal of International Money and Finance, Elsevier, vol. 32(C), pages 611-636.
    11. Clark, Todd & McCracken, Michael, 2013. "Advances in Forecast Evaluation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1107-1201, Elsevier.
    12. Degenhardt, Thomas & Auer, Benjamin R., 2018. "The “Sell in May” effect: A review and new empirical evidence," The North American Journal of Economics and Finance, Elsevier, vol. 43(C), pages 169-205.
    13. Mercik, Aleksander & Będowska-Sójka, Barbara & Karim, Sitara & Zaremba, Adam, 2025. "Cross-sectional interactions in cryptocurrency returns," International Review of Financial Analysis, Elsevier, vol. 97(C).
    14. Hsu, Po-Hsuan & Hsu, Yu-Chin & Kuan, Chung-Ming, 2010. "Testing the predictive ability of technical analysis using a new stepwise test without data snooping bias," Journal of Empirical Finance, Elsevier, vol. 17(3), pages 471-484, June.
    15. Borup, Daniel & Schütte, Erik Christian Montes, 2022. "Asset pricing with data revisions," Journal of Financial Markets, Elsevier, vol. 59(PB).
    16. Marianna Brunetti & Roberta de Luca, 2022. "Sensitivity of profitability in cointegration-based pairs trading," Centro Studi di Banca e Finanza (CEFIN) (Center for Studies in Banking and Finance) 0090, Universita di Modena e Reggio Emilia, Dipartimento di Economia "Marco Biagi".
    17. Gospodinov, Nikolay & Kan, Raymond & Robotti, Cesare, 2013. "Chi-squared tests for evaluation and comparison of asset pricing models," Journal of Econometrics, Elsevier, vol. 173(1), pages 108-125.
    18. Raffaella Giacomini & Barbara Rossi, 2013. "Forecasting in macroeconomics," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 17, pages 381-408, Edward Elgar Publishing.
    19. Xyngis, Georgios, 2017. "Business-cycle variation in macroeconomic uncertainty and the cross-section of expected returns: Evidence for scale-dependent risks," Journal of Empirical Finance, Elsevier, vol. 44(C), pages 43-65.
    20. Joseph P. Romano & Azeem M. Shaikh & Michael Wolf, 2010. "Hypothesis Testing in Econometrics," Annual Review of Economics, Annual Reviews, vol. 2(1), pages 75-104, September.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2603.09219. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.