IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2209.14532.html
   My bibliography  Save this paper

Feature Selection via the Intervened Interpolative Decomposition and its Application in Diversifying Quantitative Strategies

Author

Listed:
  • Jun Lu
  • Joerg Osterrieder

Abstract

In this paper, we propose a probabilistic model for computing an interpolative decomposition (ID) in which each column of the observed matrix has its own priority or importance, so that the end result of the decomposition finds a set of features that are representative of the entire set of features, and the selected features also have higher priority than others. This approach is commonly used for low-rank approximation, feature selection, and extracting hidden patterns in data, where the matrix factors are latent variables associated with each data dimension. Gibbs sampling for Bayesian inference is applied to carry out the optimization. We evaluate the proposed models on real-world datasets, including ten Chinese A-share stocks, and demonstrate that the proposed Bayesian ID algorithm with intervention (IID) produces comparable reconstructive errors to existing Bayesian ID algorithms while selecting features with higher scores or priority.

Suggested Citation

  • Jun Lu & Joerg Osterrieder, 2022. "Feature Selection via the Intervened Interpolative Decomposition and its Application in Diversifying Quantitative Strategies," Papers 2209.14532, arXiv.org.
  • Handle: RePEc:arx:papers:2209.14532
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2209.14532
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Zura Kakushadze, 2016. "101 Formulaic Alphas," Papers 1601.00991, arXiv.org, revised Mar 2016.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jie Fang & Shutao Xia & Jianwu Lin & Yong Jiang, 2019. "Automatic Financial Feature Construction," Papers 1912.06236, arXiv.org, revised Oct 2020.
    2. Jie Fang & Jianwu Lin & Shutao Xia & Yong Jiang & Zhikang Xia & Xiang Liu, 2020. "Neural Network-based Automatic Factor Construction," Papers 2008.06225, arXiv.org, revised Oct 2020.
    3. Zura Kakushadze & Willie Yu, 2017. "Dead Alphas as Risk Factors," Papers 1709.06641, arXiv.org.
    4. Chi Chen & Li Zhao & Wei Cao & Jiang Bian & Chunxiao Xing, 2020. "Trimming the Sail: A Second-order Learning Paradigm for Stock Prediction," Papers 2002.06878, arXiv.org.
    5. Xiao Yang & Weiqing Liu & Dong Zhou & Jiang Bian & Tie-Yan Liu, 2020. "Qlib: An AI-oriented Quantitative Investment Platform," Papers 2009.11189, arXiv.org.
    6. Shuo Yu & Hongyan Xue & Xiang Ao & Feiyang Pan & Jia He & Dandan Tu & Qing He, 2023. "Generating Synergistic Formulaic Alpha Collections via Reinforcement Learning," Papers 2306.12964, arXiv.org.
    7. Yongli Li & Tianchen Wang & Baiqing Sun & Chao Liu, 2022. "Detecting the lead–lag effect in stock markets: definition, patterns, and investment strategies," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 8(1), pages 1-36, December.
    8. Shuo Sun & Rundong Wang & Bo An, 2021. "Reinforcement Learning for Quantitative Trading," Papers 2109.13851, arXiv.org.
    9. Zura Kakushadze & Willie Yu, 2017. "Notes on Fano Ratio and Portfolio Optimization," Papers 1711.10640, arXiv.org, revised Apr 2018.
    10. Ahmed M. Khedr & Ifra Arif & Pravija Raj P V & Magdi El‐Bannany & Saadat M. Alhashmi & Meenu Sreedharan, 2021. "Cryptocurrency price prediction using traditional statistical and machine‐learning techniques: A survey," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 28(1), pages 3-34, January.
    11. Fan Fang & Carmine Ventre & Michail Basios & Leslie Kanthan & David Martinez-Rego & Fan Wu & Lingbo Li, 2022. "Cryptocurrency trading: a comprehensive survey," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 8(1), pages 1-59, December.
    12. Zura Kakushadze & Willie Yu, 2018. "Dead alphas as risk factors," Journal of Asset Management, Palgrave Macmillan, vol. 19(2), pages 110-115, March.
    13. Zura Kakushadze & Willie Yu, 2017. "Open Source Fundamental Industry Classification," Papers 1706.04210, arXiv.org, revised Dec 2017.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2209.14532. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.