IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2108.07380.html
   My bibliography  Save this paper

InfoGram and Admissible Machine Learning

Author

Listed:
  • Subhadeep Mukhopadhyay

Abstract

We have entered a new era of machine learning (ML), where the most accurate algorithm with superior predictive power may not even be deployable, unless it is admissible under the regulatory constraints. This has led to great interest in developing fair, transparent and trustworthy ML methods. The purpose of this article is to introduce a new information-theoretic learning framework (admissible machine learning) and algorithmic risk-management tools (InfoGram, L-features, ALFA-testing) that can guide an analyst to redesign off-the-shelf ML methods to be regulatory compliant, while maintaining good prediction accuracy. We have illustrated our approach using several real-data examples from financial sectors, biomedical research, marketing campaigns, and the criminal justice system.

Suggested Citation

  • Subhadeep Mukhopadhyay, 2021. "InfoGram and Admissible Machine Learning," Papers 2108.07380, arXiv.org, revised Aug 2021.
    • Handle: RePEc:arx:papers:2108.07380
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2108.07380
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Laura Blattner & Scott Nelson, 2021. "How Costly is Noise? Data and Disparities in Consumer Credit," Papers 2105.07554, arXiv.org.
    2. Blattner, Laura & Nelson, Scott, 2021. "How Costly Is Noise? Data and Disparities in Consumer Credit," Research Papers 3978, Stanford University, Graduate School of Business.
    3. Friedman, Jerome H. & Hastie, Trevor & Tibshirani, Rob, 2010. "Regularization Paths for Generalized Linear Models via Coordinate Descent," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 33(i01).
    4. Sara Reardon, 2019. "Rise of Robot Radiologists," Nature, Nature, vol. 576(7787), pages 54-58, December.
    5. Emmanuel Candès & Yingying Fan & Lucas Janson & Jinchi Lv, 2018. "Panning for gold: ‘model‐X’ knockoffs for high dimensional controlled variable selection," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 80(3), pages 551-577, June.
    6. Wall, Larry D., 2018. "Some financial regulatory implications of artificial intelligence," Journal of Economics and Business, Elsevier, vol. 100(C), pages 55-63.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Vitaly Meursault & Daniel Moulton & Larry Santucci & Nathan Schor, 2022. "One Threshold Doesn’t Fit All: Tailoring Machine Learning Predictions of Consumer Default for Lower-Income Areas," Working Papers 22-39, Federal Reserve Bank of Philadelphia.
    2. Egle Jakucionyte & Swapnil Singh, 2021. "Emergence of Subprime Lending in Minority Neighborhoods," Bank of Lithuania Working Paper Series 94, Bank of Lithuania.
    3. Langenbucher, Katja, 2022. "Consumer credit in the age of AI: Beyond anti-discrimination law," SAFE Working Paper Series 369, Leibniz Institute for Financial Research SAFE.
    4. Pedro Delicado & Daniel Peña, 2023. "Understanding complex predictive models with ghost variables," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 32(1), pages 107-145, March.
    5. Hurtado, Agustin & Sakong, Jung, 2022. "The effect of minority bank ownership on minority credit," Working Papers 325, The University of Chicago Booth School of Business, George J. Stigler Center for the Study of the Economy and the State.
    6. Sabrina T. Howell & Theresa Kuchler & David Snitkof & Johannes Stroebel & Jun Wong, 2021. "Lender Automation and Racial Disparities in Credit Access," NBER Working Papers 29364, National Bureau of Economic Research, Inc.
    7. Sabrina T. Howell & Theresa Kuchler & David Snitkof & Johannes Stroebel & Jun Wong, 2021. "Racial Disparities in Access to Small Business Credit: Evidence from the Paycheck Protection Program," CESifo Working Paper Series 9345, CESifo.
    8. Yi Liu & Veronika Ročková & Yuexi Wang, 2021. "Variable selection with ABC Bayesian forests," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 83(3), pages 453-481, July.
    9. Laura Freijeiro‐González & Manuel Febrero‐Bande & Wenceslao González‐Manteiga, 2022. "A Critical Review of LASSO and Its Derivatives for Variable Selection Under Dependence Among Covariates," International Statistical Review, International Statistical Institute, vol. 90(1), pages 118-145, April.
    10. Cusato, Antonio & Castillo, José Luis & IDB Invest, 2023. "Access to Credit and the Expansion of Broadband Internet in Peru," IDB Publications (Working Papers) 12922, Inter-American Development Bank.
    11. Langenbucher, Katja, 2022. "Consumer credit in the age of AI: Beyond anti-discrimination law," LawFin Working Paper Series 42, Goethe University, Center for Advanced Studies on the Foundations of Law and Finance (LawFin).
    12. Adel Javanmard & Jason D. Lee, 2020. "A flexible framework for hypothesis testing in high dimensions," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 82(3), pages 685-718, July.
    13. Tutz, Gerhard & Pößnecker, Wolfgang & Uhlmann, Lorenz, 2015. "Variable selection in general multinomial logit models," Computational Statistics & Data Analysis, Elsevier, vol. 82(C), pages 207-222.
    14. Ernesto Carrella & Richard M. Bailey & Jens Koed Madsen, 2018. "Indirect inference through prediction," Papers 1807.01579, arXiv.org.
    15. Mustafa Pamuk & Matthias Schumann, 2023. "Opening a New Era with Machine Learning in Financial Services? Forecasting Corporate Credit Ratings Based on Annual Financial Statements," IJFS, MDPI, vol. 11(3), pages 1-20, July.
    16. Rui Wang & Naihua Xiu & Kim-Chuan Toh, 2021. "Subspace quadratic regularization method for group sparse multinomial logistic regression," Computational Optimization and Applications, Springer, vol. 79(3), pages 531-559, July.
    17. Mkhadri, Abdallah & Ouhourane, Mohamed, 2013. "An extended variable inclusion and shrinkage algorithm for correlated variables," Computational Statistics & Data Analysis, Elsevier, vol. 57(1), pages 631-644.
    18. Masakazu Higuchi & Mitsuteru Nakamura & Shuji Shinohara & Yasuhiro Omiya & Takeshi Takano & Daisuke Mizuguchi & Noriaki Sonota & Hiroyuki Toda & Taku Saito & Mirai So & Eiji Takayama & Hiroo Terashi &, 2022. "Detection of Major Depressive Disorder Based on a Combination of Voice Features: An Exploratory Approach," IJERPH, MDPI, vol. 19(18), pages 1-13, September.
    19. Susan Athey & Guido W. Imbens & Stefan Wager, 2018. "Approximate residual balancing: debiased inference of average treatment effects in high dimensions," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 80(4), pages 597-623, September.
    20. Vincent, Martin & Hansen, Niels Richard, 2014. "Sparse group lasso and high dimensional multinomial classification," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 771-786.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2108.07380. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.