IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2106.12705.html
   My bibliography  Save this paper

Alternative Microfoundations for Strategic Classification

Author

Listed:
  • Meena Jagadeesan
  • Celestine Mendler-Dunner
  • Moritz Hardt

Abstract

When reasoning about strategic behavior in a machine learning context it is tempting to combine standard microfoundations of rational agents with the statistical decision theory underlying classification. In this work, we argue that a direct combination of these standard ingredients leads to brittle solution concepts of limited descriptive and prescriptive value. First, we show that rational agents with perfect information produce discontinuities in the aggregate response to a decision rule that we often do not observe empirically. Second, when any positive fraction of agents is not perfectly strategic, desirable stable points -- where the classifier is optimal for the data it entails -- cease to exist. Third, optimal decision rules under standard microfoundations maximize a measure of negative externality known as social burden within a broad class of possible assumptions about agent behavior. Recognizing these limitations we explore alternatives to standard microfoundations for binary classification. We start by describing a set of desiderata that help navigate the space of possible assumptions about how agents respond to a decision rule. In particular, we analyze a natural constraint on feature manipulations, and discuss properties that are sufficient to guarantee the robust existence of stable points. Building on these insights, we then propose the noisy response model. Inspired by smoothed analysis and empirical observations, noisy response incorporates imperfection in the agent responses, which we show mitigates the limitations of standard microfoundations. Our model retains analytical tractability, leads to more robust insights about stable points, and imposes a lower social burden at optimality.

Suggested Citation

  • Meena Jagadeesan & Celestine Mendler-Dunner & Moritz Hardt, 2021. "Alternative Microfoundations for Strategic Classification," Papers 2106.12705, arXiv.org.
  • Handle: RePEc:arx:papers:2106.12705
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2106.12705
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Olivier Coibion & Yuriy Gorodnichenko & Rupal Kamdar, 2018. "The Formation of Expectations, Inflation, and the Phillips Curve," Journal of Economic Literature, American Economic Association, vol. 56(4), pages 1447-1491, December.
    2. Thomas S. Dee & Will Dobbie & Brian A. Jacob & Jonah Rockoff, 2019. "The Causes and Consequences of Test Score Manipulation: Evidence from the New York Regents Examinations," American Economic Journal: Applied Economics, American Economic Association, vol. 11(3), pages 382-423, July.
    3. Michael Anderson & Jeremy Magruder, 2012. "Learning from the Crowd: Regression Discontinuity Estimates of the Effects of an Online Review Database," Economic Journal, Royal Economic Society, vol. 122(563), pages 957-989, September.
    4. Joseph E Stiglitz, 2018. "Where modern macroeconomics went wrong," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 34(1-2), pages 70-106.
    5. Shengwu Li, 2017. "Obviously Strategy-Proof Mechanisms," American Economic Review, American Economic Association, vol. 107(11), pages 3257-3287, November.
    6. Lucas, Robert Jr, 1976. "Econometric policy evaluation: A critique," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 1(1), pages 19-46, January.
    7. Daniel Bjorkegren & Joshua E. Blumenstock & Samsun Knight, 2020. "Manipulation-Proof Machine Learning," Papers 2004.03865, arXiv.org.
    8. Michael Spence, 1973. "Job Market Signaling," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 87(3), pages 355-374.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Moritz Hardt & Meena Jagadeesan & Celestine Mendler-Dunner, 2022. "Performative Power," Papers 2203.17232, arXiv.org, revised Nov 2022.
    2. Roshni Sahoo & Stefan Wager, 2022. "Policy Learning with Competing Agents," Papers 2204.01884, arXiv.org, revised Apr 2024.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Daniel Bjorkegren & Joshua E. Blumenstock & Samsun Knight, 2020. "Manipulation-Proof Machine Learning," Papers 2004.03865, arXiv.org.
    2. repec:zbw:bofrdp:2018_022 is not listed on IDEAS
    3. Gulan, Adam, 2018. "Paradise lost? A brief history of DSGE macroeconomics," Research Discussion Papers 22/2018, Bank of Finland.
    4. Tobias Berg & Valentin Burg & Ana Gombović & Manju Puri, 2020. "On the Rise of FinTechs: Credit Scoring Using Digital Footprints," The Review of Financial Studies, Society for Financial Studies, vol. 33(7), pages 2845-2897.
    5. Feng, Andy & Graetz, Georg, 2017. "A question of degree: The effects of degree class on labor market outcomes," Economics of Education Review, Elsevier, vol. 61(C), pages 140-161.
    6. Ngah Ntiga, Louis Henri, 2022. "Estimation Bayésienne d’un modèle DSGE des effets de la politique budgétaire sur l’économie camerounaise," Dynare Working Papers 76, CEPREMAP.
    7. François Gerard & Miikka Rokkanen & Christoph Rothe, 2020. "Bounds on treatment effects in regression discontinuity designs with a manipulated running variable," Quantitative Economics, Econometric Society, vol. 11(3), pages 839-870, July.
    8. Lorán Chollete & Sharon G. Harrison, 2021. "Unintended Consequences: Ambiguity Neglect and Policy Ineffectiveness," Eastern Economic Journal, Palgrave Macmillan;Eastern Economic Association, vol. 47(2), pages 206-226, April.
    9. Gómez-Cram, Roberto & Grotteria, Marco, 2022. "Real-time price discovery via verbal communication: Method and application to Fedspeak," Journal of Financial Economics, Elsevier, vol. 143(3), pages 993-1025.
    10. Stephen Gibbons & Eric Neumayer & Richard Perkins, 2013. "Student Satisfaction, League Tables and University Applications," SERC Discussion Papers 0142, Centre for Economic Performance, LSE.
    11. Basse, Tobias & Wegener, Christoph, 2022. "Inflation expectations: Australian consumer survey data versus the bond market," Journal of Economic Behavior & Organization, Elsevier, vol. 203(C), pages 416-430.
    12. Ngah Ntiga, Louis Henri, 2022. "Estimation Bayésienne d’un modèle DSGE des effets de la politique budgétaire sur l’économie camerounaise [Bayesian estimation of a DSGE model of the effects of fiscal policy on the Cameroonian econ," MPRA Paper 113929, University Library of Munich, Germany, revised Aug 2022.
    13. Alogoskoufis, George & Malliaris, A.G. & Stengos, Thanasis, 2023. "The scope and methodology of economic and financial asymmetries," The Journal of Economic Asymmetries, Elsevier, vol. 27(C).
    14. Magali Jaoul, 2004. "Enseignement supérieur et marchés du travail. Analyse économétrique de la théorie de l’engorgement," Économie et Prévision, Programme National Persée, vol. 166(5), pages 39-57.
    15. Gibbons, Stephen & Neumayer, Eric & Perkins, Richard, 2015. "Student satisfaction, league tables and university applications: Evidence from Britain," Economics of Education Review, Elsevier, vol. 48(C), pages 148-164.
    16. Francisco Louçã & Alexandre Abreu & Gonçalo Pessa Costa, 2021. "Disarray at the headquarters: Economists and Central bankers tested by the subprime and the COVID recessions [Forward guidance without common knowledge]," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 30(2), pages 273-296.
    17. Qiaochu Wang & Yan Huang & Stefanus Jasin & Param Vir Singh, 2023. "Algorithmic Transparency with Strategic Users," Management Science, INFORMS, vol. 69(4), pages 2297-2317, April.
    18. Michał Brzoza-Brzezina & Jacek Suda, 2021. "Are DSGE models irreparably flawed?," Bank i Kredyt, Narodowy Bank Polski, vol. 52(3), pages 227-252.
    19. Bernard Walliser, 1982. "Equilibres et anticipations," Revue Économique, Programme National Persée, vol. 33(4), pages 594-638.
    20. Serena Gallo, 2021. "Fintech platforms: Lax or careful borrowers’ screening?," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 7(1), pages 1-33, December.
    21. Abdulnasser Hatemi-J, 2021. "Dynamic Asymmetric Causality Tests with an Application," Papers 2106.07612, arXiv.org, revised Jun 2021.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2106.12705. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.