IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2605.07671.html

The Endogeneity of Miscalibration: Impossibility and Escape in Scored Reporting

Author

Listed:
  • Lauri Lov'en
  • Sasu Tarkoma

Abstract

An agent's probability report is paid for twice: by a strictly proper scoring rule, and by an approval rule for the decision it triggers. In this classical decision-coupled setting, non-affine approval is known to defeat truthful reporting. We show the conflict is endogenous: when feasible, the welfare-maximizing approval rule is never affine. The distortion, however, is predictable and can be designed around. There is a reserve report at which pretending to be the marginal type costs exactly the approval prize. Approving at or above the reserve screens types perfectly under every strictly proper score, and the reserve does not depend on the type distribution. A Lipschitz rule with a single kink attains first-best exactly; under strict feasibility no continuously differentiable rule does. The binding constraint is steepness, not smoothness. First-best is attainable within a slope budget if and only if the budget is at least the critical slope: the steepest chord of the pretending cost up to the reserve. Below it the welfare loss is cubic in the shortfall. Where the pretending cost is convex up to the reserve, as for Brier, log and power scores, the critical slope is closed-form. The instances are AI-agent oversight and marketplace operation.

Suggested Citation

  • Lauri Lov'en & Sasu Tarkoma, 2026. "The Endogeneity of Miscalibration: Impossibility and Escape in Scored Reporting," Papers 2605.07671, arXiv.org, revised Oct 2026.
  • Handle: RePEc:arx:papers:2605.07671
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2605.07671
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Paul Milgrom & Ilya Segal, 2002. "Envelope Theorems for Arbitrary Choice Sets," Econometrica, Econometric Society, vol. 70(2), pages 583-601, March.
    2. Milgrom,Paul, 2004. "Putting Auction Theory to Work," Cambridge Books, Cambridge University Press, number 9780521536721.
    3. Dye, Ra, 1985. "Disclosure Of Nonproprietary Information," Journal of Accounting Research, John Wiley & Sons, Ltd., vol. 23(1), pages 123-145.
    4. Jean-Jacques Laffont & Jean Tirole, 1993. "A Theory of Incentives in Procurement and Regulation," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262121743, December.
    5. Laffont, Jean-Jacques & Tirole, Jean, 1986. "Using Cost Observation to Regulate Firms," Journal of Political Economy, University of Chicago Press, vol. 94(3), pages 614-641, June.
    6. Matthew Gentzkow & Emir Kamenica, 2017. "Competition in Persuasion," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 84(1), pages 300-322.
    7. George J. Mailath & Larry Samuelson, 2001. "Who Wants a Good Reputation?," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 68(2), pages 415-441.
    8. Drew Fudenberg & David K. Levine, 2008. "Reputation And Equilibrium Selection In Games With A Patient Player," World Scientific Book Chapters, in: Drew Fudenberg & David K Levine (ed.), A Long-Run Collaboration On Long-Run Games, chapter 7, pages 123-142, World Scientific Publishing Co. Pte. Ltd..
    9. Bergemann, Dirk & Morris, Stephen, 2016. "Bayes correlated equilibrium and the comparison of information structures in games," Theoretical Economics, Econometric Society, vol. 11(2), May.
    10. Alessandro Lizzeri, 1999. "Information Revelation and Certification Intermediaries," RAND Journal of Economics, The RAND Corporation, vol. 30(2), pages 214-231, Summer.
    11. Grossman, Sanford J, 1981. "The Informational Role of Warranties and Private Disclosure about Product Quality," Journal of Law and Economics, University of Chicago Press, vol. 24(3), pages 461-483, December.
    12. Roger B. Myerson, 1981. "Optimal Auction Design," Mathematics of Operations Research, INFORMS, vol. 6(1), pages 58-73, February.
    13. Green, Jerry & Laffont, Jean-Jacques, 1977. "On the revelation of preferences for public goods," Journal of Public Economics, Elsevier, vol. 8(1), pages 79-93, August.
    14. Dirk Bergemann & Tibor Heumann & Stephen Morris, 2026. "Information Design and Mechanism Design: An Integrated Framework," Cowles Foundation Discussion Papers 2494, Cowles Foundation for Research in Economics, Yale University.
    15. Skreta, Vasiliki & Veldkamp, Laura, 2009. "Ratings shopping and asset complexity: A theory of ratings inflation," Journal of Monetary Economics, Elsevier, vol. 56(5), pages 678-695, July.
    16. Green, Jerry & Laffont, Jean-Jacques, 1977. "Characterization of Satisfactory Mechanisms for the Revelation of Preferences for Public Goods," Econometrica, Econometric Society, vol. 45(2), pages 427-438, March.
    17. Mohammad Akbarpour & Shengwu Li, 2020. "Credible Auctions: A Trilemma," Econometrica, Econometric Society, vol. 88(2), pages 425-467, March.
    18. Gibbard, Allan, 1973. "Manipulation of Voting Schemes: A General Result," Econometrica, Econometric Society, vol. 41(4), pages 587-601, July.
    19. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    20. Myerson, Roger B, 1979. "Incentive Compatibility and the Bargaining Problem," Econometrica, Econometric Society, vol. 47(1), pages 61-73, January.
    21. Piotr Dworczak, 2020. "Mechanism Design With Aftermarkets: Cutoff Mechanisms," Econometrica, Econometric Society, vol. 88(6), pages 2629-2661, November.
    22. H. Moulin, 1980. "On strategy-proofness and single peakedness," Public Choice, Springer, vol. 35(4), pages 437-455, January.
    23. Becker, Bo & Milbourn, Todd, 2011. "How did increased competition affect credit ratings?," Journal of Financial Economics, Elsevier, vol. 101(3), pages 493-514, September.
    24. Dirk Bergemann & Stephen Morris, 2019. "Information Design: A Unified Perspective," Journal of Economic Literature, American Economic Association, vol. 57(1), pages 44-95, March.
    25. Paul R. Milgrom, 1981. "Good News and Bad News: Representation Theorems and Applications," Bell Journal of Economics, The RAND Corporation, vol. 12(2), pages 380-391, Autumn.
    26. Crawford, Vincent P & Sobel, Joel, 1982. "Strategic Information Transmission," Econometrica, Econometric Society, vol. 50(6), pages 1431-1451, November.
    27. Rochet, Jean-Charles, 1987. "A necessary and sufficient condition for rationalizability in a quasi-linear context," Journal of Mathematical Economics, Elsevier, vol. 16(2), pages 191-200, April.
    28. Shengwu Li, 2017. "Obviously Strategy-Proof Mechanisms," American Economic Review, American Economic Association, vol. 107(11), pages 3257-3287, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Doherty, Neil A. & Kartasheva, Anastasia V. & Phillips, Richard D., 2012. "Information effect of entry into credit ratings market: The case of insurers' ratings," Journal of Financial Economics, Elsevier, vol. 106(2), pages 308-330.
    2. Josheski Dushko & Karamazova Elena, 2021. "Auction theory and a note on game mechanisms," Croatian Review of Economic, Business and Social Statistics, Paradigm, vol. 7(1), pages 43-59, May.
    3. Francesco Sangiorgi & Chester Spatt, 2017. "Opacity, Credit Rating Shopping, and Bias," Management Science, INFORMS, vol. 63(12), pages 4016-4036, December.
    4. Eduardo M Azevedo & Eric Budish, 2019. "Strategy-proofness in the Large," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 86(1), pages 81-116.
    5. Laffont, Jean-Jacques & Pouyet, Jerome, 2004. "The subsidiarity bias in regulation," Journal of Public Economics, Elsevier, vol. 88(1-2), pages 255-283, January.
    6. Strausz, Roland, 2006. "Deterministic versus stochastic mechanisms in principal-agent models," Journal of Economic Theory, Elsevier, vol. 128(1), pages 306-314, May.
    7. Jesse A. Schwartz & Quan Wen, 2008. "A Revelation Principle for Dominant Strategy Implementation," Vanderbilt University Department of Economics Working Papers 0819, Vanderbilt University Department of Economics.
    8. Andreas A. Haupt & Nicole Immorlica & Brendan Lucier, 2023. "Certification Design for a Competitive Market," Papers 2301.13449, arXiv.org.
    9. X. Ruiz del Portal, 2012. "Conditions for incentive compatibility in models with multidimensional allocation functions and one-dimensional types," Review of Economic Design, Springer;Society for Economic Design, vol. 16(4), pages 311-321, December.
    10. Mohammad Akbarpour & Shengwu Li, 2020. "Credible Auctions: A Trilemma," Econometrica, Econometric Society, vol. 88(2), pages 425-467, March.
    11. Migrow, Dimitri, 2021. "Designing communication hierarchies," Journal of Economic Theory, Elsevier, vol. 198(C).
    12. Eduardo Perez & Delphine Prady, 2012. "Complicating to Persuade?," Working Papers hal-03583827, HAL.
    13. Liad Wagman & Vincent Conitzer, 2014. "False-name-proof voting with costs over two alternatives," International Journal of Game Theory, Springer;Game Theory Society, vol. 43(3), pages 599-618, August.
    14. Faynzilberg, Peter S. & Kumar, Praveen, 1997. "Optimal Contracting of Separable Production Technologies," Games and Economic Behavior, Elsevier, vol. 21(1-2), pages 15-39, October.
    15. Hagenbach, Jeanne & Perez-Richet, Eduardo, 2018. "Communication with evidence in the lab," Games and Economic Behavior, Elsevier, vol. 112(C), pages 139-165.
    16. Winand Emons & Claude Fluet, 2019. "Strategic communication with reporting costs," Theory and Decision, Springer, vol. 87(3), pages 341-363, October.
    17. Chen, Jiakai, 2021. "LIBOR's poker," Journal of Financial Markets, Elsevier, vol. 55(C).
    18. Leopold Soegner, 1998. "Regulation of a Complementary Imputed Good in a Competitive Environment," Department of Economics Working Papers wuwp056, Vienna University of Economics and Business, Department of Economics.
    19. Peters, Michael, 2001. "Common Agency and the Revelation Principle," Econometrica, Econometric Society, vol. 69(5), pages 1349-1372, September.
    20. Jacob K. Goeree & Alexey Kushnir, 2011. "On the equivalence of Bayesian and dominant strategy implementation in a general class of social choice problems," ECON - Working Papers 021, Department of Economics - University of Zurich.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2605.07671. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.