IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2503.03910.html

Optimal Policy Choices Under Uncertainty

Author

Listed:
  • Sarah Moon

Abstract

Policymakers often face the decision of how to allocate resources across many different policies using noisy estimates of policy impacts. This paper develops a framework for locally optimal policy choices under statistical uncertainty. I show that posterior mean benefits and net costs are sufficient statistics for an oracle planner who knows the distribution of policy impacts. Since this distribution is unknown, I propose an empirical Bayes approach to estimate posterior means and approximate the oracle. I derive rates of convergence to the oracle's decision and show that, unlike empirical Bayes, plug-in methods can fail to converge. In an application to 127 policies, empirical Bayes rules have positive estimated local welfare effects, while the plug-in rule has negative estimated effects.

Suggested Citation

  • Sarah Moon, 2025. "Optimal Policy Choices Under Uncertainty," Papers 2503.03910, arXiv.org, revised Aug 2026.
    • Handle: RePEc:arx:papers:2503.03910
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2503.03910
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Patrick Kline & Evan K. Rose & Christopher R. Walters, 2024. "A Discrimination Report Card," American Economic Review, American Economic Association, vol. 114(8), pages 2472-2525, August.
    2. Jiaying Gu & Roger Koenker, 2023. "Reply to: Comments on “Invidious Comparisons: Ranking and Selection as Compound Decisions”," Econometrica, Econometric Society, vol. 91(1), pages 61-66, January.
    3. Victor Chernozhukov & Sokbae Lee & Adam Rosen & Liyang Sun, 2025. "Policy learning with confidence," CeMMAP working papers 15/25, Institute for Fiscal Studies.
    4. Sun, Liyang, 2026. "Empirical welfare maximization with constraints," Journal of Econometrics, Elsevier, vol. 253(C).
    5. Eric Mbakop & Max Tabord‐Meehan, 2021. "Model Selection for Treatment Choice: Penalized Welfare Maximization," Econometrica, Econometric Society, vol. 89(2), pages 825-848, March.
    6. Toru Kitagawa & Aleksey Tetenov, 2018. "Who Should Be Treated? Empirical Welfare Maximization Methods for Treatment Choice," Econometrica, Econometric Society, vol. 86(2), pages 591-616, March.
    7. Amy Finkelstein & Nathaniel Hendren, 2020. "Welfare Analysis Meets Causal Inference," NBER Working Papers 27640, National Bureau of Economic Research, Inc.
    8. Roger Koenker & Ivan Mizera, 2014. "Convex Optimization, Shape Constraints, Compound Decisions, and Empirical Bayes Rules," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(506), pages 674-685, June.
    9. Jiaying Gu & Roger Koenker, 2023. "Invidious Comparisons: Ranking and Selection as Compound Decisions," Econometrica, Econometric Society, vol. 91(1), pages 1-41, January.
    10. Susan Athey & Stefan Wager, 2021. "Policy Learning With Observational Data," Econometrica, Econometric Society, vol. 89(1), pages 133-161, January.
    11. Koenker, Roger & Mizera, Ivan, 2014. "Convex Optimization in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 60(i05).
    12. Amy Finkelstein & Nathaniel Hendren, 2020. "Welfare Analysis Meets Causal Inference," Journal of Economic Perspectives, American Economic Association, vol. 34(4), pages 146-167, Fall.
    13. Charles F. Manski, 2004. "Statistical Treatment Rules for Heterogeneous Populations," Econometrica, Econometric Society, vol. 72(4), pages 1221-1246, July.
    14. Magne Mogstad & Joseph P Romano & Azeem M Shaikh & Daniel Wilhelm, 2024. "Inference for Ranks with Applications to Mobility across Neighbourhoods and Academic Achievement across Countries," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 91(1), pages 476-518.
    15. Jiafeng Chen, 2022. "Empirical Bayes When Estimation Precision Predicts Parameters," Papers 2212.14444, arXiv.org, revised Dec 2025.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Juan C. Yamin, 2025. "Poverty Targeting with Imperfect Information," Papers 2506.18188, arXiv.org, revised May 2026.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Juan C. Yamin, 2025. "Poverty Targeting with Imperfect Information," Papers 2506.18188, arXiv.org, revised May 2026.
    2. Seungjin Han & Julius Owusu & Youngki Shin, 2026. "Ranking Treatment Saturations under Clustered Network Interference," Papers 2606.18590, arXiv.org.
    3. Cheaheon Lim & Yechan Park, 2026. "Dynamically Consistent Statistical Decisions," Papers 2607.10519, arXiv.org.
    4. Walters, Christopher, 2024. "Empirical Bayes methods in labor economics," Handbook of Labor Economics,, Elsevier.
    5. Nan Liu & Yanbo Liu & Yuya Sasaki & Yuanyuan Wan, 2025. "Nonparametric Uniform Inference in Binary Classification and Policy Values," Papers 2511.14700, arXiv.org, revised Dec 2025.
    6. Alejandro Sanchez-Becerra, 2023. "Robust inference for the treatment effect variance in experiments using machine learning," Papers 2306.03363, arXiv.org.
    7. JoonHo Lee & Daihe Sui, 2025. "Fully Bayesian Inference for Meta-Analytic Deconvolution Using Efron’s Log-Spline Prior," Mathematics, MDPI, vol. 13(16), pages 1-49, August.
    8. Daniel F. Pellatt, 2022. "PAC-Bayesian Treatment Allocation Under Budget Constraints," Papers 2212.09007, arXiv.org, revised Jun 2023.
    9. Manski, Charles F., 2023. "Probabilistic prediction for binary treatment choice: With focus on personalized medicine," Journal of Econometrics, Elsevier, vol. 234(2), pages 647-663.
    10. Ai, Chunrong & Fang, Yue & Xie, Haitian, 2026. "Data-driven policy learning for continuous treatments," Journal of Econometrics, Elsevier, vol. 253(C).
    11. Shosei Sakaguchi, 2021. "Estimation of Optimal Dynamic Treatment Assignment Rules under Policy Constraints," Papers 2106.05031, arXiv.org, revised Aug 2024.
    12. Toru Kitagawa & Weining Wang & Mengshan Xu, 2022. "Policy Choice in Time Series by Empirical Welfare Maximization," Papers 2205.03970, arXiv.org, revised Jun 2026.
    13. Toru Kitagawa & Weining Wang & Mengshan Xu, 2024. "Policy choice in time series by empirical welfare maximization," CeMMAP working papers 27/24, Institute for Fiscal Studies.
    14. Sasaki, Yuya & Ura, Takuya, 2025. "Welfare Analysis Via Marginal Treatment Effects," Econometric Theory, Cambridge University Press, vol. 41(6), pages 1392-1415, December.
    15. Timothy B. Armstrong & Shu Shen, 2023. "Inference on optimal treatment assignments," The Japanese Economic Review, Springer, vol. 74(4), pages 471-500, October.
    16. Crippa, Federico, 2025. "Regret analysis in threshold policy design," Journal of Econometrics, Elsevier, vol. 249(PB).
    17. Davide Viviano & Jess Rudder, 2020. "Policy design in experiments with unknown interference," Papers 2011.08174, arXiv.org, revised Jun 2026.
    18. Hugo Bodory & Federica Mascolo & Michael Lechner, 2024. "Enabling Decision-Making with the Modified Causal Forest: Policy Trees for Treatment Assignment," Papers 2406.02241, arXiv.org.
    19. Toru Kitagawa & Guanyi Wang, 2021. "Who should get vaccinated? Individualized allocation of vaccines over SIR network," CeMMAP working papers CWP28/21, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    20. Timothy B. Armstrong & Martin Weidner & Andrei Zeleneev, 2022. "Robust Estimation and Inference in Panels with Interactive Fixed Effects," Papers 2210.06639, arXiv.org, revised May 2025.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2503.03910. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.