IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2503.03910.html

Optimal Policy Choices Under Uncertainty

Author

Listed:
  • Sarah Moon

Abstract

Policymakers often face the decision of how to allocate resources across many different policies using noisy estimates of policy impacts. This paper develops a framework for optimal policy choices under statistical uncertainty. I consider a social planner who must choose upfront spending on a set of policies to maximize expected welfare. I show that, for small policy changes relative to the status quo, the posterior mean benefit and net cost of each policy are sufficient statistics for an oracle social planner who knows the true distribution of policy impacts. Since the true distribution is unknown in practice, I propose an empirical Bayes approach to estimate these posterior means and approximate the oracle planner. I derive finite-sample rates of convergence to the oracle planner's decision and show that, in contrast to empirical Bayes, plug-in methods can fail to converge. In an empirical application to 68 policies from Hendren and Sprung-Keyser (2020), I find welfare gains from the empirical Bayes approach and welfare losses from a plug-in approach, suggesting that careful incorporation of statistical uncertainty into policymaking can qualitatively change welfare conclusions.

Suggested Citation

  • Sarah Moon, 2025. "Optimal Policy Choices Under Uncertainty," Papers 2503.03910, arXiv.org, revised Feb 2026.
  • Handle: RePEc:arx:papers:2503.03910
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2503.03910
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Patrick Kline & Evan K. Rose & Christopher R. Walters, 2024. "A Discrimination Report Card," American Economic Review, American Economic Association, vol. 114(8), pages 2472-2525, August.
    2. Jiaying Gu & Roger Koenker, 2023. "Reply to: Comments on “Invidious Comparisons: Ranking and Selection as Compound Decisions”," Econometrica, Econometric Society, vol. 91(1), pages 61-66, January.
    3. Victor Chernozhukov & Sokbae Lee & Adam Rosen & Liyang Sun, 2025. "Policy learning with confidence," CeMMAP working papers 15/25, Institute for Fiscal Studies.
    4. Liyang Sun, 2021. "Empirical Welfare Maximization with Constraints," Papers 2103.15298, arXiv.org, revised Dec 2025.
    5. Eric Mbakop & Max Tabord‐Meehan, 2021. "Model Selection for Treatment Choice: Penalized Welfare Maximization," Econometrica, Econometric Society, vol. 89(2), pages 825-848, March.
    6. Toru Kitagawa & Aleksey Tetenov, 2018. "Who Should Be Treated? Empirical Welfare Maximization Methods for Treatment Choice," Econometrica, Econometric Society, vol. 86(2), pages 591-616, March.
    7. Amy Finkelstein & Nathaniel Hendren, 2020. "Welfare Analysis Meets Causal Inference," NBER Working Papers 27640, National Bureau of Economic Research, Inc.
    8. Roger Koenker & Ivan Mizera, 2014. "Convex Optimization, Shape Constraints, Compound Decisions, and Empirical Bayes Rules," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(506), pages 674-685, June.
    9. Jiaying Gu & Roger Koenker, 2023. "Invidious Comparisons: Ranking and Selection as Compound Decisions," Econometrica, Econometric Society, vol. 91(1), pages 1-41, January.
    10. Susan Athey & Stefan Wager, 2021. "Policy Learning With Observational Data," Econometrica, Econometric Society, vol. 89(1), pages 133-161, January.
    11. Amy Finkelstein & Nathaniel Hendren, 2020. "Welfare Analysis Meets Causal Inference," Journal of Economic Perspectives, American Economic Association, vol. 34(4), pages 146-167, Fall.
    12. Charles F. Manski, 2004. "Statistical Treatment Rules for Heterogeneous Populations," Econometrica, Econometric Society, vol. 72(4), pages 1221-1246, July.
    13. Magne Mogstad & Joseph P Romano & Azeem M Shaikh & Daniel Wilhelm, 2024. "Inference for Ranks with Applications to Mobility across Neighbourhoods and Academic Achievement across Countries," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 91(1), pages 476-518.
    14. Jiafeng Chen, 2022. "Empirical Bayes When Estimation Precision Predicts Parameters," Papers 2212.14444, arXiv.org, revised Dec 2025.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Juan C. Yamin, 2025. "Poverty Targeting with Imperfect Information," Papers 2506.18188, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Juan C. Yamin, 2025. "Poverty Targeting with Imperfect Information," Papers 2506.18188, arXiv.org.
    2. Nan Liu & Yanbo Liu & Yuya Sasaki & Yuanyuan Wan, 2025. "Nonparametric Uniform Inference in Binary Classification and Policy Values," Working Papers tecipa-811, University of Toronto, Department of Economics.
    3. Alejandro Sanchez-Becerra, 2023. "Robust inference for the treatment effect variance in experiments using machine learning," Papers 2306.03363, arXiv.org.
    4. Walters, Christopher, 2024. "Empirical Bayes methods in labor economics," Handbook of Labor Economics,, Elsevier.
    5. Daniel F. Pellatt, 2022. "PAC-Bayesian Treatment Allocation Under Budget Constraints," Papers 2212.09007, arXiv.org, revised Jun 2023.
    6. Manski, Charles F., 2023. "Probabilistic prediction for binary treatment choice: With focus on personalized medicine," Journal of Econometrics, Elsevier, vol. 234(2), pages 647-663.
    7. Nan Liu & Yanbo Liu & Yuya Sasaki & Yuanyuan Wan, 2025. "Nonparametric Uniform Inference in Binary Classification and Policy Values," Working Papers tecipa-811, University of Toronto, Department of Economics.
    8. Shosei Sakaguchi, 2021. "Estimation of Optimal Dynamic Treatment Assignment Rules under Policy Constraints," Papers 2106.05031, arXiv.org, revised Aug 2024.
    9. Toru Kitagawa & Weining Wang & Mengshan Xu, 2022. "Policy Choice in Time Series by Empirical Welfare Maximization," Papers 2205.03970, arXiv.org, revised Nov 2025.
    10. Toru Kitagawa & Weining Wang & Mengshan Xu, 2024. "Policy choice in time series by empirical welfare maximization," CeMMAP working papers 27/24, Institute for Fiscal Studies.
    11. Yuya Sasaki & Takuya Ura, 2020. "Welfare Analysis via Marginal Treatment Effects," Papers 2012.07624, arXiv.org.
    12. Timothy B. Armstrong & Shu Shen, 2023. "Inference on optimal treatment assignments," The Japanese Economic Review, Springer, vol. 74(4), pages 471-500, October.
    13. Crippa, Federico, 2025. "Regret analysis in threshold policy design," Journal of Econometrics, Elsevier, vol. 249(PB).
    14. Davide Viviano & Jess Rudder, 2020. "Policy design in experiments with unknown interference," Papers 2011.08174, arXiv.org, revised May 2024.
    15. Hugo Bodory & Federica Mascolo & Michael Lechner, 2024. "Enabling Decision-Making with the Modified Causal Forest: Policy Trees for Treatment Assignment," Papers 2406.02241, arXiv.org.
    16. Toru Kitagawa & Guanyi Wang, 2021. "Who should get vaccinated? Individualized allocation of vaccines over SIR network," CeMMAP working papers CWP28/21, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    17. Timothy Armstrong & Martin Weidner & Andrei Zeleneev, 2024. "Robust estimation and inference in panels with interactive fixed effects," IFS Working Papers WCWP28/24, Institute for Fiscal Studies.
    18. Toru Kitagawa & Sokbae Lee & Chen Qiu, 2023. "Treatment choice, mean square regret and partial identification," The Japanese Economic Review, Springer, vol. 74(4), pages 573-602, October.
    19. JoonHo Lee & Daihe Sui, 2025. "Fully Bayesian Inference for Meta-Analytic Deconvolution Using Efron’s Log-Spline Prior," Mathematics, MDPI, vol. 13(16), pages 1-49, August.
    20. Kitagawa, Toru & Wang, Guanyi, 2023. "Who should get vaccinated? Individualized allocation of vaccines over SIR network," Journal of Econometrics, Elsevier, vol. 232(1), pages 109-131.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2503.03910. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.