IDEAS home Printed from https://ideas.repec.org/a/ucp/jlstud/doi10.1086-684307.html
   My bibliography  Save this article

On Sturdy Policy Evaluation

Author

Listed:
  • William A. Brock
  • Steven N. Durlauf

Abstract

This paper provides an overview of different approaches to policy evaluation. We focus on how different types of uncertainty should be accounted for in the policy evaluation process. Appropriate incorporation of uncertainty in policy evaluation leads to what we call sturdy decisions. We describe classical Bayesian decision theory and decision theory under ambiguity. We provide examples ranging from the deterrent effect of capital punishment to Food and Drug Administration approval rules to environmental policy to illustrate the conceptual framework we present. Throughout, the role of judgment in any formal approach to policy evaluation is emphasized.

Suggested Citation

  • William A. Brock & Steven N. Durlauf, 2015. "On Sturdy Policy Evaluation," The Journal of Legal Studies, University of Chicago Press, vol. 44(S2), pages 447-473.
  • Handle: RePEc:ucp:jlstud:doi:10.1086/684307
    DOI: 10.1086/684307
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1086/684307
    Download Restriction: Access to the online full text or PDF requires a subscription.

    File URL: http://dx.doi.org/10.1086/684307
    Download Restriction: Access to the online full text or PDF requires a subscription.

    File URL: https://libkey.io/10.1086/684307?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lars Peter Hansen & Thomas J Sargent, 2014. "Robust Control and Model Misspecification," World Scientific Book Chapters, in: UNCERTAINTY WITHIN ECONOMIC MODELS, chapter 6, pages 155-216, World Scientific Publishing Co. Pte. Ltd..
    2. Martin Ellison & Thomas J. Sargent, 2012. "A Defense Of The Fomc," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 53(4), pages 1047-1065, November.
    3. William A. Brock & Steven N. Durlauf & Kenneth D. West, 2003. "Policy Evaluation in Uncertain Economic Environments," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 34(1), pages 235-322.
    4. Carmen Fernandez & Eduardo Ley & Mark F. J. Steel, 2001. "Model uncertainty in cross-country growth regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 16(5), pages 563-576.
    5. Timothy Cogley & Thomas J. Sargent, 2005. "The conquest of US inflation: Learning and robustness to model uncertainty," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 8(2), pages 528-563, April.
    6. Hashem Dezhbakhsh & Paul Rubin, 2011. "From the 'econometrics of capital punishment' to the 'capital punishment' of econometrics: on the use and abuse of sensitivity analysis," Applied Economics, Taylor & Francis Journals, vol. 43(25), pages 3655-3670.
    7. William A. Brock, 2006. "Profiling Problems With Partially Identified Structure," Economic Journal, Royal Economic Society, vol. 116(515), pages 427-440, November.
    8. Jörg Stoye, 2011. "Statistical decisions under ambiguity," Theory and Decision, Springer, vol. 70(2), pages 129-148, February.
    9. Cogley, Timothy & De Paoli, Bianca & Matthes, Christian & Nikolov, Kalin & Yates, Tony, 2011. "A Bayesian approach to optimal monetary policy with parameter and model uncertainty," Journal of Economic Dynamics and Control, Elsevier, vol. 35(12), pages 2186-2212.
    10. Gilboa, Itzhak & Schmeidler, David, 1989. "Maxmin expected utility with non-unique prior," Journal of Mathematical Economics, Elsevier, vol. 18(2), pages 141-153, April.
    11. James J. Heckman, 2000. "Causal Parameters and Policy Analysis in Economics: A Twentieth Century Retrospective," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 115(1), pages 45-97.
    12. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    13. Karl Schlag & Andriy Zapechelnyuk, 2009. "Decision Making in Uncertain and Changing Environments," Discussion Papers 19, Kyiv School of Economics.
    14. Hashem Dezhbakhsh & Paul H. Rubin & Joanna M. Shepherd, 2003. "Does Capital Punishment Have a Deterrent Effect? New Evidence from Postmoratorium Panel Data," American Law and Economics Review, Oxford University Press, vol. 5(2), pages 344-376, August.
    15. John M. Drake & Blaine D. Griffen, 2010. "Early warning signals of extinction in deteriorating environments," Nature, Nature, vol. 467(7314), pages 456-459, September.
    16. Giannis Vardas & Anastasios Xepapadeas, 2010. "Model Uncertainty, Ambiguity and the Precautionary Principle: Implications for Biodiversity Management," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 45(3), pages 379-404, March.
    17. Al-Najjar, Nabil I. & Weinstein, Jonathan, 2009. "Rejoinder: The €Œambiguity Aversion Literature: A Critical Assessmentâ€," Economics and Philosophy, Cambridge University Press, vol. 25(3), pages 357-369, November.
    18. Michael Funke & Michael Paetz, 2011. "Environmental policy under model uncertainty: a robust optimal control approach," Climatic Change, Springer, vol. 107(3), pages 225-239, August.
    19. Durlauf, Steven N. & Navarro, Salvador & Rivers, David A., 2010. "Understanding aggregate crime regressions," Journal of Econometrics, Elsevier, vol. 158(2), pages 306-317, October.
    20. Christina D. Romer & David H. Romer, 2008. "The FOMC versus the Staff: Where Can Monetary Policymakers Add Value?," American Economic Review, American Economic Association, vol. 98(2), pages 230-235, May.
    21. Xavier Sala-I-Martin & Gernot Doppelhofer & Ronald I. Miller, 2004. "Determinants of Long-Term Growth: A Bayesian Averaging of Classical Estimates (BACE) Approach," American Economic Review, American Economic Association, vol. 94(4), pages 813-835, September.
    22. Peter Klibanoff, 2013. "Thoughts on Policy Choice under Ambiguity," Journal of Institutional and Theoretical Economics (JITE), Mohr Siebeck, Tübingen, vol. 169(1), pages 134-138, March.
    23. Al-Najjar, Nabil I. & Weinstein, Jonathan, 2009. "The Ambiguity Aversion Literature: A Critical Assessment," Economics and Philosophy, Cambridge University Press, vol. 25(3), pages 249-284, November.
    24. Marten Scheffer & Jordi Bascompte & William A. Brock & Victor Brovkin & Stephen R. Carpenter & Vasilis Dakos & Hermann Held & Egbert H. van Nes & Max Rietkerk & George Sugihara, 2009. "Early-warning signals for critical transitions," Nature, Nature, vol. 461(7260), pages 53-59, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Durlauf, Steven N. & Navarro, Salvador & Rivers, David A., 2016. "Model uncertainty and the effect of shall-issue right-to-carry laws on crime," European Economic Review, Elsevier, vol. 81(C), pages 32-67.
    2. Mark F. J. Steel, 2020. "Model Averaging and Its Use in Economics," Journal of Economic Literature, American Economic Association, vol. 58(3), pages 644-719, September.
    3. Peter von zur Muehlen, 2022. "Prices and Taxes in a Ramsey Climate Policy Model under Heterogeneous Beliefs and Ambiguity," Economies, MDPI, vol. 10(10), pages 1-56, October.
    4. Lucchetti, Riccardo & Pedini, Luca & Pigini, Claudia, 2022. "No such thing as the perfect match: Bayesian Model Averaging for treatment evaluation," Economic Modelling, Elsevier, vol. 107(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Brock,W.A. & Durlauf,S.N., 2004. "Macroeconomics and model uncertainty," Working papers 20, Wisconsin Madison - Social Systems.
    2. Steven N. Durlauf & Chao Fu & Salvador Navarro, 2011. "Capital Punishment and Deterrence: Understanding Disparate Results," Working Papers 2012-005, Human Capital and Economic Opportunity Working Group.
    3. Steven N. Durlauf & Andros Kourtellos & Chih Ming Tan, 2012. "Is God in the details? A reexamination of the role of religion in economic growth," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(7), pages 1059-1075, November.
    4. Durlauf, Steven N. & Navarro, Salvador & Rivers, David A., 2016. "Model uncertainty and the effect of shall-issue right-to-carry laws on crime," European Economic Review, Elsevier, vol. 81(C), pages 32-67.
    5. Mark F. J. Steel, 2020. "Model Averaging and Its Use in Economics," Journal of Economic Literature, American Economic Association, vol. 58(3), pages 644-719, September.
    6. Brock, William A. & Durlauf, Steven N. & West, Kenneth D., 2007. "Model uncertainty and policy evaluation: Some theory and empirics," Journal of Econometrics, Elsevier, vol. 136(2), pages 629-664, February.
    7. Cohen-Cole, Ethan B. & Durlauf, Steven N. & Rondina, Giacomo, 2012. "Nonlinearities in growth: From evidence to policy," Journal of Macroeconomics, Elsevier, vol. 34(1), pages 42-58.
    8. repec:ebl:ecbull:v:4:y:2006:i:36:p:1-7 is not listed on IDEAS
    9. Massimo Marinacci, 2015. "Model Uncertainty," Journal of the European Economic Association, European Economic Association, vol. 13(6), pages 1022-1100, December.
    10. Steven N. Durlauf & Andros Kourtelos & Chih Ming Tan, 2006. "Is God in the details? A reexamination of the Role of Relegion in Economic," University of Cyprus Working Papers in Economics 10-2006, University of Cyprus Department of Economics.
    11. Moral-Benito, Enrique, 2010. "Model averaging in economics," MPRA Paper 26047, University Library of Munich, Germany.
    12. Kindy R. Sjahrir, 2018. "Formulating Regional Competitiveness Fiscal Policy based upon Leverage Factors for Indonesian Data," Working Papers in Economics and Development Studies (WoPEDS) 201804, Department of Economics, Padjadjaran University, revised Dec 2018.
    13. Athanassoglou, Stergios & Xepapadeas, Anastasios, 2012. "Pollution control with uncertain stock dynamics: When, and how, to be precautious," Journal of Environmental Economics and Management, Elsevier, vol. 63(3), pages 304-320.
    14. Antonio Ciccone & Marek Jarociński, 2010. "Determinants of Economic Growth: Will Data Tell?," American Economic Journal: Macroeconomics, American Economic Association, vol. 2(4), pages 222-246, October.
    15. Federica Ceron & Vassili Vergopoulos, 2020. "Recursive objective and subjective multiple priors," Post-Print halshs-02900497, HAL.
    16. Baker, Erin & Bosetti, Valentina & Salo, Ahti, 2016. "Finding Common Ground when Experts Disagree: Belief Dominance over Portfolios of Alternatives," MITP: Mitigation, Innovation and Transformation Pathways 243147, Fondazione Eni Enrico Mattei (FEEM).
    17. Panagiotidis, Theodore & Printzis, Panagiotis, 2020. "What is the investment loss due to uncertainty?," Global Finance Journal, Elsevier, vol. 45(C).
    18. Steven N. Durlauf & Andros Kourtellos & Chih Ming Tan, 2008. "Empirics of Growth and Development," Chapters, in: Amitava Krishna Dutt & Jaime Ros (ed.), International Handbook of Development Economics, Volumes 1 & 2, volume 0, chapter 3, Edward Elgar Publishing.
    19. Moral-Benito, Enrique & Roehn, Oliver, 2016. "The impact of financial regulation on current account balances," European Economic Review, Elsevier, vol. 81(C), pages 148-166.
    20. Dominiak, Adam & Duersch, Peter & Lefort, Jean-Philippe, 2012. "A dynamic Ellsberg urn experiment," Games and Economic Behavior, Elsevier, vol. 75(2), pages 625-638.
    21. Fleurbaey, Marc & Zuber, Stéphane, 2017. "Fair management of social risk," Journal of Economic Theory, Elsevier, vol. 169(C), pages 666-706.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ucp:jlstud:doi:10.1086/684307. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Journals Division (email available below). General contact details of provider: https://www.journals.uchicago.edu/JLS .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.