IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2103.01115.html
   My bibliography  Save this paper

Structural models for policy-making: Coping with parametric uncertainty

Author

Listed:
  • Philipp Eisenhauer
  • Jano's Gabler
  • Lena Janys
  • Christopher Walsh

Abstract

The ex-ante evaluation of policies using structural econometric models is based on estimated parameters as a stand-in for the true parameters. This practice ignores uncertainty in the counterfactual policy predictions of the model. We develop a generic approach that deals with parametric uncertainty using uncertainty sets and frames model-informed policy-making as a decision problem under uncertainty. The seminal human capital investment model by Keane and Wolpin (1997) provides a well-known, influential, and empirically-grounded test case. We document considerable uncertainty in the models's policy predictions and highlight the resulting policy recommendations obtained from using different formal rules of decision-making under uncertainty.

Suggested Citation

  • Philipp Eisenhauer & Jano's Gabler & Lena Janys & Christopher Walsh, 2021. "Structural models for policy-making: Coping with parametric uncertainty," Papers 2103.01115, arXiv.org, revised Jun 2022.
  • Handle: RePEc:arx:papers:2103.01115
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2103.01115
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Charles F. Manski, 2013. "Response to the Review of ‘Public Policy in an Uncertain World’," Economic Journal, Royal Economic Society, vol. 0, pages 412-415, August.
    2. Yongyang Cai & Thomas S. Lontzek, 2019. "The Social Cost of Carbon with Economic and Climate Risks," Journal of Political Economy, University of Chicago Press, vol. 127(6), pages 2684-2734.
    3. Andrés Erosa & Tatyana Koreshkova & Diego Restuccia, 2010. "How Important Is Human Capital? A Quantitative Theory Assessment of World Income Inequality," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 77(4), pages 1421-1449.
    4. Elizabeth M. Caucutt & Lance Lochner, 2020. "Early and Late Human Capital Investments, Borrowing Constraints, and the Family," Journal of Political Economy, University of Chicago Press, vol. 128(3), pages 1065-1147.
    5. Jérôme Adda & Christian Dustmann & Katrien Stevens, 2017. "The Career Costs of Children," Journal of Political Economy, University of Chicago Press, vol. 125(2), pages 293-337.
    6. Daniel Kahneman & Peter P. Wakker & Rakesh Sarin, 1997. "Back to Bentham? Explorations of Experienced Utility," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 112(2), pages 375-406.
    7. Richard Blundell & Monica Costa Dias & Costas Meghir & Jonathan Shaw, 2016. "Female Labor Supply, Human Capital, and Welfare Reform," Econometrica, Econometric Society, vol. 84, pages 1705-1753, September.
    8. Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2020. "On the Informativeness of Descriptive Statistics for Structural Estimates," Econometrica, Econometric Society, vol. 88(6), pages 2231-2258, November.
    9. Flavio Cunha & James J. Heckman & Susanne M. Schennach, 2010. "Estimating the Technology of Cognitive and Noncognitive Skill Formation," Econometrica, Econometric Society, vol. 78(3), pages 883-931, May.
    10. Aguirregabiria, Victor & Mira, Pedro, 2010. "Dynamic discrete choice structural models: A survey," Journal of Econometrics, Elsevier, vol. 156(1), pages 38-67, May.
    11. Petra E. Todd & Kenneth I. Wolpin, 2007. "The Production of Cognitive Achievement in Children: Home, School, and Racial Test Score Gaps," Journal of Human Capital, University of Chicago Press, vol. 1(1), pages 91-136.
    12. Jürg Niehans, 1948. "Zur Preisbildungen bei ungewissen Erwartungen," Swiss Journal of Economics and Statistics (SJES), Swiss Society of Economics and Statistics (SSES), vol. 84(V), pages 433-456.
    13. Loic BERGER & Nicolas BERGER & Valentina BOSETTI & Itzhak GILBOA & Lars Peter HANSEN & Christopher JARVIS & Massimo MARINACCI & Richard D. Smith, 2020. "Rational policymaking during a pandemic," Working Papers 2020-iRisk-02, IESEG School of Management.
    14. Richard Blundell & Andrew Shephard, 2012. "Employment, Hours of Work and the Optimal Taxation of Low-Income Families," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 79(2), pages 481-510.
    15. Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2020. "Reply to: Comments on “On the Informativeness of Descriptive Statistics for Structural Estimates”," Econometrica, Econometric Society, vol. 88(6), pages 2277-2279, November.
    16. Zvi Eckstein & Michael Keane & Osnat Lifshitz, 2019. "Career and Family Decisions: Cohorts Born 1935–1975," Econometrica, Econometric Society, vol. 87(1), pages 217-253, January.
    17. Keane, Michael P. & Todd, Petra E. & Wolpin, Kenneth I., 2011. "The Structural Estimation of Behavioral Models: Discrete Choice Dynamic Programming Methods and Applications," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 4, pages 331-461, Elsevier.
    18. Manski, Charles F., 2013. "Public Policy in an Uncertain World: Analysis and Decisions," Economics Books, Harvard University Press, number 9780674066892, Spring.
    19. Charles F. Manski, 2004. "Statistical Treatment Rules for Heterogeneous Populations," Econometrica, Econometric Society, vol. 72(4), pages 1221-1246, July.
    20. Daniel Harenberg & Stefano Marelli & Bruno Sudret & Viktor Winschel, 2019. "Uncertainty quantification and global sensitivity analysis for economic models," Quantitative Economics, Econometric Society, vol. 10(1), pages 1-41, January.
    21. Gilboa,Itzhak, 2009. "Theory of Decision under Uncertainty," Cambridge Books, Cambridge University Press, number 9780521741231, September.
    22. Keane, Michael P & Wolpin, Kenneth I, 1997. "The Career Decisions of Young Men," Journal of Political Economy, University of Chicago Press, vol. 105(3), pages 473-522, June.
    23. Kenneth I. Wolpin & Petra E. Todd, 2006. "Assessing the Impact of a School Subsidy Program in Mexico: Using a Social Experiment to Validate a Dynamic Behavioral Model of Child Schooling and Fertility," American Economic Review, American Economic Association, vol. 96(5), pages 1384-1417, December.
    24. Wolpin, Kenneth I., 2013. "The Limits of Inference without Theory," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262019086, April.
    25. Philipp Eisenhauer & James J. Heckman & Stefano Mosso, 2015. "Estimation Of Dynamic Discrete Choice Models By Maximum Likelihood And The Simulated Method Of Moments," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 56, pages 331-357, May.
    26. Charles F. Manski, 2021. "Econometrics for Decision Making: Building Foundations Sketched by Haavelmo and Wald," Econometrica, Econometric Society, vol. 89(6), pages 2827-2853, November.
    27. Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2017. "Measuring the Sensitivity of Parameter Estimates to Estimation Moments," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(4), pages 1553-1592.
    28. Hamish Low & Costas Meghir, 2017. "The Use of Structural Models in Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 33-58, Spring.
    29. Gilboa, Itzhak & Schmeidler, David, 1989. "Maxmin expected utility with non-unique prior," Journal of Mathematical Economics, Elsevier, vol. 18(2), pages 141-153, April.
    30. Altonji, Joseph G, 1993. "The Demand for and Return to Education When Education Outcomes Are Uncertain," Journal of Labor Economics, University of Chicago Press, vol. 11(1), pages 48-83, January.
    31. Loic BERGER & Nicolas BERGER & Valentina BOSETTI & Itzhak GILBOA & Lars Peter HANSEN & Christopher JARVIS & Massimo MARINACCI & Richard D. Smith, 2020. "Rational policymaking during a pandemic," Working Papers 2020-iRisk-01, IESEG School of Management.
    32. Manski, Charles F & Lerman, Steven R, 1977. "The Estimation of Choice Probabilities from Choice Based Samples," Econometrica, Econometric Society, vol. 45(8), pages 1977-1988, November.
    33. Timothy Christensen & Benjamin Connault, 2019. "Counterfactual Sensitivity and Robustness," Papers 1904.00989, arXiv.org, revised May 2022.
    34. Richard Blundell, 2017. "What Have We Learned from Structural Models?," American Economic Review, American Economic Association, vol. 107(5), pages 287-292, May.
    35. Paul A. Samuelson, 1937. "A Note on Measurement of Utility," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 4(2), pages 155-161.
    36. Andrea Saltelli & Gabriele Bammer & Isabelle Bruno & Erica Charters & Monica Di Fiore & Emmanuel Didier & Wendy Nelson Espeland & John Kay & Samuele Lo Piano & Deborah Mayo & Roger Pielke Jr & Tommaso, 2020. "Five ways to ensure that models serve society: a manifesto," Nature, Nature, vol. 582(7813), pages 482-484, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Eisenhauer, Philipp & Gabler, Janos & Janys, Lena, 2021. "Structural Models for Policy-Making: Coping with Parametric Uncertainty," IZA Discussion Papers 14317, Institute of Labor Economics (IZA).
    2. Philipp Eisenhauer & Janos Gabler & Lena Janys, 2021. "Structural Models for Policy-Making: Coping with Parametric Uncertainty," ECONtribute Discussion Papers Series 082, University of Bonn and University of Cologne, Germany.
    3. Philipp Eisenhauer & Lena Janys & Christopher Walsh & Janós Gabler, 2023. "Structural Models for Policy-Making," CRC TR 224 Discussion Paper Series crctr224_2023_484, University of Bonn and University of Mannheim, Germany.
    4. Maximilian Blesch & Philipp Eisenhauer, 2021. "Robust decision-making under risk and ambiguity," Papers 2104.12573, arXiv.org, revised Oct 2021.
    5. Sebastian Galiani & Juan Pantano, 2021. "Structural Models: Inception and Frontier," NBER Working Papers 28698, National Bureau of Economic Research, Inc.
    6. Maximilian Blesch & Philipp Eisenhauer, 2021. "Robust Decision-Making Under Risk and Ambiguity," ECONtribute Discussion Papers Series 104, University of Bonn and University of Cologne, Germany.
    7. Maximilian Blesch & Philipp Eisenhauer, 2023. "Robust Decision-Making under Risk and Ambiguity," Rationality and Competition Discussion Paper Series 463, CRC TRR 190 Rationality and Competition.
    8. Manudeep Bhuller & Philipp Eisenhauer & Moritz Mendel, 2022. "Sequential Choices, Option Values, and the Returns to Education," Papers 2205.05444, arXiv.org, revised Jul 2024.
    9. Heckman, James J. & Raut, Lakshmi K., 2016. "Intergenerational long-term effects of preschool-structural estimates from a discrete dynamic programming model," Journal of Econometrics, Elsevier, vol. 191(1), pages 164-175.
    10. Elena Mattana & Juanna Joensen, 2016. "Student Aid, Academic Achievement, and Labor Market Behavior," 2016 Meeting Papers 1102, Society for Economic Dynamics.
    11. Elena Mattana & Juanna Joensen, 2014. "Student Aid, Academic Achievement, and Labor Market Behavior: Grants or Loans?," 2014 Meeting Papers 707, Society for Economic Dynamics.
    12. Stéphane Bonhomme & Martin Weidner, 2022. "Minimizing sensitivity to model misspecification," Quantitative Economics, Econometric Society, vol. 13(3), pages 907-954, July.
    13. Philipp Eisenhauer & James J. Heckman & Stefano Mosso, 2015. "Estimation Of Dynamic Discrete Choice Models By Maximum Likelihood And The Simulated Method Of Moments," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 56(2), pages 331-357, May.
    14. Heckman, James J. & Humphries, John Eric & Veramendi, Gregory, 2016. "Dynamic treatment effects," Journal of Econometrics, Elsevier, vol. 191(2), pages 276-292.
    15. Francesconi, Marco & Heckman, James J, 2015. "Symposium on Child Development and Parental Investment: Introduction," Economics Discussion Papers 16868, University of Essex, Department of Economics.
    16. Juan Chaparro & Aaron Sojourner & Matthew J. Wiswall, 2020. "Early Childhood Care and Cognitive Development," NBER Working Papers 26813, National Bureau of Economic Research, Inc.
    17. Richard Blundell, 2017. "What Have We Learned from Structural Models?," American Economic Review, American Economic Association, vol. 107(5), pages 287-292, May.
    18. Deaton, Angus & Cartwright, Nancy, 2018. "Understanding and misunderstanding randomized controlled trials," Social Science & Medicine, Elsevier, vol. 210(C), pages 2-21.
    19. Elizabeth M. Caucutt & Lance Lochner & Youngmin Park, 2017. "Correlation, Consumption, Confusion, or Constraints: Why Do Poor Children Perform so Poorly?," Scandinavian Journal of Economics, Wiley Blackwell, vol. 119(1), pages 102-147, January.
    20. Stéphane Bonhomme & Martin Weidner, 2020. "Minimizing Sensitivity to Model Misspecification," CeMMAP working papers CWP37/20, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2103.01115. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.