IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp14317.html
   My bibliography  Save this paper

Structural Models for Policy-Making: Coping with Parametric Uncertainty

Author

Listed:
  • Eisenhauer, Philipp

    (University of Bonn)

  • Gabler, Janos

    (IZA)

  • Janys, Lena

    (Newcastle University)

Abstract

The ex-ante evaluation of policies using structural econometric models is based on estimated parameters as a stand-in for the truth. This practice ignores uncertainty in the counterfactual policy predictions of the model. We develop a generic approach that deals with parametric uncertainty using uncertainty sets and frames model-informed policymaking as a decision problem under uncertainty. The seminal human capital investment model by Keane and Wolpin (1997) provides us with a well-known, influential, and empirically-grounded test case. We document considerable uncertainty in their policy predictions and highlight the resulting policy recommendations from using different formal rules on decision-making under uncertainty.

Suggested Citation

  • Eisenhauer, Philipp & Gabler, Janos & Janys, Lena, 2021. "Structural Models for Policy-Making: Coping with Parametric Uncertainty," IZA Discussion Papers 14317, Institute of Labor Economics (IZA).
  • Handle: RePEc:iza:izadps:dp14317
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp14317.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Charles F. Manski, 2013. "Response to the Review of ‘Public Policy in an Uncertain World’," Economic Journal, Royal Economic Society, vol. 0, pages 412-415, August.
    2. Andrés Erosa & Tatyana Koreshkova & Diego Restuccia, 2010. "How Important Is Human Capital? A Quantitative Theory Assessment of World Income Inequality," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 77(4), pages 1421-1449.
    3. Jérôme Adda & Christian Dustmann & Katrien Stevens, 2017. "The Career Costs of Children," Journal of Political Economy, University of Chicago Press, vol. 125(2), pages 293-337.
    4. Richard Blundell & Monica Costa Dias & Costas Meghir & Jonathan Shaw, 2016. "Female Labor Supply, Human Capital, and Welfare Reform," Econometrica, Econometric Society, vol. 84, pages 1705-1753, September.
    5. Zvi Eckstein & Michael Keane & Osnat Lifshitz, 2019. "Career and Family Decisions: Cohorts Born 1935–1975," Econometrica, Econometric Society, vol. 87(1), pages 217-253, January.
    6. Aguirregabiria, Victor & Mira, Pedro, 2010. "Dynamic discrete choice structural models: A survey," Journal of Econometrics, Elsevier, vol. 156(1), pages 38-67, May.
    7. Petra E. Todd & Kenneth I. Wolpin, 2007. "The Production of Cognitive Achievement in Children: Home, School, and Racial Test Score Gaps," Journal of Human Capital, University of Chicago Press, vol. 1(1), pages 91-136.
    8. George‐Levi Gayle & Andrew Shephard, 2019. "Optimal Taxation, Marriage, Home Production, and Family Labor Supply," Econometrica, Econometric Society, vol. 87(1), pages 291-326, January.
    9. Elizabeth M. Caucutt & Lance Lochner, 2020. "Early and Late Human Capital Investments, Borrowing Constraints, and the Family," Journal of Political Economy, University of Chicago Press, vol. 128(3), pages 1065-1147.
    10. Gilboa, Itzhak & Rouziou, Maria & Sibony, Olivier, 2018. "Decision theory made relevant: Between the software and the shrink," Research in Economics, Elsevier, vol. 72(2), pages 240-250.
    11. Flavio Cunha & James J. Heckman & Susanne M. Schennach, 2010. "Estimating the Technology of Cognitive and Noncognitive Skill Formation," Econometrica, Econometric Society, vol. 78(3), pages 883-931, May.
    12. Wolpin, Kenneth I., 2013. "The Limits of Inference without Theory," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262019086, December.
    13. Hamish Low & Costas Meghir, 2017. "The Use of Structural Models in Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 33-58, Spring.
    14. Jacob A. Mincer, 1974. "Schooling, Experience, and Earnings," NBER Books, National Bureau of Economic Research, Inc, number minc74-1, May.
    15. Yongyang Cai & Thomas S. Lontzek, 2019. "The Social Cost of Carbon with Economic and Climate Risks," Journal of Political Economy, University of Chicago Press, vol. 127(6), pages 2684-2734.
    16. Gilboa,Itzhak, 2009. "Theory of Decision under Uncertainty," Cambridge Books, Cambridge University Press, number 9780521517324.
    17. Keane, Michael P & Wolpin, Kenneth I, 1997. "The Career Decisions of Young Men," Journal of Political Economy, University of Chicago Press, vol. 105(3), pages 473-522, June.
    18. Federico A. Bugni & Takuya Ura, 2019. "Inference in dynamic discrete choice problems under local misspecification," Quantitative Economics, Econometric Society, vol. 10(1), pages 67-103, January.
    19. Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2020. "On the Informativeness of Descriptive Statistics for Structural Estimates," Econometrica, Econometric Society, vol. 88(6), pages 2231-2258, November.
    20. Jürg Niehans, 1948. "Zur Preisbildungen bei ungewissen Erwartungen," Swiss Journal of Economics and Statistics (SJES), Swiss Society of Economics and Statistics (SSES), vol. 84(V), pages 433-456.
    21. Richard Blundell & Andrew Shephard, 2012. "Employment, Hours of Work and the Optimal Taxation of Low-Income Families," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 79(2), pages 481-510.
    22. Thomas H. Jørgensen, 2023. "Sensitivity to Calibrated Parameters," The Review of Economics and Statistics, MIT Press, vol. 105(2), pages 474-481, March.
    23. Jacob A. Mincer, 1974. "Schooling and Earnings," NBER Chapters, in: Schooling, Experience, and Earnings, pages 41-63, National Bureau of Economic Research, Inc.
    24. Gilboa, Itzhak & Schmeidler, David, 1989. "Maxmin expected utility with non-unique prior," Journal of Mathematical Economics, Elsevier, vol. 18(2), pages 141-153, April.
    25. Loic BERGER & Nicolas BERGER & Valentina BOSETTI & Itzhak GILBOA & Lars Peter HANSEN & Christopher JARVIS & Massimo MARINACCI & Richard D. Smith, 2020. "Rational policymaking during a pandemic," Working Papers 2020-iRisk-01, IESEG School of Management.
    26. Daniel Kahneman & Peter P. Wakker & Rakesh Sarin, 1997. "Back to Bentham? Explorations of Experienced Utility," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 112(2), pages 375-406.
    27. Loic BERGER & Nicolas BERGER & Valentina BOSETTI & Itzhak GILBOA & Lars Peter HANSEN & Christopher JARVIS & Massimo MARINACCI & Richard D. Smith, 2020. "Rational policymaking during a pandemic," Working Papers 2020-iRisk-02, IESEG School of Management.
    28. Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2020. "Reply to: Comments on “On the Informativeness of Descriptive Statistics for Structural Estimates”," Econometrica, Econometric Society, vol. 88(6), pages 2277-2279, November.
    29. Stéphane Bonhomme & Martin Weidner, 2020. "Minimizing Sensitivity to Model Misspecification," CeMMAP working papers CWP37/20, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    30. Hungerford, Thomas & Solon, Gary, 1987. "Sheepskin Effects in the Returns to Education," The Review of Economics and Statistics, MIT Press, vol. 69(1), pages 175-177, February.
    31. Charles F. Manski, 2019. "Communicating uncertainty in policy analysis," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 116(16), pages 7634-7641, April.
    32. Kenneth I. Wolpin & Petra E. Todd, 2006. "Assessing the Impact of a School Subsidy Program in Mexico: Using a Social Experiment to Validate a Dynamic Behavioral Model of Child Schooling and Fertility," American Economic Review, American Economic Association, vol. 96(5), pages 1384-1417, December.
    33. Charles F. Manski, 2004. "Statistical Treatment Rules for Heterogeneous Populations," Econometrica, Econometric Society, vol. 72(4), pages 1221-1246, July.
    34. Philipp Eisenhauer & James J. Heckman & Stefano Mosso, 2015. "Estimation Of Dynamic Discrete Choice Models By Maximum Likelihood And The Simulated Method Of Moments," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 56, pages 331-357, May.
    35. Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2017. "Measuring the Sensitivity of Parameter Estimates to Estimation Moments," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(4), pages 1553-1592.
    36. Altonji, Joseph G, 1993. "The Demand for and Return to Education When Education Outcomes Are Uncertain," Journal of Labor Economics, University of Chicago Press, vol. 11(1), pages 48-83, January.
    37. Yaroslav Mukhin, 2018. "Sensitivity of Regular Estimators," Papers 1805.08883, arXiv.org.
    38. Aharon Ben-Tal & Dick den Hertog & Anja De Waegenaere & Bertrand Melenberg & Gijs Rennen, 2013. "Robust Solutions of Optimization Problems Affected by Uncertain Probabilities," Management Science, INFORMS, vol. 59(2), pages 341-357, April.
    39. Keane, Michael P. & Todd, Petra E. & Wolpin, Kenneth I., 2011. "The Structural Estimation of Behavioral Models: Discrete Choice Dynamic Programming Methods and Applications," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 4, pages 331-461, Elsevier.
    40. Manski, Charles F., 2013. "Public Policy in an Uncertain World: Analysis and Decisions," Economics Books, Harvard University Press, number 9780674066892, Spring.
    41. Daniel Harenberg & Stefano Marelli & Bruno Sudret & Viktor Winschel, 2019. "Uncertainty quantification and global sensitivity analysis for economic models," Quantitative Economics, Econometric Society, vol. 10(1), pages 1-41, January.
    42. Jaeger, David A & Page, Marianne E, 1996. "Degrees Matter: New Evidence on Sheepskin Effects in the Returns to Education," The Review of Economics and Statistics, MIT Press, vol. 78(4), pages 733-740, November.
    43. Charles F. Manski, 2021. "Econometrics for Decision Making: Building Foundations Sketched by Haavelmo and Wald," Econometrica, Econometric Society, vol. 89(6), pages 2827-2853, November.
    44. Manski, Charles F & Lerman, Steven R, 1977. "The Estimation of Choice Probabilities from Choice Based Samples," Econometrica, Econometric Society, vol. 45(8), pages 1977-1988, November.
    45. Richard Blundell, 2017. "What Have We Learned from Structural Models?," American Economic Review, American Economic Association, vol. 107(5), pages 287-292, May.
    46. Paul A. Samuelson, 1937. "A Note on Measurement of Utility," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 4(2), pages 155-161.
    47. Andrea Saltelli & Gabriele Bammer & Isabelle Bruno & Erica Charters & Monica Di Fiore & Emmanuel Didier & Wendy Nelson Espeland & John Kay & Samuele Lo Piano & Deborah Mayo & Roger Pielke Jr & Tommaso, 2020. "Five ways to ensure that models serve society: a manifesto," Nature, Nature, vol. 582(7813), pages 482-484, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Philipp Eisenhauer & Janos Gabler & Lena Janys, 2021. "Structural Models for Policy-Making: Coping with Parametric Uncertainty," ECONtribute Discussion Papers Series 082, University of Bonn and University of Cologne, Germany.
    2. Philipp Eisenhauer & Jano's Gabler & Lena Janys & Christopher Walsh, 2021. "Structural models for policy-making: Coping with parametric uncertainty," Papers 2103.01115, arXiv.org, revised Jun 2022.
    3. Philipp Eisenhauer & Lena Janys & Christopher Walsh & Janós Gabler, 2023. "Structural Models for Policy-Making," CRC TR 224 Discussion Paper Series crctr224_2023_484, University of Bonn and University of Mannheim, Germany.
    4. Maximilian Blesch & Philipp Eisenhauer, 2021. "Robust decision-making under risk and ambiguity," Papers 2104.12573, arXiv.org, revised Oct 2021.
    5. Maximilian Blesch & Philipp Eisenhauer, 2021. "Robust Decision-Making Under Risk and Ambiguity," ECONtribute Discussion Papers Series 104, University of Bonn and University of Cologne, Germany.
    6. Manudeep Bhuller & Philipp Eisenhauer & Moritz Mendel, 2022. "Sequential Choices, Option Values, and the Returns to Education," Papers 2205.05444, arXiv.org.
    7. Sebastian Galiani & Juan Pantano, 2021. "Structural Models: Inception and Frontier," NBER Working Papers 28698, National Bureau of Economic Research, Inc.
    8. Maximilian Blesch & Philipp Eisenhauer, 2023. "Robust Decision-Making under Risk and Ambiguity," Rationality and Competition Discussion Paper Series 463, CRC TRR 190 Rationality and Competition.
    9. Timothy B. Armstrong & Michal Kolesár, 2021. "Sensitivity analysis using approximate moment condition models," Quantitative Economics, Econometric Society, vol. 12(1), pages 77-108, January.
    10. Heckman, James J. & Humphries, John Eric & Veramendi, Gregory, 2016. "Dynamic treatment effects," Journal of Econometrics, Elsevier, vol. 191(2), pages 276-292.
    11. Elena Mattana & Juanna Joensen, 2014. "Student Aid, Academic Achievement, and Labor Market Behavior: Grants or Loans?," 2014 Meeting Papers 707, Society for Economic Dynamics.
    12. Heckman, James J. & Raut, Lakshmi K., 2016. "Intergenerational long-term effects of preschool-structural estimates from a discrete dynamic programming model," Journal of Econometrics, Elsevier, vol. 191(1), pages 164-175.
    13. Stéphane Bonhomme & Martin Weidner, 2022. "Minimizing sensitivity to model misspecification," Quantitative Economics, Econometric Society, vol. 13(3), pages 907-954, July.
    14. Elena Mattana & Juanna Joensen, 2016. "Student Aid, Academic Achievement, and Labor Market Behavior," 2016 Meeting Papers 1102, Society for Economic Dynamics.
    15. Philipp Eisenhauer & James J. Heckman & Stefano Mosso, 2015. "Estimation Of Dynamic Discrete Choice Models By Maximum Likelihood And The Simulated Method Of Moments," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 56(2), pages 331-357, May.
    16. Francesconi, Marco & Heckman, James J, 2015. "Symposium on Child Development and Parental Investment: Introduction," Economics Discussion Papers 16868, University of Essex, Department of Economics.
    17. Flávio Cunha & James Heckman, 2016. "Decomposing Trends in Inequality in Earnings into Forecastable and Uncertain Components," Journal of Labor Economics, University of Chicago Press, vol. 34(S2), pages 31-65.
    18. Eckstein, Zvi & Keane, Michael P. & Lifshitz, Osnat, 2023. "What Explains the Growing Gender Education Gap? The Effects of Parental Background, the Labor Market and the Marriage Market on College Attainment," IZA Discussion Papers 16612, Institute of Labor Economics (IZA).
    19. Polachek, Solomon W., 2008. "Earnings Over the Life Cycle: The Mincer Earnings Function and Its Applications," Foundations and Trends(R) in Microeconomics, now publishers, vol. 4(3), pages 165-272, April.
    20. Richard Blundell, 2017. "What Have We Learned from Structural Models?," American Economic Review, American Economic Association, vol. 107(5), pages 287-292, May.

    More about this item

    Keywords

    uncertainty quantification; structural estimation; statistical decision rules;
    All these keywords.

    JEL classification:

    • C44 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Operations Research; Statistical Decision Theory
    • C54 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Quantitative Policy Modeling
    • D81 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Criteria for Decision-Making under Risk and Uncertainty

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp14317. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.