IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp17977.html
   My bibliography  Save this paper

Heterogeneity, Uncertainty and Learning: Semiparametric Identification and Estimation

Author

Listed:
  • Bunting, Jackson

    (University of Washington)

  • Diegert, Paul

    (Toulouse School of Economics)

  • Maurel, Arnaud

    (Duke University)

Abstract

We provide identification results for a broad class of learning models in which continuous outcomes depend on three types of unobservables: known heterogeneity, initially unknown heterogeneity that may be revealed over time, and transitory uncertainty. We consider a common environment where the researcher only has access to a short panel on choices and realized outcomes. We establish identification of the outcome equation parameters and the distribution of the unobservables, under the standard assumption that unknown heterogeneity and uncertainty are normally distributed. We also show that, absent known heterogeneity, the model is identified without making any distributional assumption. We then derive the asymptotic properties of a sieve MLE estimator for the model parameters, and devise a tractable profile likelihood based estimation procedure. Our estimator exhibits good finite-sample properties. Finally, we illustrate our approach with an application to ability learning in the context of occupational choice. Our results point to substantial ability learning based on realized wages.

Suggested Citation

  • Bunting, Jackson & Diegert, Paul & Maurel, Arnaud, 2025. "Heterogeneity, Uncertainty and Learning: Semiparametric Identification and Estimation," IZA Discussion Papers 17977, Institute of Labor Economics (IZA).
  • Handle: RePEc:iza:izadps:dp17977
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp17977.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Albert Madansky, 1964. "Instrumental variables in factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 29(2), pages 105-113, June.
    2. Fox, Jeremy T. & Kim, Kyoo il & Yang, Chenyu, 2016. "A simple nonparametric approach to estimating the distribution of random coefficients in structural models," Journal of Econometrics, Elsevier, vol. 195(2), pages 236-254.
    3. Heckman, James J. & Navarro, Salvador, 2007. "Dynamic discrete choice and dynamic treatment effects," Journal of Econometrics, Elsevier, vol. 136(2), pages 341-396, February.
    4. Aguirregabiria, Victor & Mira, Pedro, 2010. "Dynamic discrete choice structural models: A survey," Journal of Econometrics, Elsevier, vol. 156(1), pages 38-67, May.
    5. V. Joseph Hotz & Robert A. Miller, 1993. "Conditional Choice Probabilities and the Estimation of Dynamic Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 60(3), pages 497-529.
    6. Flávio Cunha & James Heckman, 2016. "Decomposing Trends in Inequality in Earnings into Forecastable and Uncertain Components," Journal of Labor Economics, University of Chicago Press, vol. 34(S2), pages 31-65.
    7. Tat Y. Chan & Barton H. Hamilton, 2006. "Learning, Private Information, and the Economic Evaluation of Randomized Experiments," Journal of Political Economy, University of Chicago Press, vol. 114(6), pages 997-1040, December.
    8. Nicolas Berman & Vincent Rebeyrol & Vincent Vicard, 2019. "Demand Learning and Firm Dynamics: Evidence from Exporters," The Review of Economics and Statistics, MIT Press, vol. 101(1), pages 91-106, March.
    9. Yifan Gong & Todd Stinebrickner & Ralph Stinebrickner, 2019. "Uncertainty about future income: Initial beliefs and resolution during college," Quantitative Economics, Econometric Society, vol. 10(2), pages 607-641, May.
    10. Yingyao Hu & Susanne M. Schennach, 2008. "Instrumental Variable Treatment of Nonclassical Measurement Error Models," Econometrica, Econometric Society, vol. 76(1), pages 195-216, January.
    11. Thomas F Crossley & Yifan Gong & Ralph Stinebrickner & Todd Stinebrickner, 2024. "Examining Income Expectations in the College and Early Post-College Periods: New Distributional Tests of Rational Expectations," Journal of the European Economic Association, European Economic Association, vol. 22(6), pages 2700-2747.
    12. Flavio Cunha & James J. Heckman & Susanne M. Schennach, 2010. "Estimating the Technology of Cognitive and Noncognitive Skill Formation," Econometrica, Econometric Society, vol. 78(3), pages 883-931, May.
    13. Miller, Robert A, 1984. "Job Matching and Occupational Choice," Journal of Political Economy, University of Chicago Press, vol. 92(6), pages 1086-1120, December.
    14. Chen, Xiaohong & Liao, Zhipeng & Sun, Yixiao, 2014. "Sieve inference on possibly misspecified semi-nonparametric time series models," Journal of Econometrics, Elsevier, vol. 178(P3), pages 639-658.
    15. Xavier D'Haultfoeuille & Christophe Gaillac & Arnaud Maurel, 2021. "Rationalizing rational expectations: Characterizations and tests," Quantitative Economics, Econometric Society, vol. 12(3), pages 817-842, July.
    16. Manuel Arellano & Stéphane Bonhomme, 2017. "Nonlinear Panel Data Methods for Dynamic Heterogeneous Agent Models," Annual Review of Economics, Annual Reviews, vol. 9(1), pages 471-496, September.
    17. Arcidiacono, Peter, 2004. "Ability sorting and the returns to college major," Journal of Econometrics, Elsevier, vol. 121(1-2), pages 343-375.
    18. Limor Golan & Carl Sanders, 2019. "Racial Gaps, Occupational Matching, and Skill Uncertainty," Review, Federal Reserve Bank of St. Louis, vol. 101(2), pages 135-153.
    19. Aguirregabiria, Victor & Gu, Jiaying & Luo, Yao, 2021. "Sufficient statistics for unobserved heterogeneity in structural dynamic logit models," Journal of Econometrics, Elsevier, vol. 223(2), pages 280-311.
    20. Flavio Cunha & James Heckman & Salvador Navarro, 2005. "Separating uncertainty from heterogeneity in life cycle earnings," Oxford Economic Papers, Oxford University Press, vol. 57(2), pages 191-261, April.
    21. Roger Koenker & Ivan Mizera, 2014. "Convex Optimization, Shape Constraints, Compound Decisions, and Empirical Bayes Rules," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(506), pages 674-685, June.
    22. John J. Conlon & Laura Pilossoph & Matthew Wiswall & Basit Zafar, 2018. "Labor Market Search With Imperfect Information and Learning," Working Papers 2018-068, Human Capital and Economic Opportunity Working Group.
    23. Elena Pastorino, 2015. "Job Matching Within And Across Firms," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 56(2), pages 647-671, May.
    24. Mark Huggett & Gustavo Ventura & Amir Yaron, 2011. "Sources of Lifetime Inequality," American Economic Review, American Economic Association, vol. 101(7), pages 2923-2954, December.
    25. Josh Kinsler & Ronni Pavan, 2021. "Local Distortions in Parental Beliefs over Child Skill," Journal of Political Economy, University of Chicago Press, vol. 129(1), pages 81-100.
    26. Elena Pastorino, 2015. "Job Matching Within And Across Firms," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 56, pages 647-671, May.
    27. Andrew T. Ching & Tülin Erdem & Michael P. Keane, 2013. "Invited Paper ---Learning Models: An Assessment of Progress, Challenges, and New Developments," Marketing Science, INFORMS, vol. 32(6), pages 913-938, November.
    28. Gregory S. Crawford & Matthew Shum, 2005. "Uncertainty and Learning in Pharmaceutical Demand," Econometrica, Econometric Society, vol. 73(4), pages 1137-1173, July.
    29. Hu, Yingyao & Sasaki, Yuya, 2018. "Closed-Form Identification Of Dynamic Discrete Choice Models With Proxies For Unobserved State Variables," Econometric Theory, Cambridge University Press, vol. 34(1), pages 166-185, February.
    30. Kate Antonovics & Limor Golan, 2012. "Experimentation and Job Choice," Journal of Labor Economics, University of Chicago Press, vol. 30(2), pages 333-366.
    31. Marc Henry & Yuichi Kitamura & Bernard Salanié, 2014. "Partial identification of finite mixtures in econometric models," Quantitative Economics, Econometric Society, vol. 5, pages 123-144, March.
    32. Jared Ashworth & V. Joseph Hotz & Arnaud Maurel & Tyler Ransom, 2021. "Changes across Cohorts in Wage Returns to Schooling and Early Work Experiences," Journal of Labor Economics, University of Chicago Press, vol. 39(4), pages 931-964.
    33. Chen, Xiaohong, 2007. "Large Sample Sieve Estimation of Semi-Nonparametric Models," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 76, Elsevier.
    34. Joachim Freyberger, 2018. "Non-parametric Panel Data Models with Interactive Fixed Effects," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 85(3), pages 1824-1851.
    35. Peter Arcidiacono & Esteban Aucejo & Arnaud Maurel & Tyler Ransom, 2025. "College Attrition and the Dynamics of Information Revelation," Journal of Political Economy, University of Chicago Press, vol. 133(1), pages 53-110.
    36. Manuel Arellano & Stéphane Bonhomme, 2017. "Nonlinear Panel Data Methods for Dynamic Heterogeneous Agent Models," Working Papers wp2018_1703, CEMFI.
    37. Daniel A. Ackerberg, 2003. "Advertising, learning, and consumer choice in experience good markets: an empirical examination," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 44(3), pages 1007-1040, August.
    38. Todd Stinebrickner & Ralph Stinebrickner, 2012. "Learning about Academic Ability and the College Dropout Decision," Journal of Labor Economics, University of Chicago Press, vol. 30(4), pages 707-748.
    39. Nicolas Berman & Vincent Rebeyrol & Vincent Vicard, 2019. "Demand Learning and Firm Dynamics: Evidence from Exporters," The Review of Economics and Statistics, MIT Press, vol. 101(1), pages 91-106, March.
    40. Jushan Bai, 2009. "Panel Data Models With Interactive Fixed Effects," Econometrica, Econometric Society, vol. 77(4), pages 1229-1279, July.
    41. Andrew T. Ching & Tülin Erdem & Michael P. Keane, 2013. "Learning Models: An Assessment of Progress, Challenges and New Developments," Economics Papers 2013-W07, Economics Group, Nuffield College, University of Oxford.
    42. Hiroyuki Kasahara & Katsumi Shimotsu, 2009. "Nonparametric Identification of Finite Mixture Models of Dynamic Discrete Choices," Econometrica, Econometric Society, vol. 77(1), pages 135-175, January.
    43. Coscelli, Andrea & Shum, Matthew, 2004. "An empirical model of learning and patient spillovers in new drug entry," Journal of Econometrics, Elsevier, vol. 122(2), pages 213-246, October.
    44. Giovanni Compiani & Yuichi Kitamura, 2016. "Using mixtures in econometric models: a brief review and some new results," Econometrics Journal, Royal Economic Society, vol. 19(3), pages 95-127, October.
    45. Hu, Yingyao & Shum, Matthew, 2012. "Nonparametric identification of dynamic models with unobserved state variables," Journal of Econometrics, Elsevier, vol. 171(1), pages 32-44.
    46. Yuichi Kitamura & Louise Laage, 2018. "Nonparametric Analysis of Finite Mixtures," Papers 1811.02727, arXiv.org.
    47. Sasaki, Yuya, 2015. "Heterogeneity and selection in dynamic panel data," Journal of Econometrics, Elsevier, vol. 188(1), pages 236-249.
    48. Elena Pastorino, 2024. "Careers in Firms: The Role of Learning about Ability and Human Capital Acquisition," Journal of Political Economy, University of Chicago Press, vol. 132(6), pages 1994-2073.
    49. Jackson Bunting, 2022. "Continuous permanent unobserved heterogeneity in dynamic discrete choice models," Papers 2202.03960, arXiv.org, revised Feb 2024.
    50. Victor Aguirregabiria & Jihye Jeon, 2020. "Firms’ Beliefs and Learning: Models, Identification, and Empirical Evidence," Review of Industrial Organization, Springer;The Industrial Organization Society, vol. 56(2), pages 203-235, March.
    51. James Heckman & Jose Scheinkman, 1987. "The Importance of Bundling in a Gorman-Lancaster Model of Earnings," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 54(2), pages 243-255.
    52. Khai Xiang Chiong & Alfred Galichon & Matt Shum, 2016. "Duality in dynamic discrete‐choice models," Quantitative Economics, Econometric Society, vol. 7(1), pages 83-115, March.
    53. Andrés Hincapié, 2020. "Entrepreneurship Over The Life Cycle: Where Are The Young Entrepreneurs?," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 61(2), pages 617-681, May.
    54. Tülin Erdem & Michael P. Keane, 1996. "Decision-Making Under Uncertainty: Capturing Dynamic Brand Choice Processes in Turbulent Consumer Goods Markets," Marketing Science, INFORMS, vol. 15(1), pages 1-20.
    55. Koenker, Roger & Mizera, Ivan, 2014. "Convex Optimization in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 60(i05).
    56. Kevin M. Stange, 2012. "An Empirical Investigation of the Option Value of College Enrollment," American Economic Journal: Applied Economics, American Economic Association, vol. 4(1), pages 49-84, January.
    57. Theodore Papageorgiou, 2014. "Learning Your Comparative Advantages," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(3), pages 1263-1295.
    58. Richard Blundell, 2017. "What Have We Learned from Structural Models?," American Economic Review, American Economic Association, vol. 107(5), pages 287-292, May.
    59. James Thomas, 2019. "The signal quality of grades across academic fields," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(4), pages 566-587, June.
    60. Jaap H. Abbring & Jeffrey R. Campbell, 2005. "A Firm's First Year," Tinbergen Institute Discussion Papers 05-046/3, Tinbergen Institute.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Olivier De Groote, 2025. "Dynamic Effort Choice in High School: Costs and Benefits of an Academic Track," Journal of Labor Economics, University of Chicago Press, vol. 43(2), pages 467-502.
    2. Hu, Yingyao, 2017. "The Econometrics of Unobservables -- Latent Variable and Measurement Error Models and Their Applications in Empirical Industrial Organization and Labor Economics [The Econometrics of Unobservables]," Economics Working Paper Archive 64578, The Johns Hopkins University,Department of Economics, revised 2021.
    3. Andrew T. Ching & Tülin Erdem & Michael P. Keane, 2013. "Invited Paper ---Learning Models: An Assessment of Progress, Challenges, and New Developments," Marketing Science, INFORMS, vol. 32(6), pages 913-938, November.
    4. Li, Hongyan & Xia, Xing, 2024. "Grades as signals of comparative advantage: How letter grades affect major choices," Journal of Economic Behavior & Organization, Elsevier, vol. 227(C).
    5. Andrew T. Ching & Tülin Erdem & Michael P. Keane, 2013. "Learning Models: An Assessment of Progress, Challenges and New Developments," Economics Papers 2013-W07, Economics Group, Nuffield College, University of Oxford.
    6. Hu, Yingyao & Xin, Yi, 2024. "Identification and estimation of dynamic structural models with unobserved choices," Journal of Econometrics, Elsevier, vol. 242(2).
    7. Hu, Yingyao & Shum, Matthew, 2012. "Nonparametric identification of dynamic models with unobserved state variables," Journal of Econometrics, Elsevier, vol. 171(1), pages 32-44.
    8. Sebastian Galiani & Juan Pantano, 2021. "Structural Models: Inception and Frontier," NBER Working Papers 28698, National Bureau of Economic Research, Inc.
    9. Arcidiacono, Peter & Miller, Robert A., 2020. "Identifying dynamic discrete choice models off short panels," Journal of Econometrics, Elsevier, vol. 215(2), pages 473-485.
    10. Hu, Yingyao, 2017. "The econometrics of unobservables: Applications of measurement error models in empirical industrial organization and labor economics," Journal of Econometrics, Elsevier, vol. 200(2), pages 154-168.
    11. Manudeep Bhuller & Philipp Eisenhauer & Moritz Mendel, 2022. "Sequential Choices, Option Values, and the Returns to Education," Papers 2205.05444, arXiv.org, revised Jul 2024.
    12. Jaap H. Abbring, 2010. "Identification of Dynamic Discrete Choice Models," Annual Review of Economics, Annual Reviews, vol. 2(1), pages 367-394, September.
    13. Yifan Gong & Todd Stinebrickner & Ralph Stinebrickner, 2020. "Perceived and actual option values of college enrollment," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(7), pages 940-959, November.
    14. Ralph Stinebrickner & Todd Stinebrickner, 2014. "Academic Performance and College Dropout: Using Longitudinal Expectations Data to Estimate a Learning Model," Journal of Labor Economics, University of Chicago Press, vol. 32(3), pages 601-644.
    15. Hoffman, Mitchell & Burks, Stephen V., 2017. "Worker Overconfidence: Field Evidence and Implications for Employee Turnover and Returns from Training," IZA Discussion Papers 10794, Institute of Labor Economics (IZA).
    16. Mira Frick & Ryota Iijima & Tomasz Strzalecki, 2019. "Dynamic Random Utility," Econometrica, Econometric Society, vol. 87(6), pages 1941-2002, November.
    17. Jie Bai, 2016. "Melons as Lemons: Asymmetric Information, Consumer Learning and Seller Reputation," Natural Field Experiments 00540, The Field Experiments Website.
    18. John Eric Humphries & Juanna Schr¿ter Joensen & Gregory F. Veramendi, 2025. "Complementarities in High School and College Investments," Cowles Foundation Discussion Papers 2446, Cowles Foundation for Research in Economics, Yale University.
    19. Kalouptsidi, Myrto & Scott, Paul & Souza-Rodrigues, Eduardo, 2015. "Identification of Counterfactuals and Payoffs in Dynamic Discrete Choice with an Application to Land Use," TSE Working Papers 15-596, Toulouse School of Economics (TSE).
    20. Lutz Hendricks & Oksana Leukhina, 2018. "The Return To College: Selection And Dropout Risk," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 59(3), pages 1077-1102, August.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp17977. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.