IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2402.08575.html
   My bibliography  Save this paper

Heterogeneity, Uncertainty and Learning: Semiparametric Identification and Estimation

Author

Listed:
  • Jackson Bunting
  • Paul Diegert
  • Arnaud Maurel

Abstract

We provide identification results for a broad class of learning models in which continuous outcomes depend on three types of unobservables: known heterogeneity, initially unknown heterogeneity that may be revealed over time, and transitory uncertainty. We consider a common environment where the researcher only has access to a short panel on choices and realized outcomes. We establish identification of the outcome equation parameters and the distribution of the unobservables, under the standard assumption that unknown heterogeneity and uncertainty are normally distributed. We also show that, absent known heterogeneity, the model is identified without making any distributional assumption. We then derive the asymptotic properties of a sieve MLE estimator for the model parameters, and devise a tractable profile likelihood-based estimation procedure. Our estimator exhibits good finite-sample properties. Finally, we illustrate our approach with an application to ability learning in the context of occupational choice. Our results point to substantial ability learning based on realized wages.

Suggested Citation

  • Jackson Bunting & Paul Diegert & Arnaud Maurel, 2024. "Heterogeneity, Uncertainty and Learning: Semiparametric Identification and Estimation," Papers 2402.08575, arXiv.org, revised Jun 2025.
  • Handle: RePEc:arx:papers:2402.08575
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2402.08575
    File Function: Latest version
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Josh Kinsler & Ronni Pavan, 2021. "Local Distortions in Parental Beliefs over Child Skill," Journal of Political Economy, University of Chicago Press, vol. 129(1), pages 81-100.
    2. Nicolas Berman & Vincent Rebeyrol & Vincent Vicard, 2019. "Demand Learning and Firm Dynamics: Evidence from Exporters," The Review of Economics and Statistics, MIT Press, vol. 101(1), pages 91-106, March.
    3. Manuel Arellano & Stéphane Bonhomme, 2017. "Nonlinear Panel Data Methods for Dynamic Heterogeneous Agent Models," Annual Review of Economics, Annual Reviews, vol. 9(1), pages 471-496, September.
    4. Andrés Hincapié, 2020. "Entrepreneurship Over The Life Cycle: Where Are The Young Entrepreneurs?," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 61(2), pages 617-681, May.
    5. Fox, Jeremy T. & Kim, Kyoo il & Yang, Chenyu, 2016. "A simple nonparametric approach to estimating the distribution of random coefficients in structural models," Journal of Econometrics, Elsevier, vol. 195(2), pages 236-254.
    6. Elena Pastorino, 2015. "Job Matching Within And Across Firms," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 56, pages 647-671, May.
    7. Flavio Cunha & James J. Heckman & Susanne M. Schennach, 2010. "Estimating the Technology of Cognitive and Noncognitive Skill Formation," Econometrica, Econometric Society, vol. 78(3), pages 883-931, May.
    8. Aguirregabiria, Victor & Mira, Pedro, 2010. "Dynamic discrete choice structural models: A survey," Journal of Econometrics, Elsevier, vol. 156(1), pages 38-67, May.
    9. Albert Madansky, 1964. "Instrumental variables in factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 29(2), pages 105-113, June.
    10. Andrew T. Ching & Tülin Erdem & Michael P. Keane, 2013. "Invited Paper ---Learning Models: An Assessment of Progress, Challenges, and New Developments," Marketing Science, INFORMS, vol. 32(6), pages 913-938, November.
    11. Flavio Cunha & James Heckman & Salvador Navarro, 2005. "Separating uncertainty from heterogeneity in life cycle earnings," Oxford Economic Papers, Oxford University Press, vol. 57(2), pages 191-261, April.
    12. Tülin Erdem & Michael P. Keane, 1996. "Decision-Making Under Uncertainty: Capturing Dynamic Brand Choice Processes in Turbulent Consumer Goods Markets," Marketing Science, INFORMS, vol. 15(1), pages 1-20.
    13. Jared Ashworth & V. Joseph Hotz & Arnaud Maurel & Tyler Ransom, 2021. "Changes across Cohorts in Wage Returns to Schooling and Early Work Experiences," Journal of Labor Economics, University of Chicago Press, vol. 39(4), pages 931-964.
    14. Giovanni Compiani & Yuichi Kitamura, 2016. "Using mixtures in econometric models: a brief review and some new results," Econometrics Journal, Royal Economic Society, vol. 19(3), pages 95-127, October.
    15. Gregory S. Crawford & Matthew Shum, 2005. "Uncertainty and Learning in Pharmaceutical Demand," Econometrica, Econometric Society, vol. 73(4), pages 1137-1173, July.
    16. Hu, Yingyao & Sasaki, Yuya, 2018. "Closed-Form Identification Of Dynamic Discrete Choice Models With Proxies For Unobserved State Variables," Econometric Theory, Cambridge University Press, vol. 34(1), pages 166-185, February.
    17. Kate Antonovics & Limor Golan, 2012. "Experimentation and Job Choice," Journal of Labor Economics, University of Chicago Press, vol. 30(2), pages 333-366.
    18. Heckman, James J. & Navarro, Salvador, 2007. "Dynamic discrete choice and dynamic treatment effects," Journal of Econometrics, Elsevier, vol. 136(2), pages 341-396, February.
    19. V. Joseph Hotz & Robert A. Miller, 1993. "Conditional Choice Probabilities and the Estimation of Dynamic Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 60(3), pages 497-529.
    20. Hu, Yingyao & Shum, Matthew, 2012. "Nonparametric identification of dynamic models with unobserved state variables," Journal of Econometrics, Elsevier, vol. 171(1), pages 32-44.
    21. Marc Henry & Yuichi Kitamura & Bernard Salanié, 2014. "Partial identification of finite mixtures in econometric models," Quantitative Economics, Econometric Society, vol. 5, pages 123-144, March.
    22. Yifan Gong & Todd Stinebrickner & Ralph Stinebrickner, 2019. "Uncertainty about future income: Initial beliefs and resolution during college," Quantitative Economics, Econometric Society, vol. 10(2), pages 607-641, May.
    23. Elena Pastorino, 2015. "Job Matching Within And Across Firms," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 56(2), pages 647-671, May.
    24. Aguirregabiria, Victor & Gu, Jiaying & Luo, Yao, 2021. "Sufficient statistics for unobserved heterogeneity in structural dynamic logit models," Journal of Econometrics, Elsevier, vol. 223(2), pages 280-311.
    25. Flávio Cunha & James Heckman, 2016. "Decomposing Trends in Inequality in Earnings into Forecastable and Uncertain Components," Journal of Labor Economics, University of Chicago Press, vol. 34(S2), pages 31-65.
    26. Mark Huggett & Gustavo Ventura & Amir Yaron, 2011. "Sources of Lifetime Inequality," American Economic Review, American Economic Association, vol. 101(7), pages 2923-2954, December.
    27. Chen, Xiaohong, 2007. "Large Sample Sieve Estimation of Semi-Nonparametric Models," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 76, Elsevier.
    28. Xavier D'Haultfoeuille & Christophe Gaillac & Arnaud Maurel, 2021. "Rationalizing rational expectations: Characterizations and tests," Quantitative Economics, Econometric Society, vol. 12(3), pages 817-842, July.
    29. Joachim Freyberger, 2018. "Non-parametric Panel Data Models with Interactive Fixed Effects," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 85(3), pages 1824-1851.
    30. Peter Arcidiacono & Esteban Aucejo & Arnaud Maurel & Tyler Ransom, 2025. "College Attrition and the Dynamics of Information Revelation," Journal of Political Economy, University of Chicago Press, vol. 133(1), pages 53-110.
    31. Yuichi Kitamura & Louise Laage, 2018. "Nonparametric Analysis of Finite Mixtures," Papers 1811.02727, arXiv.org.
    32. Koenker, Roger & Mizera, Ivan, 2014. "Convex Optimization in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 60(i05).
    33. Tat Y. Chan & Barton H. Hamilton, 2006. "Learning, Private Information, and the Economic Evaluation of Randomized Experiments," Journal of Political Economy, University of Chicago Press, vol. 114(6), pages 997-1040, December.
    34. Manuel Arellano & Stéphane Bonhomme, 2017. "Nonlinear Panel Data Methods for Dynamic Heterogeneous Agent Models," Working Papers wp2018_1703, CEMFI.
    35. Yingyao Hu & Susanne M. Schennach, 2008. "Instrumental Variable Treatment of Nonclassical Measurement Error Models," Econometrica, Econometric Society, vol. 76(1), pages 195-216, January.
    36. Daniel A. Ackerberg, 2003. "Advertising, learning, and consumer choice in experience good markets: an empirical examination," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 44(3), pages 1007-1040, August.
    37. Todd Stinebrickner & Ralph Stinebrickner, 2012. "Learning about Academic Ability and the College Dropout Decision," Journal of Labor Economics, University of Chicago Press, vol. 30(4), pages 707-748.
    38. Thomas F Crossley & Yifan Gong & Ralph Stinebrickner & Todd Stinebrickner, 2024. "Examining Income Expectations in the College and Early Post-College Periods: New Distributional Tests of Rational Expectations," Journal of the European Economic Association, European Economic Association, vol. 22(6), pages 2700-2747.
    39. Sasaki, Yuya, 2015. "Heterogeneity and selection in dynamic panel data," Journal of Econometrics, Elsevier, vol. 188(1), pages 236-249.
    40. Elena Pastorino, 2024. "Careers in Firms: The Role of Learning about Ability and Human Capital Acquisition," Journal of Political Economy, University of Chicago Press, vol. 132(6), pages 1994-2073.
    41. Miller, Robert A, 1984. "Job Matching and Occupational Choice," Journal of Political Economy, University of Chicago Press, vol. 92(6), pages 1086-1120, December.
    42. Chen, Xiaohong & Liao, Zhipeng & Sun, Yixiao, 2014. "Sieve inference on possibly misspecified semi-nonparametric time series models," Journal of Econometrics, Elsevier, vol. 178(P3), pages 639-658.
    43. Kevin M. Stange, 2012. "An Empirical Investigation of the Option Value of College Enrollment," American Economic Journal: Applied Economics, American Economic Association, vol. 4(1), pages 49-84, January.
    44. Victor Aguirregabiria & Jihye Jeon, 2020. "Firms’ Beliefs and Learning: Models, Identification, and Empirical Evidence," Review of Industrial Organization, Springer;The Industrial Organization Society, vol. 56(2), pages 203-235, March.
    45. Nicolas Berman & Vincent Rebeyrol & Vincent Vicard, 2019. "Demand Learning and Firm Dynamics: Evidence from Exporters," The Review of Economics and Statistics, MIT Press, vol. 101(1), pages 91-106, March.
    46. Arcidiacono, Peter, 2004. "Ability sorting and the returns to college major," Journal of Econometrics, Elsevier, vol. 121(1-2), pages 343-375.
    47. Theodore Papageorgiou, 2014. "Learning Your Comparative Advantages," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(3), pages 1263-1295.
    48. Jushan Bai, 2009. "Panel Data Models With Interactive Fixed Effects," Econometrica, Econometric Society, vol. 77(4), pages 1229-1279, July.
    49. Andrew T. Ching & Tülin Erdem & Michael P. Keane, 2013. "Learning Models: An Assessment of Progress, Challenges and New Developments," Economics Papers 2013-W07, Economics Group, Nuffield College, University of Oxford.
    50. Hiroyuki Kasahara & Katsumi Shimotsu, 2009. "Nonparametric Identification of Finite Mixture Models of Dynamic Discrete Choices," Econometrica, Econometric Society, vol. 77(1), pages 135-175, January.
    51. Limor Golan & Carl Sanders, 2019. "Racial Gaps, Occupational Matching, and Skill Uncertainty," Review, Federal Reserve Bank of St. Louis, vol. 101(2), pages 135-153.
    52. Jackson Bunting, 2022. "Continuous permanent unobserved heterogeneity in dynamic discrete choice models," Papers 2202.03960, arXiv.org, revised Feb 2024.
    53. Richard Blundell, 2017. "What Have We Learned from Structural Models?," American Economic Review, American Economic Association, vol. 107(5), pages 287-292, May.
    54. James Thomas, 2019. "The signal quality of grades across academic fields," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(4), pages 566-587, June.
    55. Roger Koenker & Ivan Mizera, 2014. "Convex Optimization, Shape Constraints, Compound Decisions, and Empirical Bayes Rules," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(506), pages 674-685, June.
    56. John J. Conlon & Laura Pilossoph & Matthew Wiswall & Basit Zafar, 2018. "Labor Market Search With Imperfect Information and Learning," Working Papers 2018-068, Human Capital and Economic Opportunity Working Group.
    57. Coscelli, Andrea & Shum, Matthew, 2004. "An empirical model of learning and patient spillovers in new drug entry," Journal of Econometrics, Elsevier, vol. 122(2), pages 213-246, October.
    58. James Heckman & Jose Scheinkman, 1987. "The Importance of Bundling in a Gorman-Lancaster Model of Earnings," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 54(2), pages 243-255.
    59. Khai Xiang Chiong & Alfred Galichon & Matt Shum, 2016. "Duality in dynamic discrete‐choice models," Quantitative Economics, Econometric Society, vol. 7(1), pages 83-115, March.
    60. Jaap H. Abbring & Jeffrey R. Campbell, 2005. "A Firm's First Year," Tinbergen Institute Discussion Papers 05-046/3, Tinbergen Institute.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Olivier De Groote, 2025. "Dynamic Effort Choice in High School: Costs and Benefits of an Academic Track," Journal of Labor Economics, University of Chicago Press, vol. 43(2), pages 467-502.
    2. Hu, Yingyao, 2017. "The Econometrics of Unobservables -- Latent Variable and Measurement Error Models and Their Applications in Empirical Industrial Organization and Labor Economics [The Econometrics of Unobservables]," Economics Working Paper Archive 64578, The Johns Hopkins University,Department of Economics, revised 2021.
    3. Andrew T. Ching & Tülin Erdem & Michael P. Keane, 2013. "Invited Paper ---Learning Models: An Assessment of Progress, Challenges, and New Developments," Marketing Science, INFORMS, vol. 32(6), pages 913-938, November.
    4. Li, Hongyan & Xia, Xing, 2024. "Grades as signals of comparative advantage: How letter grades affect major choices," Journal of Economic Behavior & Organization, Elsevier, vol. 227(C).
    5. Andrew T. Ching & Tülin Erdem & Michael P. Keane, 2013. "Learning Models: An Assessment of Progress, Challenges and New Developments," Economics Papers 2013-W07, Economics Group, Nuffield College, University of Oxford.
    6. Hu, Yingyao & Shum, Matthew, 2012. "Nonparametric identification of dynamic models with unobserved state variables," Journal of Econometrics, Elsevier, vol. 171(1), pages 32-44.
    7. Hu, Yingyao & Xin, Yi, 2024. "Identification and estimation of dynamic structural models with unobserved choices," Journal of Econometrics, Elsevier, vol. 242(2).
    8. Sebastian Galiani & Juan Pantano, 2021. "Structural Models: Inception and Frontier," NBER Working Papers 28698, National Bureau of Economic Research, Inc.
    9. Arcidiacono, Peter & Miller, Robert A., 2020. "Identifying dynamic discrete choice models off short panels," Journal of Econometrics, Elsevier, vol. 215(2), pages 473-485.
    10. Hu, Yingyao, 2017. "The econometrics of unobservables: Applications of measurement error models in empirical industrial organization and labor economics," Journal of Econometrics, Elsevier, vol. 200(2), pages 154-168.
    11. Manudeep Bhuller & Philipp Eisenhauer & Moritz Mendel, 2022. "Sequential Choices, Option Values, and the Returns to Education," Papers 2205.05444, arXiv.org, revised Jul 2024.
    12. Jaap H. Abbring, 2010. "Identification of Dynamic Discrete Choice Models," Annual Review of Economics, Annual Reviews, vol. 2(1), pages 367-394, September.
    13. Yifan Gong & Todd Stinebrickner & Ralph Stinebrickner, 2020. "Perceived and actual option values of college enrollment," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(7), pages 940-959, November.
    14. Ralph Stinebrickner & Todd Stinebrickner, 2014. "Academic Performance and College Dropout: Using Longitudinal Expectations Data to Estimate a Learning Model," Journal of Labor Economics, University of Chicago Press, vol. 32(3), pages 601-644.
    15. Hoffman, Mitchell & Burks, Stephen V., 2017. "Worker Overconfidence: Field Evidence and Implications for Employee Turnover and Returns from Training," IZA Discussion Papers 10794, Institute of Labor Economics (IZA).
    16. Hu Yingyao & Shum Matthew & Tan Wei & Xiao Ruli, 2017. "A Simple Estimator for Dynamic Models with Serially Correlated Unobservables," Journal of Econometric Methods, De Gruyter, vol. 6(1), pages 1-16, January.
    17. Mira Frick & Ryota Iijima & Tomasz Strzalecki, 2019. "Dynamic Random Utility," Econometrica, Econometric Society, vol. 87(6), pages 1941-2002, November.
    18. Jie Bai, 2016. "Melons as Lemons: Asymmetric Information, Consumer Learning and Seller Reputation," Natural Field Experiments 00540, The Field Experiments Website.
    19. John Eric Humphries & Juanna Schr¿ter Joensen & Gregory F. Veramendi, 2025. "Complementarities in High School and College Investments," Cowles Foundation Discussion Papers 2446, Cowles Foundation for Research in Economics, Yale University.
    20. Kalouptsidi, Myrto & Scott, Paul & Souza-Rodrigues, Eduardo, 2015. "Identification of Counterfactuals and Payoffs in Dynamic Discrete Choice with an Application to Land Use," TSE Working Papers 15-596, Toulouse School of Economics (TSE).

    More about this item

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C50 - Mathematical and Quantitative Methods - - Econometric Modeling - - - General
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2402.08575. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.