IDEAS home Printed from https://ideas.repec.org/p/ifs/cemmap/43-19.html
   My bibliography  Save this paper

Posterior average effects

Author

Listed:
  • Stéphane Bonhomme

    (Institute for Fiscal Studies and University of Chicago)

  • Martin Weidner

    (Institute for Fiscal Studies and University College London)

Abstract

Economists are often interested in estimating averages with respect to distributions of unobservables. Examples are moments of individual fixed-effects, average effects in discrete choice models, or counterfactual simulations in structural models. For such quantities, we propose and study "posterior average effects", where the average is computed conditional on the sample, in the spirit of empirical Bayes and shrinkage methods. While the usefulness of shrinkage for prediction is well-understood, a justification of posterior conditioning to estimate population averages is currently lacking. We establish two robustness properties of posterior average effects under misspecification of the assumed distribution of unobservables: they are optimal in terms of local worst-case bias, and their global bias is at most twice the minimum worst-case bias within a large class of estimators. We establish related robustness results for posterior predictors. In addition, we suggest a simple measure of the information contained in the posterior conditioning. Lastly, we present two empirical illustrations, to estimate the distributions of neighborhood effects in the US, and of permanent and transitory components in a model of income dynamics.

Suggested Citation

  • Stéphane Bonhomme & Martin Weidner, 2019. "Posterior average effects," CeMMAP working papers CWP43/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
  • Handle: RePEc:ifs:cemmap:43/19
    as

    Download full text from publisher

    File URL: https://www.ifs.org.uk/uploads/CWP4319-average-posterior-effects.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Rust, John, 1987. "Optimal Replacement of GMC Bus Engines: An Empirical Model of Harold Zurcher," Econometrica, Econometric Society, vol. 55(5), pages 999-1033, September.
    2. Raj Chetty & Nathaniel Hendren, 2018. "The Impacts of Neighborhoods on Intergenerational Mobility II: County-Level Estimates," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(3), pages 1163-1228.
    3. Okui, Ryo & Yanagi, Takahide, 2019. "Panel data analysis with heterogeneous dynamics," Journal of Econometrics, Elsevier, vol. 212(2), pages 451-475.
    4. Powell, James L, 1986. "Symmetrically Trimmed Least Squares Estimation for Tobit Models," Econometrica, Econometric Society, vol. 54(6), pages 1435-1460, November.
    5. St'ephane Bonhomme & Martin Weidner, 2018. "Minimizing Sensitivity to Model Misspecification," Papers 1807.02161, arXiv.org, revised Oct 2021.
    6. Thomas J. Kane & Douglas O. Staiger, 2008. "Estimating Teacher Impacts on Student Achievement: An Experimental Evaluation," NBER Working Papers 14607, National Bureau of Economic Research, Inc.
    7. Tamer, Elie, 2010. "Partial Identification in Econometrics," Scholarly Articles 34728615, Harvard University Department of Economics.
    8. Richard W. Blundell & James L. Powell, 2004. "Endogeneity in Semiparametric Binary Response Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 71(3), pages 655-679.
    9. Koen Jochmans & Martin Weidner, 2018. "Inference on a Distribution from Noisy Draws," Papers 1803.04991, arXiv.org, revised Dec 2021.
    10. Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2020. "On the Informativeness of Descriptive Statistics for Structural Estimates," Econometrica, Econometric Society, vol. 88(6), pages 2231-2258, November.
    11. Hansen, Bruce E., 2016. "Efficient shrinkage in parametric models," Journal of Econometrics, Elsevier, vol. 190(1), pages 115-132.
    12. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers I: Evaluating Bias in Teacher Value-Added Estimates," American Economic Review, American Economic Association, vol. 104(9), pages 2593-2632, September.
    13. Will Dobbie & Roland G. Fryer Jr., 2013. "Getting beneath the Veil of Effective Schools: Evidence from New York City," American Economic Journal: Applied Economics, American Economic Association, vol. 5(4), pages 28-60, October.
    14. Pirmin Fessler & Kasy, Maximilian, 2017. "How to use economic theory to improve estimators," Working Paper 309271, Harvard University OpenScholar.
    15. Manuel Arellano & Stéphane Bonhomme, 2012. "Identifying Distributional Characteristics in Random Coefficients Panel Data Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 79(3), pages 987-1020.
    16. Manuel Arellano & Stéphane Bonhomme, 2009. "Robust Priors in Nonlinear Panel Data Models," Econometrica, Econometric Society, vol. 77(2), pages 489-536, March.
    17. Florios, Kostas & Skouras, Spyros, 2008. "Exact computation of max weighted score estimators," Journal of Econometrics, Elsevier, vol. 146(1), pages 86-91, September.
    18. Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2017. "Measuring the Sensitivity of Parameter Estimates to Estimation Moments," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(4), pages 1553-1592.
    19. Hall, Robert E & Mishkin, Frederic S, 1982. "The Sensitivity of Consumption to Transitory Income: Estimates from Panel Data on Households," Econometrica, Econometric Society, vol. 50(2), pages 461-481, March.
    20. Aguirregabiria, Victor & Gu, Jiaying & Luo, Yao, 2021. "Sufficient statistics for unobserved heterogeneity in structural dynamic logit models," Journal of Econometrics, Elsevier, vol. 223(2), pages 280-311.
    21. Manski, Charles F., 1985. "Semiparametric analysis of discrete response : Asymptotic properties of the maximum score estimator," Journal of Econometrics, Elsevier, vol. 27(3), pages 313-333, March.
    22. Roger Koenker & Ivan Mizera, 2014. "Convex Optimization, Shape Constraints, Compound Decisions, and Empirical Bayes Rules," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(506), pages 674-685, June.
    23. Geweke, John & Keane, Michael, 2000. "An empirical analysis of earnings dynamics among men in the PSID: 1968-1989," Journal of Econometrics, Elsevier, vol. 96(2), pages 293-356, June.
    24. Manuel Arellano & Richard Blundell & Stéphane Bonhomme, 2017. "Earnings and Consumption Dynamics: A Nonlinear Panel Data Framework," Econometrica, Econometric Society, vol. 85, pages 693-734, May.
    25. Richard Blundell & Luigi Pistaferri & Ian Preston, 2008. "Consumption Inequality and Partial Insurance," American Economic Review, American Economic Association, vol. 98(5), pages 1887-1921, December.
    26. Jonah E. Rockoff, 2004. "The Impact of Individual Teachers on Student Achievement: Evidence from Panel Data," American Economic Review, American Economic Association, vol. 94(2), pages 247-252, May.
    27. Joshua D. Angrist & Peter D. Hull & Parag A. Pathak & Christopher R. Walters, 2017. "Leveraging Lotteries for School Value-Added: Testing and Estimation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(2), pages 871-919.
    28. White, Halbert, 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, Econometric Society, vol. 48(4), pages 817-838, May.
    29. Koenker, Roger & Mizera, Ivan, 2014. "Convex Optimization in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 60(i05).
    30. Li, Tong & Vuong, Quang, 1998. "Nonparametric Estimation of the Measurement Error Model Using Multiple Indicators," Journal of Multivariate Analysis, Elsevier, vol. 65(2), pages 139-165, May.
    31. Hyungsik Roger Moon & Frank Schorfheide, 2012. "Bayesian and Frequentist Inference in Partially Identified Models," Econometrica, Econometric Society, vol. 80(2), pages 755-782, March.
    32. Alberto Abadie & Kasy, Maximilian, 2017. "The risk of machine learning," Working Paper 383316, Harvard University OpenScholar.
    33. Manuel Arellano & Stèphane Bonhomme, 2011. "Nonlinear Panel Data Analysis," Annual Review of Economics, Annual Reviews, vol. 3(1), pages 395-424, September.
    34. Ryo Okui & Takahide Yanagi, 2020. "Kernel estimation for panel data with heterogeneous dynamics [Econometric tools for analyzing market outcomes]," The Econometrics Journal, Royal Economic Society, vol. 23(1), pages 156-175.
    35. Elie Tamer, 2010. "Partial Identification in Econometrics," Annual Review of Economics, Annual Reviews, vol. 2(1), pages 167-195, September.
    36. Manski, Charles F., 1975. "Maximum score estimation of the stochastic utility model of choice," Journal of Econometrics, Elsevier, vol. 3(3), pages 205-228, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. John Carter Braxton & Kyle F. Herkenhoff & Jonathan Rothbaum & Lawrence Schmidt, 2021. "Changing Income Risk across the US Skill Distribution: Evidence from a Generalized Kalman Filter," Opportunity and Inclusive Growth Institute Working Papers 55, Federal Reserve Bank of Minneapolis.
    2. Timothy B. Armstrong & Michal Kolesár & Mikkel Plagborg‐Møller, 2022. "Robust Empirical Bayes Confidence Intervals," Econometrica, Econometric Society, vol. 90(6), pages 2567-2602, November.
    3. Manuel Arellano & Stéphane Bonhomme, 2023. "Recovering Latent Variables by Matching," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 118(541), pages 693-706, January.
    4. Stéphane Bonhomme & Kerstin Holzheu & Thibaut Lamadon & Elena Manresa & Magne Mogstad & Bradley Setzler, 2023. "How Much Should We Trust Estimates of Firm Effects and Worker Sorting?," Journal of Labor Economics, University of Chicago Press, vol. 41(2), pages 291-322.
    5. Timothy B. Armstrong & Michal Koles'ar & Mikkel Plagborg-M{o}ller, 2020. "Robust Empirical Bayes Confidence Intervals," Papers 2004.03448, arXiv.org, revised May 2022.
    6. Stéphane Bonhomme & Martin Weidner, 2022. "Minimizing sensitivity to model misspecification," Quantitative Economics, Econometric Society, vol. 13(3), pages 907-954, July.
    7. Pengzhou Wu & Kenji Fukumizu, 2021. "$\beta$-Intact-VAE: Identifying and Estimating Causal Effects under Limited Overlap," Papers 2110.05225, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Stéphane Bonhomme & Martin Weidner, 2020. "Posterior average effects," CeMMAP working papers CWP49/20, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    2. Manuel Arellano & Stéphane Bonhomme, 2023. "Recovering Latent Variables by Matching," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 118(541), pages 693-706, January.
    3. Arthur Lewbel, 2019. "The Identification Zoo: Meanings of Identification in Econometrics," Journal of Economic Literature, American Economic Association, vol. 57(4), pages 835-903, December.
    4. Timothy B. Armstrong & Michal Kolesár & Mikkel Plagborg‐Møller, 2022. "Robust Empirical Bayes Confidence Intervals," Econometrica, Econometric Society, vol. 90(6), pages 2567-2602, November.
    5. St'ephane Bonhomme & Martin Weidner, 2018. "Minimizing Sensitivity to Model Misspecification," Papers 1807.02161, arXiv.org, revised Oct 2021.
    6. Timothy B. Armstrong & Michal Koles'ar & Mikkel Plagborg-M{o}ller, 2020. "Robust Empirical Bayes Confidence Intervals," Papers 2004.03448, arXiv.org, revised May 2022.
    7. Irene Botosaru & Chris Muris & Krishna Pendakur, 2020. "Intertemporal Collective Household Models: Identification in Short Panels with Unobserved Heterogeneity in Resource Shares," Department of Economics Working Papers 2020-09, McMaster University.
    8. Okui, Ryo & Yanagi, Takahide, 2019. "Panel data analysis with heterogeneous dynamics," Journal of Econometrics, Elsevier, vol. 212(2), pages 451-475.
    9. Koen Jochmans & Martin Weidner, 2018. "Inference on a distribution from noisy draws," CeMMAP working papers CWP14/18, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    10. Sasaki, Yuya & Takahashi, Yuya & Xin, Yi & Hu, Yingyao, 2023. "Dynamic discrete choice models with incomplete data: Sharp identification," Journal of Econometrics, Elsevier, vol. 236(1).
    11. Botosaru, Irene & Muris, Chris & Pendakur, Krishna, 2023. "Identification of time-varying transformation models with fixed effects, with an application to unobserved heterogeneity in resource shares," Journal of Econometrics, Elsevier, vol. 232(2), pages 576-597.
    12. Mike Gilraine & Jiaying Gu & Robert McMillan, 2022. "A Nonparametric Approach for Studying Teacher Impacts," Working Papers tecipa-716, University of Toronto, Department of Economics.
    13. Manuel Arellano & Stéphane Bonhomme & Micole De Vera & Laura Hospido & Siqi Wei, 2022. "Income risk inequality: Evidence from Spanish administrative records," Quantitative Economics, Econometric Society, vol. 13(4), pages 1747-1801, November.
    14. Maximilian Blesch & Philipp Eisenhauer, 2021. "Robust decision-making under risk and ambiguity," Papers 2104.12573, arXiv.org, revised Oct 2021.
    15. Stéphane Bonhomme & Martin Weidner, 2020. "Minimizing Sensitivity to Model Misspecification," CeMMAP working papers CWP37/20, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    16. Stéphane Bonhomme & Martin Weidner, 2022. "Minimizing sensitivity to model misspecification," Quantitative Economics, Econometric Society, vol. 13(3), pages 907-954, July.
    17. Yingying Dong & Arthur Lewbel, 2015. "A Simple Estimator for Binary Choice Models with Endogenous Regressors," Econometric Reviews, Taylor & Francis Journals, vol. 34(1-2), pages 82-105, February.
    18. Chen, Le-Yu & Lee, Sokbae, 2019. "Breaking the curse of dimensionality in conditional moment inequalities for discrete choice models," Journal of Econometrics, Elsevier, vol. 210(2), pages 482-497.
    19. Hinnerich, Björn Tyrefors & Vlachos, Jonas, 2017. "The impact of upper-secondary voucher school attendance on student achievement. Swedish evidence using external and internal evaluations," Labour Economics, Elsevier, vol. 47(C), pages 1-14.
    20. Kline, Patrick & Walters, Christopher, 2019. "Audits as Evidence: Experiments, Ensembles, and Enforcement," Institute for Research on Labor and Employment, Working Paper Series qt3z72m9kn, Institute of Industrial Relations, UC Berkeley.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ifs:cemmap:43/19. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Emma Hyman (email available below). General contact details of provider: https://edirc.repec.org/data/cmifsuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.