IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2301.07782.html
   My bibliography  Save this paper

An MCMC Approach to Classical Estimation

Author

Listed:
  • Victor Chernozhukov
  • Han Hong

Abstract

This paper studies computationally and theoretically attractive estimators called the Laplace type estimators (LTE), which include means and quantiles of Quasi-posterior distributions defined as transformations of general (non-likelihood-based) statistical criterion functions, such as those in GMM, nonlinear IV, empirical likelihood, and minimum distance methods. The approach generates an alternative to classical extremum estimation and also falls outside the parametric Bayesian approach. For example, it offers a new attractive estimation method for such important semi-parametric problems as censored and instrumental quantile, nonlinear GMM and value-at-risk models. The LTE's are computed using Markov Chain Monte Carlo methods, which help circumvent the computational curse of dimensionality. A large sample theory is obtained for regular cases.

Suggested Citation

  • Victor Chernozhukov & Han Hong, 2023. "An MCMC Approach to Classical Estimation," Papers 2301.07782, arXiv.org.
    • Handle: RePEc:arx:papers:2301.07782
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2301.07782
    File Function: Latest version
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-1054, July.
    2. Chib, Siddhartha, 2001. "Markov chain Monte Carlo methods: computation and inference," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 57, pages 3569-3649, Elsevier.
    3. Newey, Whitney K. & Powell, James L., 1990. "Efficient Estimation of Linear and Type I Censored Regression Models Under Conditional Quantile Restrictions," Econometric Theory, Cambridge University Press, vol. 6(3), pages 295-317, September.
    4. Andrews, Donald W K, 1994. "The Large Sample Correspondence between Classical Hypothesis Tests and Bayesian Posterior Odds Tests," Econometrica, Econometric Society, vol. 62(5), pages 1207-1232, September.
    5. Hahn, Jinyong, 1997. "Bayesian Bootstrap of the Quantile Regression Estimator: A Large Sample Study," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 38(4), pages 795-808, November.
    6. White,Halbert, 1996. "Estimation, Inference and Specification Analysis," Cambridge Books, Cambridge University Press, number 9780521574464.
    7. Len Umantsev & Victor Chernozhukov, 2001. "Conditional value-at-risk: Aspects of modeling and estimation," Empirical Economics, Springer, vol. 26(1), pages 271-292.
    8. Yuichi Kitamura & Michael Stutzer, 1997. "An Information-Theoretic Alternative to Generalized Method of Moments Estimation," Econometrica, Econometric Society, vol. 65(4), pages 861-874, July.
    9. Moshe Buchinsky & Jinyong Hahn, 1998. "An Alternative Estimator for the Censored Quantile Regression Model," Econometrica, Econometric Society, vol. 66(3), pages 653-672, May.
    10. Powell, James L., 1984. "Least absolute deviations estimation for the censored regression model," Journal of Econometrics, Elsevier, vol. 25(3), pages 303-325, July.
    11. Peter Christoffersen & Jinyong Hahn & Atsushi Inoue, 1999. "Testing, Comparing, and Combining Value at Risk Measures," Center for Financial Institutions Working Papers 99-44, Wharton School Center for Financial Institutions, University of Pennsylvania.
    12. Guido W. Imbens & Richard H. Spady & Phillip Johnson, 1998. "Information Theoretic Approaches to Inference in Moment Condition Models," Econometrica, Econometric Society, vol. 66(2), pages 333-358, March.
    13. Phillips, Peter C B & Ploberger, Werner, 1996. "An Asymptotic Theory of Bayesian Inference for Time Series," Econometrica, Econometric Society, vol. 64(2), pages 381-412, March.
    14. Kim, Jae-Young, 2002. "Limited information likelihood and Bayesian analysis," Journal of Econometrics, Elsevier, vol. 107(1-2), pages 175-193, March.
    15. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    16. Van Aelst, Stefan & Rousseeuw, Peter J. & Hubert, Mia & Struyf, Anja, 2002. "The Deepest Regression Method," Journal of Multivariate Analysis, Elsevier, vol. 81(1), pages 138-166, April.
    17. Jae-Young Kim, 1998. "Large Sample Properties of Posterior Densities, Bayesian Information Criterion and the Likelihood Principle in Nonstationary Time Series Models," Econometrica, Econometric Society, vol. 66(2), pages 359-380, March.
    18. Alberto Abadie, 1997. "Changes in Spanish labor income structure during the 1980's: a quantile regression aproach," Investigaciones Economicas, Fundación SEPI, vol. 21(2), pages 253-272, May.
    19. Pollard, David, 1991. "Asymptotics for Least Absolute Deviation Regression Estimators," Econometric Theory, Cambridge University Press, vol. 7(2), pages 186-199, June.
    20. Newey, Whitney K, 1991. "Uniform Convergence in Probability and Stochastic Equicontinuity," Econometrica, Econometric Society, vol. 59(4), pages 1161-1167, July.
    21. Pakes, Ariel & Pollard, David, 1989. "Simulation and the Asymptotics of Optimization Estimators," Econometrica, Econometric Society, vol. 57(5), pages 1027-1057, September.
    22. Ernst R. Berndt & Bronwyn H. Hall & Robert E. Hall & Jerry A. Hausman, 1974. "Estimation and Inference in Nonlinear Structural Models," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 3, number 4, pages 653-665, National Bureau of Economic Research, Inc.
    23. Goffe, William L. & Ferrier, Gary D. & Rogers, John, 1994. "Global optimization of statistical functions with simulated annealing," Journal of Econometrics, Elsevier, vol. 60(1-2), pages 65-99.
    24. Donald W. K. Andrews, 1997. "A Stopping Rule for the Computation of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 65(4), pages 913-932, July.
    25. Guido W. Imbens, 1997. "One-Step Estimators for Over-Identified Generalized Method of Moments Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(3), pages 359-383.
    26. Kottas A. & Gelfand A.E., 2001. "Bayesian Semiparametric Median Regression Modeling," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1458-1468, December.
    27. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    28. Geweke, John & Keane, Michael, 2001. "Computationally intensive methods for integration in econometrics," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 56, pages 3463-3568, Elsevier.
    29. Donald W. K. Andrews, 1999. "Estimation When a Parameter Is on a Boundary," Econometrica, Econometric Society, vol. 67(6), pages 1341-1384, November.
    30. Khan, Shakeeb & Powell, James L., 2001. "Two-step estimation of semiparametric censored regression models," Journal of Econometrics, Elsevier, vol. 103(1-2), pages 73-110, July.
    31. Berry, Steven & Levinsohn, James & Pakes, Ariel, 1995. "Automobile Prices in Market Equilibrium," Econometrica, Econometric Society, vol. 63(4), pages 841-890, July.
    32. Hansen, Lars Peter & Heaton, John & Yaron, Amir, 1996. "Finite-Sample Properties of Some Alternative GMM Estimators," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(3), pages 262-280, July.
    33. Amemiya, Takeshi, 1977. "The Maximum Likelihood and the Nonlinear Three-Stage Least Squares Estimator in the General Nonlinear Simultaneous Equation Model," Econometrica, Econometric Society, vol. 45(4), pages 955-968, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kim, Jae-Young, 2014. "An alternative quasi likelihood approach, Bayesian analysis and data-based inference for model specification," Journal of Econometrics, Elsevier, vol. 178(P1), pages 132-145.
    2. Parente, Paulo M.D.C. & Smith, Richard J., 2011. "Gel Methods For Nonsmooth Moment Indicators," Econometric Theory, Cambridge University Press, vol. 27(1), pages 74-113, February.
    3. Donald, Stephen G. & Imbens, Guido W. & Newey, Whitney K., 2003. "Empirical likelihood estimation and consistent tests with conditional moment restrictions," Journal of Econometrics, Elsevier, vol. 117(1), pages 55-93, November.
    4. Komunjer, Ivana, 2013. "Quantile Prediction," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 961-994, Elsevier.
    5. Mikio Ito & Akihiko Noda, 2012. "The GEL estimates resolve the risk-free rate puzzle in Japan," Applied Financial Economics, Taylor & Francis Journals, vol. 22(5), pages 365-374, March.
    6. Antoine, Bertille & Bonnal, Helene & Renault, Eric, 2007. "On the efficient use of the informational content of estimating equations: Implied probabilities and Euclidean empirical likelihood," Journal of Econometrics, Elsevier, vol. 138(2), pages 461-487, June.
    7. Hill, Jonathan B. & Prokhorov, Artem, 2016. "GEL estimation for heavy-tailed GARCH models with robust empirical likelihood inference," Journal of Econometrics, Elsevier, vol. 190(1), pages 18-45.
    8. Otsu, Taisuke, 2011. "Moderate deviations of generalized method of moments and empirical likelihood estimators," Journal of Multivariate Analysis, Elsevier, vol. 102(8), pages 1203-1216, September.
    9. Cui, Li-E & Zhao, Puying & Tang, Niansheng, 2022. "Generalized empirical likelihood for nonsmooth estimating equations with missing data," Journal of Multivariate Analysis, Elsevier, vol. 190(C).
    10. Honore, Bo & Khan, Shakeeb & Powell, James L., 2002. "Quantile regression under random censoring," Journal of Econometrics, Elsevier, vol. 109(1), pages 67-105, July.
    11. Kim, Jae-Young, 2002. "Limited information likelihood and Bayesian analysis," Journal of Econometrics, Elsevier, vol. 107(1-2), pages 175-193, March.
    12. Komunjer, Ivana & Vuong, Quang, 2010. "Efficient estimation in dynamic conditional quantile models," Journal of Econometrics, Elsevier, vol. 157(2), pages 272-285, August.
    13. Prosper Dovonon, 2016. "Large Sample Properties of the Three-Step Euclidean Likelihood Estimators under Model Misspecification," Econometric Reviews, Taylor & Francis Journals, vol. 35(4), pages 465-514, April.
    14. Yuichi Kitamura, 2006. "Empirical Likelihood Methods in Econometrics: Theory and Practice," CIRJE F-Series CIRJE-F-430, CIRJE, Faculty of Economics, University of Tokyo.
    15. Guggenberger, Patrik & Ramalho, Joaquim J.S. & Smith, Richard J., 2012. "GEL statistics under weak identification," Journal of Econometrics, Elsevier, vol. 170(2), pages 331-349.
    16. Giacomini, Raffaella & Komunjer, Ivana, 2005. "Evaluation and Combination of Conditional Quantile Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 416-431, October.
    17. Chang, Jinyuan & Chen, Song Xi & Chen, Xiaohong, 2015. "High dimensional generalized empirical likelihood for moment restrictions with dependent data," Journal of Econometrics, Elsevier, vol. 185(1), pages 283-304.
    18. Whitney K. Newey & Frank Windmeijer, 2005. "GMM with many weak moment conditions," CeMMAP working papers CWP18/05, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    19. Joachim Inkmann, 2000. "Finite Sample Properties of One-Step, Two-Step and Bootstrap Empirical Likelihood Approaches to Efficient GMM Estimation," Econometric Society World Congress 2000 Contributed Papers 0332, Econometric Society.
    20. Shane M. Sherlund, 2004. "Quasi Empirical Likelihood Estimation of Moment Condition Models," Econometric Society 2004 North American Summer Meetings 507, Econometric Society.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2301.07782. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.