IDEAS home Printed from https://ideas.repec.org/a/eee/econom/v195y2016i1p104-119.html
   My bibliography  Save this article

Econometric estimation with high-dimensional moment equalities

Author

Listed:
  • Shi, Zhentao

Abstract

We consider a nonlinear structural model in which the number of moments is not limited by the sample size. The econometric problem here is to estimate and perform inference on a finite-dimensional parameter. To handle the high dimensionality, we must systematically choose a set of informative moments; in other words, delete the uninformative ones. In nonlinear models, a consistent estimator is a prerequisite for moment selection. We develop in this paper a novel two-step procedure. The first step achieves consistency in high-dimensional asymptotics by relaxing the moment constraints of empirical likelihood. Given the consistent estimator, in the second step we propose a computationally efficient algorithm to select the informative moments from a vast number of candidate combinations, and then use these moments to correct the bias of the first-step estimator. We show that the resulting second-step estimator is n-asymptotic normal, and achieves the lowest variance under a sparsity condition. To the best of our knowledge, we provide the first asymptotically normally distributed estimator in such an environment. The new estimator is shown to have favorable finite sample properties in simulations, and it is applied to estimate an international trade model with massive Chinese datasets.

Suggested Citation

  • Shi, Zhentao, 2016. "Econometric estimation with high-dimensional moment equalities," Journal of Econometrics, Elsevier, vol. 195(1), pages 104-119.
  • Handle: RePEc:eee:econom:v:195:y:2016:i:1:p:104-119
    DOI: 10.1016/j.jeconom.2016.07.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304407616301373
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jeconom.2016.07.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Han, Chirok & Orea, Luis & Schmidt, Peter, 2005. "Estimation of a panel data model with parametric temporal variation in individual effects," Journal of Econometrics, Elsevier, vol. 126(2), pages 241-267, June.
    2. Carrasco, Marine & Florens, Jean-Pierre, 2014. "On The Asymptotic Efficiency Of Gmm," Econometric Theory, Cambridge University Press, vol. 30(2), pages 372-406, April.
    3. Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-1054, July.
    4. Bai, Jushan & Ng, Serena, 2010. "Instrumental Variable Estimation In A Data Rich Environment," Econometric Theory, Cambridge University Press, vol. 26(6), pages 1577-1606, December.
    5. Whitney K. Newey & Richard J. Smith, 2004. "Higher Order Properties of Gmm and Generalized Empirical Likelihood Estimators," Econometrica, Econometric Society, vol. 72(1), pages 219-255, January.
    6. Carrasco, Marine & Tchuente, Guy, 2015. "Regularized LIML for many instruments," Journal of Econometrics, Elsevier, vol. 186(2), pages 427-442.
    7. Koenker, Roger & Machado, Jose A. F., 1999. "GMM inference when the number of moment conditions is large," Journal of Econometrics, Elsevier, vol. 93(2), pages 327-344, December.
    8. Chirok Han & Peter C. B. Phillips, 2006. "GMM with Many Moment Conditions," Econometrica, Econometric Society, vol. 74(1), pages 147-192, January.
    9. Joseph G. Altonji & Anthony A. Smith Jr. & Ivan Vidangos, 2013. "Modeling Earnings Dynamics," Econometrica, Econometric Society, vol. 81(4), pages 1395-1454, July.
    10. Jonathan Eaton & Samuel Kortum & Francis Kramarz, 2011. "An Anatomy of International Trade: Evidence From French Firms," Econometrica, Econometric Society, vol. 79(5), pages 1453-1498, September.
    11. Hansen, Christian & Kozbur, Damian, 2014. "Instrumental variables estimation with many weak instruments using regularized JIVE," Journal of Econometrics, Elsevier, vol. 182(2), pages 290-308.
    12. Hahn, Jinyong, 2002. "Optimal Inference With Many Instruments," Econometric Theory, Cambridge University Press, vol. 18(1), pages 140-168, February.
    13. Angrist, Joshua D, 1990. "Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records," American Economic Review, American Economic Association, vol. 80(3), pages 313-336, June.
    14. Whitney K. Newey & Frank Windmeijer, 2009. "Generalized Method of Moments With Many Weak Moment Conditions," Econometrica, Econometric Society, vol. 77(3), pages 687-719, May.
    15. Cheng, Xu & Liao, Zhipeng, 2015. "Select the valid and relevant moments: An information-based LASSO for GMM with many moments," Journal of Econometrics, Elsevier, vol. 186(2), pages 443-464.
    16. Yuichi Kitamura & Michael Stutzer, 1997. "An Information-Theoretic Alternative to Generalized Method of Moments Estimation," Econometrica, Econometric Society, vol. 65(4), pages 861-874, July.
    17. Carrasco, Marine & Florens, Jean-Pierre, 2000. "Generalization Of Gmm To A Continuum Of Moment Conditions," Econometric Theory, Cambridge University Press, vol. 16(6), pages 797-834, December.
    18. A. Belloni & D. Chen & V. Chernozhukov & C. Hansen, 2012. "Sparse Models and Methods for Optimal Instruments With an Application to Eminent Domain," Econometrica, Econometric Society, vol. 80(6), pages 2369-2429, November.
    19. Liao, Zhipeng, 2013. "Adaptive Gmm Shrinkage Estimation With Consistent Moment Selection," Econometric Theory, Cambridge University Press, vol. 29(5), pages 857-904, October.
    20. John C. Chao & Norman R. Swanson, 2005. "Consistent Estimation with a Large Number of Weak Instruments," Econometrica, Econometric Society, vol. 73(5), pages 1673-1692, September.
    21. Eric Gautier & Alexandre Tsybakov, 2013. "Pivotal estimation in high-dimensional regression via linear programming," Papers 1303.7092, arXiv.org, revised Apr 2013.
    22. Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2011. "Estimation of treatment effects with high-dimensional controls," CeMMAP working papers CWP42/11, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    23. Chao, John C. & Swanson, Norman R. & Hausman, Jerry A. & Newey, Whitney K. & Woutersen, Tiemen, 2012. "Asymptotic Distribution Of Jive In A Heteroskedastic Iv Regression With Many Instruments," Econometric Theory, Cambridge University Press, vol. 28(1), pages 42-86, February.
    24. Fan, Jianqing & Hall, Peter & Yao, Qiwei, 2007. "To How Many Simultaneous Hypothesis Tests Can Normal, Student's t or Bootstrap Calibration Be Applied?," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1282-1288, December.
    25. Donald, Stephen G. & Imbens, Guido W. & Newey, Whitney K., 2003. "Empirical likelihood estimation and consistent tests with conditional moment restrictions," Journal of Econometrics, Elsevier, vol. 117(1), pages 55-93, November.
    26. Breusch, Trevor & Qian, Hailong & Schmidt, Peter & Wyhowski, Donald, 1999. "Redundancy of moment conditions," Journal of Econometrics, Elsevier, vol. 91(1), pages 89-111, July.
    27. A. Belloni & V. Chernozhukov & L. Wang, 2011. "Square-root lasso: pivotal recovery of sparse signals via conic programming," Biometrika, Biometrika Trust, vol. 98(4), pages 791-806.
    28. Hong, Han & Preston, Bruce & Shum, Matthew, 2003. "Generalized Empirical Likelihood–Based Model Selection Criteria For Moment Condition Models," Econometric Theory, Cambridge University Press, vol. 19(6), pages 923-943, December.
    29. Alastair R. Hall & Fernanda P. M. Peixe, 2003. "A Consistent Method for the Selection of Relevant Instruments," Econometric Reviews, Taylor & Francis Journals, vol. 22(3), pages 269-287, January.
    30. Angrist, Joshua D, 1990. "Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records: Errata," American Economic Review, American Economic Association, vol. 80(5), pages 1284-1286, December.
    31. Chen, Xiaohong, 2007. "Large Sample Sieve Estimation of Semi-Nonparametric Models," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 76, Elsevier.
    32. Otsu, Taisuke, 2010. "On Bahadur efficiency of empirical likelihood," Journal of Econometrics, Elsevier, vol. 157(2), pages 248-256, August.
    33. Joshua D. Angrist & Alan B. Keueger, 1991. "Does Compulsory School Attendance Affect Schooling and Earnings?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 106(4), pages 979-1014.
    34. Caner, Mehmet, 2009. "Lasso-Type Gmm Estimator," Econometric Theory, Cambridge University Press, vol. 25(1), pages 270-290, February.
    35. Yuichi Kitamura, 2001. "Asymptotic Optimality of Empirical Likelihood for Testing Moment Restrictions," Econometrica, Econometric Society, vol. 69(6), pages 1661-1672, November.
    36. Hansen, Lars Peter & Heaton, John & Yaron, Amir, 1996. "Finite-Sample Properties of Some Alternative GMM Estimators," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(3), pages 262-280, July.
    37. Jushan Bai & Serena Ng, 2009. "Boosting diffusion indices," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(4), pages 607-629.
    38. Andrews, Donald W. K. & Lu, Biao, 2001. "Consistent model and moment selection procedures for GMM estimation with application to dynamic panel data models," Journal of Econometrics, Elsevier, vol. 101(1), pages 123-164, March.
    39. Hall, Alastair R. & Inoue, Atsushi & Jana, Kalidas & Shin, Changmock, 2007. "Information in generalized method of moments estimation and entropy-based moment selection," Journal of Econometrics, Elsevier, vol. 138(2), pages 488-512, June.
    40. Otsu, Taisuke, 2007. "Penalized empirical likelihood estimation of semiparametric models," Journal of Multivariate Analysis, Elsevier, vol. 98(10), pages 1923-1954, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Peter C. B. Phillips & Zhentao Shi, 2021. "Boosting: Why You Can Use The Hp Filter," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 62(2), pages 521-570, May.
    2. Peter C.B. Phillips & Zhentao Shi, 2019. "Boosting the Hodrick-Prescott Filter," Cowles Foundation Discussion Papers 2192, Cowles Foundation for Research in Economics, Yale University.
    3. Victor Chernozhukov & Iv'an Fern'andez-Val & Chen Huang & Weining Wang, 2024. "Arellano-Bond LASSO Estimator for Dynamic Linear Panel Models," Papers 2402.00584, arXiv.org.
    4. Hao, Bowen & Prokhorov, Artem & Qian, Hailong, 2018. "Moment redundancy test with application to efficiency-improving copulas," Economics Letters, Elsevier, vol. 171(C), pages 29-33.
    5. Zhan Gao & Zhentao Shi, 2021. "Implementing Convex Optimization in R: Two Econometric Examples," Computational Economics, Springer;Society for Computational Economics, vol. 58(4), pages 1127-1135, December.
    6. Tomohiro Ando & Naoya Sueishi, 2019. "On the Convergence Rate of the SCAD-Penalized Empirical Likelihood Estimator," Econometrics, MDPI, vol. 7(1), pages 1-14, March.
    7. Ziwei Mei & Peter C. B. Phillips & Zhentao Shi, 2022. "The boosted HP filter is more general than you might think," Papers 2209.09810, arXiv.org.
    8. Tang, Niansheng & Yan, Xiaodong & Zhao, Puying, 2018. "Exponentially tilted likelihood inference on growing dimensional unconditional moment models," Journal of Econometrics, Elsevier, vol. 202(1), pages 57-74.
    9. Zhentao Shi & Liangjun Su & Tian Xie, 2020. "L2-Relaxation: With Applications to Forecast Combination and Portfolio Analysis," Papers 2010.09477, arXiv.org, revised Aug 2022.
    10. Wei Lin & Zhentao Shi & Yishu Wang & Ting Hin Yan, 2023. "Unfolding Beijing in a Hedonic Way," Computational Economics, Springer;Society for Computational Economics, vol. 61(1), pages 317-340, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alastair R. Hall, 2015. "Econometricians Have Their Moments: GMM at 32," The Economic Record, The Economic Society of Australia, vol. 91(S1), pages 1-24, June.
    2. Mardi Dungey & Vitali Alexeev & Jing Tian & Alastair R. Hall, 2015. "Econometricians Have Their Moments: GMM at 32," The Economic Record, The Economic Society of Australia, vol. 91, pages 1-24, June.
    3. Jinyuan Chang & Zhentao Shi & Jia Zhang, 2021. "Culling the herd of moments with penalized empirical likelihood," Papers 2108.03382, arXiv.org, revised May 2022.
    4. Xu Cheng & Zhipeng Liao, 2012. "Select the Valid and Relevant Moments: A One-Step Procedure for GMM with Many Moments," PIER Working Paper Archive 12-045, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    5. Carrasco, Marine & Tchuente, Guy, 2015. "Regularized LIML for many instruments," Journal of Econometrics, Elsevier, vol. 186(2), pages 427-442.
    6. Dong, Chaohua & Gao, Jiti & Linton, Oliver, 2023. "High dimensional semiparametric moment restriction models," Journal of Econometrics, Elsevier, vol. 232(2), pages 320-345.
    7. Sølvsten, Mikkel, 2020. "Robust estimation with many instruments," Journal of Econometrics, Elsevier, vol. 214(2), pages 495-512.
    8. Okui, Ryo, 2009. "The optimal choice of moments in dynamic panel data models," Journal of Econometrics, Elsevier, vol. 151(1), pages 1-16, July.
    9. Cheng, Xu & Liao, Zhipeng, 2015. "Select the valid and relevant moments: An information-based LASSO for GMM with many moments," Journal of Econometrics, Elsevier, vol. 186(2), pages 443-464.
    10. Whitney K. Newey & Frank Windmeijer, 2005. "GMM with many weak moment conditions," CeMMAP working papers CWP18/05, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    11. Guo, Zijian & Kang, Hyunseung & Cai, T. Tony & Small, Dylan S., 2018. "Testing endogeneity with high dimensional covariates," Journal of Econometrics, Elsevier, vol. 207(1), pages 175-187.
    12. Dennis Lim & Wenjie Wang & Yichong Zhang, 2022. "A Conditional Linear Combination Test with Many Weak Instruments," Papers 2207.11137, arXiv.org, revised Apr 2023.
    13. Jin, Fei & Lee, Lung-fei, 2019. "GEL estimation and tests of spatial autoregressive models," Journal of Econometrics, Elsevier, vol. 208(2), pages 585-612.
    14. Stanislav Anatolyev, 2007. "Optimal Instruments In Time Series: A Survey," Journal of Economic Surveys, Wiley Blackwell, vol. 21(1), pages 143-173, February.
    15. Chirok Han & Peter C. B. Phillips, 2006. "GMM with Many Moment Conditions," Econometrica, Econometric Society, vol. 74(1), pages 147-192, January.
    16. Guy Tchuente, 2019. "Weak Identification and Estimation of Social Interaction Models," Papers 1902.06143, arXiv.org.
    17. Martins, Luis F. & Gabriel, Vasco J., 2014. "Linear instrumental variables model averaging estimation," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 709-724.
    18. Bekker, Paul A. & Crudu, Federico, 2015. "Jackknife instrumental variable estimation with heteroskedasticity," Journal of Econometrics, Elsevier, vol. 185(2), pages 332-342.
    19. Hansen, Christian & Kozbur, Damian, 2014. "Instrumental variables estimation with many weak instruments using regularized JIVE," Journal of Econometrics, Elsevier, vol. 182(2), pages 290-308.
    20. Stefan Boes, 2010. "Count Data Models with Correlated Unobserved Heterogeneity," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 37(3), pages 382-402, September.

    More about this item

    Keywords

    Bias correction; Empirical likelihood; Greedy algorithm; High-dimensional estimation;
    All these keywords.

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C55 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Large Data Sets: Modeling and Analysis
    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:195:y:2016:i:1:p:104-119. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jeconom .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.