IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2308.13564.html
   My bibliography  Save this paper

SGMM: Stochastic Approximation to Generalized Method of Moments

Author

Listed:
  • Xiaohong Chen
  • Sokbae Lee
  • Yuan Liao
  • Myung Hwan Seo
  • Youngki Shin
  • Myunghyun Song

Abstract

We introduce a new class of algorithms, Stochastic Generalized Method of Moments (SGMM), for estimation and inference on (overidentified) moment restriction models. Our SGMM is a novel stochastic approximation alternative to the popular Hansen (1982) (offline) GMM, and offers fast and scalable implementation with the ability to handle streaming datasets in real time. We establish the almost sure convergence, and the (functional) central limit theorem for the inefficient online 2SLS and the efficient SGMM. Moreover, we propose online versions of the Durbin-Wu-Hausman and Sargan-Hansen tests that can be seamlessly integrated within the SGMM framework. Extensive Monte Carlo simulations show that as the sample size increases, the SGMM matches the standard (offline) GMM in terms of estimation accuracy and gains over computational efficiency, indicating its practical value for both large-scale and online datasets. We demonstrate the efficacy of our approach by a proof of concept using two well known empirical examples with large sample sizes.

Suggested Citation

  • Xiaohong Chen & Sokbae Lee & Yuan Liao & Myung Hwan Seo & Youngki Shin & Myunghyun Song, 2023. "SGMM: Stochastic Approximation to Generalized Method of Moments," Papers 2308.13564, arXiv.org, revised Oct 2023.
    • Handle: RePEc:arx:papers:2308.13564
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2308.13564
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Yixiao Sun, 2013. "A heteroskedasticity and autocorrelation robust F test using an orthonormal series variance estimator," Econometrics Journal, Royal Economic Society, vol. 16(1), pages 1-26, February.
    2. Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-1054, July.
    3. Tengyuan Liang & Weijie J. Su, 2019. "Statistical inference for the population landscape via moment‐adjusted stochastic gradients," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 81(2), pages 431-456, April.
    4. Velasco, Carlos & Robinson, Peter M., 2001. "Edgeworth Expansions For Spectral Density Estimates And Studentized Sample Mean," Econometric Theory, Cambridge University Press, vol. 17(3), pages 497-539, June.
    5. Chen, Xiaohong & Liao, Zhipeng & Sun, Yixiao, 2014. "Sieve inference on possibly misspecified semi-nonparametric time series models," Journal of Econometrics, Elsevier, vol. 178(P3), pages 639-658.
    6. Chen Xiaohong & White Halbert, 2002. "Asymptotic Properties of Some Projection-based Robbins-Monro Procedures in a Hilbert Space," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 6(1), pages 1-55, April.
    7. Angrist, Joshua D & Evans, William N, 1998. "Children and Their Parents' Labor Supply: Evidence from Exogenous Variation in Family Size," American Economic Review, American Economic Association, vol. 88(3), pages 450-477, June.
    8. Nicholas M. Kiefer & Timothy J. Vogelsang & Helle Bunzel, 2000. "Simple Robust Testing of Regression Hypotheses," Econometrica, Econometric Society, vol. 68(3), pages 695-714, May.
    9. Eben Lazarus & Daniel J. Lewis & James H. Stock & Mark W. Watson, 2018. "HAR Inference: Recommendations for Practice Rejoinder," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 36(4), pages 574-575, October.
    10. Abhimanyu Gupta & Myung Hwan Seo, 2023. "Robust Inference on Infinite and Growing Dimensional Time‐Series Regression," Econometrica, Econometric Society, vol. 91(4), pages 1333-1361, July.
    11. Riccardo Della Vecchia & Debabrota Basu, 2023. "Online Instrumental Variable Regression: Regret Analysis and Bandit Feedback," Working Papers hal-03831210, HAL.
    12. Yixiao Sun & Peter C. B. Phillips & Sainan Jin, 2008. "Optimal Bandwidth Selection in Heteroskedasticity-Autocorrelation Robust Testing," Econometrica, Econometric Society, vol. 76(1), pages 175-194, January.
    13. Pastorello, Sergio & Patilea, Valentin & Renault, Eric, 2003. "Iterative and Recursive Estimation in Structural Nonadaptive Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 21(4), pages 449-482, October.
    14. Pastorello, Sergio & Patilea, Valentin & Renault, Eric, 2003. "Iterative and Recursive Estimation in Structural Nonadaptive Models: Rejoinder," Journal of Business & Economic Statistics, American Statistical Association, vol. 21(4), pages 503-509, October.
    15. Chen, Xiaohong & White, Halbert, 1998. "Nonparametric Adaptive Learning with Feedback," Journal of Economic Theory, Elsevier, vol. 82(1), pages 190-222, September.
    16. Eben Lazarus & Daniel J. Lewis & James H. Stock & Mark W. Watson, 2018. "HAR Inference: Recommendations for Practice," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 36(4), pages 541-559, October.
    17. Joshua D. Angrist & Alan B. Keueger, 1991. "Does Compulsory School Attendance Affect Schooling and Earnings?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 106(4), pages 979-1014.
    18. Wanrong Zhu & Xi Chen & Wei Biao Wu, 2023. "Online Covariance Matrix Estimation in Stochastic Gradient Descent," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 118(541), pages 393-404, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sokbae Lee & Yuan Liao & Myung Hwan Seo & Youngki Shin, 2021. "Fast and Robust Online Inference with Stochastic Gradient Descent via Random Scaling," Papers 2106.03156, arXiv.org, revised Oct 2021.
    2. Federico Belotti & Alessandro Casini & Leopoldo Catania & Stefano Grassi & Pierre Perron, 2023. "Simultaneous bandwidths determination for DK-HAC estimators and long-run variance estimation in nonparametric settings," Econometric Reviews, Taylor & Francis Journals, vol. 42(3), pages 281-306, February.
    3. Hirukawa, Masayuki, 2023. "Robust Covariance Matrix Estimation in Time Series: A Review," Econometrics and Statistics, Elsevier, vol. 27(C), pages 36-61.
    4. Martínez-Iriarte, Julián & Sun, Yixiao & Wang, Xuexin, 2020. "Asymptotic F tests under possibly weak identification," Journal of Econometrics, Elsevier, vol. 218(1), pages 140-177.
    5. Casini, Alessandro, 2023. "Theory of evolutionary spectra for heteroskedasticity and autocorrelation robust inference in possibly misspecified and nonstationary models," Journal of Econometrics, Elsevier, vol. 235(2), pages 372-392.
    6. Eben Lazarus & Daniel J. Lewis & James H. Stock, 2021. "The Size‐Power Tradeoff in HAR Inference," Econometrica, Econometric Society, vol. 89(5), pages 2497-2516, September.
    7. Chen, Xiaohong, 2007. "Large Sample Sieve Estimation of Semi-Nonparametric Models," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 76, Elsevier.
    8. Hwang, Jungbin & Valdés, Gonzalo, 2023. "Finite-sample corrected inference for two-step GMM in time series," Journal of Econometrics, Elsevier, vol. 234(1), pages 327-352.
    9. Ulrich K. Müller & Mark W. Watson, 2020. "Low-Frequency Analysis of Economic Time Series," Working Papers 2020-13, Princeton University. Economics Department..
    10. Jungbin Hwang & Gonzalo Valdés, 2020. "Low Frequency Cointegrating Regression in the Presence of Local to Unity Regressors and Unknown Form of Serial Dependence," Working papers 2020-03, University of Connecticut, Department of Economics, revised Aug 2020.
    11. Boudoukh, Jacob & Israel, Ronen & Richardson, Matthew, 2022. "Biases in long-horizon predictive regressions," Journal of Financial Economics, Elsevier, vol. 145(3), pages 937-969.
    12. Rho, Seunghwa & Vogelsang, Timothy J., 2021. "Inference in time series models using smoothed-clustered standard errors," Journal of Econometrics, Elsevier, vol. 224(1), pages 113-133.
    13. Chen, Xiaohong & Liao, Zhipeng, 2015. "Sieve semiparametric two-step GMM under weak dependence," Journal of Econometrics, Elsevier, vol. 189(1), pages 163-186.
    14. Yixiao Sun & Xuexin Wang, 2019. "An Asymptotically F-Distributed Chow Test in the Presence of Heteroscedasticity and Autocorrelation," Papers 1911.03771, arXiv.org.
    15. Hwang, Jungbin & Sun, Yixiao, 2018. "Should we go one step further? An accurate comparison of one-step and two-step procedures in a generalized method of moments framework," Journal of Econometrics, Elsevier, vol. 207(2), pages 381-405.
    16. Pellatt, Daniel F. & Sun, Yixiao, 2023. "Asymptotic F test in regressions with observations collected at high frequency over long span," Journal of Econometrics, Elsevier, vol. 235(2), pages 1281-1309.
    17. Sun, Yixiao, 2013. "Fixed-smoothing Asymptotics in a Two-step GMM Framework," University of California at San Diego, Economics Working Paper Series qt64x4z265, Department of Economics, UC San Diego.
    18. Laura Coroneo & Fabrizio Iacone, 2020. "Comparing predictive accuracy in small samples using fixed‐smoothing asymptotics," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(4), pages 391-409, June.
    19. Alessandro Casini, 2021. "Theory of Evolutionary Spectra for Heteroskedasticity and Autocorrelation Robust Inference in Possibly Misspecified and Nonstationary Models," Papers 2103.02981, arXiv.org.
    20. Jungbin Hwang & Gonzalo Valdés, 2020. "Finite-sample Corrected Inference for Two-step GMM in Time Series," Working papers 2020-02, University of Connecticut, Department of Economics.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2308.13564. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.