IDEAS home Printed from https://ideas.repec.org/p/tin/wpaper/20180045.html
   My bibliography  Save this paper

Strong consistency of the least squares estimator in regression models with adaptive learning

Author

Listed:
  • Norbert Christopeit

    (University of Bonn)

  • Michael Massmann

    (VU Amsterdam)

Abstract

This paper looks at the strong consistency of the ordinary least squares (OLS) estimator in a stereotypical macroeconomic model with adaptive learning. It is a companion to Christopeit & Massmann (2017, Econometric Theory) which considers the estimator’s convergence in distribution and its weak consistency in the same setting. Under constant gain learning, the model is closely related to stationary, (alternating) unit root or explosive autoregressive processes. Under decreasing gain learning, the regressors in the model are asymptotically collinear. The paper examines, first, the issue of strong convergence of the learning recursion: It is argued that, under constant gain learning, the recursion does not converge in any probabilistic sense, while for decreasing gain learning rates are derived at which the recursion converges almost surely to the rational expectations equilibrium. Secondly, the paper establishes the strong consistency of the OLS estimators, under both constant and decreasing gain learning, as well as rates at which the estimators converge almost surely. In the constant gain model, separate estimators for the intercept and slope parameters are juxtaposed to the joint estimator, drawing on the recent literature on explosive autoregressive models. Thirdly, it is emphasised that strong consistency is obtained in all models although the near-optimal condition for the strong consistency of OLS in linear regression models with stochastic regressors, established by Lai & Wei (1982), is not always met.

Suggested Citation

  • Norbert Christopeit & Michael Massmann, 2018. "Strong consistency of the least squares estimator in regression models with adaptive learning," Tinbergen Institute Discussion Papers 18-045/III, Tinbergen Institute.
  • Handle: RePEc:tin:wpaper:20180045
    as

    Download full text from publisher

    File URL: https://papers.tinbergen.nl/18045.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Norbert Christopeit & Michael Massmann, 2012. "Strong Consistency of the Least-Squares Estimator in Simple Regression Models with Stochastic Regressors," Tinbergen Institute Discussion Papers 12-109/III, Tinbergen Institute.
    2. Chevillon, Guillaume & Massmann, Michael & Mavroeidis, Sophocles, 2010. "Inference in models with adaptive learning," Journal of Monetary Economics, Elsevier, vol. 57(3), pages 341-351, April.
    3. Nielsen, Bent, 2005. "Strong Consistency Results For Least Squares Estimators In General Vector Autoregressions With Deterministic Terms," Econometric Theory, Cambridge University Press, vol. 21(3), pages 534-561, June.
    4. Dieppe, Alistair & Pandiella, Alberto González & Hall, Stephen & Willman, Alpo, 2013. "Limited information minimal state variable learning in a medium-scale multi-country model," Economic Modelling, Elsevier, vol. 33(C), pages 808-825.
    5. Sargent, Thomas J., 1993. "Bounded Rationality in Macroeconomics: The Arne Ryde Memorial Lectures," OUP Catalogue, Oxford University Press, number 9780198288695.
    6. Lai, T. L. & Wei, C. Z., 1983. "Asymptotic properties of general autoregressive models and strong consistency of least-squares estimates of their parameters," Journal of Multivariate Analysis, Elsevier, vol. 13(1), pages 1-23, March.
    7. Phillips, Peter C.B. & Magdalinos, Tassos, 2007. "Limit theory for moderate deviations from a unit root," Journal of Econometrics, Elsevier, vol. 136(1), pages 115-130, January.
    8. Phillips, Peter C.B., 2007. "Regression With Slowly Varying Regressors And Nonlinear Trends," Econometric Theory, Cambridge University Press, vol. 23(4), pages 557-614, August.
    9. Bray, Margaret M & Savin, Nathan E, 1986. "Rational Expectations Equilibria, Learning, and Model Specification," Econometrica, Econometric Society, vol. 54(5), pages 1129-1160, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Norbert Christopeit & Michael Massmann, 2017. "Strong consistency of the least squares estimator in regression models with adaptive learning," WHU Working Paper Series - Economics Group 17-07, WHU - Otto Beisheim School of Management.
    2. Norbert Christopeit & Michael Massmann, 2013. "Estimating Structural Parameters in Regression Models with Adaptive Learning," Tinbergen Institute Discussion Papers 13-111/III, Tinbergen Institute.
    3. Norbert Christopeit & Michael Massmann, 2013. "A Note on an Estimation Problem in Models with Adaptive Learning," Tinbergen Institute Discussion Papers 13-151/III, Tinbergen Institute.
    4. Chevillon, Guillaume & Mavroeidis, Sophocles, 2011. "Learning generates Long Memory," ESSEC Working Papers WP1113, ESSEC Research Center, ESSEC Business School.
    5. Norbert Christopeit & Michael Massmann, 2010. "Consistent Estimation of Structural Parameters in Regression Models with Adaptive Learning," Tinbergen Institute Discussion Papers 10-077/4, Tinbergen Institute.
    6. Agnieszka Markiewicz, 2012. "Model Uncertainty And Exchange Rate Volatility," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 53(3), pages 815-844, August.
    7. Alexander Mayer, 2022. "Estimation and inference in adaptive learning models with slowly decreasing gains," Journal of Time Series Analysis, Wiley Blackwell, vol. 43(5), pages 720-749, September.
    8. Gerunov, Anton, 2014. "Критичен Преглед На Основните Подходи За Моделиране На Икономическите Очаквания [A Critical Review of Major Approaches for Modeling Economic Expectations]," MPRA Paper 68797, University Library of Munich, Germany.
    9. Berardi, Michele & Galimberti, Jaqueson K., 2017. "On the initialization of adaptive learning in macroeconomic models," Journal of Economic Dynamics and Control, Elsevier, vol. 78(C), pages 26-53.
    10. Bao, Te & Duffy, John, 2016. "Adaptive versus eductive learning: Theory and evidence," European Economic Review, Elsevier, vol. 83(C), pages 64-89.
    11. Berardi, Michele & Galimberti, Jaqueson K., 2017. "Empirical calibration of adaptive learning," Journal of Economic Behavior & Organization, Elsevier, vol. 144(C), pages 219-237.
    12. Evans, David & Evans, George W. & McGough, Bruce, 2022. "The RPEs of RBCs and other DSGEs," Journal of Economic Dynamics and Control, Elsevier, vol. 143(C).
    13. Böhm, Volker & Wenzelburger, Jan, 2002. "Perfect Predictions In Economic Dynamical Systems With Random Perturbations," Macroeconomic Dynamics, Cambridge University Press, vol. 6(5), pages 687-712, November.
    14. Hommes, Cars & Sonnemans, Joep & Tuinstra, Jan & Van De Velden, Henk, 2007. "Learning In Cobweb Experiments," Macroeconomic Dynamics, Cambridge University Press, vol. 11(S1), pages 8-33, November.
    15. Ye Chen & Jian Li & Qiyuan Li, 2023. "Seemingly Unrelated Regression Estimation for VAR Models with Explosive Roots," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 85(4), pages 910-937, August.
    16. Hommes, Cars, 2018. "Behavioral & experimental macroeconomics and policy analysis: a complex systems approach," Working Paper Series 2201, European Central Bank.
    17. George W Evans & Roger Guesnerie & Bruce McGough, 2019. "Eductive Stability in Real Business Cycle Models," Economic Journal, Royal Economic Society, vol. 129(618), pages 821-852.
    18. Mohamad Kazem Shirani Faradonbeh & Ambuj Tewari & George Michailidis, 2017. "Finite Time Identification in Unstable Linear Systems," Papers 1710.01852, arXiv.org, revised Jun 2018.
    19. Chevillon, Guillaume & Mavroeidis, Sophocles, 2018. "Perpetual learning and apparent long memory," Journal of Economic Dynamics and Control, Elsevier, vol. 90(C), pages 343-365.
    20. Troy Tassier, 2013. "Handbook of Research on Complexity, by J. Barkley Rosser, Jr. and Edward Elgar," Eastern Economic Journal, Palgrave Macmillan;Eastern Economic Association, vol. 39(1), pages 132-133.

    More about this item

    Keywords

    adaptive learning; non-stationary regression; ordinary least squares; almost sure convergence;
    All these keywords.

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tin:wpaper:20180045. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Tinbergen Office +31 (0)10-4088900 (email available below). General contact details of provider: https://edirc.repec.org/data/tinbenl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.