IDEAS home Printed from https://ideas.repec.org/p/nan/wpaper/1206.html
   My bibliography  Save this paper

Improved Variance Estimation of Maximum Likelihood Estimators in Stable First-Order Dynamic Regression Models

Author

Listed:
  • Jan F. KIVIET

    (Division of Economics, Nanyang Technological University, Singapore 637332, Singapore)

  • Garry D.A. PHILLIPS

    (Cardiff Business School, Aberconway Building, Colum Drive, CF10 3EU, Cardiff, Wales, UK)

Abstract

In dynamic regression models conditional maximum likelihood (least-squares) coefficient and variance estimators are biased. From expansions of the coefficient variance and its estimator we obtain an approximation to the bias in variance es- timation and a bias corrected variance estimator, for both the standard and a bias corrected coefficient estimator. These enable a comparison of their mean squared errors to second order. We formally derive sufficient conditions for admissibility of these approximations. Illustrative numerical and simulation results are presented on bias reduction of coefficient and variance estimation for three relevant classes of ?rst-order autoregressive models, supplemented by e¤ects on mean squared er- rors, test size and size corrected power. These indicate that substantial biases do occur in moderately large samples, but these can be mitigated substantially and may also yield mean squared error reduction. Crude asymptotic tests are cursed by huge size distortions. However, operational bias corrections of both the esti- mates of coefficients and their estimated variance are shown to curb type I errors reasonably well.

Suggested Citation

  • Jan F. KIVIET & Garry D.A. PHILLIPS, 2012. "Improved Variance Estimation of Maximum Likelihood Estimators in Stable First-Order Dynamic Regression Models," Economic Growth Centre Working Paper Series 1206, Nanyang Technological University, School of Social Sciences, Economic Growth Centre.
  • Handle: RePEc:nan:wpaper:1206
    as

    Download full text from publisher

    File URL: http://www3.ntu.edu.sg/hss2/egc/wp/2012/2012-06.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Kiviet, J.F. & Phillips, G.D.A., 1999. "The Bias of the 2SLS Variance Estimator," Discussion Papers 9904, University of Exeter, Department of Economics.
    2. Rudebusch, Glenn D, 1993. "The Uncertain Unit Root in Real GNP," American Economic Review, American Economic Association, vol. 83(1), pages 264-272, March.
    3. Ullah, Aman, 2004. "Finite Sample Econometrics," OUP Catalogue, Oxford University Press, number 9780198774488.
    4. Rudebusch, Glenn D, 1992. "Trends and Random Walks in Macroeconomic Time Series: A Re-examination," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 33(3), pages 661-680, August.
    5. Kiviet, Jan F., 2012. "Monte Carlo Simulation for Econometricians," Foundations and Trends(R) in Econometrics, now publishers, vol. 5(1–2), pages 1-181, March.
    6. Bao, Yong & Ullah, Aman, 2007. "The second-order bias and mean squared error of estimators in time-series models," Journal of Econometrics, Elsevier, vol. 140(2), pages 650-669, October.
    7. Jan F. Kiviet & Garry D.A. Phillips, 1998. "Degrees of freedom adjustment for disturbance variance estimators in dynamic regression models," Econometrics Journal, Royal Economic Society, vol. 1(RegularPa), pages 44-70.
    8. Kiviet, Jan F. & Phillips, Garry D. A., 1994. "Bias assessment and reduction in linear error-correction models," Journal of Econometrics, Elsevier, vol. 63(1), pages 215-243, July.
    9. Kiviet, Jan F. & Phillips, Garry D.A., 2012. "Higher-order asymptotic expansions of the least-squares estimation bias in first-order dynamic regression models," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3705-3729.
    10. Grubb, David & Symons, James, 1987. "Bias in Regressions With a Lagged Dependent Variable," Econometric Theory, Cambridge University Press, vol. 3(3), pages 371-386, June.
    11. Sargan, J D, 1976. "Econometric Estimators and the Edgeworth Approximation," Econometrica, Econometric Society, vol. 44(3), pages 421-448, May.
    12. Jan F. Kiviet & Garry D. A. Phillips, 2000. "Improved Coefficient and Variance Estimation in Stable First-Order Dynamic Regression Models," Econometric Society World Congress 2000 Contributed Papers 0631, Econometric Society.
    13. Kiviet, Jan F. & Phillips, Garry D. A. & Schipp, Bernhard, 1995. "The bias of OLS, GLS, and ZEF estimators in dynamic seemingly unrelated regression models," Journal of Econometrics, Elsevier, vol. 69(1), pages 241-266, September.
    14. Kiviet, Jan F. & Phillips, Garry D.A., 1993. "Alternative Bias Approximations in Regressions with a Lagged-Dependent Variable," Econometric Theory, Cambridge University Press, vol. 9(1), pages 62-80, January.
    15. Bao, Yong, 2007. "The Approximate Moments Of The Least Squares Estimator For The Stationary Autoregressive Model Under A General Error Distribution," Econometric Theory, Cambridge University Press, vol. 23(5), pages 1013-1021, October.
    16. MacKinnon, James G. & Smith Jr., Anthony A., 1998. "Approximate bias correction in econometrics," Journal of Econometrics, Elsevier, vol. 85(2), pages 205-230, August.
    17. Sawa, Takamitsu, 1978. "The exact moments of the least squares estimator for the autoregressive model," Journal of Econometrics, Elsevier, vol. 8(2), pages 159-172, October.
    18. Phillips, Garry D. A., 2000. "An alternative approach to obtaining Nagar-type moment approximations in simultaneous equation models," Journal of Econometrics, Elsevier, vol. 97(2), pages 345-364, August.
    19. Orcutt, Guy H & Winokur, Herbert S, Jr, 1969. "First Order Autoregression: Inference, Estimation, and Prediction," Econometrica, Econometric Society, vol. 37(1), pages 1-14, January.
    20. Yang, Zhenlin, 2015. "A general method for third-order bias and variance corrections on a nonlinear estimator," Journal of Econometrics, Elsevier, vol. 186(1), pages 178-200.
    21. Karim M. Abadir & Kaddour Hadri & Elias Tzavalis, 1999. "The Influence of VAR Dimensions on Estimator Biases," Econometrica, Econometric Society, vol. 67(1), pages 163-182, January.
    22. Jan F. Kiviet & Garry D. A. Phillips, 2005. "Moment approximation for least-squares estimators in dynamic regression models with a unit root *," Econometrics Journal, Royal Economic Society, vol. 8(2), pages 115-142, July.
    23. Anindya Roy & Barry Falk & Wayne A. Fuller, 2004. "Testing for Trend in the Presence of Autoregressive Error," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 1082-1091, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gareth Liu-Evans, 2021. "Improving the Estimation and Predictions of Small Time Series Models," Working Papers 202106, University of Liverpool, Department of Economics.
    2. Phillip, Garry & Xu, Yongdeng, 2016. "Almost Unbiased Variance Estimation in Simultaneous Equation Models," Cardiff Economics Working Papers E2016/10, Cardiff University, Cardiff Business School, Economics Section.
    3. Liu-Evans, Gareth, 2014. "A note on approximating moments of least squares estimators," MPRA Paper 57543, University Library of Munich, Germany.
    4. Quintana Carapia, Gustavo & Markovsky, Ivan & Pintelon, Rik & Csurcsia, Péter Zoltán & Verbeke, Dieter, 2020. "Bias and covariance of the least squares estimate in a structured errors-in-variables problem," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    5. Valerie Good & Douglas E. Hughes & Hao Wang, 2022. "More than money: establishing the importance of a sense of purpose for salespeople," Journal of the Academy of Marketing Science, Springer, vol. 50(2), pages 272-295, March.
    6. Maoshan Tian & Huw Dixon, 2022. "The variances of non-parametric estimates of the cross-sectional distribution of durations," Econometric Reviews, Taylor & Francis Journals, vol. 41(10), pages 1243-1264, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kiviet, Jan F. & Phillips, Garry D.A., 2012. "Higher-order asymptotic expansions of the least-squares estimation bias in first-order dynamic regression models," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3705-3729.
    2. Jan F. Kiviet & Garry D. A. Phillips, 2000. "Improved Coefficient and Variance Estimation in Stable First-Order Dynamic Regression Models," Econometric Society World Congress 2000 Contributed Papers 0631, Econometric Society.
    3. Aman Ullah & Yong Bao & Ru Zhang, 2014. "Moment Approximation for Unit Root Models with Nonnormal Errors," Working Papers 201401, University of California at Riverside, Department of Economics.
    4. Liu-Evans, Gareth, 2014. "A note on approximating moments of least squares estimators," MPRA Paper 57543, University Library of Munich, Germany.
    5. Liu-Evans Gareth D. & Phillips Garry D. A., 2012. "Bootstrap, Jackknife and COLS: Bias and Mean Squared Error in Estimation of Autoregressive Models," Journal of Time Series Econometrics, De Gruyter, vol. 4(2), pages 1-35, November.
    6. Liu-Evans, Gareth, 2010. "An alternative approach to approximating the moments of least squares estimators," MPRA Paper 26550, University Library of Munich, Germany.
    7. Bao, Yong & Ullah, Aman, 2007. "The second-order bias and mean squared error of estimators in time-series models," Journal of Econometrics, Elsevier, vol. 140(2), pages 650-669, October.
    8. MacKinnon, James G. & Smith Jr., Anthony A., 1998. "Approximate bias correction in econometrics," Journal of Econometrics, Elsevier, vol. 85(2), pages 205-230, August.
    9. Pesaran, M. Hashem & Timmermann, Allan, 2005. "Small sample properties of forecasts from autoregressive models under structural breaks," Journal of Econometrics, Elsevier, vol. 129(1-2), pages 183-217.
    10. Yong Bao & Aman Ullah, 2021. "Analytical Finite Sample Econometrics: From A. L. Nagar to Now," Journal of Quantitative Economics, Springer;The Indian Econometric Society (TIES), vol. 19(1), pages 17-37, December.
    11. Phillips, Garry David Alan & Wang, Dandan, 2019. "Bias assessment and reduction for the 2SLS estimator in general dynamic simultaneous equations models," DES - Working Papers. Statistics and Econometrics. WS 28322, Universidad Carlos III de Madrid. Departamento de Estadística.
    12. Phillips, Garry D.A. & Liu-Evans, Gareth, 2016. "Approximating and reducing bias in 2SLS estimation of dynamic simultaneous equation models," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 734-762.
    13. Yu, Jun, 2012. "Bias in the estimation of the mean reversion parameter in continuous time models," Journal of Econometrics, Elsevier, vol. 169(1), pages 114-122.
    14. Hisashi Tanizaki & Shigeyuki Hamori & Yoichi Matsubayashi, 2006. "On least-squares bias in the AR(p) models: Bias correction using the bootstrap methods," Statistical Papers, Springer, vol. 47(1), pages 109-124, January.
    15. Kiviet, Jan F. & Phillips, Garry D. A. & Schipp, Bernhard, 1999. "Alternative bias approximations in first-order dynamic reduced form models," Journal of Economic Dynamics and Control, Elsevier, vol. 23(7), pages 909-928, June.
    16. Tom Engsted & Thomas Q. Pedersen, 2014. "Bias-Correction in Vector Autoregressive Models: A Simulation Study," Econometrics, MDPI, vol. 2(1), pages 1-27, March.
    17. Kruse, Robinson & Kaufmann, Hendrik & Wegener, Christoph, 2018. "Bias-corrected estimation for speculative bubbles in stock prices," Economic Modelling, Elsevier, vol. 73(C), pages 354-364.
    18. Chambers, Marcus J., 2013. "Jackknife estimation of stationary autoregressive models," Journal of Econometrics, Elsevier, vol. 172(1), pages 142-157.
    19. Müller, Ulrich K. & Wang, Yulong, 2019. "Nearly weighted risk minimal unbiased estimation," Journal of Econometrics, Elsevier, vol. 209(1), pages 18-34.
    20. Marcet, Albert & Jarociński, Marek, 2010. "Autoregressions in small samples, priors about observables and initial conditions," Working Paper Series 1263, European Central Bank.

    More about this item

    Keywords

    higher-order asymptotic expansions; bias correction; efficiency gains; lagged dependent variables; finite sample moments; size improvement;
    All these keywords.

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nan:wpaper:1206. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Magdalene Lim (email available below). General contact details of provider: https://edirc.repec.org/data/dentusg.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.