IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v56y2012i11p3705-3729.html
   My bibliography  Save this article

Higher-order asymptotic expansions of the least-squares estimation bias in first-order dynamic regression models

Author

Listed:
  • Kiviet, Jan F.
  • Phillips, Garry D.A.

Abstract

An approximation to order T−2 is obtained for the bias of the full vector of least-squares estimates obtained from a sample of size T in general stable but not necessarily stationary ARX(1) models with normal disturbances. This yields generalizations, allowing for various forms of initial conditions, of Kendall’s and White’s classic results for stationary AR(1) models. The accuracy of various alternative approximations is examined and compared by simulation for particular parameterizations of AR(1) and ARX(1) models. The results show that often the second-order approximation is considerably better than its first-order counterpart and hence opens up perspectives for improved bias correction. However, order T−2 approximations are also found to be more vulnerable in the near unit root case than the much simpler order T−1 approximations.

Suggested Citation

  • Kiviet, Jan F. & Phillips, Garry D.A., 2012. "Higher-order asymptotic expansions of the least-squares estimation bias in first-order dynamic regression models," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3705-3729.
  • Handle: RePEc:eee:csdana:v:56:y:2012:i:11:p:3705-3729
    DOI: 10.1016/j.csda.2010.07.013
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947310002860
    Download Restriction: Full text for ScienceDirect subscribers only.

    File URL: https://libkey.io/10.1016/j.csda.2010.07.013?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Kiviet, Jan F. & Dufour, Jean-Marie, 1997. "Exact tests in single equation autoregressive distributed lag models," Journal of Econometrics, Elsevier, vol. 80(2), pages 325-353, October.
    2. Emma M. Iglesias & Garry D. A. Phillips, 2008. "Finite Sample Theory of QMLE in ARCH Models with Dynamics in the Mean Equation," Journal of Time Series Analysis, Wiley Blackwell, vol. 29(4), pages 719-737, July.
    3. Jan R. Magnus, 1978. "The moments of products of quadratic forms in normal variables," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 32(4), pages 201-210, December.
    4. Bao, Yong & Ullah, Aman, 2007. "The second-order bias and mean squared error of estimators in time-series models," Journal of Econometrics, Elsevier, vol. 140(2), pages 650-669, October.
    5. Jan F. Kiviet & Garry D.A. Phillips, 1998. "Degrees of freedom adjustment for disturbance variance estimators in dynamic regression models," Econometrics Journal, Royal Economic Society, vol. 1(RegularPa), pages 44-70.
    6. Tanizaki, Hisashi, 2000. "Bias correction of OLSE in the regression model with lagged dependent variables," Computational Statistics & Data Analysis, Elsevier, vol. 34(4), pages 495-511, October.
    7. Grubb, David & Symons, James, 1987. "Bias in Regressions With a Lagged Dependent Variable," Econometric Theory, Cambridge University Press, vol. 3(3), pages 371-386, June.
    8. Evans, G B A & Savin, N E, 1984. "Testing for Unit Roots: 2," Econometrica, Econometric Society, vol. 52(5), pages 1241-1269, September.
    9. Broda, Simon & Carstensen, Kai & Paolella, Marc S., 2007. "Bias-adjusted estimation in the ARX(1) model," Computational Statistics & Data Analysis, Elsevier, vol. 51(7), pages 3355-3367, April.
    10. Kiviet, Jan F. & Phillips, Garry D. A. & Schipp, Bernhard, 1995. "The bias of OLS, GLS, and ZEF estimators in dynamic seemingly unrelated regression models," Journal of Econometrics, Elsevier, vol. 69(1), pages 241-266, September.
    11. Tsui, Albert K. & Ali, Mukhtar M., 1994. "Exact distributions, density functions and moments of the last squares estimator in a first-order autoregressive model," Computational Statistics & Data Analysis, Elsevier, vol. 17(4), pages 433-454, May.
    12. Bao, Yong, 2007. "The Approximate Moments Of The Least Squares Estimator For The Stationary Autoregressive Model Under A General Error Distribution," Econometric Theory, Cambridge University Press, vol. 23(5), pages 1013-1021, October.
    13. Russell Davidson & James G. MacKinnon, 1985. "Testing Linear and Loglinear Regressions against Box-Cox Alternatives," Canadian Journal of Economics, Canadian Economics Association, vol. 18(3), pages 499-517, August.
    14. Rudebusch, Glenn D, 1992. "Trends and Random Walks in Macroeconomic Time Series: A Re-examination," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 33(3), pages 661-680, August.
    15. Maekawa, Koichi, 1983. "An Approximation to the Distribution of the Least Squares Estimator in an Autoregressive Model with Exogenous Variables," Econometrica, Econometric Society, vol. 51(1), pages 229-238, January.
    16. Jan F. Kiviet & Garry D. A. Phillips, 2005. "Moment approximation for least-squares estimators in dynamic regression models with a unit root *," Econometrics Journal, Royal Economic Society, vol. 8(2), pages 115-142, July.
    17. MacKinnon, James G. & Smith Jr., Anthony A., 1998. "Approximate bias correction in econometrics," Journal of Econometrics, Elsevier, vol. 85(2), pages 205-230, August.
    18. Tanaka, Katsuto, 1983. "Asymptotic Expansions Associated with the AR(1) Model with Unknown Mean," Econometrica, Econometric Society, vol. 51(4), pages 1221-1231, July.
    19. Vinod, H.D. & Shenton, L.R., 1996. "Exact Moments for Autor1egressive and Random walk Models for a Zero or Stationary Initial Value," Econometric Theory, Cambridge University Press, vol. 12(3), pages 481-499, August.
    20. Ullah, Aman, 2004. "Finite Sample Econometrics," OUP Catalogue, Oxford University Press, number 9780198774488.
    21. Hadri, Kaddour & Phillips, Garry D. A., 1999. "The accuracy of the higher order bias approximation for the 2SLS estimator," Economics Letters, Elsevier, vol. 62(2), pages 167-174, February.
    22. Kiviet, Jan F. & Phillips, Garry D. A., 1994. "Bias assessment and reduction in linear error-correction models," Journal of Econometrics, Elsevier, vol. 63(1), pages 215-243, July.
    23. repec:exe:wpaper:99/06 is not listed on IDEAS
    24. Kiviet, Jan F. & Phillips, Garry D.A., 1993. "Alternative Bias Approximations in Regressions with a Lagged-Dependent Variable," Econometric Theory, Cambridge University Press, vol. 9(1), pages 62-80, January.
    25. Sawa, Takamitsu, 1978. "The exact moments of the least squares estimator for the autoregressive model," Journal of Econometrics, Elsevier, vol. 8(2), pages 159-172, October.
    26. Evans, G B A & Savin, N E, 1981. "Testing for Unit Roots: 1," Econometrica, Econometric Society, vol. 49(3), pages 753-779, May.
    27. Orcutt, Guy H & Winokur, Herbert S, Jr, 1969. "First Order Autoregression: Inference, Estimation, and Prediction," Econometrica, Econometric Society, vol. 37(1), pages 1-14, January.
    28. Nankervis, J. C. & Savin, N. E., 1988. "The exact moments of the least-squares estimator for the autoregressive model corrections and extensions," Journal of Econometrics, Elsevier, vol. 37(3), pages 381-388, March.
    29. Kadane, Joseph B, 1971. "Comparison of k-Class Estimators when the Disturbances are Small," Econometrica, Econometric Society, vol. 39(5), pages 723-737, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jacob Boudoukh & Ronen Israel & Matthew P. Richardson, 2020. "Biases in Long-Horizon Predictive Regressions," NBER Working Papers 27410, National Bureau of Economic Research, Inc.
    2. Kiviet, Jan, 2019. "Instrument-free inference under confined regressor endogeneity; derivations and applications," MPRA Paper 96839, University Library of Munich, Germany.
    3. Kruse, Robinson & Kaufmann, Hendrik & Wegener, Christoph, 2018. "Bias-corrected estimation for speculative bubbles in stock prices," Economic Modelling, Elsevier, vol. 73(C), pages 354-364.
    4. Kiviet, Jan F. & Phillips, Garry D.A., 2014. "Improved variance estimation of maximum likelihood estimators in stable first-order dynamic regression models," Computational Statistics & Data Analysis, Elsevier, vol. 76(C), pages 424-448.
    5. Liu-Evans, Gareth, 2014. "A note on approximating moments of least squares estimators," MPRA Paper 57543, University Library of Munich, Germany.
    6. Boudoukh, Jacob & Israel, Ronen & Richardson, Matthew, 2022. "Biases in long-horizon predictive regressions," Journal of Financial Economics, Elsevier, vol. 145(3), pages 937-969.
    7. Atukorala, Ranjani & Sriananthakumar, Sivagowry, 2015. "A comparison of the accuracy of asymptotic approximations in the dynamic regression model using Kullback-Leibler information," Economic Modelling, Elsevier, vol. 45(C), pages 169-174.
    8. Kiviet, Jan F., 2023. "Instrument-free inference under confined regressor endogeneity and mild regularity," Econometrics and Statistics, Elsevier, vol. 25(C), pages 1-22.
    9. Gareth Liu-Evans, 2021. "Improving the Estimation and Predictions of Small Time Series Models," Working Papers 202106, University of Liverpool, Department of Economics.
    10. Liu-Evans Gareth D. & Phillips Garry D. A., 2012. "Bootstrap, Jackknife and COLS: Bias and Mean Squared Error in Estimation of Autoregressive Models," Journal of Time Series Econometrics, De Gruyter, vol. 4(2), pages 1-35, November.
    11. Quintana Carapia, Gustavo & Markovsky, Ivan & Pintelon, Rik & Csurcsia, Péter Zoltán & Verbeke, Dieter, 2020. "Bias and covariance of the least squares estimate in a structured errors-in-variables problem," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    12. Liu-Evans, Gareth, 2010. "An alternative approach to approximating the moments of least squares estimators," MPRA Paper 26550, University Library of Munich, Germany.
    13. Jan F. Kiviet & Garry D. A. Phillips, 2000. "Improved Coefficient and Variance Estimation in Stable First-Order Dynamic Regression Models," Econometric Society World Congress 2000 Contributed Papers 0631, Econometric Society.
    14. van Giersbergen, Noud P.A., 2016. "The ability to correct the bias in the stable AD(1,1) model with a feedback effect," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 186-204.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kiviet, Jan F. & Phillips, Garry D.A., 2014. "Improved variance estimation of maximum likelihood estimators in stable first-order dynamic regression models," Computational Statistics & Data Analysis, Elsevier, vol. 76(C), pages 424-448.
    2. Aman Ullah & Yong Bao & Ru Zhang, 2014. "Moment Approximation for Unit Root Models with Nonnormal Errors," Working Papers 201401, University of California at Riverside, Department of Economics.
    3. Hisashi Tanizaki & Shigeyuki Hamori & Yoichi Matsubayashi, 2006. "On least-squares bias in the AR(p) models: Bias correction using the bootstrap methods," Statistical Papers, Springer, vol. 47(1), pages 109-124, January.
    4. Lawford, Steve & Stamatogiannis, Michalis P., 2009. "The finite-sample effects of VAR dimensions on OLS bias, OLS variance, and minimum MSE estimators," Journal of Econometrics, Elsevier, vol. 148(2), pages 124-130, February.
    5. Liu-Evans Gareth D. & Phillips Garry D. A., 2012. "Bootstrap, Jackknife and COLS: Bias and Mean Squared Error in Estimation of Autoregressive Models," Journal of Time Series Econometrics, De Gruyter, vol. 4(2), pages 1-35, November.
    6. Liu-Evans, Gareth, 2010. "An alternative approach to approximating the moments of least squares estimators," MPRA Paper 26550, University Library of Munich, Germany.
    7. Jan F. Kiviet & Garry D. A. Phillips, 2000. "Improved Coefficient and Variance Estimation in Stable First-Order Dynamic Regression Models," Econometric Society World Congress 2000 Contributed Papers 0631, Econometric Society.
    8. Bao, Yong & Ullah, Aman, 2007. "The second-order bias and mean squared error of estimators in time-series models," Journal of Econometrics, Elsevier, vol. 140(2), pages 650-669, October.
    9. Yu, Jun, 2012. "Bias in the estimation of the mean reversion parameter in continuous time models," Journal of Econometrics, Elsevier, vol. 169(1), pages 114-122.
    10. MacKinnon, James G. & Smith Jr., Anthony A., 1998. "Approximate bias correction in econometrics," Journal of Econometrics, Elsevier, vol. 85(2), pages 205-230, August.
    11. Liu-Evans, Gareth, 2014. "A note on approximating moments of least squares estimators," MPRA Paper 57543, University Library of Munich, Germany.
    12. Pesaran, M. Hashem & Timmermann, Allan, 2005. "Small sample properties of forecasts from autoregressive models under structural breaks," Journal of Econometrics, Elsevier, vol. 129(1-2), pages 183-217.
    13. Yong Bao & Aman Ullah, 2021. "Analytical Finite Sample Econometrics: From A. L. Nagar to Now," Journal of Quantitative Economics, Springer;The Indian Econometric Society (TIES), vol. 19(1), pages 17-37, December.
    14. Yong Bao & Aman Ullah, 2009. "Expectation of Quadratic Forms in Normal and Nonnormal Variables with Econometric Applications," Working Papers 200907, University of California at Riverside, Department of Economics, revised Jun 2009.
    15. Tanizaki, Hisashi, 2000. "Bias correction of OLSE in the regression model with lagged dependent variables," Computational Statistics & Data Analysis, Elsevier, vol. 34(4), pages 495-511, October.
    16. Chambers, Marcus J., 2013. "Jackknife estimation of stationary autoregressive models," Journal of Econometrics, Elsevier, vol. 172(1), pages 142-157.
    17. Phillips, Garry D.A. & Liu-Evans, Gareth, 2016. "Approximating and reducing bias in 2SLS estimation of dynamic simultaneous equation models," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 734-762.
    18. Müller, Ulrich K. & Wang, Yulong, 2019. "Nearly weighted risk minimal unbiased estimation," Journal of Econometrics, Elsevier, vol. 209(1), pages 18-34.
    19. Hashem Pesaran, M. & Yamagata, Takashi, 2008. "Testing slope homogeneity in large panels," Journal of Econometrics, Elsevier, vol. 142(1), pages 50-93, January.
    20. Kiviet, Jan F. & Phillips, Garry D. A. & Schipp, Bernhard, 1999. "Alternative bias approximations in first-order dynamic reduced form models," Journal of Economic Dynamics and Control, Elsevier, vol. 23(7), pages 909-928, June.

    More about this item

    Keywords

    ARX-model; Asymptotic expansion; Bias approximation; Lagged dependent variable; Monte Carlo simulation;
    All these keywords.

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:56:y:2012:i:11:p:3705-3729. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.