IDEAS home Printed from https://ideas.repec.org/p/cwl/cwldpp/1585r.html
   My bibliography  Save this paper

Adaptive Estimation of Autoregressive Models with Time-Varying Variances

Author

Listed:

Abstract

Stable autoregressive models of known finite order are considered with martingale differences errors scaled by an unknown nonparametric time-varying function generating heterogeneity. An important special case involves structural change in the error variance, but in most practical cases the pattern of variance change over time is unknown and may involve shifts at unknown discrete points in time, continuous evolution or combinations of the two. This paper develops kernel-based estimators of the residual variances and associated adaptive least squares (ALS) estimators of the autoregressive coefficients. These are shown to be asymptotically efficient, having the same limit distribution as the infeasible generalized least squares (GLS). Comparisons of the efficient procedure and ordinary least squares (OLS) reveal that least squares can be extremely inefficient in some cases while nearly optimal in others. Simulations show that, when least squares work well, the adaptive estimators perform comparably well, whereas when least squares work poorly, major efficiency gains are achieved by the new estimators.

Suggested Citation

  • Ke-Li Xu & Peter C.B. Phillips, 2006. "Adaptive Estimation of Autoregressive Models with Time-Varying Variances," Cowles Foundation Discussion Papers 1585R, Cowles Foundation for Research in Economics, Yale University, revised Nov 2006.
  • Handle: RePEc:cwl:cwldpp:1585r
    as

    Download full text from publisher

    File URL: http://cowles.yale.edu/sites/default/files/files/pub/d15/d1585-r.pdf
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. de Pooter, M.D. & van Dijk, D.J.C., 2004. "Testing for changes in volatility in heteroskedastic time series - a further examination," Econometric Institute Research Papers EI 2004-38, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    2. Jörg Polzehl & Vladimir Spokoiny, 2006. "Varying coefficient GARCH versus local constant volatility modeling. Comparison of the predictive power," SFB 649 Discussion Papers SFB649DP2006-033, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    3. Kuersteiner, Guido M., 2002. "Efficient Iv Estimation For Autoregressive Models With Conditional Heteroskedasticity," Econometric Theory, Cambridge University Press, vol. 18(03), pages 547-583, June.
    4. Jushan Bai & Pierre Perron, 1998. "Estimating and Testing Linear Models with Multiple Structural Changes," Econometrica, Econometric Society, vol. 66(1), pages 47-78, January.
    5. Park, Joon Y. & Phillips, Peter C.B., 1999. "Asymptotics For Nonlinear Transformations Of Integrated Time Series," Econometric Theory, Cambridge University Press, vol. 15(03), pages 269-298, June.
    6. Davidson, James, 1994. "Stochastic Limit Theory: An Introduction for Econometricians," OUP Catalogue, Oxford University Press, number 9780198774037.
    7. Goncalves, Silvia & Kilian, Lutz, 2004. "Bootstrapping autoregressions with conditional heteroskedasticity of unknown form," Journal of Econometrics, Elsevier, vol. 123(1), pages 89-120, November.
    8. Cavaliere, Giuseppe & Taylor, A.M. Robert, 2007. "Testing for unit roots in time series models with non-stationary volatility," Journal of Econometrics, Elsevier, vol. 140(2), pages 919-947, October.
    9. Silvia Goncalves & Lutz Kilian, 2007. "Asymptotic and Bootstrap Inference for AR(∞) Processes with Conditional Heteroskedasticity," Econometric Reviews, Taylor & Francis Journals, vol. 26(6), pages 609-641.
    10. Robinson, P M, 1987. "Asymptotically Efficient Estimation in the Presence of Heteroskedasticity of Unknown Form," Econometrica, Econometric Society, vol. 55(4), pages 875-891, July.
    11. Giuseppe Cavaliere, 2005. "Unit Root Tests under Time-Varying Variances," Econometric Reviews, Taylor & Francis Journals, vol. 23(3), pages 259-292.
    12. Yuichi Kitamura & Gautam Tripathi & Hyungtaik Ahn, 2004. "Empirical Likelihood-Based Inference in Conditional Moment Restriction Models," Econometrica, Econometric Society, vol. 72(6), pages 1667-1714, November.
    13. Chung, Heetaik & Park, Joon Y., 2007. "Nonstationary nonlinear heteroskedasticity in regression," Journal of Econometrics, Elsevier, vol. 137(1), pages 230-259, March.
    14. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    15. Thomas Mikosch & Catalin Starica, 2004. "Non-stationarities in financial time series, the long range dependence and the IGARCH effects," Econometrics 0412005, EconWPA.
    16. Mark W. Watson, 1999. "Explaining the increased variability in long-term interest rates," Economic Quarterly, Federal Reserve Bank of Richmond, issue Fall, pages 71-96.
    17. D van Dijk & D R Osborn & M Sensier, 2002. "Changes in variability of the business cycle in the G7 countries," The School of Economics Discussion Paper Series 0204, Economics, The University of Manchester.
    18. Hansen, Bruce E, 1995. "Regression with Nonstationary Volatility," Econometrica, Econometric Society, vol. 63(5), pages 1113-1132, September.
    19. Kuersteiner, Guido M., 2001. "Optimal instrumental variables estimation for ARMA models," Journal of Econometrics, Elsevier, vol. 104(2), pages 359-405, September.
    20. Peter C.B. Phillips & Mico Loretan, 1990. "Testing Covariance Stationarity Under Moment Condition Failure with an Application to Common Stock Returns," Cowles Foundation Discussion Papers 947, Cowles Foundation for Research in Economics, Yale University.
    21. Catalin Starica & Stefano Herzel & Tomas Nord, 2005. "Why does the GARCH(1,1) model fail to provide sensible longer- horizon volatility forecasts?," Econometrics 0508003, EconWPA.
    22. French, Kenneth R. & Schwert, G. William & Stambaugh, Robert F., 1987. "Expected stock returns and volatility," Journal of Financial Economics, Elsevier, vol. 19(1), pages 3-29, September.
    23. Cătălin Stărică & Clive Granger, 2005. "Nonstationarities in Stock Returns," The Review of Economics and Statistics, MIT Press, vol. 87(3), pages 503-522, August.
    24. Margaret M. McConnell & Gabriel Perez-Quiros, 2000. "Output fluctuations in the United States: what has changed since the early 1980s?," Proceedings, Federal Reserve Bank of San Francisco, issue Mar.
    25. B. Abraham & W. Wei, 1984. "Inferences about the parameters of a time series model with changing variance," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 31(1), pages 183-194, December.
    26. Robert F. Engle & Jose Gonzalo Rangel, 2005. "The Spline GARCH Model for Unconditional Volatility and its Global Macroeconomic Causes," Working Papers 2005/13, Czech National Bank, Research Department.
    27. Kim, Tae-Hwan & Leybourne, Stephen & Newbold, Paul, 2002. "Unit root tests with a break in innovation variance," Journal of Econometrics, Elsevier, vol. 109(2), pages 365-387, August.
    28. Sílvia Gonçalves & Lutz Kilian, 2003. "Asymptotic and Bootstrap Inference for AR( Infinite ) Processes with Conditional Heteroskedasticity," CIRANO Working Papers 2003s-28, CIRANO.
    29. Cavaliere, Giuseppe, 2004. "Testing stationarity under a permanent variance shift," Economics Letters, Elsevier, vol. 82(3), pages 403-408, March.
    30. Galeano, Pedro & Peña, Daniel, 2004. "Variance changes detection in multivariate time series," DES - Working Papers. Statistics and Econometrics. WS ws041305, Universidad Carlos III de Madrid. Departamento de Estadística.
    31. Li, W K & Ling, Shiqing & McAleer, Michael, 2002. " Recent Theoretical Results for Time Series Models with GARCH Errors," Journal of Economic Surveys, Wiley Blackwell, vol. 16(3), pages 245-269, July.
    32. Hamori, Shigeyuki & Tokihisa, Akira, 1997. "Testing for a unit root in the presence of a variance shift1," Economics Letters, Elsevier, vol. 57(3), pages 245-253, December.
    33. Park, Joon Y & Phillips, Peter C B, 2001. "Nonlinear Regressions with Integrated Time Series," Econometrica, Econometric Society, vol. 69(1), pages 117-161, January.
    34. Merton, Robert C., 1980. "On estimating the expected return on the market : An exploratory investigation," Journal of Financial Economics, Elsevier, vol. 8(4), pages 323-361, December.
    35. Delgado, Miguel A. & Hidalgo, Javier, 2000. "Nonparametric inference on structural breaks," Journal of Econometrics, Elsevier, vol. 96(1), pages 113-144, May.
    36. Yu, K. & Jones, M.C., 2004. "Likelihood-Based Local Linear Estimation of the Conditional Variance Function," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 139-144, January.
    37. Fan, Jianqing & Yao, Qiwei, 1998. "Efficient estimation of conditional variance functions in stochastic regression," LSE Research Online Documents on Economics 6635, London School of Economics and Political Science, LSE Library.
    38. Peter C. B. Phillips & Ke-Li Xu, 2006. "Inference in Autoregression under Heteroskedasticity," Journal of Time Series Analysis, Wiley Blackwell, vol. 27(2), pages 289-308, March.
    39. Peter C.B. Phillips & Ke-Li Xu, 2007. "Tilted Nonparametric Estimation of Volatility Functions," Cowles Foundation Discussion Papers 1612, Cowles Foundation for Research in Economics, Yale University, revised Jul 2010.
    40. Andrews, Donald W.K., 1988. "Laws of Large Numbers for Dependent Non-Identically Distributed Random Variables," Econometric Theory, Cambridge University Press, vol. 4(03), pages 458-467, December.
    41. Busetti, Fabio & Taylor, A M Robert, 2003. "Variance Shifts, Structural Breaks, and Stationarity Tests," Journal of Business & Economic Statistics, American Statistical Association, vol. 21(4), pages 510-531, October.
    42. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ke-Li Xu & Peter C. B. Phillips, 2011. "Tilted Nonparametric Estimation of Volatility Functions With Empirical Applications," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(4), pages 518-528, October.
    2. Tu, Yundong & Yi, Yanping, 2017. "Forecasting cointegrated nonstationary time series with time-varying variance," Journal of Econometrics, Elsevier, vol. 196(1), pages 83-98.
    3. Amado Peiró, 2016. "Changes in the Unconditional Variance and Autoregressive Conditional Heteroscedasticity," International Journal of Economics and Financial Issues, Econjournals, vol. 6(4), pages 1338-1343.
    4. Ke Zhu, 2018. "Statistical inference for autoregressive models under heteroscedasticity of unknown form," Papers 1804.02348, arXiv.org.
    5. Angeliki Papana & Catherine Kyrtsou & Dimitris Kugiumtzis & Cees Diks, 2016. "Detecting Causality in Non-stationary Time Series Using Partial Symbolic Transfer Entropy: Evidence in Financial Data," Computational Economics, Springer;Society for Computational Economics, vol. 47(3), pages 341-365, March.
    6. Xu, Ke-Li, 2016. "Multivariate trend function testing with mixed stationary and integrated disturbances," Journal of Multivariate Analysis, Elsevier, vol. 147(C), pages 38-57.
    7. Xu, Ke-Li, 2012. "Robustifying multivariate trend tests to nonstationary volatility," Journal of Econometrics, Elsevier, vol. 169(2), pages 147-154.
    8. Xu, Ke-Li, 2013. "Power monotonicity in detecting volatility levels change," Economics Letters, Elsevier, vol. 121(1), pages 64-69.
    9. Nikolaos Kourogenis, 2015. "Polynomial Trends, Nonstationary Volatility and the Eicker-White Asymptotic Variance Estimator," Economics Bulletin, AccessEcon, vol. 35(3), pages 1675-1680.
    10. Dabo-Niang, Sophie & Francq, Christian & Zakoian, Jean-Michel, 2009. "Combining parametric and nonparametric approaches for more efficient time series prediction," MPRA Paper 16893, University Library of Munich, Germany.
    11. Xu, Ke-Li, 2008. "Testing against nonstationary volatility in time series," Economics Letters, Elsevier, vol. 101(3), pages 288-292, December.
    12. David Harris & Hsein Kew, 2014. "Portmanteau Autocorrelation Tests Under Q-Dependence And Heteroskedasticity," Journal of Time Series Analysis, Wiley Blackwell, vol. 35(3), pages 203-217, May.
    13. Dabo-Niang, Sophie & Francq, Christian & Zakoïan, Jean-Michel, 2010. "Combining Nonparametric and Optimal Linear Time Series Predictions," Journal of the American Statistical Association, American Statistical Association, vol. 105(492), pages 1554-1565.
    14. Cizek, P., 2010. "Modelling Conditional Heteroscedasticity in Nonstationary Series," Discussion Paper 2010-84, Tilburg University, Center for Economic Research.
    15. Cavaliere, Giuseppe & Rahbek, Anders & Taylor, A.M. Robert, 2010. "Testing for co-integration in vector autoregressions with non-stationary volatility," Journal of Econometrics, Elsevier, vol. 158(1), pages 7-24, September.
    16. Chandler, Gabriel, 2010. "Order selection for heteroscedastic autoregression: A study on concentration," Statistics & Probability Letters, Elsevier, vol. 80(23-24), pages 1904-1910, December.
    17. Cheng, Xu & Phillips, Peter C.B., 2012. "Cointegrating rank selection in models with time-varying variance," Journal of Econometrics, Elsevier, vol. 169(2), pages 155-165.
    18. Patilea, V. & Raïssi, H., 2013. "Corrected portmanteau tests for VAR models with time-varying variance," Journal of Multivariate Analysis, Elsevier, vol. 116(C), pages 190-207.
    19. Ke-Li Xu & Jui-Chung Yang, 2015. "Towards Uniformly Efficient Trend Estimation Under Weak/Strong Correlation and Non-stationary Volatility," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 42(1), pages 63-86, March.
    20. Jarrow, Robert & Teo, Melvyn & Tse, Yiu Kuen & Warachka, Mitch, 2012. "An improved test for statistical arbitrage," Journal of Financial Markets, Elsevier, vol. 15(1), pages 47-80.
    21. Brendan K. Beare, 2008. "Unit Root Testing with Unstable Volatility," Economics Papers 2008-W06, Economics Group, Nuffield College, University of Oxford.
    22. Matei Demetrescu & Christoph Hanck & Robinson Kruse, 2016. "Fixed-b Inference in the Presence of Time-Varying Volatility," CREATES Research Papers 2016-01, Department of Economics and Business Economics, Aarhus University.
    23. Peter C.B. Phillips & Ke-Li Xu, 2007. "Tilted Nonparametric Estimation of Volatility Functions," Cowles Foundation Discussion Papers 1612, Cowles Foundation for Research in Economics, Yale University, revised Jul 2010.
    24. Papana, A. & Kyrtsou, K. & Kugiumtzis, D. & Diks, C.G.H., 2013. "Partial Symbolic Transfer Entropy," CeNDEF Working Papers 13-16, Universiteit van Amsterdam, Center for Nonlinear Dynamics in Economics and Finance.

    More about this item

    Keywords

    Adaptive estimation; Autoregression; Heterogeneity; Weighted regression;

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cwl:cwldpp:1585r. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Matthew Regan). General contact details of provider: http://edirc.repec.org/data/cowleus.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.