IDEAS home Printed from https://ideas.repec.org/a/spr/sistpr/v25y2022i3d10.1007_s11203-021-09262-4.html
   My bibliography  Save this article

Finite-sample properties of estimators for first and second order autoregressive processes

Author

Listed:
  • Sigrunn H. Sørbye

    (UiT The Arctic University of Norway)

  • Pedro G. Nicolau

    (UiT The Arctic University of Norway)

  • Håvard Rue

    (King Abdullah University of Science and Technology)

Abstract

The class of autoregressive (AR) processes is extensively used to model temporal dependence in observed time series. Such models are easily available and routinely fitted using freely available statistical software like R. A potential problem is that commonly applied estimators for the coefficients of AR processes are severely biased when the time series are short. This paper studies the finite-sample properties of well-known estimators for the coefficients of stationary AR(1) and AR(2) processes and provides bias-corrected versions of these estimators which are quick and easy to apply. The new estimators are constructed by modeling the relationship between the true and originally estimated AR coefficients using weighted orthogonal polynomial regression, taking the sampling distribution of the original estimators into account. The finite-sample distributions of the new bias-corrected estimators are approximated using transformations of skew-normal densities, combined with a Gaussian copula approximation in the AR(2) case. The properties of the new estimators are demonstrated by simulations and in the analysis of a real ecological data set. The estimators are easily available in our accompanying R-package for AR(1) and AR(2) processes of length 10–50, both giving bias-corrected coefficient estimates and corresponding confidence intervals.

Suggested Citation

  • Sigrunn H. Sørbye & Pedro G. Nicolau & Håvard Rue, 2022. "Finite-sample properties of estimators for first and second order autoregressive processes," Statistical Inference for Stochastic Processes, Springer, vol. 25(3), pages 577-598, October.
  • Handle: RePEc:spr:sistpr:v:25:y:2022:i:3:d:10.1007_s11203-021-09262-4
    DOI: 10.1007/s11203-021-09262-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11203-021-09262-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11203-021-09262-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kim, Jae H., 2003. "Forecasting autoregressive time series with bias-corrected parameter estimators," International Journal of Forecasting, Elsevier, vol. 19(3), pages 493-502.
    2. Tanja Krone & Casper J. Albers & Marieke E. Timmerman, 2017. "A comparative simulation study of AR(1) estimators in short time series," Quality & Quantity: International Journal of Methodology, Springer, vol. 51(1), pages 1-21, January.
    3. Andrews, Donald W K & Chen, Hong-Yuan, 1994. "Approximately Median-Unbiased Estimation of Autoregressive Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 12(2), pages 187-204, April.
    4. A. I. McLeod & Y. Zhang, 2006. "Partial autocorrelation parameterization for subset autoregression," Journal of Time Series Analysis, Wiley Blackwell, vol. 27(4), pages 599-612, July.
    5. Liu, Shen & Maharaj, Elizabeth Ann, 2013. "A hypothesis test using bias-adjusted AR estimators for classifying time series in small samples," Computational Statistics & Data Analysis, Elsevier, vol. 60(C), pages 32-49.
    6. Jaume Arnau & Roser Bono, 2001. "Autocorrelation and Bias in Short Time Series: An Alternative Estimator," Quality & Quantity: International Journal of Methodology, Springer, vol. 35(4), pages 365-387, November.
    7. Roy, Anindya & Fuller, Wayne A, 2001. "Estimation for Autoregressive Time Series with a Root Near 1," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(4), pages 482-493, October.
    8. Patterson, K. D., 2000. "Bias reduction in autoregressive models," Economics Letters, Elsevier, vol. 68(2), pages 135-141, August.
    9. Cordeiro, Gauss M. & Klein, Ruben, 1994. "Bias correction in ARMA models," Statistics & Probability Letters, Elsevier, vol. 19(3), pages 169-176, February.
    10. McLeod, A. Ian & Zhang, Ying, 2008. "Improved Subset Autoregression: With R Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 28(i02).
    11. Kruse, Robinson & Kaufmann, Hendrik & Wegener, Christoph, 2018. "Bias-corrected estimation for speculative bubbles in stock prices," Economic Modelling, Elsevier, vol. 73(C), pages 354-364.
    12. Andrews, Donald W K, 1993. "Exactly Median-Unbiased Estimation of First Order Autoregressive/Unit Root Models," Econometrica, Econometric Society, vol. 61(1), pages 139-165, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Carlos A. Medel & Pablo M. Pincheira, 2016. "The out-of-sample performance of an exact median-unbiased estimator for the near-unity AR(1) model," Applied Economics Letters, Taylor & Francis Journals, vol. 23(2), pages 126-131, February.
    2. Falk, Barry & Roy, Anindya, 2005. "Forecasting using the trend model with autoregressive errors," International Journal of Forecasting, Elsevier, vol. 21(2), pages 291-302.
    3. Giorgio Canarella & Rangan Gupta & Stephen M. Miller & Stephen K. Pollard, 2019. "Unemployment rate hysteresis and the great recession: exploring the metropolitan evidence," Empirical Economics, Springer, vol. 56(1), pages 61-79, January.
    4. Kruse, Yves Robinson & Kaufmann, Hendrik, 2015. "Bias-corrected estimation in mildly explosive autoregressions," VfS Annual Conference 2015 (Muenster): Economic Development - Theory and Policy 112897, Verein für Socialpolitik / German Economic Association.
    5. Kruse, Robinson & Kaufmann, Hendrik & Wegener, Christoph, 2018. "Bias-corrected estimation for speculative bubbles in stock prices," Economic Modelling, Elsevier, vol. 73(C), pages 354-364.
    6. Marques, André M. & Lima, Gilberto Tadeu & Troster, Victor, 2017. "Unemployment persistence in OECD countries after the Great Recession," Economic Modelling, Elsevier, vol. 64(C), pages 105-116.
    7. Carlos Medel, 2017. "Forecasting Chilean inflation with the hybrid new keynesian Phillips curve: globalisation, combination, and accuracy," Journal Economía Chilena (The Chilean Economy), Central Bank of Chile, vol. 20(3), pages 004-050, December.
    8. Müller, Ulrich K. & Wang, Yulong, 2019. "Nearly weighted risk minimal unbiased estimation," Journal of Econometrics, Elsevier, vol. 209(1), pages 18-34.
    9. Josep Lluís Carrion-i-Silvestre & María Dolores Gadea & Antonio Montañés, 2017. "“Unbiased estimation of autoregressive models forbounded stochastic processes," AQR Working Papers 201710, University of Barcelona, Regional Quantitative Analysis Group, revised Dec 2017.
    10. Carlos A. Medel, 2018. "Forecasting Inflation with the Hybrid New Keynesian Phillips Curve: A Compact-Scale Global VAR Approach," International Economic Journal, Taylor & Francis Journals, vol. 32(3), pages 331-371, July.
    11. Gustavsson, Magnus & Österholm, Pär, 2014. "Does the labor-income process contain a unit root? Evidence from individual-specific time series," Journal of Economic Dynamics and Control, Elsevier, vol. 47(C), pages 152-167.
    12. Kim, Hyeongwoo & Durmaz, Nazif, 2012. "Bias correction and out-of-sample forecast accuracy," International Journal of Forecasting, Elsevier, vol. 28(3), pages 575-586.
    13. Tom Engsted & Thomas Q. Pedersen, 2014. "Bias-Correction in Vector Autoregressive Models: A Simulation Study," Econometrics, MDPI, vol. 2(1), pages 1-27, March.
    14. Kim, Jae H. & Silvapulle, Param & Hyndman, Rob J., 2007. "Half-life estimation based on the bias-corrected bootstrap: A highest density region approach," Computational Statistics & Data Analysis, Elsevier, vol. 51(7), pages 3418-3432, April.
    15. Kim, Jae H., 2003. "Forecasting autoregressive time series with bias-corrected parameter estimators," International Journal of Forecasting, Elsevier, vol. 19(3), pages 493-502.
    16. Hendrik Kaufmannz & Robinson Kruse, 2013. "Bias-corrected estimation in potentially mildly explosive autoregressive models," CREATES Research Papers 2013-10, Department of Economics and Business Economics, Aarhus University.
    17. K. D. Patterson, 2007. "Bias Reduction through First-order Mean Correction, Bootstrapping and Recursive Mean Adjustment," Journal of Applied Statistics, Taylor & Francis Journals, vol. 34(1), pages 23-45.
    18. Clements, Michael P. & Kim, Jae H., 2007. "Bootstrap prediction intervals for autoregressive time series," Computational Statistics & Data Analysis, Elsevier, vol. 51(7), pages 3580-3594, April.
    19. Josep Lluís Carrion‐i‐Silvestre & María Dolores Gadea & Antonio Montañés, 2021. "Nearly Unbiased Estimation of Autoregressive Models for Bounded Near‐Integrated Stochastic Processes," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 83(1), pages 273-297, February.
    20. Victor Bystrov, 2018. "Measuring the Natural Rates of Interest in Germany and Italy," Central European Journal of Economic Modelling and Econometrics, Central European Journal of Economic Modelling and Econometrics, vol. 10(4), pages 333-353, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:sistpr:v:25:y:2022:i:3:d:10.1007_s11203-021-09262-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.