IDEAS home Printed from https://ideas.repec.org/p/abn/wpaper/auwp2010-02.html
   My bibliography  Save this paper

Bias Correction and Out-of-Sample Forecast Accuracy

Author

Listed:
  • Hyeongwoo Kim
  • Nazif Durmaz

Abstract

We evaluate the usefulness of bias-correction methods for autoregressive (AR) models in terms of out-of-sample forecast accuracy, employing two popular methods proposed by Hansen (1999) and So and Shin (1999). Our Monte Carlo simulations show that these methods do not necessarily achieve better forecasting performances than the bias-uncorrected Least Squares (LS) method, because bias correction tends to increase the variance of the estimator. There is a gain from correcting for bias only when the true data generating process is sufficiently persistent. Though the bias arises in finite samples, the sample size (N) is not a crucial factor of the gains from bias-correction, because both the bias and the variance tend to decrease as N goes up. We also provide a real data application with 7 commodity price indices which confirms our findings.

Suggested Citation

  • Hyeongwoo Kim & Nazif Durmaz, 2010. "Bias Correction and Out-of-Sample Forecast Accuracy," Auburn Economics Working Paper Series auwp2010-02, Department of Economics, Auburn University.
  • Handle: RePEc:abn:wpaper:auwp2010-02
    as

    Download full text from publisher

    File URL: https://cla.auburn.edu/econwp/Archives/2010/2010-02.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Cheung, Yin-Wong & Lai, Kon S., 2000. "On the purchasing power parity puzzle," Journal of International Economics, Elsevier, vol. 52(2), pages 321-330, December.
    2. Donggyu Sul & Peter C. B. Phillips & Chi‐Young Choi, 2005. "Prewhitening Bias in HAC Estimation," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(4), pages 517-546, August.
    3. Kim, Jae H., 2003. "Forecasting autoregressive time series with bias-corrected parameter estimators," International Journal of Forecasting, Elsevier, vol. 19(3), pages 493-502.
    4. So, Beong Soo & Shin, Dong Wan, 1999. "Recursive mean adjustment in time-series inferences," Statistics & Probability Letters, Elsevier, vol. 43(1), pages 65-73, May.
    5. Serena Ng & Pierre Perron, 2001. "LAG Length Selection and the Construction of Unit Root Tests with Good Size and Power," Econometrica, Econometric Society, vol. 69(6), pages 1519-1554, November.
    6. Bruce E. Hansen, 1999. "The Grid Bootstrap And The Autoregressive Model," The Review of Economics and Statistics, MIT Press, vol. 81(4), pages 594-607, November.
    7. Taylor, Alan M, 2001. "Potential Pitfalls for the Purchasing-Power-Parity Puzzle? Sampling and Specification Biases in Mean-Reversion Tests of the Law of One Price," Econometrica, Econometric Society, vol. 69(2), pages 473-498, March.
    8. Kim, Hyeongwoo & Moh, Young-Kyu, 2012. "Examining the evidence of purchasing power parity by recursive mean adjustment," Economic Modelling, Elsevier, vol. 29(5), pages 1850-1857.
    9. Hyeongwoo Kim & Ippei Fujiwara & Bruce E. Hansen & Masao Ogaki, 2015. "Purchasing Power Parity and the Taylor Rule," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(6), pages 874-903, September.
    10. Andrews, Donald W K & Chen, Hong-Yuan, 1994. "Approximately Median-Unbiased Estimation of Autoregressive Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 12(2), pages 187-204, April.
    11. Kim, Hyeongwoo & Stern, Liliana V. & Stern, Michael L., 2010. "Half-life bias correction and the G7 stock markets," Economics Letters, Elsevier, vol. 109(1), pages 1-3, October.
    12. Rossi, Barbara, 2005. "Confidence Intervals for Half-Life Deviations From Purchasing Power Parity," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 432-442, October.
    13. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    14. Andrews, Donald W K & Monahan, J Christopher, 1992. "An Improved Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimator," Econometrica, Econometric Society, vol. 60(4), pages 953-966, July.
    15. Jón Steinsson, 2008. "The Dynamic Behavior of the Real Exchange Rate in Sticky Price Models," American Economic Review, American Economic Association, vol. 98(1), pages 519-533, March.
    16. Karanasos, M. & Sekioua, S.H. & Zeng, N., 2006. "On the order of integration of monthly US ex-ante and ex-post real interest rates: New evidence from over a century of data," Economics Letters, Elsevier, vol. 90(2), pages 163-169, February.
    17. Gospodinov, Nikolay, 2002. "Median unbiased forecasts for highly persistent autoregressive processes," Journal of Econometrics, Elsevier, vol. 111(1), pages 85-101, November.
    18. Kim, Hyeongwoo, 2009. "On the usefulness of the contrarian strategy across national stock markets: A grid bootstrap analysis," Journal of Empirical Finance, Elsevier, vol. 16(5), pages 734-744, December.
    19. Murray, Christian J. & Papell, David H., 2002. "The purchasing power parity persistence paradigm," Journal of International Economics, Elsevier, vol. 56(1), pages 1-19, January.
    20. Cook, Steven, 2002. "Correcting size distortion of the Dickey-Fuller test via recursive mean adjustment," Statistics & Probability Letters, Elsevier, vol. 60(1), pages 75-79, November.
    21. Chi‐Young Choi & Nelson C. Mark & Donggyu Sul, 2010. "Bias Reduction in Dynamic Panel Data Models by Common Recursive Mean Adjustment," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 72(5), pages 567-599, October.
    22. Andrews, Donald W K, 1993. "Exactly Median-Unbiased Estimation of First Order Autoregressive/Unit Root Models," Econometrica, Econometric Society, vol. 61(1), pages 139-165, January.
    23. Anna Mikusheva, 2007. "Uniform Inference in Autoregressive Models," Econometrica, Econometric Society, vol. 75(5), pages 1411-1452, September.
    24. Taylor, A M Robert, 2002. "Regression-Based Unit Root Tests with Recursive Mean Adjustment for Seasonal and Nonseasonal Time Series," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 269-281, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Carlos A. Medel & Pablo M. Pincheira, 2016. "The out-of-sample performance of an exact median-unbiased estimator for the near-unity AR(1) model," Applied Economics Letters, Taylor & Francis Journals, vol. 23(2), pages 126-131, February.
    2. João Henrique Gonçalves Mazzeu & Esther Ruiz & Helena Veiga, 2018. "Uncertainty And Density Forecasts Of Arma Models: Comparison Of Asymptotic, Bayesian, And Bootstrap Procedures," Journal of Economic Surveys, Wiley Blackwell, vol. 32(2), pages 388-419, April.
    3. Juraj Hucek & Alexander Karsay & Marian Vavra, 2015. "Short-term Forecasting of Real GDP Using Monthly Data," Working and Discussion Papers OP 1/2015, Research Department, National Bank of Slovakia.
    4. Marian Vavra, 2015. "On a Bootstrap Test for Forecast Evaluations," Working and Discussion Papers WP 5/2015, Research Department, National Bank of Slovakia.
    5. Zi‐Yi Guo, 2021. "Out‐of‐sample performance of bias‐corrected estimators for diffusion processes," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(2), pages 243-268, March.
    6. Pablo M. Pincheira & Carlos A. Medel, 2016. "Forecasting with a Random Walk," Czech Journal of Economics and Finance (Finance a uver), Charles University Prague, Faculty of Social Sciences, vol. 66(6), pages 539-564, December.
    7. Gonçalves Mazzeu, Joao Henrique & Ruiz Ortega, Esther & Veiga, Helena, 2015. "Model uncertainty and the forecast accuracy of ARMA models: A survey," DES - Working Papers. Statistics and Econometrics. WS ws1508, Universidad Carlos III de Madrid. Departamento de Estadística.
    8. Kruse, Robinson & Kaufmann, Hendrik & Wegener, Christoph, 2018. "Bias-corrected estimation for speculative bubbles in stock prices," Economic Modelling, Elsevier, vol. 73(C), pages 354-364.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kim, Hyeongwoo & Moh, Young-Kyu, 2012. "Examining the evidence of purchasing power parity by recursive mean adjustment," Economic Modelling, Elsevier, vol. 29(5), pages 1850-1857.
    2. Claude Lopez & Christian J. Murray & David H. Papell, 2013. "Median-unbiased estimation in DF-GLS regressions and the PPP puzzle," Applied Economics, Taylor & Francis Journals, vol. 45(4), pages 455-464, February.
    3. Sofiane H. Sekioua, 2004. "Real interest parity (RIP) over the 20th century: New evidence based on confidence intervals for the dominant root and half-lives of shocks," Money Macro and Finance (MMF) Research Group Conference 2004 91, Money Macro and Finance Research Group.
    4. Ding, Hui & Kim, Jaebeom, 2017. "Inflation-targeting and real interest rate parity: A bias correction approach," Economic Modelling, Elsevier, vol. 60(C), pages 132-137.
    5. Kim, Hyeongwoo & Stern, Liliana V. & Stern, Michael L., 2010. "Half-life bias correction and the G7 stock markets," Economics Letters, Elsevier, vol. 109(1), pages 1-3, October.
    6. Carlos A. Medel & Pablo M. Pincheira, 2016. "The out-of-sample performance of an exact median-unbiased estimator for the near-unity AR(1) model," Applied Economics Letters, Taylor & Francis Journals, vol. 23(2), pages 126-131, February.
    7. Hyeongwoo Kim & Ippei Fujiwara & Bruce E. Hansen & Masao Ogaki, 2015. "Purchasing Power Parity and the Taylor Rule," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(6), pages 874-903, September.
    8. Sofiane Sekioua & Menelaos Karanasos, 2006. "The real exchange rate and the Purchasing Power Parity puzzle: further evidence," Applied Financial Economics, Taylor & Francis Journals, vol. 16(1-2), pages 199-211.
    9. Lopez, Claude & Murray, Christian J & Papell, David H, 2005. "State of the Art Unit Root Tests and Purchasing Power Parity," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(2), pages 361-369, April.
    10. Hyeongwoo Kim & Young-Kyu Moh, 2009. "On the Importance of Span of the Data in Univariate Estimation of the Persistence in Real Exchange Rates," Economics Bulletin, AccessEcon, vol. 29(1), pages 129-140.
    11. Kim, Hyeongwoo, 2009. "On the usefulness of the contrarian strategy across national stock markets: A grid bootstrap analysis," Journal of Empirical Finance, Elsevier, vol. 16(5), pages 734-744, December.
    12. Rossi, Barbara, 2005. "Confidence Intervals for Half-Life Deviations From Purchasing Power Parity," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 432-442, October.
    13. Sekioua, Sofiane H., 2008. "Real interest parity (RIP) over the 20th century: New evidence based on confidence intervals for the largest root and the half-life," Journal of International Money and Finance, Elsevier, vol. 27(1), pages 76-101, February.
    14. repec:csg:ajrcwp:05 is not listed on IDEAS
    15. Meng, Ming & Lee, Hyejin & Cho, Myeong Hyeon & Lee, Junsoo, 2013. "Impacts of the initial observation on unit root tests using recursive demeaning and detrending procedures," Economics Letters, Elsevier, vol. 120(2), pages 195-199.
    16. Kim, Hyeongwoo & Ryu, Deockhyun, 2015. "A nonparametric study of real exchange rate persistence over a century," International Review of Economics & Finance, Elsevier, vol. 37(C), pages 406-418.
    17. Jón Steinsson, 2008. "The Dynamic Behavior of the Real Exchange Rate in Sticky Price Models," American Economic Review, American Economic Association, vol. 98(1), pages 519-533, March.
    18. Kruse, Robinson & Kaufmann, Hendrik & Wegener, Christoph, 2018. "Bias-corrected estimation for speculative bubbles in stock prices," Economic Modelling, Elsevier, vol. 73(C), pages 354-364.
    19. Kim, Hyeongwoo & Ryu, Deockhyun, 2015. "Measuring the speed of convergence of stock prices: A nonparametric and nonlinear approach," Economic Modelling, Elsevier, vol. 51(C), pages 227-241.
    20. Luis Alberiko Gil-Alana & Tommaso Trani, 2019. "An examination of trade-weighted real exchange rates based on fractional integration," International Economics, CEPII research center, issue 158, pages 64-76.
    21. Josep Lluís Carrion-i-Silvestre & María Dolores Gadea & Antonio Montañés, 2017. "“Unbiased estimation of autoregressive models forbounded stochastic processes," AQR Working Papers 201710, University of Barcelona, Regional Quantitative Analysis Group, revised Dec 2017.

    More about this item

    Keywords

    Small-Sample Bias; Grid Bootstrap; Recursive Mean Adjustment; Out-of-Sample Forecast;
    All these keywords.

    JEL classification:

    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:abn:wpaper:auwp2010-02. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Hyeongwoo Kim (email available below). General contact details of provider: https://edirc.repec.org/data/deaubus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.