IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v30y2014i2p217-234.html
   My bibliography  Save this article

Empirical prediction intervals revisited

Author

Listed:
  • Lee, Yun Shin
  • Scholtes, Stefan

Abstract

Empirical prediction intervals are constructed based on the distribution of previous out-of-sample forecast errors. Given historical data, a sample of such forecast errors is generated by successively applying a chosen point forecasting model to a sequence of fixed windows of past observations and recording the associated deviations of the model predictions from the actual observations out-of-sample. The suitable quantiles of the distribution of these forecast errors are then used along with the point forecast made by the selected model to construct an empirical prediction interval. This paper re-examines the properties of the empirical prediction interval. Specifically, we provide conditions for its asymptotic validity, evaluate its small sample performance and discuss its limitations.

Suggested Citation

  • Lee, Yun Shin & Scholtes, Stefan, 2014. "Empirical prediction intervals revisited," International Journal of Forecasting, Elsevier, vol. 30(2), pages 217-234.
    • Handle: RePEc:eee:intfor:v:30:y:2014:i:2:p:217-234
    DOI: 10.1016/j.ijforecast.2013.07.018
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207013001313
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ijforecast.2013.07.018?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jean Imbs & Haroon Mumtaz & Morten O. Ravn & Hélène Rey, 2005. "PPP Strikes Back: Aggregation And the Real Exchange Rate," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 120(1), pages 1-43.
    2. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    3. Diebold, Francis X. & Rudebusch, Glenn D., 1991. "On the power of Dickey-Fuller tests against fractional alternatives," Economics Letters, Elsevier, vol. 35(2), pages 155-160, February.
    4. Kim, Jae H, 2001. "Bootstrap-after-Bootstrap Prediction Intervals for Autoregressive Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(1), pages 117-128, January.
    5. Chatfield, Chris, 1993. "Calculating Interval Forecasts: Reply," Journal of Business & Economic Statistics, American Statistical Association, vol. 11(2), pages 143-144, April.
    6. Robert F. Engle & Simone Manganelli, 2004. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," Journal of Business & Economic Statistics, American Statistical Association, vol. 22, pages 367-381, October.
    7. Phillips, Peter C. B., 1979. "The sampling distribution of forecasts from a first-order autoregression," Journal of Econometrics, Elsevier, vol. 9(3), pages 241-261, February.
    8. Everette S. Gardner, Jr., 1988. "A Simple Method of Computing Prediction Intervals for Time Series Forecasts," Management Science, INFORMS, vol. 34(4), pages 541-546, April.
    9. Chris Chatfield, 1995. "Model Uncertainty, Data Mining and Statistical Inference," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 158(3), pages 419-444, May.
    10. Stefan Rayer & Stanley Smith & Jeff Tayman, 2009. "Empirical Prediction Intervals for County Population Forecasts," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 28(6), pages 773-793, December.
    11. Chatfield, Chris, 1993. "Calculating Interval Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 11(2), pages 121-135, April.
    12. Hansen, Bruce E., 2006. "Interval forecasts and parameter uncertainty," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 377-398.
    13. DeJong, David N, et al, 1992. "Integration versus Trend Stationarity in Time Series," Econometrica, Econometric Society, vol. 60(2), pages 423-433, March.
    14. Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-862, November.
    15. James W. Taylor & Derek W. Bunn, 1999. "A Quantile Regression Approach to Generating Prediction Intervals," Management Science, INFORMS, vol. 45(2), pages 225-237, February.
    16. Taylor, James W., 2007. "Forecasting daily supermarket sales using exponentially weighted quantile regression," European Journal of Operational Research, Elsevier, vol. 178(1), pages 154-167, April.
    17. Olga Isengildina-Massa & Scott Irwin & Darrel Good & Luca Massa, 2011. "Empirical confidence intervals for USDA commodity price forecasts," Applied Economics, Taylor & Francis Journals, vol. 43(26), pages 3789-3803.
    18. Yoshihara, Ken-ichi, 1995. "The Bahadur representation of sample quantiles for sequences of strongly mixing random variables," Statistics & Probability Letters, Elsevier, vol. 24(4), pages 299-304, September.
    19. Reeves, Jonathan J., 2005. "Bootstrap prediction intervals for ARCH models," International Journal of Forecasting, Elsevier, vol. 21(2), pages 237-248.
    20. Joel Cohen, 1986. "Population forecasts and confidence intervals for sweden: a comparison of model-based and empirical approaches," Demography, Springer;Population Association of America (PAA), vol. 23(1), pages 105-126, February.
    21. Mark Taylor, 2006. "Real exchange rates and Purchasing Power Parity: mean-reversion in economic thought," Applied Financial Economics, Taylor & Francis Journals, vol. 16(1-2), pages 1-17.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Farmer, J. Doyne & Lafond, François, 2016. "How predictable is technological progress?," Research Policy, Elsevier, vol. 45(3), pages 647-665.
    2. Trapero, Juan R., 2016. "Calculation of solar irradiation prediction intervals combining volatility and kernel density estimates," Energy, Elsevier, vol. 114(C), pages 266-274.
    3. Knüppel, Malte, 2018. "Forecast-error-based estimation of forecast uncertainty when the horizon is increased," International Journal of Forecasting, Elsevier, vol. 34(1), pages 105-116.
    4. Xu Huang & Guoqiang Zu & Qi Ding & Ran Wei & Yudong Wang & Wei Wei, 2023. "An Online Control Method of Reactive Power and Voltage Based on Mechanism–Data Hybrid Drive Model Considering Source–Load Uncertainty," Energies, MDPI, vol. 16(8), pages 1-15, April.
    5. Ke Yang & Langnan Chen & Fengping Tian, 2015. "Realized Volatility Forecast of Stock Index Under Structural Breaks," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 34(1), pages 57-82, January.
    6. Trapero, Juan R. & Cardós, Manuel & Kourentzes, Nikolaos, 2019. "Empirical safety stock estimation based on kernel and GARCH models," Omega, Elsevier, vol. 84(C), pages 199-211.
    7. Saoud, Patrick & Kourentzes, Nikolaos & Boylan, John E., 2022. "Approximations for the Lead Time Variance: a Forecasting and Inventory Evaluation," Omega, Elsevier, vol. 110(C).
    8. Peng Li & Chen Zhang & Huan Long, 2019. "Solar Power Interval Prediction via Lower and Upper Bound Estimation with a New Model Initialization Approach," Energies, MDPI, vol. 12(21), pages 1-17, October.
    9. Pritularga, Kandrika F. & Svetunkov, Ivan & Kourentzes, Nikolaos, 2023. "Shrinkage estimator for exponential smoothing models," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1351-1365.
    10. Spiliotis, Evangelos & Nikolopoulos, Konstantinos & Assimakopoulos, Vassilios, 2019. "Tales from tails: On the empirical distributions of forecasting errors and their implication to risk," International Journal of Forecasting, Elsevier, vol. 35(2), pages 687-698.
    11. Wachtmeister, Henrik & Henke, Petter & Höök, Mikael, 2018. "Oil projections in retrospect: Revisions, accuracy and current uncertainty," Applied Energy, Elsevier, vol. 220(C), pages 138-153.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Taylor, James W., 2007. "Forecasting daily supermarket sales using exponentially weighted quantile regression," European Journal of Operational Research, Elsevier, vol. 178(1), pages 154-167, April.
    2. Gonçalves Mazzeu, Joao Henrique & Ruiz Ortega, Esther & Veiga, Helena, 2015. "Model uncertainty and the forecast accuracy of ARMA models: A survey," DES - Working Papers. Statistics and Econometrics. WS ws1508, Universidad Carlos III de Madrid. Departamento de Estadística.
    3. Kim, Jae H. & Wong, Kevin & Athanasopoulos, George & Liu, Shen, 2011. "Beyond point forecasting: Evaluation of alternative prediction intervals for tourist arrivals," International Journal of Forecasting, Elsevier, vol. 27(3), pages 887-901.
    4. Komunjer, Ivana, 2013. "Quantile Prediction," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 961-994, Elsevier.
    5. Gardner, Everette Jr., 2006. "Exponential smoothing: The state of the art--Part II," International Journal of Forecasting, Elsevier, vol. 22(4), pages 637-666.
    6. Roberto Buizza & James W. Taylor, 2004. "A comparison of temperature density forecasts from GARCH and atmospheric models," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(5), pages 337-355.
    7. Trapero, Juan R., 2016. "Calculation of solar irradiation prediction intervals combining volatility and kernel density estimates," Energy, Elsevier, vol. 114(C), pages 266-274.
    8. Clements, Michael P. & Franses, Philip Hans & Swanson, Norman R., 2004. "Forecasting economic and financial time-series with non-linear models," International Journal of Forecasting, Elsevier, vol. 20(2), pages 169-183.
    9. Ke Yang & Langnan Chen & Fengping Tian, 2015. "Realized Volatility Forecast of Stock Index Under Structural Breaks," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 34(1), pages 57-82, January.
    10. Li, Jing, 2011. "Bootstrap prediction intervals for SETAR models," International Journal of Forecasting, Elsevier, vol. 27(2), pages 320-332.
    11. Li, Jing, 2011. "Bootstrap prediction intervals for SETAR models," International Journal of Forecasting, Elsevier, vol. 27(2), pages 320-332, April.
    12. Saoud, Patrick & Kourentzes, Nikolaos & Boylan, John E., 2022. "Approximations for the Lead Time Variance: a Forecasting and Inventory Evaluation," Omega, Elsevier, vol. 110(C).
    13. Li, Yushu & Andersson, Jonas, 2014. "A Likelihood Ratio and Markov Chain Based Method to Evaluate Density Forecasting," Discussion Papers 2014/12, Norwegian School of Economics, Department of Business and Management Science.
    14. Chen, Yi-Hsuan & Tu, Anthony H., 2013. "Estimating hedged portfolio value-at-risk using the conditional copula: An illustration of model risk," International Review of Economics & Finance, Elsevier, vol. 27(C), pages 514-528.
    15. De Gooijer, Jan G. & Hyndman, Rob J., 2006. "25 years of time series forecasting," International Journal of Forecasting, Elsevier, vol. 22(3), pages 443-473.
    16. Daniel W. Apley & Hyun Cheol Lee, 2010. "The effects of model parameter deviations on the variance of a linearly filtered time series," Naval Research Logistics (NRL), John Wiley & Sons, vol. 57(5), pages 460-471, August.
    17. Charles, Amelie & Darne, Olivier & Kim, Jae, 2016. "Stock Return Predictability: Evaluation based on Prediction Intervals," MPRA Paper 70143, University Library of Munich, Germany.
    18. James W. Taylor & Derek W. Bunn, 1999. "A Quantile Regression Approach to Generating Prediction Intervals," Management Science, INFORMS, vol. 45(2), pages 225-237, February.
    19. Gourieroux, C. & Jasiak, J., 2008. "Dynamic quantile models," Journal of Econometrics, Elsevier, vol. 147(1), pages 198-205, November.
    20. Carol Alexander & Emese Lazar & Silvia Stanescu, 2011. "Analytic Approximations to GARCH Aggregated Returns Distributions with Applications to VaR and ETL," ICMA Centre Discussion Papers in Finance icma-dp2011-08, Henley Business School, University of Reading.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:30:y:2014:i:2:p:217-234. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.