IDEAS home Printed from https://ideas.repec.org/p/msh/ebswps/2008-11.html
   My bibliography  Save this paper

Beyond point forecasting: evaluation of alternative prediction intervals for tourist arrivals

Author

Listed:
  • Jae H. Kim
  • Haiyang Song
  • Kevin Wong
  • George Athanasopoulos
  • Shen Liu

Abstract

This paper evaluates the performance of prediction intervals generated from alternative time series models, in the context of tourism forecasting. The forecasting methods considered include the autoregressive (AR) model, the AR model using the bias-corrected bootstrap, seasonal ARIMA models, innovations state-space models for exponential smoothing, and Harvey's structural time series models. We use thirteen monthly time series for the number of tourist arrivals to Hong Kong and to Australia. The mean coverage rate and length of alternative prediction intervals are evaluated in an empirical setting. It is found that the prediction intervals from all models show satisfactory performance, except for those from the autoregressive model. In particular, those based on the bias-corrected bootstrap in general perform best, providing tight intervals with accurate coverage rates, especially when the forecast horizon is long.

Suggested Citation

  • Jae H. Kim & Haiyang Song & Kevin Wong & George Athanasopoulos & Shen Liu, 2008. "Beyond point forecasting: evaluation of alternative prediction intervals for tourist arrivals," Monash Econometrics and Business Statistics Working Papers 11/08, Monash University, Department of Econometrics and Business Statistics, revised Oct 2009.
  • Handle: RePEc:msh:ebswps:2008-11
    as

    Download full text from publisher

    File URL: http://www.buseco.monash.edu.au/ebs/pubs/wpapers/2008/wp11-08.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Kim, Jae H., 2003. "Forecasting autoregressive time series with bias-corrected parameter estimators," International Journal of Forecasting, Elsevier, vol. 19(3), pages 493-502.
    2. Taylor, James W., 2008. "An evaluation of methods for very short-term load forecasting using minute-by-minute British data," International Journal of Forecasting, Elsevier, vol. 24(4), pages 645-658.
    3. Hyndman, Rob J. & Khandakar, Yeasmin, 2008. "Automatic Time Series Forecasting: The forecast Package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i03).
    4. De Gooijer, Jan G. & Hyndman, Rob J., 2006. "25 years of time series forecasting," International Journal of Forecasting, Elsevier, vol. 22(3), pages 443-473.
    5. Hyndman, Rob J. & Koehler, Anne B. & Snyder, Ralph D. & Grose, Simone, 2002. "A state space framework for automatic forecasting using exponential smoothing methods," International Journal of Forecasting, Elsevier, vol. 18(3), pages 439-454.
    6. Kim, Jae H, 2001. "Bootstrap-after-Bootstrap Prediction Intervals for Autoregressive Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(1), pages 117-128, January.
    7. Taylor, James W., 2003. "Exponential smoothing with a damped multiplicative trend," International Journal of Forecasting, Elsevier, vol. 19(4), pages 715-725.
    8. Yar, Mohammed & Chatfield, Chris, 1990. "Prediction intervals for the Holt-Winters forecasting procedure," International Journal of Forecasting, Elsevier, vol. 6(1), pages 127-137.
    9. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    10. Chatfield, Chris, 1993. "Calculating Interval Forecasts: Reply," Journal of Business & Economic Statistics, American Statistical Association, vol. 11(2), pages 143-144, April.
    11. Canova, Fabio & Hansen, Bruce E, 1995. "Are Seasonal Patterns Constant over Time? A Test for Seasonal Stability," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(3), pages 237-252, July.
    12. Witt, Stephen F. & Witt, Christine A., 1995. "Forecasting tourism demand: A review of empirical research," International Journal of Forecasting, Elsevier, vol. 11(3), pages 447-475, September.
    13. Chatfield, Chris, 1993. "Calculating Interval Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 11(2), pages 121-135, April.
    14. Kim, Jae H., 2004. "Bootstrap prediction intervals for autoregression using asymptotically mean-unbiased estimators," International Journal of Forecasting, Elsevier, vol. 20(1), pages 85-97.
    15. Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-862, November.
    16. Clements, Michael P. & Taylor, Nick, 2001. "Bootstrapping prediction intervals for autoregressive models," International Journal of Forecasting, Elsevier, vol. 17(2), pages 247-267.
    17. Ord, J.K. & Koehler, A. & Snyder, R.D., 1995. "Estimation and Prediction for a Class of Dynamic Nonlinear Statistical Models," Monash Econometrics and Business Statistics Working Papers 4/95, Monash University, Department of Econometrics and Business Statistics.
    18. James W. Taylor & Derek W. Bunn, 1999. "A Quantile Regression Approach to Generating Prediction Intervals," Management Science, INFORMS, vol. 45(2), pages 225-237, February.
    19. Alejandro Rodriguez & Esther Ruiz, 2009. "Bootstrap prediction intervals in state–space models," Journal of Time Series Analysis, Wiley Blackwell, vol. 30(2), pages 167-178, March.
    20. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    21. Lutz Kilian, 1998. "Small-Sample Confidence Intervals For Impulse Response Functions," The Review of Economics and Statistics, MIT Press, vol. 80(2), pages 218-230, May.
    22. Jae H. Kim & Imad Moosa, 2001. "Seasonal Behaviour of Monthly International Tourist Flows: Specification and Implications for Forecasting Models," Tourism Economics, , vol. 7(4), pages 381-396, December.
    23. Osborn, Denise R. & Heravi, Saeed & Birchenhall, C. R., 1999. "Seasonal unit roots and forecasts of two-digit European industrial production," International Journal of Forecasting, Elsevier, vol. 15(1), pages 27-47, February.
    24. Kim, Jae H., 1999. "Asymptotic and bootstrap prediction regions for vector autoregression," International Journal of Forecasting, Elsevier, vol. 15(4), pages 393-403, October.
    25. Haiyan Song & Stephen F. Witt & Xinyan Zhang, 2008. "Developing a Web-Based Tourism Demand Forecasting System," Tourism Economics, , vol. 14(3), pages 445-468, September.
    26. Chatfield, Chris & Yar, Mohammed, 1991. "Prediction intervals for multiplicative Holt-Winters," International Journal of Forecasting, Elsevier, vol. 7(1), pages 31-37, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Song, Haiyan & Wen, Long & Liu, Chang, 2019. "Density tourism demand forecasting revisited," Annals of Tourism Research, Elsevier, vol. 75(C), pages 379-392.
    2. Hassani, Hossein & Webster, Allan & Silva, Emmanuel Sirimal & Heravi, Saeed, 2015. "Forecasting U.S. Tourist arrivals using optimal Singular Spectrum Analysis," Tourism Management, Elsevier, vol. 46(C), pages 322-335.
    3. Athanasopoulos, George & Hyndman, Rob J. & Song, Haiyan & Wu, Doris C., 2011. "The tourism forecasting competition," International Journal of Forecasting, Elsevier, vol. 27(3), pages 822-844, July.
    4. Andrea Saayman & Ilsé Botha, 2017. "Non-linear models for tourism demand forecasting," Tourism Economics, , vol. 23(3), pages 594-613, May.
    5. Liu, Shen & Maharaj, Elizabeth Ann, 2013. "A hypothesis test using bias-adjusted AR estimators for classifying time series in small samples," Computational Statistics & Data Analysis, Elsevier, vol. 60(C), pages 32-49.
    6. Cem Işık & Ercan Sirakaya-Turk & Serdar Ongan, 2020. "Testing the efficacy of the economic policy uncertainty index on tourism demand in USMCA: Theory and evidence," Tourism Economics, , vol. 26(8), pages 1344-1357, December.
    7. Jun, Wang & Yuyan, Luo & Lingyu, Tang & Peng, Ge, 2018. "Modeling a combined forecast algorithm based on sequence patterns and near characteristics: An application for tourism demand forecasting," Chaos, Solitons & Fractals, Elsevier, vol. 108(C), pages 136-147.
    8. Xiaofeng Lv & Deyun Zhou & Yongchuan Tang & Ling Ma, 2018. "An Improved Test Selection Optimization Model Based on Fault Ambiguity Group Isolation and Chaotic Discrete PSO," Complexity, Hindawi, vol. 2018, pages 1-10, January.
    9. Li, Gang & Wu, Doris Chenguang & Zhou, Menglin & Liu, Anyu, 2019. "The combination of interval forecasts in tourism," Annals of Tourism Research, Elsevier, vol. 75(C), pages 363-378.
    10. Ulrich Gunter, 2021. "Improving Hotel Room Demand Forecasts for Vienna across Hotel Classes and Forecast Horizons: Single Models and Combination Techniques Based on Encompassing Tests," Forecasting, MDPI, vol. 3(4), pages 1-36, November.
    11. Yang, Dongchuan & Guo, Ju-e & Sun, Shaolong & Han, Jing & Wang, Shouyang, 2022. "An interval decomposition-ensemble approach with data-characteristic-driven reconstruction for short-term load forecasting," Applied Energy, Elsevier, vol. 306(PA).
    12. Eden Xiaoying Jiao & Jason Li Chen, 2019. "Tourism forecasting: A review of methodological developments over the last decade," Tourism Economics, , vol. 25(3), pages 469-492, May.
    13. Jakob Heins & Jan Schoenfelder & Steffen Heider & Axel R. Heller & Jens O. Brunner, 2022. "A Scalable Forecasting Framework to Predict COVID-19 Hospital Bed Occupancy," Interfaces, INFORMS, vol. 52(6), pages 508-523, November.
    14. Peng, Bo & Song, Haiyan & Crouch, Geoffrey I., 2014. "A meta-analysis of international tourism demand forecasting and implications for practice," Tourism Management, Elsevier, vol. 45(C), pages 181-193.
    15. Wai Kit Tsang & Dries F. Benoit, 2020. "Gaussian processes for daily demand prediction in tourism planning," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(3), pages 551-568, April.
    16. Hassani, Hossein & Silva, Emmanuel Sirimal & Antonakakis, Nikolaos & Filis, George & Gupta, Rangan, 2017. "Forecasting accuracy evaluation of tourist arrivals," Annals of Tourism Research, Elsevier, vol. 63(C), pages 112-127.
    17. Liu, Shen & Maharaj, Elizabeth Ann & Inder, Brett, 2014. "Polarization of forecast densities: A new approach to time series classification," Computational Statistics & Data Analysis, Elsevier, vol. 70(C), pages 345-361.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. De Gooijer, Jan G. & Hyndman, Rob J., 2006. "25 years of time series forecasting," International Journal of Forecasting, Elsevier, vol. 22(3), pages 443-473.
    2. Jan G. De Gooijer & Rob J. Hyndman, 2005. "25 Years of IIF Time Series Forecasting: A Selective Review," Monash Econometrics and Business Statistics Working Papers 12/05, Monash University, Department of Econometrics and Business Statistics.
    3. Gonçalves Mazzeu, Joao Henrique & Ruiz Ortega, Esther & Veiga, Helena, 2015. "Model uncertainty and the forecast accuracy of ARMA models: A survey," DES - Working Papers. Statistics and Econometrics. WS ws1508, Universidad Carlos III de Madrid. Departamento de Estadística.
    4. Gardner, Everette Jr., 2006. "Exponential smoothing: The state of the art--Part II," International Journal of Forecasting, Elsevier, vol. 22(4), pages 637-666.
    5. Li, Jing, 2011. "Bootstrap prediction intervals for SETAR models," International Journal of Forecasting, Elsevier, vol. 27(2), pages 320-332, April.
    6. Hyndman, Rob J. & Khandakar, Yeasmin, 2008. "Automatic Time Series Forecasting: The forecast Package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i03).
    7. Charles, Amelie & Darne, Olivier & Kim, Jae, 2016. "Stock Return Predictability: Evaluation based on Prediction Intervals," MPRA Paper 70143, University Library of Munich, Germany.
    8. Athanasopoulos, George & Hyndman, Rob J. & Song, Haiyan & Wu, Doris C., 2011. "The tourism forecasting competition," International Journal of Forecasting, Elsevier, vol. 27(3), pages 822-844.
    9. Amélie Charles & Olivier Darné & Jae H. Kim, 2022. "Stock return predictability: Evaluation based on interval forecasts," Bulletin of Economic Research, Wiley Blackwell, vol. 74(2), pages 363-385, April.
    10. Clements, Michael P. & Kim, Jae H., 2007. "Bootstrap prediction intervals for autoregressive time series," Computational Statistics & Data Analysis, Elsevier, vol. 51(7), pages 3580-3594, April.
    11. Li, Jing, 2011. "Bootstrap prediction intervals for SETAR models," International Journal of Forecasting, Elsevier, vol. 27(2), pages 320-332.
    12. Jae H. Kim, 2004. "Bias-corrected bootstrap prediction regions for vector autoregression," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(2), pages 141-154.
    13. Lee, Yun Shin & Scholtes, Stefan, 2014. "Empirical prediction intervals revisited," International Journal of Forecasting, Elsevier, vol. 30(2), pages 217-234.
    14. Dick van Dijk & Philip Hans Franses & Michael P. Clements & Jeremy Smith, 2003. "On SETAR non-linearity and forecasting," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 22(5), pages 359-375.
    15. Diego Fresoli, 2022. "Bootstrap VAR forecasts: The effect of model uncertainties," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(2), pages 279-293, March.
    16. Snyder, Ralph D. & Koehler, Anne B. & Hyndman, Rob J. & Ord, J. Keith, 2004. "Exponential smoothing models: Means and variances for lead-time demand," European Journal of Operational Research, Elsevier, vol. 158(2), pages 444-455, October.
    17. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    18. Jing Li, 2021. "Block bootstrap prediction intervals for parsimonious first‐order vector autoregression," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(3), pages 512-527, April.
    19. Jing, Li, 2009. "Bootstrap prediction intervals for threshold autoregressive models," MPRA Paper 13086, University Library of Munich, Germany.
    20. Taylor, James W., 2007. "Forecasting daily supermarket sales using exponentially weighted quantile regression," European Journal of Operational Research, Elsevier, vol. 178(1), pages 154-167, April.

    More about this item

    Keywords

    Automatic forecasting; Bootstrapping; Interval forecasting;
    All these keywords.

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:msh:ebswps:2008-11. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Professor Xibin Zhang (email available below). General contact details of provider: https://edirc.repec.org/data/dxmonau.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.