IDEAS home Printed from https://ideas.repec.org/a/sae/toueco/v29y2023i8p2143-2164.html
   My bibliography  Save this article

Judgmental Adjustments of Algorithmic Hotel Occupancy Forecasts: Does User Override Frequency Impact Accuracy at Different Time Horizons?

Author

Listed:
  • Larissa Koupriouchina
  • Jean-Pierre van der Rest
  • Zvi Schwartz

Abstract

Judgmental adjustments of algorithmic predictions with the aim of improving demand forecast accuracy are a common revenue management practice. While empirical evidence on the impact of these user overrides is growing, little research attention has been given to the time horizon and the frequency in which these adjustments take place. Utilizing a multilevel regression model for repeated measures, 20,081,973 forecasts comprising seven different time horizons were analyzed. Data were collected from 1752 hotels of different hotel types belonging to 232 hotel chains in seven geographical regions. We find that the accuracy of algorithmic computer forecasts improves as time nears the date of stay and that the number of user overrides impacts this accuracy. The effect of the override frequency depends on the type of the forecasted demand and on the presence of special events. A higher number of user overrides is beneficial for group segment, but damaging for the transient segment. During special events periods, override frequency enhances accuracy.

Suggested Citation

  • Larissa Koupriouchina & Jean-Pierre van der Rest & Zvi Schwartz, 2023. "Judgmental Adjustments of Algorithmic Hotel Occupancy Forecasts: Does User Override Frequency Impact Accuracy at Different Time Horizons?," Tourism Economics, , vol. 29(8), pages 2143-2164, December.
    • Handle: RePEc:sae:toueco:v:29:y:2023:i:8:p:2143-2164
    DOI: 10.1177/13548166221126572
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/13548166221126572
    Download Restriction: no
    File URL: https://libkey.io/10.1177/13548166221126572?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Gneiting, Tilmann, 2011. "Making and Evaluating Point Forecasts," Journal of the American Statistical Association, American Statistical Association, vol. 106(494), pages 746-762.
    2. P H Franses & R Legerstee, 2011. "Experts' adjustment to model-based SKU-level forecasts: does the forecast horizon matter?," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(3), pages 537-543, March.
    3. Sharon Hormby & Julia Morrison & Prashant Dave & Michele Meyers & Tim Tenca, 2010. "Marriott International Increases Revenue by Implementing a Group Pricing Optimizer," Interfaces, INFORMS, vol. 40(1), pages 47-57, February.
    4. Hsiao, Cheng & Wan, Shui Ki, 2014. "Is there an optimal forecast combination?," Journal of Econometrics, Elsevier, vol. 178(P2), pages 294-309.
    5. Andrawis, Robert R. & Atiya, Amir F. & El-Shishiny, Hisham, 2011. "Combination of long term and short term forecasts, with application to tourism demand forecasting," International Journal of Forecasting, Elsevier, vol. 27(3), pages 870-886.
    6. Lawrence, Michael & Goodwin, Paul & O'Connor, Marcus & Onkal, Dilek, 2006. "Judgmental forecasting: A review of progress over the last 25 years," International Journal of Forecasting, Elsevier, vol. 22(3), pages 493-518.
    7. Claeskens, Gerda & Magnus, Jan R. & Vasnev, Andrey L. & Wang, Wendun, 2016. "The forecast combination puzzle: A simple theoretical explanation," International Journal of Forecasting, Elsevier, vol. 32(3), pages 754-762.
    8. Larry Weatherford, 2016. "The history of forecasting models in revenue management," Journal of Revenue and Pricing Management, Palgrave Macmillan, vol. 15(3), pages 212-221, July.
    9. Lin, Vera Shanshan & Goodwin, Paul & Song, Haiyan, 2014. "Accuracy and bias of experts’ adjusted forecasts," Annals of Tourism Research, Elsevier, vol. 48(C), pages 156-174.
    10. Weatherford, Larry R. & Kimes, Sheryl E., 2003. "A comparison of forecasting methods for hotel revenue management," International Journal of Forecasting, Elsevier, vol. 19(3), pages 401-415.
    11. Van den Broeke, Maud & De Baets, Shari & Vereecke, Ann & Baecke, Philippe & Vanderheyden, Karlien, 2019. "Judgmental forecast adjustments over different time horizons," Omega, Elsevier, vol. 87(C), pages 34-45.
    12. Goodwin, Paul & Lawton, Richard, 1999. "On the asymmetry of the symmetric MAPE," International Journal of Forecasting, Elsevier, vol. 15(4), pages 405-408, October.
    13. Jaganathan, Srihari & Prakash, P.K.S., 2020. "A combination-based forecasting method for the M4-competition," International Journal of Forecasting, Elsevier, vol. 36(1), pages 98-104.
    14. Vera Shanshan Lin, 2019. "Judgmental adjustments in tourism forecasting practice: How good are they?," Tourism Economics, , vol. 25(3), pages 402-424, May.
    15. Haensel, Alwin & Koole, Ger, 2011. "Booking horizon forecasting with dynamic updating: A case study of hotel reservation data," International Journal of Forecasting, Elsevier, vol. 27(3), pages 942-960, July.
    16. Chris Tofallis, 2015. "A better measure of relative prediction accuracy for model selection and model estimation," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 66(8), pages 1352-1362, August.
    17. S E Kimes, 1999. "Group forecasting accuracy in hotels," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 50(11), pages 1104-1110, November.
    18. Goodwin, P & Wright, G, 1994. "Heuristics, biases and improvement strategies in judgmental time series forecasting," Omega, Elsevier, vol. 22(6), pages 553-568, November.
    19. J. Neil Bearden & Ryan O. Murphy & Amnon Rapoport, 2008. "Decision Biases in Revenue Management: Some Behavioral Evidence," Manufacturing & Service Operations Management, INFORMS, vol. 10(4), pages 625-636, June.
    20. Andrawis, Robert R. & Atiya, Amir F. & El-Shishiny, Hisham, 2011. "Combination of long term and short term forecasts, with application to tourism demand forecasting," International Journal of Forecasting, Elsevier, vol. 27(3), pages 870-886, July.
    21. Makridakis, Spyros, 1986. "The art and science of forecasting An assessment and future directions," International Journal of Forecasting, Elsevier, vol. 2(1), pages 15-39.
    22. Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
    23. McNees, Stephen K., 1990. "The role of judgment in macroeconomic forecasting accuracy," International Journal of Forecasting, Elsevier, vol. 6(3), pages 287-299, October.
    24. Davydenko, Andrey & Fildes, Robert, 2013. "Measuring forecasting accuracy: The case of judgmental adjustments to SKU-level demand forecasts," International Journal of Forecasting, Elsevier, vol. 29(3), pages 510-522.
    25. Armstrong, J. Scott & Collopy, Fred, 1992. "Error measures for generalizing about forecasting methods: Empirical comparisons," International Journal of Forecasting, Elsevier, vol. 8(1), pages 69-80, June.
    26. Chris Tofallis, 2015. "A better measure of relative prediction accuracy for model selection and model estimation," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 66(3), pages 524-524, March.
    27. Alvarado-Valencia, Jorge & Barrero, Lope H. & Önkal, Dilek & Dennerlein, Jack T., 2017. "Expertise, credibility of system forecasts and integration methods in judgmental demand forecasting," International Journal of Forecasting, Elsevier, vol. 33(1), pages 298-313.
    28. Song, Haiyan & Gao, Bastian Z. & Lin, Vera S., 2013. "Combining statistical and judgmental forecasts via a web-based tourism demand forecasting system," International Journal of Forecasting, Elsevier, vol. 29(2), pages 295-310.
    29. Makridakis, Spyros, 1993. "Accuracy measures: theoretical and practical concerns," International Journal of Forecasting, Elsevier, vol. 9(4), pages 527-529, December.
    30. Juan R. Trapero & Robert Fildes & Andrey Davydenko, 2011. "Nonlinear identification of judgmental forecasts effects at SKU level," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 30(5), pages 490-508, August.
    31. Dirk Sierag & Jean-Pierre Van Der Rest & Ger Koole & Rob Van Der Mei & Bert Zwart, 2017. "A call for exploratory data analysis in revenue management forecasting: a case study of a small and independent hotel in The Netherlands," International Journal of Revenue Management, Inderscience Enterprises Ltd, vol. 10(1), pages 28-51.
    32. Haensel, Alwin & Koole, Ger, 2011. "Booking horizon forecasting with dynamic updating: A case study of hotel reservation data," International Journal of Forecasting, Elsevier, vol. 27(3), pages 942-960.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    2. Ulrich Gunter, 2021. "Improving Hotel Room Demand Forecasts for Vienna across Hotel Classes and Forecast Horizons: Single Models and Combination Techniques Based on Encompassing Tests," Forecasting, MDPI, vol. 3(4), pages 1-36, November.
    3. Perera, H. Niles & Hurley, Jason & Fahimnia, Behnam & Reisi, Mohsen, 2019. "The human factor in supply chain forecasting: A systematic review," European Journal of Operational Research, Elsevier, vol. 274(2), pages 574-600.
    4. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2020. "The M4 Competition: 100,000 time series and 61 forecasting methods," International Journal of Forecasting, Elsevier, vol. 36(1), pages 54-74.
    5. Timothy Webb, 2022. "Forecasting at capacity: the bias of unconstrained forecasts in model evaluation," Journal of Revenue and Pricing Management, Palgrave Macmillan, vol. 21(6), pages 645-656, December.
    6. Bacci, Livio Agnew & Mello, Luiz Gustavo & Incerti, Taynara & Paulo de Paiva, Anderson & Balestrassi, Pedro Paulo, 2019. "Optimization of combined time series methods to forecast the demand for coffee in Brazil: A new approach using Normal Boundary Intersection coupled with mixture designs of experiments and rotated fact," International Journal of Production Economics, Elsevier, vol. 212(C), pages 186-211.
    7. Sroginis, Anna & Fildes, Robert & Kourentzes, Nikolaos, 2023. "Use of contextual and model-based information in adjusting promotional forecasts," European Journal of Operational Research, Elsevier, vol. 307(3), pages 1177-1191.
    8. Makridakis, Spyros & Hyndman, Rob J. & Petropoulos, Fotios, 2020. "Forecasting in social settings: The state of the art," International Journal of Forecasting, Elsevier, vol. 36(1), pages 15-28.
    9. Arvan, Meysam & Fahimnia, Behnam & Reisi, Mohsen & Siemsen, Enno, 2019. "Integrating human judgement into quantitative forecasting methods: A review," Omega, Elsevier, vol. 86(C), pages 237-252.
    10. Wen, Xin & Jaxa-Rozen, Marc & Trutnevyte, Evelina, 2022. "Accuracy indicators for evaluating retrospective performance of energy system models," Applied Energy, Elsevier, vol. 325(C).
    11. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2022. "M5 accuracy competition: Results, findings, and conclusions," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1346-1364.
    12. Che-Yu Hung & Chien-Chih Wang & Shi-Woei Lin & Bernard C. Jiang, 2022. "An Empirical Comparison of the Sales Forecasting Performance for Plastic Tray Manufacturing Using Missing Data," Sustainability, MDPI, vol. 14(4), pages 1-21, February.
    13. Apostolos Ampountolas, 2019. "Forecasting hotel demand uncertainty using time series Bayesian VAR models," Tourism Economics, , vol. 25(5), pages 734-756, August.
    14. Massimiliano Giacalone, 2022. "Optimal forecasting accuracy using Lp-norm combination," METRON, Springer;Sapienza Università di Roma, vol. 80(2), pages 187-230, August.
    15. Fildes, Robert & Goodwin, Paul & Lawrence, Michael & Nikolopoulos, Konstantinos, 2009. "Effective forecasting and judgmental adjustments: an empirical evaluation and strategies for improvement in supply-chain planning," International Journal of Forecasting, Elsevier, vol. 25(1), pages 3-23.
    16. Kim, Sungil & Kim, Heeyoung, 2016. "A new metric of absolute percentage error for intermittent demand forecasts," International Journal of Forecasting, Elsevier, vol. 32(3), pages 669-679.
    17. Athanasopoulos, George & Hyndman, Rob J. & Kourentzes, Nikolaos & Petropoulos, Fotios, 2017. "Forecasting with temporal hierarchies," European Journal of Operational Research, Elsevier, vol. 262(1), pages 60-74.
    18. Ji Wu & Xian Cheng & Stephen Shaoyi Liao, 2020. "Tourism forecast combination using the stochastic frontier analysis technique," Tourism Economics, , vol. 26(7), pages 1086-1107, November.
    19. Zvi Schwartz & Timothy Webb & Jean-Pierre I van der Rest & Larissa Koupriouchina, 2021. "Enhancing the accuracy of revenue management system forecasts: The impact of machine and human learning on the effectiveness of hotel occupancy forecast combinations across multiple forecasting horizo," Tourism Economics, , vol. 27(2), pages 273-291, March.
    20. Daud Ali Aser & Esin Firuzan, 2022. "Improving Forecast Accuracy Using Combined Forecasts with Regard to Structural Breaks and ARCH Innovations," EKOIST Journal of Econometrics and Statistics, Istanbul University, Faculty of Economics, vol. 0(37), pages 1-25, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:toueco:v:29:y:2023:i:8:p:2143-2164. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.