IDEAS home Printed from https://ideas.repec.org/p/ags/feemth/253725.html
   My bibliography  Save this paper

Statistical and Economic Evaluation of Time Series Models for Forecasting Arrivals at Call Centers

Author

Listed:
  • Bastianin, Andrea
  • Galeotti, Marzio
  • Manera, Matteo

Abstract

Call centers' managers are interested in obtaining accurate forecasts of call arrivals because these are a key input in staffing and scheduling decisions. Therefore their ability to achieve an optimal balance between service quality and operating costs ultimately hinges on forecast accuracy. We present a strategy to model selection in call centers which is based on three pillars: (i) a flexible loss function; (ii) statistical evaluation of forecast accuracy; (iii) economic evaluation of forecast performance using money metrics. We implement fourteen time series models and seven forecast combination schemes on three series of call arrivals. We show that second moment modeling is important when forecasting call arrivals. From the point of view of a call center manager, our results indicate that outsourcing the development of a forecasting model is worth its cost, since the simple Seasonal Random Walk model is always outperformed by other, relatively more sophisticated, specifications.

Suggested Citation

  • Bastianin, Andrea & Galeotti, Marzio & Manera, Matteo, 2017. "Statistical and Economic Evaluation of Time Series Models for Forecasting Arrivals at Call Centers," ETA: Economic Theory and Applications 253725, Fondazione Eni Enrico Mattei (FEEM).
  • Handle: RePEc:ags:feemth:253725
    DOI: 10.22004/ag.econ.253725
    as

    Download full text from publisher

    File URL: https://ageconsearch.umn.edu/record/253725/files/NDL2017-006.pdf
    Download Restriction: no

    File URL: https://libkey.io/10.22004/ag.econ.253725?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Bastianin, Andrea & Galeotti, Marzio & Manera, Matteo, 2014. "Causality and predictability in distribution: The ethanol–food price relation revisited," Energy Economics, Elsevier, vol. 42(C), pages 152-160.
    2. Tych, Wlodek & Pedregal, Diego J. & Young, Peter C. & Davies, John, 2002. "An unobserved component model for multi-rate forecasting of telephone call demand: the design of a forecasting support system," International Journal of Forecasting, Elsevier, vol. 18(4), pages 673-695.
    3. Garratt A. & Lee K. & Pesaran M.H. & Shin Y., 2003. "Forecast Uncertainties in Macroeconomic Modeling: An Application to the U.K. Economy," Journal of the American Statistical Association, American Statistical Association, vol. 98, pages 829-838, January.
    4. Franses, Philip Hans & van Dijk, Dick, 2005. "The forecasting performance of various models for seasonality and nonlinearity for quarterly industrial production," International Journal of Forecasting, Elsevier, vol. 21(1), pages 87-102.
    5. Alex Roubos & Ger Koole & Raik Stolletz, 2012. "Service-Level Variability of Inbound Call Centers," Manufacturing & Service Operations Management, INFORMS, vol. 14(3), pages 402-413, July.
    6. Edward E. Gbur & Robert A. Collins, 1989. "A Small-Sample Comparison of Estimators in the EU-MGF Approach to Decision Making," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 71(1), pages 202-210.
    7. James W. Taylor, 2012. "Density Forecasting of Intraday Call Center Arrivals Using Models Based on Exponential Smoothing," Management Science, INFORMS, vol. 58(3), pages 534-549, March.
    8. Gneiting, Tilmann, 2011. "Quantiles as optimal point forecasts," International Journal of Forecasting, Elsevier, vol. 27(2), pages 197-207, April.
    9. Franses, Philip Hans & Paap, Richard, 2004. "Periodic Time Series Models," OUP Catalogue, Oxford University Press, number 9780199242030.
    10. Dorfman, Jeffrey H. & McIntosh, Christopher S., 1997. "Economic Criteria For Evaluating Commodity Price Forecasts," Journal of Agricultural and Applied Economics, Southern Agricultural Economics Association, vol. 29(2), pages 1-9, December.
    11. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    12. Ivana Komunjer & Michael T. Owyang, 2012. "Multivariate Forecast Evaluation and Rationality Testing," The Review of Economics and Statistics, MIT Press, vol. 94(4), pages 1066-1080, November.
    13. Geurt Jongbloed & Ger Koole, 2001. "Managing uncertainty in call centres using Poisson mixtures," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 17(4), pages 307-318, October.
    14. Peter R. Hansen & Asger Lunde & James M. Nason, 2011. "The Model Confidence Set," Econometrica, Econometric Society, vol. 79(2), pages 453-497, March.
    15. Zeng Tian & Swanson Norman R., 1998. "Predictive Evaluation of Econometric Forecasting Models in Commodity Futures Markets," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 2(4), pages 1-21, January.
    16. Andrea BASTIANIN & Marzio GALEOTTI & Matteo MANERA, 2011. "Forecast evaluation in call centers: combined forecasts, flexible loss functions and economic criteria," Departmental Working Papers 2011-08, Department of Economics, Management and Quantitative Methods at Università degli Studi di Milano.
    17. Taeyoon Kim & Phil Kenkel & B. Wade Brorsen, 2012. "Forecasting Hourly Peak Call Volume for a Rural Electric Cooperative Call Center," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 31(4), pages 314-329, July.
    18. Robert Neil Collender & James A. Chalfant, 1986. "An Alternative Approach to Decisions under Uncertainty Using the Empirical Moment-Generating Function," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 68(3), pages 727-731.
    19. Robert Jung & A. Tremayne, 2011. "Useful models for time series of counts or simply wrong ones?," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 95(1), pages 59-91, March.
    20. Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
    21. Andrea Bastianin & Marzio Galeotti & Matteo Manera, 2019. "Statistical and economic evaluation of time series models for forecasting arrivals at call centers," Empirical Economics, Springer, vol. 57(3), pages 923-955, September.
    22. Gneiting, Tilmann, 2011. "Quantiles as optimal point forecasts," International Journal of Forecasting, Elsevier, vol. 27(2), pages 197-207.
    23. Joseph M. Milner & Tava Lennon Olsen, 2008. "Service-Level Agreements in Call Centers: Perils and Prescriptions," Management Science, INFORMS, vol. 54(2), pages 238-252, February.
    24. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    25. Robert Engle, 2002. "New frontiers for arch models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 17(5), pages 425-446.
    26. James W. Taylor, 2008. "A Comparison of Univariate Time Series Methods for Forecasting Intraday Arrivals at a Call Center," Management Science, INFORMS, vol. 54(2), pages 253-265, February.
    27. Bruce H. Andrews & Shawn M. Cunningham, 1995. "L. L. Bean Improves Call-Center Forecasting," Interfaces, INFORMS, vol. 25(6), pages 1-13, December.
    28. Bianchi, Lisa & Jarrett, Jeffrey & Choudary Hanumara, R., 1998. "Improving forecasting for telemarketing centers by ARIMA modeling with intervention," International Journal of Forecasting, Elsevier, vol. 14(4), pages 497-504, December.
    29. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    30. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
    31. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
    32. Weinberg, Jonathan & Brown, Lawrence D. & Stroud, Jonathan R., 2007. "Bayesian Forecasting of an Inhomogeneous Poisson Process With Applications to Call Center Data," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1185-1198, December.
    33. A Antipov & N Meade, 2002. "Forecasting call frequency at a financial services call centre," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 53(9), pages 953-960, September.
    34. Douglas J. Thomas, 2005. "Measuring Item Fill-Rate Performance in a Finite Horizon," Manufacturing & Service Operations Management, INFORMS, vol. 7(1), pages 74-80, September.
    35. Leitch, Gordon & Tanner, J Ernest, 1991. "Economic Forecast Evaluation: Profits versus the Conventional Error Measures," American Economic Review, American Economic Association, vol. 81(3), pages 580-590, June.
    36. Newey, Whitney K & Powell, James L, 1987. "Asymmetric Least Squares Estimation and Testing," Econometrica, Econometric Society, vol. 55(4), pages 819-847, July.
    37. Graham Elliott & Ivana Komunjer & Allan Timmermann, 2008. "Biases in Macroeconomic Forecasts: Irrationality or Asymmetric Loss?," Journal of the European Economic Association, MIT Press, vol. 6(1), pages 122-157, March.
    38. Ibrahim, Rouba & Ye, Han & L’Ecuyer, Pierre & Shen, Haipeng, 2016. "Modeling and forecasting call center arrivals: A literature survey and a case study," International Journal of Forecasting, Elsevier, vol. 32(3), pages 865-874.
    39. Graham Elliott & Allan Timmermann & Ivana Komunjer, 2005. "Estimation and Testing of Forecast Rationality under Flexible Loss," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(4), pages 1107-1125.
    40. Gardner, Everette Jr., 2006. "Exponential smoothing: The state of the art--Part II," International Journal of Forecasting, Elsevier, vol. 22(4), pages 637-666.
    41. Cameron, A. Colin & Trivedi, Pravin K., 1990. "Regression-based tests for overdispersion in the Poisson model," Journal of Econometrics, Elsevier, vol. 46(3), pages 347-364, December.
    42. Nabil Channouf & Pierre L’Ecuyer & Armann Ingolfsson & Athanassios Avramidis, 2007. "The application of forecasting techniques to modeling emergency medical system calls in Calgary, Alberta," Health Care Management Science, Springer, vol. 10(1), pages 25-45, February.
    43. Noah Gans & Ger Koole & Avishai Mandelbaum, 2003. "Telephone Call Centers: Tutorial, Review, and Research Prospects," Manufacturing & Service Operations Management, INFORMS, vol. 5(2), pages 79-141, September.
    44. Elamin H. Elbasha, 2005. "Risk aversion and uncertainty in cost‐effectiveness analysis: the expected‐utility, moment‐generating function approach," Health Economics, John Wiley & Sons, Ltd., vol. 14(5), pages 457-470, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrea Bastianin & Marzio Galeotti & Matteo Manera, 2011. "Forecast Evaluation in Call Centers: Combined Forecasts, Flexible Loss Functions and Economic Criteria," UNIMI - Research Papers in Economics, Business, and Statistics unimi-1109, Universitá degli Studi di Milano.
    2. Andrea BASTIANIN & Marzio GALEOTTI & Matteo MANERA, 2011. "Forecast evaluation in call centers: combined forecasts, flexible loss functions and economic criteria," Departmental Working Papers 2011-08, Department of Economics, Management and Quantitative Methods at Università degli Studi di Milano.
    3. Andrea Bastianin & Marzio Galeotti & Matteo Manera, 2011. "Forecast Evaluation in Call Centers: Combined Forecasts, Flexible Loss Functions and Economic Criteria," Working Papers 20110301, Università degli Studi di Milano-Bicocca, Dipartimento di Statistica.
    4. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    5. Ibrahim, Rouba & Ye, Han & L’Ecuyer, Pierre & Shen, Haipeng, 2016. "Modeling and forecasting call center arrivals: A literature survey and a case study," International Journal of Forecasting, Elsevier, vol. 32(3), pages 865-874.
    6. Theresa Maria Rausch & Tobias Albrecht & Daniel Baier, 2022. "Beyond the beaten paths of forecasting call center arrivals: on the use of dynamic harmonic regression with predictor variables," Journal of Business Economics, Springer, vol. 92(4), pages 675-706, May.
    7. Barrow, Devon & Kourentzes, Nikolaos, 2018. "The impact of special days in call arrivals forecasting: A neural network approach to modelling special days," European Journal of Operational Research, Elsevier, vol. 264(3), pages 967-977.
    8. Barrow, Devon K., 2016. "Forecasting intraday call arrivals using the seasonal moving average method," Journal of Business Research, Elsevier, vol. 69(12), pages 6088-6096.
    9. Meade, Nigel & Islam, Towhidul, 2015. "Forecasting in telecommunications and ICT—A review," International Journal of Forecasting, Elsevier, vol. 31(4), pages 1105-1126.
    10. Rouba Ibrahim & Pierre L'Ecuyer, 2013. "Forecasting Call Center Arrivals: Fixed-Effects, Mixed-Effects, and Bivariate Models," Manufacturing & Service Operations Management, INFORMS, vol. 15(1), pages 72-85, May.
    11. Graham Elliott & Allan Timmermann, 2016. "Forecasting in Economics and Finance," Annual Review of Economics, Annual Reviews, vol. 8(1), pages 81-110, October.
    12. Albrecht, Tobias & Rausch, Theresa Maria & Derra, Nicholas Daniel, 2021. "Call me maybe: Methods and practical implementation of artificial intelligence in call center arrivals’ forecasting," Journal of Business Research, Elsevier, vol. 123(C), pages 267-278.
    13. Komunjer, Ivana, 2013. "Quantile Prediction," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 961-994, Elsevier.
    14. Robert Lehmann, 2016. "Economic Growth and Business Cycle Forecasting at the Regional Level," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 65.
    15. Raffaella Giacomini & Barbara Rossi, 2013. "Forecasting in macroeconomics," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 17, pages 381-408, Edward Elgar Publishing.
    16. Yen, Yu-Min & Yen, Tso-Jung, 2021. "Testing forecast accuracy of expectiles and quantiles with the extremal consistent loss functions," International Journal of Forecasting, Elsevier, vol. 37(2), pages 733-758.
    17. Mauro Bernardi & Leopoldo Catania, 2016. "Comparison of Value-at-Risk models using the MCS approach," Computational Statistics, Springer, vol. 31(2), pages 579-608, June.
    18. Haipeng Shen & Jianhua Z. Huang, 2008. "Interday Forecasting and Intraday Updating of Call Center Arrivals," Manufacturing & Service Operations Management, INFORMS, vol. 10(3), pages 391-410, July.
    19. Valentina Corradi & Norman Swanson, 2013. "A Survey of Recent Advances in Forecast Accuracy Comparison Testing, with an Extension to Stochastic Dominance," Departmental Working Papers 201309, Rutgers University, Department of Economics.
    20. James W. Taylor, 2008. "A Comparison of Univariate Time Series Methods for Forecasting Intraday Arrivals at a Call Center," Management Science, INFORMS, vol. 54(2), pages 253-265, February.

    More about this item

    Keywords

    Research Methods/ Statistical Methods;

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C25 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Discrete Regression and Qualitative Choice Models; Discrete Regressors; Proportions; Probabilities
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • D81 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Criteria for Decision-Making under Risk and Uncertainty
    • M15 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Business Administration - - - IT Management

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ags:feemth:253725. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: AgEcon Search (email available below). General contact details of provider: https://edirc.repec.org/data/feemmit.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.