IDEAS home Printed from https://ideas.repec.org/a/spr/empeco/v57y2019i3d10.1007_s00181-018-1475-y.html
   My bibliography  Save this article

Statistical and economic evaluation of time series models for forecasting arrivals at call centers

Author

Listed:
  • Andrea Bastianin

    (University of Milan)

  • Marzio Galeotti

    (University of Milan)

  • Matteo Manera

    (University of Milan-Bicocca)

Abstract

Call centers’ managers are interested in obtaining accurate point and distributional forecasts of call arrivals in order to achieve an optimal balance between service quality and operating costs. We present a strategy for selecting forecast models of call arrivals which is based on three pillars: (i) flexibility of the loss function; (ii) statistical evaluation of forecast accuracy; and (iii) economic evaluation of forecast performance using money metrics. We implement fourteen time series models and seven forecast combination schemes on three series of daily call arrivals. Although we focus mainly on point forecasts, we also analyze density forecast evaluation. We show that second-moment modeling is important for both point and density forecasting and that the simple seasonal random walk model is always outperformed by more general specifications. Our results suggest that call center managers should invest in the use of forecast models which describe both first and second moments of call arrivals.

Suggested Citation

  • Andrea Bastianin & Marzio Galeotti & Matteo Manera, 2019. "Statistical and economic evaluation of time series models for forecasting arrivals at call centers," Empirical Economics, Springer, vol. 57(3), pages 923-955, September.
  • Handle: RePEc:spr:empeco:v:57:y:2019:i:3:d:10.1007_s00181-018-1475-y
    DOI: 10.1007/s00181-018-1475-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00181-018-1475-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s00181-018-1475-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Tych, Wlodek & Pedregal, Diego J. & Young, Peter C. & Davies, John, 2002. "An unobserved component model for multi-rate forecasting of telephone call demand: the design of a forecasting support system," International Journal of Forecasting, Elsevier, vol. 18(4), pages 673-695.
    2. Edward E. Gbur & Robert A. Collins, 1989. "A Small-Sample Comparison of Estimators in the EU-MGF Approach to Decision Making," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 71(1), pages 202-210.
    3. James W. Taylor, 2012. "Density Forecasting of Intraday Call Center Arrivals Using Models Based on Exponential Smoothing," Management Science, INFORMS, vol. 58(3), pages 534-549, March.
    4. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    5. Ivana Komunjer & Michael T. Owyang, 2012. "Multivariate Forecast Evaluation and Rationality Testing," The Review of Economics and Statistics, MIT Press, vol. 94(4), pages 1066-1080, November.
    6. Bastianin, Andrea & Galeotti, Marzio & Manera, Matteo, 2014. "Causality and predictability in distribution: The ethanol–food price relation revisited," Energy Economics, Elsevier, vol. 42(C), pages 152-160.
    7. Zeng Tian & Swanson Norman R., 1998. "Predictive Evaluation of Econometric Forecasting Models in Commodity Futures Markets," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 2(4), pages 1-21, January.
    8. Andrea BASTIANIN & Marzio GALEOTTI & Matteo MANERA, 2011. "Forecast evaluation in call centers: combined forecasts, flexible loss functions and economic criteria," Departmental Working Papers 2011-08, Department of Economics, Management and Quantitative Methods at Università degli Studi di Milano.
    9. Taeyoon Kim & Phil Kenkel & B. Wade Brorsen, 2012. "Forecasting Hourly Peak Call Volume for a Rural Electric Cooperative Call Center," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 31(4), pages 314-329, July.
    10. Robert Neil Collender & James A. Chalfant, 1986. "An Alternative Approach to Decisions under Uncertainty Using the Empirical Moment-Generating Function," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 68(3), pages 727-731.
    11. Robert Jung & A. Tremayne, 2011. "Useful models for time series of counts or simply wrong ones?," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 95(1), pages 59-91, March.
    12. Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
    13. Andrea Bastianin & Marzio Galeotti & Matteo Manera, 2019. "Statistical and economic evaluation of time series models for forecasting arrivals at call centers," Empirical Economics, Springer, vol. 57(3), pages 923-955, September.
    14. Joseph M. Milner & Tava Lennon Olsen, 2008. "Service-Level Agreements in Call Centers: Perils and Prescriptions," Management Science, INFORMS, vol. 54(2), pages 238-252, February.
    15. Robert Engle, 2002. "New frontiers for arch models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 17(5), pages 425-446.
    16. James W. Taylor, 2008. "A Comparison of Univariate Time Series Methods for Forecasting Intraday Arrivals at a Call Center," Management Science, INFORMS, vol. 54(2), pages 253-265, February.
    17. Franses, Philip Hans & van Dijk, Dick, 2005. "The forecasting performance of various models for seasonality and nonlinearity for quarterly industrial production," International Journal of Forecasting, Elsevier, vol. 21(1), pages 87-102.
    18. Bruce H. Andrews & Shawn M. Cunningham, 1995. "L. L. Bean Improves Call-Center Forecasting," Interfaces, INFORMS, vol. 25(6), pages 1-13, December.
    19. Bianchi, Lisa & Jarrett, Jeffrey & Choudary Hanumara, R., 1998. "Improving forecasting for telemarketing centers by ARIMA modeling with intervention," International Journal of Forecasting, Elsevier, vol. 14(4), pages 497-504, December.
    20. Douglas J. Thomas, 2005. "Measuring Item Fill-Rate Performance in a Finite Horizon," Manufacturing & Service Operations Management, INFORMS, vol. 7(1), pages 74-80, September.
    21. Graham Elliott & Ivana Komunjer & Allan Timmermann, 2008. "Biases in Macroeconomic Forecasts: Irrationality or Asymmetric Loss?," Journal of the European Economic Association, MIT Press, vol. 6(1), pages 122-157, March.
    22. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    23. Ibrahim, Rouba & Ye, Han & L’Ecuyer, Pierre & Shen, Haipeng, 2016. "Modeling and forecasting call center arrivals: A literature survey and a case study," International Journal of Forecasting, Elsevier, vol. 32(3), pages 865-874.
    24. Graham Elliott & Allan Timmermann & Ivana Komunjer, 2005. "Estimation and Testing of Forecast Rationality under Flexible Loss," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(4), pages 1107-1125.
    25. Cameron, A. Colin & Trivedi, Pravin K., 1990. "Regression-based tests for overdispersion in the Poisson model," Journal of Econometrics, Elsevier, vol. 46(3), pages 347-364, December.
    26. Peter R. Hansen & Asger Lunde & James M. Nason, 2011. "The Model Confidence Set," Econometrica, Econometric Society, vol. 79(2), pages 453-497, March.
    27. Noah Gans & Ger Koole & Avishai Mandelbaum, 2003. "Telephone Call Centers: Tutorial, Review, and Research Prospects," Manufacturing & Service Operations Management, INFORMS, vol. 5(2), pages 79-141, September.
    28. Elamin H. Elbasha, 2005. "Risk aversion and uncertainty in cost‐effectiveness analysis: the expected‐utility, moment‐generating function approach," Health Economics, John Wiley & Sons, Ltd., vol. 14(5), pages 457-470, May.
    29. Garratt A. & Lee K. & Pesaran M.H. & Shin Y., 2003. "Forecast Uncertainties in Macroeconomic Modeling: An Application to the U.K. Economy," Journal of the American Statistical Association, American Statistical Association, vol. 98, pages 829-838, January.
    30. Alex Roubos & Ger Koole & Raik Stolletz, 2012. "Service-Level Variability of Inbound Call Centers," Manufacturing & Service Operations Management, INFORMS, vol. 14(3), pages 402-413, July.
    31. Gneiting, Tilmann, 2011. "Quantiles as optimal point forecasts," International Journal of Forecasting, Elsevier, vol. 27(2), pages 197-207, April.
    32. Franses, Philip Hans & Paap, Richard, 2004. "Periodic Time Series Models," OUP Catalogue, Oxford University Press, number 9780199242030.
    33. Dorfman, Jeffrey H. & McIntosh, Christopher S., 1997. "Economic Criteria For Evaluating Commodity Price Forecasts," Journal of Agricultural and Applied Economics, Southern Agricultural Economics Association, vol. 29(2), pages 1-9, December.
    34. Geurt Jongbloed & Ger Koole, 2001. "Managing uncertainty in call centres using Poisson mixtures," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 17(4), pages 307-318, October.
    35. Gneiting, Tilmann, 2011. "Quantiles as optimal point forecasts," International Journal of Forecasting, Elsevier, vol. 27(2), pages 197-207.
    36. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    37. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
    38. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
    39. Weinberg, Jonathan & Brown, Lawrence D. & Stroud, Jonathan R., 2007. "Bayesian Forecasting of an Inhomogeneous Poisson Process With Applications to Call Center Data," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1185-1198, December.
    40. A Antipov & N Meade, 2002. "Forecasting call frequency at a financial services call centre," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 53(9), pages 953-960, September.
    41. Leitch, Gordon & Tanner, J Ernest, 1991. "Economic Forecast Evaluation: Profits versus the Conventional Error Measures," American Economic Review, American Economic Association, vol. 81(3), pages 580-590, June.
    42. Newey, Whitney K & Powell, James L, 1987. "Asymmetric Least Squares Estimation and Testing," Econometrica, Econometric Society, vol. 55(4), pages 819-847, July.
    43. Gardner, Everette Jr., 2006. "Exponential smoothing: The state of the art--Part II," International Journal of Forecasting, Elsevier, vol. 22(4), pages 637-666.
    44. Nabil Channouf & Pierre L’Ecuyer & Armann Ingolfsson & Athanassios Avramidis, 2007. "The application of forecasting techniques to modeling emergency medical system calls in Calgary, Alberta," Health Care Management Science, Springer, vol. 10(1), pages 25-45, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrea Bastianin & Marzio Galeotti & Matteo Manera, 2011. "Forecast Evaluation in Call Centers: Combined Forecasts, Flexible Loss Functions and Economic Criteria," UNIMI - Research Papers in Economics, Business, and Statistics unimi-1109, Universitá degli Studi di Milano.
    2. Andrea BASTIANIN & Marzio GALEOTTI & Matteo MANERA, 2011. "Forecast evaluation in call centers: combined forecasts, flexible loss functions and economic criteria," Departmental Working Papers 2011-08, Department of Economics, Management and Quantitative Methods at Università degli Studi di Milano.
    3. Andrea Bastianin & Marzio Galeotti & Matteo Manera, 2011. "Forecast Evaluation in Call Centers: Combined Forecasts, Flexible Loss Functions and Economic Criteria," Working Papers 20110301, Università degli Studi di Milano-Bicocca, Dipartimento di Statistica.
    4. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    5. Theresa Maria Rausch & Tobias Albrecht & Daniel Baier, 2022. "Beyond the beaten paths of forecasting call center arrivals: on the use of dynamic harmonic regression with predictor variables," Journal of Business Economics, Springer, vol. 92(4), pages 675-706, May.
    6. Ibrahim, Rouba & Ye, Han & L’Ecuyer, Pierre & Shen, Haipeng, 2016. "Modeling and forecasting call center arrivals: A literature survey and a case study," International Journal of Forecasting, Elsevier, vol. 32(3), pages 865-874.
    7. Barrow, Devon & Kourentzes, Nikolaos, 2018. "The impact of special days in call arrivals forecasting: A neural network approach to modelling special days," European Journal of Operational Research, Elsevier, vol. 264(3), pages 967-977.
    8. Barrow, Devon K., 2016. "Forecasting intraday call arrivals using the seasonal moving average method," Journal of Business Research, Elsevier, vol. 69(12), pages 6088-6096.
    9. Meade, Nigel & Islam, Towhidul, 2015. "Forecasting in telecommunications and ICT—A review," International Journal of Forecasting, Elsevier, vol. 31(4), pages 1105-1126.
    10. Rouba Ibrahim & Pierre L'Ecuyer, 2013. "Forecasting Call Center Arrivals: Fixed-Effects, Mixed-Effects, and Bivariate Models," Manufacturing & Service Operations Management, INFORMS, vol. 15(1), pages 72-85, May.
    11. Graham Elliott & Allan Timmermann, 2016. "Forecasting in Economics and Finance," Annual Review of Economics, Annual Reviews, vol. 8(1), pages 81-110, October.
    12. Albrecht, Tobias & Rausch, Theresa Maria & Derra, Nicholas Daniel, 2021. "Call me maybe: Methods and practical implementation of artificial intelligence in call center arrivals’ forecasting," Journal of Business Research, Elsevier, vol. 123(C), pages 267-278.
    13. Raffaella Giacomini & Barbara Rossi, 2013. "Forecasting in macroeconomics," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 17, pages 381-408, Edward Elgar Publishing.
    14. Yen, Yu-Min & Yen, Tso-Jung, 2021. "Testing forecast accuracy of expectiles and quantiles with the extremal consistent loss functions," International Journal of Forecasting, Elsevier, vol. 37(2), pages 733-758.
    15. Haipeng Shen & Jianhua Z. Huang, 2008. "Interday Forecasting and Intraday Updating of Call Center Arrivals," Manufacturing & Service Operations Management, INFORMS, vol. 10(3), pages 391-410, July.
    16. Komunjer, Ivana, 2013. "Quantile Prediction," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 961-994, Elsevier.
    17. Robert Lehmann, 2016. "Economic Growth and Business Cycle Forecasting at the Regional Level," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 65.
    18. Mauro Bernardi & Leopoldo Catania, 2016. "Comparison of Value-at-Risk models using the MCS approach," Computational Statistics, Springer, vol. 31(2), pages 579-608, June.
    19. James W. Taylor, 2012. "Density Forecasting of Intraday Call Center Arrivals Using Models Based on Exponential Smoothing," Management Science, INFORMS, vol. 58(3), pages 534-549, March.
    20. Degiannakis, Stavros & Filis, George, 2017. "Forecasting oil price realized volatility using information channels from other asset classes," Journal of International Money and Finance, Elsevier, vol. 76(C), pages 28-49.

    More about this item

    Keywords

    ARIMA; Call center arrivals; Loss function; Seasonality; Telecommunications forecasting;
    All these keywords.

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C25 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Discrete Regression and Qualitative Choice Models; Discrete Regressors; Proportions; Probabilities
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • D81 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Criteria for Decision-Making under Risk and Uncertainty
    • M15 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Business Administration - - - IT Management

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:empeco:v:57:y:2019:i:3:d:10.1007_s00181-018-1475-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.