IDEAS home Printed from https://ideas.repec.org/p/fem/femwpa/2017.06.html
   My bibliography  Save this paper

Statistical and Economic Evaluation of Time Series Models for Forecasting Arrivals at Call Centers

Author

Listed:
  • Andrea Bastianin

    (University of Milan)

  • Marzio Galeotti

    (University of Milan and IEFE Bocconi)

  • Matteo Manera

    (University of Milan-Bicocca and Fondazione Eni Enrico Mattei)

Abstract

Call centers' managers are interested in obtaining accurate forecasts of call arrivals because these are a key input in staffing and scheduling decisions. Therefore their ability to achieve an optimal balance between service quality and operating costs ultimately hinges on forecast accuracy. We present a strategy to model selection in call centers which is based on three pillars: (i) a flexible loss function; (ii) statistical evaluation of forecast accuracy; (iii) economic evaluation of forecast performance using money metrics. We implement fourteen time series models and seven forecast combination schemes on three series of call arrivals. We show that second moment modeling is important when forecasting call arrivals. From the point of view of a call center manager, our results indicate that outsourcing the development of a forecasting model is worth its cost, since the simple Seasonal Random Walk model is always outperformed by other, relatively more sophisticated, specifications.

Suggested Citation

  • Andrea Bastianin & Marzio Galeotti & Matteo Manera, 2017. "Statistical and Economic Evaluation of Time Series Models for Forecasting Arrivals at Call Centers," Working Papers 2017.06, Fondazione Eni Enrico Mattei.
  • Handle: RePEc:fem:femwpa:2017.06
    as

    Download full text from publisher

    File URL: https://feem-media.s3.eu-central-1.amazonaws.com/wp-content/uploads/NDL2017-006.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. James W. Taylor, 2012. "Density Forecasting of Intraday Call Center Arrivals Using Models Based on Exponential Smoothing," Management Science, INFORMS, vol. 58(3), pages 534-549, March.
    2. Ivana Komunjer & Michael T. Owyang, 2012. "Multivariate Forecast Evaluation and Rationality Testing," The Review of Economics and Statistics, MIT Press, vol. 94(4), pages 1066-1080, November.
    3. Robert Jung & A. Tremayne, 2011. "Useful models for time series of counts or simply wrong ones?," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 95(1), pages 59-91, March.
    4. Bruce H. Andrews & Shawn M. Cunningham, 1995. "L. L. Bean Improves Call-Center Forecasting," Interfaces, INFORMS, vol. 25(6), pages 1-13, December.
    5. Graham Elliott & Allan Timmermann & Ivana Komunjer, 2005. "Estimation and Testing of Forecast Rationality under Flexible Loss," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(4), pages 1107-1125.
    6. Peter R. Hansen & Asger Lunde & James M. Nason, 2011. "The Model Confidence Set," Econometrica, Econometric Society, vol. 79(2), pages 453-497, March.
    7. Elamin H. Elbasha, 2005. "Risk aversion and uncertainty in cost‐effectiveness analysis: the expected‐utility, moment‐generating function approach," Health Economics, John Wiley & Sons, Ltd., vol. 14(5), pages 457-470, May.
    8. Gneiting, Tilmann, 2011. "Quantiles as optimal point forecasts," International Journal of Forecasting, Elsevier, vol. 27(2), pages 197-207.
    9. Weinberg, Jonathan & Brown, Lawrence D. & Stroud, Jonathan R., 2007. "Bayesian Forecasting of an Inhomogeneous Poisson Process With Applications to Call Center Data," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1185-1198, December.
    10. Graham Elliott & Ivana Komunjer & Allan Timmermann, 2008. "Biases in Macroeconomic Forecasts: Irrationality or Asymmetric Loss?," Journal of the European Economic Association, MIT Press, vol. 6(1), pages 122-157, March.
    11. Zeng Tian & Swanson Norman R., 1998. "Predictive Evaluation of Econometric Forecasting Models in Commodity Futures Markets," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 2(4), pages 1-21, January.
    12. Taeyoon Kim & Phil Kenkel & B. Wade Brorsen, 2012. "Forecasting Hourly Peak Call Volume for a Rural Electric Cooperative Call Center," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 31(4), pages 314-329, July.
    13. Robert Neil Collender & James A. Chalfant, 1986. "An Alternative Approach to Decisions under Uncertainty Using the Empirical Moment-Generating Function," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 68(3), pages 727-731.
    14. James W. Taylor, 2008. "A Comparison of Univariate Time Series Methods for Forecasting Intraday Arrivals at a Call Center," Management Science, INFORMS, vol. 54(2), pages 253-265, February.
    15. Franses, Philip Hans & van Dijk, Dick, 2005. "The forecasting performance of various models for seasonality and nonlinearity for quarterly industrial production," International Journal of Forecasting, Elsevier, vol. 21(1), pages 87-102.
    16. Garratt A. & Lee K. & Pesaran M.H. & Shin Y., 2003. "Forecast Uncertainties in Macroeconomic Modeling: An Application to the U.K. Economy," Journal of the American Statistical Association, American Statistical Association, vol. 98, pages 829-838, January.
    17. Bastianin, Andrea & Galeotti, Marzio & Manera, Matteo, 2014. "Causality and predictability in distribution: The ethanol–food price relation revisited," Energy Economics, Elsevier, vol. 42(C), pages 152-160.
    18. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    19. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
    20. A Antipov & N Meade, 2002. "Forecasting call frequency at a financial services call centre," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 53(9), pages 953-960, September.
    21. Nabil Channouf & Pierre L’Ecuyer & Armann Ingolfsson & Athanassios Avramidis, 2007. "The application of forecasting techniques to modeling emergency medical system calls in Calgary, Alberta," Health Care Management Science, Springer, vol. 10(1), pages 25-45, February.
    22. Tych, Wlodek & Pedregal, Diego J. & Young, Peter C. & Davies, John, 2002. "An unobserved component model for multi-rate forecasting of telephone call demand: the design of a forecasting support system," International Journal of Forecasting, Elsevier, vol. 18(4), pages 673-695.
    23. Edward E. Gbur & Robert A. Collins, 1989. "A Small-Sample Comparison of Estimators in the EU-MGF Approach to Decision Making," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 71(1), pages 202-210.
    24. Andrea BASTIANIN & Marzio GALEOTTI & Matteo MANERA, 2011. "Forecast evaluation in call centers: combined forecasts, flexible loss functions and economic criteria," Departmental Working Papers 2011-08, Department of Economics, Management and Quantitative Methods at Università degli Studi di Milano.
    25. Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
    26. Joseph M. Milner & Tava Lennon Olsen, 2008. "Service-Level Agreements in Call Centers: Perils and Prescriptions," Management Science, INFORMS, vol. 54(2), pages 238-252, February.
    27. Robert Engle, 2002. "New frontiers for arch models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 17(5), pages 425-446.
    28. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    29. Noah Gans & Ger Koole & Avishai Mandelbaum, 2003. "Telephone Call Centers: Tutorial, Review, and Research Prospects," Manufacturing & Service Operations Management, INFORMS, vol. 5(2), pages 79-141, September.
    30. Alex Roubos & Ger Koole & Raik Stolletz, 2012. "Service-Level Variability of Inbound Call Centers," Manufacturing & Service Operations Management, INFORMS, vol. 14(3), pages 402-413, July.
    31. Gneiting, Tilmann, 2011. "Quantiles as optimal point forecasts," International Journal of Forecasting, Elsevier, vol. 27(2), pages 197-207, April.
    32. Franses, Philip Hans & Paap, Richard, 2004. "Periodic Time Series Models," OUP Catalogue, Oxford University Press, number 9780199242030.
    33. Dorfman, Jeffrey H. & Mcintosh, Christopher S., 1997. "Economic Criteria for Evaluating Commodity Price Forecasts," Journal of Agricultural and Applied Economics, Cambridge University Press, vol. 29(2), pages 337-345, December.
    34. Gardner, Everette Jr., 2006. "Exponential smoothing: The state of the art--Part II," International Journal of Forecasting, Elsevier, vol. 22(4), pages 637-666.
    35. Andrea BASTIANIN & Marzio GALEOTTI & Matteo MANERA, 2011. "Forecast evaluation in call centers: combined forecasts, flexible loss functions and economic criteria," Departmental Working Papers 2011-08, Department of Economics, Management and Quantitative Methods at Università degli Studi di Milano.
    36. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    37. Bianchi, Lisa & Jarrett, Jeffrey & Choudary Hanumara, R., 1998. "Improving forecasting for telemarketing centers by ARIMA modeling with intervention," International Journal of Forecasting, Elsevier, vol. 14(4), pages 497-504, December.
    38. Douglas J. Thomas, 2005. "Measuring Item Fill-Rate Performance in a Finite Horizon," Manufacturing & Service Operations Management, INFORMS, vol. 7(1), pages 74-80, September.
    39. Ibrahim, Rouba & Ye, Han & L’Ecuyer, Pierre & Shen, Haipeng, 2016. "Modeling and forecasting call center arrivals: A literature survey and a case study," International Journal of Forecasting, Elsevier, vol. 32(3), pages 865-874.
    40. Cameron, A. Colin & Trivedi, Pravin K., 1990. "Regression-based tests for overdispersion in the Poisson model," Journal of Econometrics, Elsevier, vol. 46(3), pages 347-364, December.
    41. Geurt Jongbloed & Ger Koole, 2001. "Managing uncertainty in call centres using Poisson mixtures," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 17(4), pages 307-318, October.
    42. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
    43. Leitch, Gordon & Tanner, J Ernest, 1991. "Economic Forecast Evaluation: Profits versus the Conventional Error Measures," American Economic Review, American Economic Association, vol. 81(3), pages 580-590, June.
    44. Newey, Whitney K & Powell, James L, 1987. "Asymmetric Least Squares Estimation and Testing," Econometrica, Econometric Society, vol. 55(4), pages 819-847, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Andrea Bastianin & Marzio Galeotti & Matteo Manera, 2019. "Statistical and economic evaluation of time series models for forecasting arrivals at call centers," Empirical Economics, Springer, vol. 57(3), pages 923-955, September.
    2. Andrea Bastianin & Marzio Galeotti & Matteo Manera, 2011. "Forecast Evaluation in Call Centers: Combined Forecasts, Flexible Loss Functions and Economic Criteria," UNIMI - Research Papers in Economics, Business, and Statistics unimi-1109, Universitá degli Studi di Milano.
    3. Andrea BASTIANIN & Marzio GALEOTTI & Matteo MANERA, 2011. "Forecast evaluation in call centers: combined forecasts, flexible loss functions and economic criteria," Departmental Working Papers 2011-08, Department of Economics, Management and Quantitative Methods at Università degli Studi di Milano.
    4. Andrea Bastianin & Marzio Galeotti & Matteo Manera, 2011. "Forecast Evaluation in Call Centers: Combined Forecasts, Flexible Loss Functions and Economic Criteria," Working Papers 20110301, Università degli Studi di Milano-Bicocca, Dipartimento di Statistica.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrea BASTIANIN & Marzio GALEOTTI & Matteo MANERA, 2011. "Forecast evaluation in call centers: combined forecasts, flexible loss functions and economic criteria," Departmental Working Papers 2011-08, Department of Economics, Management and Quantitative Methods at Università degli Studi di Milano.
    2. Andrea Bastianin & Marzio Galeotti & Matteo Manera, 2011. "Forecast Evaluation in Call Centers: Combined Forecasts, Flexible Loss Functions and Economic Criteria," Working Papers 20110301, Università degli Studi di Milano-Bicocca, Dipartimento di Statistica.
    3. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    4. Theresa Maria Rausch & Tobias Albrecht & Daniel Baier, 2022. "Beyond the beaten paths of forecasting call center arrivals: on the use of dynamic harmonic regression with predictor variables," Journal of Business Economics, Springer, vol. 92(4), pages 675-706, May.
    5. Ibrahim, Rouba & Ye, Han & L’Ecuyer, Pierre & Shen, Haipeng, 2016. "Modeling and forecasting call center arrivals: A literature survey and a case study," International Journal of Forecasting, Elsevier, vol. 32(3), pages 865-874.
    6. Barrow, Devon K., 2016. "Forecasting intraday call arrivals using the seasonal moving average method," Journal of Business Research, Elsevier, vol. 69(12), pages 6088-6096.
    7. Barrow, Devon & Kourentzes, Nikolaos, 2018. "The impact of special days in call arrivals forecasting: A neural network approach to modelling special days," European Journal of Operational Research, Elsevier, vol. 264(3), pages 967-977.
    8. Meade, Nigel & Islam, Towhidul, 2015. "Forecasting in telecommunications and ICT—A review," International Journal of Forecasting, Elsevier, vol. 31(4), pages 1105-1126.
    9. Rouba Ibrahim & Pierre L'Ecuyer, 2013. "Forecasting Call Center Arrivals: Fixed-Effects, Mixed-Effects, and Bivariate Models," Manufacturing & Service Operations Management, INFORMS, vol. 15(1), pages 72-85, May.
    10. Graham Elliott & Allan Timmermann, 2016. "Forecasting in Economics and Finance," Annual Review of Economics, Annual Reviews, vol. 8(1), pages 81-110, October.
    11. Raffaella Giacomini & Barbara Rossi, 2013. "Forecasting in macroeconomics," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 17, pages 381-408, Edward Elgar Publishing.
    12. Robert Lehmann, 2016. "Economic Growth and Business Cycle Forecasting at the Regional Level," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 65.
    13. Mauro Bernardi & Leopoldo Catania, 2016. "Comparison of Value-at-Risk models using the MCS approach," Computational Statistics, Springer, vol. 31(2), pages 579-608, June.
    14. Albrecht, Tobias & Rausch, Theresa Maria & Derra, Nicholas Daniel, 2021. "Call me maybe: Methods and practical implementation of artificial intelligence in call center arrivals’ forecasting," Journal of Business Research, Elsevier, vol. 123(C), pages 267-278.
    15. Yen, Yu-Min & Yen, Tso-Jung, 2021. "Testing forecast accuracy of expectiles and quantiles with the extremal consistent loss functions," International Journal of Forecasting, Elsevier, vol. 37(2), pages 733-758.
    16. Haipeng Shen & Jianhua Z. Huang, 2008. "Interday Forecasting and Intraday Updating of Call Center Arrivals," Manufacturing & Service Operations Management, INFORMS, vol. 10(3), pages 391-410, July.
    17. Komunjer, Ivana, 2013. "Quantile Prediction," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 961-994, Elsevier.
    18. Smirnov, Dmitry & Huchzermeier, Arnd, 2020. "Analytics for labor planning in systems with load-dependent service times," European Journal of Operational Research, Elsevier, vol. 287(2), pages 668-681.
    19. Martin, Gael M. & Loaiza-Maya, Rubén & Maneesoonthorn, Worapree & Frazier, David T. & Ramírez-Hassan, Andrés, 2022. "Optimal probabilistic forecasts: When do they work?," International Journal of Forecasting, Elsevier, vol. 38(1), pages 384-406.
    20. Ding, S. & Koole, G. & van der Mei, R.D., 2015. "On the estimation of the true demand in call centers with redials and reconnects," European Journal of Operational Research, Elsevier, vol. 246(1), pages 250-262.

    More about this item

    Keywords

    ARIMA; Call Center Arrivals; Loss Function; Seasonality; Telecommunications Forecasting;
    All these keywords.

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C25 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Discrete Regression and Qualitative Choice Models; Discrete Regressors; Proportions; Probabilities
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • D81 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Criteria for Decision-Making under Risk and Uncertainty
    • M15 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Business Administration - - - IT Management

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fem:femwpa:2017.06. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Alberto Prina Cerai (email available below). General contact details of provider: https://edirc.repec.org/data/feemmit.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.