IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Log in (now much improved!) to save this paper

Forecast evaluation in call centers: combined forecasts, flexible loss functions and economic criteria

Listed author(s):
  • Andrea BASTIANIN

    ()

  • Marzio GALEOTTI

    ()

  • Matteo MANERA

    ()

Accurate forecasts of incoming calls are crucial to optimal staffing decisions in call centers. This paper evaluates a wide range of models and forecast combination techniques by means of statistical and economic criteria. Relative to the previous literature, this paper is novel in several respects. In particular, the statistical evaluation of competing models is carried out by using a flexible loss function as input to pairwise and joint forecast diagnostic checks. Informative rankings across alternative single models and different groups of models are obtained. Moreover, models are evaluated from the perspective of a manager, who needs reliable forecasts to dimension the call center. Money metrics of forecasting performance are computed, which are based on the economic value of information and the certainty equivalent.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://wp.demm.unimi.it/files/wp/2011/DEMM-2011_008wp.pdf
Download Restriction: no

Paper provided by Department of Economics, Management and Quantitative Methods at Università degli Studi di Milano in its series Departmental Working Papers with number 2011-08.

as
in new window

Length:
Date of creation: 21 Mar 2011
Handle: RePEc:mil:wpdepa:2011-08
Contact details of provider: Postal:
Via Conservatorio 7, I-20122 Milan - Italy

Phone: +39 02 50321522
Fax: +39 02 50321505
Web page: http://www.demm.unimi.it

More information through EDIRC

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. Komunjer, Ivana & OWYANG, MICHAEL, 2007. "Multivariate Forecast Evaluation And Rationality Testing," University of California at San Diego, Economics Working Paper Series qt81w8m5sf, Department of Economics, UC San Diego.
  2. Franses, Ph.H.B.F. & van Dijk, D.J.C., 2001. "The forecasting performance of various models for seasonality and nonlinearity for quarterly industrial production," Econometric Institute Research Papers EI 2001-14, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
  3. Dorfman, Jeffrey H. & McIntosh, Christopher S., 1997. "Economic Criteria For Evaluating Commodity Price Forecasts," Journal of Agricultural and Applied Economics, Southern Agricultural Economics Association, vol. 29(02), December.
  4. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
  5. Zeng, T. & Swanson, N.R., 1997. "Predictive Evaluation of Econometric Forecasting Models in Commodity Futures Markets," Papers 9-97-4, Pennsylvania State - Department of Economics.
  6. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
  7. Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
  8. Robert Jung & A. Tremayne, 2011. "Useful models for time series of counts or simply wrong ones?," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 95(1), pages 59-91, March.
  9. James W. Taylor, 2008. "A Comparison of Univariate Time Series Methods for Forecasting Intraday Arrivals at a Call Center," Management Science, INFORMS, vol. 54(2), pages 253-265, February.
  10. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
  11. James W. Taylor, 2012. "Density Forecasting of Intraday Call Center Arrivals Using Models Based on Exponential Smoothing," Management Science, INFORMS, vol. 58(3), pages 534-549, March.
  12. Graham Elliott & Allan Timmermann & Ivana Komunjer, 2005. "Estimation and Testing of Forecast Rationality under Flexible Loss," Review of Economic Studies, Oxford University Press, vol. 72(4), pages 1107-1125.
  13. Robert Engle, 2002. "New frontiers for arch models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 17(5), pages 425-446.
  14. Garratt A. & Lee K. & Pesaran M.H. & Shin Y., 2003. "Forecast Uncertainties in Macroeconomic Modeling: An Application to the U.K. Economy," Journal of the American Statistical Association, American Statistical Association, vol. 98, pages 829-838, January.
  15. Gardner, Everette Jr., 2006. "Exponential smoothing: The state of the art--Part II," International Journal of Forecasting, Elsevier, vol. 22(4), pages 637-666.
  16. Leitch, Gordon & Tanner, J Ernest, 1991. "Economic Forecast Evaluation: Profits versus the Conventional Error Measures," American Economic Review, American Economic Association, vol. 81(3), pages 580-590, June.
  17. Elamin H. Elbasha, 2005. "Risk aversion and uncertainty in cost-effectiveness analysis: the expected-utility, moment-generating function approach," Health Economics, John Wiley & Sons, Ltd., vol. 14(5), pages 457-470.
  18. Noah Gans & Ger Koole & Avishai Mandelbaum, 2003. "Telephone Call Centers: Tutorial, Review, and Research Prospects," Manufacturing & Service Operations Management, INFORMS, vol. 5(2), pages 79-141, September.
  19. Robert Neil Collender & James A. Chalfant, 1986. "An Alternative Approach to Decisions under Uncertainty Using the Empirical Moment-Generating Function," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 68(3), pages 727-731.
  20. Ibrahim, Rouba & Ye, Han & L’Ecuyer, Pierre & Shen, Haipeng, 2016. "Modeling and forecasting call center arrivals: A literature survey and a case study," International Journal of Forecasting, Elsevier, vol. 32(3), pages 865-874.
  21. Edward E. Gbur & Robert A. Collins, 1989. "A Small-Sample Comparison of Estimators in the EU-MGF Approach to Decision Making," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 71(1), pages 202-210.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:mil:wpdepa:2011-08. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (DEMM Working Papers)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.