IDEAS home Printed from https://ideas.repec.org/a/eee/tefoso/v111y2016icp235-243.html
   My bibliography  Save this article

A novel ranking procedure for forecasting approaches using Data Envelopment Analysis

Author

Listed:
  • Emrouznejad, Ali
  • Rostami-Tabar, Bahman
  • Petridis, Konstantinos

Abstract

To compare the accuracy of different forecasting approaches an error measure is required. Many error measures have been proposed in the literature, however in practice there are some situations where different measures yield different decisions on forecasting approach selection and there is no agreement on which approach should be used. Generally forecasting measures represent ratios or percentages providing an overall image of how well fitted the forecasting technique is to the observations. This paper proposes a multiplicative Data Envelopment Analysis (DEA) model in order to rank several forecasting techniques. We demonstrate the proposed model by applying it to the set of yearly time series of the M3 competition. The usefulness of the proposed approach has been tested using the M3-competition where five error measures have been applied in and aggregated to a single DEA score.

Suggested Citation

  • Emrouznejad, Ali & Rostami-Tabar, Bahman & Petridis, Konstantinos, 2016. "A novel ranking procedure for forecasting approaches using Data Envelopment Analysis," Technological Forecasting and Social Change, Elsevier, vol. 111(C), pages 235-243.
  • Handle: RePEc:eee:tefoso:v:111:y:2016:i:c:p:235-243
    DOI: 10.1016/j.techfore.2016.07.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0040162516301482
    Download Restriction: Full text for ScienceDirect subscribers only

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Athanasopoulos, George & Hyndman, Rob J., 2011. "The value of feedback in forecasting competitions," International Journal of Forecasting, Elsevier, vol. 27(3), pages 845-849.
    2. B. Hollingsworth & P. Smith, 2003. "Use of ratios in data envelopment analysis," Applied Economics Letters, Taylor & Francis Journals, vol. 10(11), pages 733-735.
    3. De Gooijer, Jan G. & Hyndman, Rob J., 2006. "25 years of time series forecasting," International Journal of Forecasting, Elsevier, vol. 22(3), pages 443-473.
    4. Yokuma, J. Thomas & Armstrong, J. Scott, 1995. "Beyond accuracy: Comparison of criteria used to select forecasting methods," International Journal of Forecasting, Elsevier, vol. 11(4), pages 591-597, December.
    5. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    6. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    7. Collopy, Fred & Armstrong, J. Scott, 1992. "Expert opinions about extrapolation and the mystery of the overlooked discontinuities," International Journal of Forecasting, Elsevier, vol. 8(4), pages 575-582, December.
    8. B. Xu & J. Ouenniche, 2011. "A multidimensional framework for performance evaluation of forecasting models: context-dependent DEA," Applied Financial Economics, Taylor & Francis Journals, vol. 21(24), pages 1873-1890, December.
    9. Fildes, Robert & Wei, Yingqi & Ismail, Suzilah, 2011. "Evaluating the forecasting performance of econometric models of air passenger traffic flows using multiple error measures," International Journal of Forecasting, Elsevier, vol. 27(3), pages 902-922.
    10. Makridakis, Spyros & Hibon, Michele, 2000. "The M3-Competition: results, conclusions and implications," International Journal of Forecasting, Elsevier, vol. 16(4), pages 451-476.
    11. Geurts, Michael D. & Patrick Kelly, J., 1986. "Forecasting retail sales using alternative models," International Journal of Forecasting, Elsevier, vol. 2(3), pages 261-272.
    12. Syntetos, Aris A. & Boylan, John E., 2005. "The accuracy of intermittent demand estimates," International Journal of Forecasting, Elsevier, vol. 21(2), pages 303-314.
    13. Chen, Yao, 2005. "Measuring super-efficiency in DEA in the presence of infeasibility," European Journal of Operational Research, Elsevier, vol. 161(2), pages 545-551, March.
    14. Lim, Dong-Joon & Anderson, Timothy R. & Inman, Oliver Lane, 2014. "Choosing effective dates from multiple optima in Technology Forecasting using Data Envelopment Analysis (TFDEA)," Technological Forecasting and Social Change, Elsevier, vol. 88(C), pages 91-97.
    15. Cook, Wade D. & Seiford, Larry M., 2009. "Data envelopment analysis (DEA) - Thirty years on," European Journal of Operational Research, Elsevier, vol. 192(1), pages 1-17, January.
    16. R. D. Banker & A. Charnes & W. W. Cooper, 1984. "Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis," Management Science, INFORMS, vol. 30(9), pages 1078-1092, September.
    17. Rajiv D. Banker & Ajay Maindiratta, 1986. "Piecewise Loglinear Estimation of Efficient Production Surfaces," Management Science, INFORMS, vol. 32(1), pages 126-135, January.
    18. Davydenko, Andrey & Fildes, Robert, 2013. "Measuring forecasting accuracy: The case of judgmental adjustments to SKU-level demand forecasts," International Journal of Forecasting, Elsevier, vol. 29(3), pages 510-522.
    19. Emrouznejad, Ali & De Witte, Kristof, 2010. "COOPER-framework: A unified process for non-parametric projects," European Journal of Operational Research, Elsevier, vol. 207(3), pages 1573-1586, December.
    20. Seiford, Lawrence M. & Zhu, Joe, 2002. "Modeling undesirable factors in efficiency evaluation," European Journal of Operational Research, Elsevier, vol. 142(1), pages 16-20, October.
    21. Emrouznejad, A. & De Witte, K., 2010. "COOPER-framework: A Unified Standard Process for Non-parametric Projects," Working Papers 18, Top Institute for Evidence Based Education Research.
    22. Rajiv D. Banker & Ajay Maindiratta, 1986. "Erratum to: "Piecewise Loglinear Estimation of Efficient Production Surfaces"," Management Science, INFORMS, vol. 32(3), pages 385-385, March.
    23. Charnes, A. & Cooper, W. W. & Seiford, L. & Stutz, J., 1982. "A multiplicative model for efficiency analysis," Socio-Economic Planning Sciences, Elsevier, vol. 16(5), pages 223-224.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wu, Yunna & Ke, Yiming & Zhang, Ting & Liu, Fangtong & Wang, Jing, 2018. "Performance efficiency assessment of photovoltaic poverty alleviation projects in China: A three-phase data envelopment analysis model," Energy, Elsevier, vol. 159(C), pages 599-610.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:tefoso:v:111:y:2016:i:c:p:235-243. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Haili He). General contact details of provider: http://www.sciencedirect.com/science/journal/00401625 .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.