IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v32y2016i1p20-22.html
   My bibliography  Save this article

A note on the Mean Absolute Scaled Error

Author

Listed:
  • Franses, Philip Hans

Abstract

Hyndman and Koehler (2006) recommend that the Mean Absolute Scaled Error (MASE) should become the standard when comparing forecast accuracies. This note supports their claim by showing that the MASE fits nicely within the standard statistical procedures initiated by Diebold and Mariano (1995) for testing equal forecast accuracies. Various other criteria do not fit, as they do not imply the relevant moment properties, and this is illustrated in some simulation experiments.

Suggested Citation

  • Franses, Philip Hans, 2016. "A note on the Mean Absolute Scaled Error," International Journal of Forecasting, Elsevier, vol. 32(1), pages 20-22.
  • Handle: RePEc:eee:intfor:v:32:y:2016:i:1:p:20-22
    DOI: 10.1016/j.ijforecast.2015.03.008
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207015000448
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2015.03.008?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    2. Francis X. Diebold, 2015. "Comparing Predictive Accuracy, Twenty Years Later: A Personal Perspective on the Use and Abuse of Diebold-Mariano Tests," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(1), pages 1-1, January.
    3. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chiang, Shu-Mei & Chen, Chun-Da & Huang, Chien-Ming, 2019. "Analyzing the impacts of foreign exchange and oil price on biofuel commodity futures," Journal of International Money and Finance, Elsevier, vol. 96(C), pages 37-48.
    2. Drachal, Krzysztof, 2019. "Forecasting prices of selected metals with Bayesian data-rich models," Resources Policy, Elsevier, vol. 64(C).
    3. Kang, Yanfei & Spiliotis, Evangelos & Petropoulos, Fotios & Athiniotis, Nikolaos & Li, Feng & Assimakopoulos, Vassilios, 2021. "Déjà vu: A data-centric forecasting approach through time series cross-similarity," Journal of Business Research, Elsevier, vol. 132(C), pages 719-731.
    4. Beltrán, Sergio & Castro, Alain & Irizar, Ion & Naveran, Gorka & Yeregui, Imanol, 2022. "Framework for collaborative intelligence in forecasting day-ahead electricity price," Applied Energy, Elsevier, vol. 306(PA).
    5. Wen, Shizhao & Wang, Hongzeng & Qian, Jinhua & Men, Xuanyu, 2023. "A novel combined model based on echo state network optimized by whale optimization algorithm for blast furnace gas prediction," Energy, Elsevier, vol. 279(C).
    6. Jiangwei Liu & Xiaohong Huang, 2021. "Forecasting Crude Oil Price Using Event Extraction," Papers 2111.09111, arXiv.org.
    7. Krzysztof Tomczyk, 2023. "Extended Calibration of Charge Mode Accelerometers to Improve the Accuracy of Energy Systems," Energies, MDPI, vol. 16(22), pages 1-14, November.
    8. Pokorný, Jiří & Froněk, Pavel, 2021. "Price Forecasting Accuracy of the OECD-FAO's Agricultural Outlook and the European Commission DG AGRI's Medium-Term Agricultural Outlook Report," AGRIS on-line Papers in Economics and Informatics, Czech University of Life Sciences Prague, Faculty of Economics and Management, vol. 13(3), September.
    9. Nuri Hacıevliyagil & Krzysztof Drachal & Ibrahim Halil Eksi, 2022. "Predicting House Prices Using DMA Method: Evidence from Turkey," Economies, MDPI, vol. 10(3), pages 1-27, March.
    10. Julio Barzola-Monteses & Mónica Mite-León & Mayken Espinoza-Andaluz & Juan Gómez-Romero & Waldo Fajardo, 2019. "Time Series Analysis for Predicting Hydroelectric Power Production: The Ecuador Case," Sustainability, MDPI, vol. 11(23), pages 1-19, November.
    11. Krzysztof Drachal, 2019. "Analysis of Agricultural Commodities Prices with New Bayesian Model Combination Schemes," Sustainability, MDPI, vol. 11(19), pages 1-23, September.
    12. Drachal, Krzysztof, 2021. "Forecasting crude oil real prices with averaging time-varying VAR models," Resources Policy, Elsevier, vol. 74(C).
    13. Franses, Ph.H.B.F. & Maassen, N.R., 2015. "Consensus forecasters: How good are they individually and why?," Econometric Institute Research Papers EI2015-21, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    14. Fotios Petropoulos & Enno Siemsen, 2023. "Forecast Selection and Representativeness," Management Science, INFORMS, vol. 69(5), pages 2672-2690, May.
    15. Ismail Shah & Francesco Lisi, 2020. "Forecasting of electricity price through a functional prediction of sale and purchase curves," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(2), pages 242-259, March.
    16. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2020. "The M4 Competition: 100,000 time series and 61 forecasting methods," International Journal of Forecasting, Elsevier, vol. 36(1), pages 54-74.
    17. Viacheslav Kramkov, 2023. "Does CPI disaggregation improve inflation forecast accuracy?," Bank of Russia Working Paper Series wps112, Bank of Russia.
    18. Rostami-Tabar, Bahman & Ziel, Florian, 2022. "Anticipating special events in Emergency Department forecasting," International Journal of Forecasting, Elsevier, vol. 38(3), pages 1197-1213.
    19. Evangelos Spiliotis & Spyros Makridakis & Artemios-Anargyros Semenoglou & Vassilios Assimakopoulos, 2022. "Comparison of statistical and machine learning methods for daily SKU demand forecasting," Operational Research, Springer, vol. 22(3), pages 3037-3061, July.
    20. Ogliari, Emanuele & Guilizzoni, Manfredo & Giglio, Alessandro & Pretto, Silvia, 2021. "Wind power 24-h ahead forecast by an artificial neural network and an hybrid model: Comparison of the predictive performance," Renewable Energy, Elsevier, vol. 178(C), pages 1466-1474.
    21. David BENATIA, 2020. "Reaching New Lows? The Pandemic's Consequences for Electricity Markets," Working Papers 2020-12, Center for Research in Economics and Statistics.
    22. Kolassa, Stephan, 2016. "Evaluating predictive count data distributions in retail sales forecasting," International Journal of Forecasting, Elsevier, vol. 32(3), pages 788-803.
    23. Jens Kley-Holsteg & Florian Ziel, 2020. "Probabilistic Multi-Step-Ahead Short-Term Water Demand Forecasting with Lasso," Papers 2005.04522, arXiv.org.
    24. Montero-Sousa, Juan Aurelio & Aláiz-Moretón, Héctor & Quintián, Héctor & González-Ayuso, Tomás & Novais, Paulo & Calvo-Rolle, José Luis, 2020. "Hydrogen consumption prediction of a fuel cell based system with a hybrid intelligent approach," Energy, Elsevier, vol. 205(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Isabel Figuerola‐Ferretti & Alejandro Rodríguez & Eduardo Schwartz, 2021. "Oil price analysts' forecasts," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 41(9), pages 1351-1374, September.
    2. Aysun Türkvatan, 2023. "Exports and imports in Turkey: A regime‐switching approach," The World Economy, Wiley Blackwell, vol. 46(3), pages 791-834, March.
    3. Rafal Weron & Florian Ziel, 2018. "Electricity price forecasting," HSC Research Reports HSC/18/08, Hugo Steinhaus Center, Wroclaw University of Technology.
    4. Lago, Jesus & Marcjasz, Grzegorz & De Schutter, Bart & Weron, Rafał, 2021. "Forecasting day-ahead electricity prices: A review of state-of-the-art algorithms, best practices and an open-access benchmark," Applied Energy, Elsevier, vol. 293(C).
    5. Frank J. Fabozzi & Francesco A. Fabozzi & Diana Tunaru, 2023. "A comparison of multi-factor term structure models for interbank rates," Review of Quantitative Finance and Accounting, Springer, vol. 61(1), pages 323-356, July.
    6. João C. Claudio & Katja Heinisch & Oliver Holtemöller, 2020. "Nowcasting East German GDP growth: a MIDAS approach," Empirical Economics, Springer, vol. 58(1), pages 29-54, January.
    7. Barbara Rossi, 2013. "Exchange Rate Predictability," Journal of Economic Literature, American Economic Association, vol. 51(4), pages 1063-1119, December.
    8. Frank, Johannes, 2023. "Forecasting realized volatility in turbulent times using temporal fusion transformers," FAU Discussion Papers in Economics 03/2023, Friedrich-Alexander University Erlangen-Nuremberg, Institute for Economics.
    9. Cameron Roach & Rob Hyndman & Souhaib Ben Taieb, 2021. "Non‐linear mixed‐effects models for time series forecasting of smart meter demand," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(6), pages 1118-1130, September.
    10. Christopher Kath & Florian Ziel, 2018. "The value of forecasts: Quantifying the economic gains of accurate quarter-hourly electricity price forecasts," Papers 1811.08604, arXiv.org.
    11. Joseph P. Byrne & Dimitris Korobilis & Pinho J. Ribeiro, 2018. "On The Sources Of Uncertainty In Exchange Rate Predictability," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 59(1), pages 329-357, February.
    12. Nikitopoulos, Christina Sklibosios & Thomas, Alice Carole & Wang, Jianxin, 2023. "The economic impact of daily volatility persistence on energy markets," Journal of Commodity Markets, Elsevier, vol. 30(C).
    13. Blaskowitz, Oliver & Herwartz, Helmut, 2011. "On economic evaluation of directional forecasts," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1058-1065, October.
    14. Martin Guth, 2022. "Predicting Default Probabilities for Stress Tests: A Comparison of Models," Papers 2202.03110, arXiv.org.
    15. Christiane Baumeister & Lutz Kilian, 2015. "Forecasting the Real Price of Oil in a Changing World: A Forecast Combination Approach," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(3), pages 338-351, July.
    16. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    17. Kunze, Frederik, 2017. "Predicting exchange rates in Asia: New insights on the accuracy of survey forecasts," University of Göttingen Working Papers in Economics 326, University of Goettingen, Department of Economics.
    18. Drachal, Krzysztof, 2021. "Forecasting crude oil real prices with averaging time-varying VAR models," Resources Policy, Elsevier, vol. 74(C).
    19. Maciej Kostrzewski & Jadwiga Kostrzewska, 2021. "The Impact of Forecasting Jumps on Forecasting Electricity Prices," Energies, MDPI, vol. 14(2), pages 1-17, January.
    20. Tim Bollerslev & Benjamin Hood & John Huss & Lasse Heje Pedersen, 2018. "Risk Everywhere: Modeling and Managing Volatility," Review of Financial Studies, Society for Financial Studies, vol. 31(7), pages 2729-2773.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:32:y:2016:i:1:p:20-22. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.