IDEAS home Printed from https://ideas.repec.org/a/bap/journl/150301.html
   My bibliography  Save this article

On the Relationship among Values of the Same Summary Measure of Error when it is used across Multiple Characteristics at the Same Point in Time: An Examination of MALPE and MAPE

Author

Listed:
  • David A. Swanson

    (Department of Sociology, University of California Riverside£¬ Riverside, California 92521, U.S.A.)

Abstract

This paper deals with an issue that appears to be unexplored by demographers and others who conduct cross-sectional forecasts of populations with multiple characteristics. The issue is based on the question: "if one was conducting an ex post facto evaluation of a forecast or estimate that includes more than one characteristic (e.g., age, gender, race, and geography), how can one explain the fact that there are differences among the summary measures of error for all of the characteristics?" Using a hypothetical demographic forecast as an illustration, the paper examines this issue for two characteristics (race and geography) using a standard summary measure of forecast errors for each of two error dimensions, bias and precision. For the bias dimension, we examine the ¡°Mean Algebraic Percent Error¡± (MALPE) and ¡°Mean Absolute Percent Error (MAPE) for the precision dimension. The paper finds that hitherto unknown relationships across characteristics exist for each of the two summary error measures. For example, in evaluating a forecast that includes more than one characteristic, one can express MAPE taken for one characteristic (e.g., race) in terms of each of the other characteristics (e.g., age and geography). This finding allows one to explain the reason for differences in the summary error measures used to evaluate a forecast or estimate done for more than one characteristic. The findings are informative and suggestive and are likely to be generalizable. While the discussion is not formally rigorous, a formal general proof is presented of the relationship between values of MALPE across multiple characteristics as well as the values of MAPE.

Suggested Citation

  • David A. Swanson, 2015. "On the Relationship among Values of the Same Summary Measure of Error when it is used across Multiple Characteristics at the Same Point in Time: An Examination of MALPE and MAPE," Review of Economics & Finance, Better Advances Press, Canada, vol. 5, pages 1-14, August.
    • Handle: RePEc:bap:journl:150301
    as

    Download full text from publisher

    File URL: http://www.bapress.ca/ref/ref-article/1923-7529-2015-03-01-14.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. David Swanson & Jeff Tayman & Charles Barr, 2000. "A note on the measurement of accuracy for subnational demographic estimates," Demography, Springer;Population Association of America (PAA), vol. 37(2), pages 193-201, May.
    2. Smith, Stanley K. & Sincich, Terry, 1992. "Evaluating the forecast accuracy and bias of alternative population projections for states," International Journal of Forecasting, Elsevier, vol. 8(3), pages 495-508, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Steinegger, Josef & Wallner, Stefan & Greiml, Matthias & Kienberger, Thomas, 2023. "A new quasi-dynamic load flow calculation for district heating networks," Energy, Elsevier, vol. 266(C).
    2. Jeff Tayman & David A. Swanson & Jack Baker, 2021. "Using Synthetic Adjustments and Controlling to Improve County Population Forecasts from the Hamilton–Perry Method," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 40(6), pages 1355-1383, December.
    3. Hüseyin İlker Erçen & Hüseyin Özdeşer & Turgut Türsoy, 2022. "The Impact of Macroeconomic Sustainability on Exchange Rate: Hybrid Machine-Learning Approach," Sustainability, MDPI, vol. 14(9), pages 1-19, April.
    4. Jeff Tayman & David A. Swanson, 2017. "Using modified cohort change and child-woman ratios in the Hamilton–Perry forecasting method," Journal of Population Research, Springer, vol. 34(3), pages 209-231, September.
    5. Jack Baker & David Swanson & Jeff Tayman, 2021. "The Accuracy of Hamilton–Perry Population Projections for Census Tracts in the United States," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 40(6), pages 1341-1354, December.
    6. Rosa Francesca De Masi & Gerardo Maria Mauro & Silvia Ruggiero & Francesca Villano, 2023. "Predicting Building Energy Demand and Retrofit Potentials Using New Climatic Stress Indices and Curves," Energies, MDPI, vol. 16(16), pages 1-23, August.
    7. Raihan Tanvir & Md Tanvir Rouf Shawon & Md. Golam Rabiul Alam, 2023. "DSE Stock Price Prediction using Hidden Markov Model," Papers 2302.08911, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Herman O. Stekler, 2008. "Evaluating Consensus Forecasts," Working Papers 2008-007, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    2. Stefan Rayer, 2007. "Population forecast accuracy: does the choice of summary measure of error matter?," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 26(2), pages 163-184, April.
    3. Booth, Heather, 2006. "Demographic forecasting: 1980 to 2005 in review," International Journal of Forecasting, Elsevier, vol. 22(3), pages 547-581.
    4. Carter, Lawrence R., 1998. "Combining probabilistic and subjective assessments of error to provide realistic appraisals of demographic forecast uncertainty: Alho's approach," International Journal of Forecasting, Elsevier, vol. 14(4), pages 523-526, December.
    5. Richard E Klosterman, 2012. "Simple and Complex Models," Environment and Planning B, , vol. 39(1), pages 1-6, February.
    6. Wickstrom, Jannie & Serup-Hansen, Niels & Kristiansen, Ivar Sonbo, 2002. "Future health care costs--do health care costs during the last year of life matter?," Health Policy, Elsevier, vol. 62(2), pages 161-172, November.
    7. Jeff Tayman & Stanley Smith & Jeffrey Lin, 2007. "Precision, bias, and uncertainty for state population forecasts: an exploratory analysis of time series models," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 26(3), pages 347-369, June.
    8. Meng Xu & Helge Brunborg & Joel E. Cohen, 2017. "Evaluating multi-regional population projections with Taylor’s law of mean–variance scaling and its generalisation," Journal of Population Research, Springer, vol. 34(1), pages 79-99, March.
    9. Fullerton, Thomas Jr. & Laaksonen, Mika M. & West, Carol T., 2001. "Regional multi-family housing start forecast accuracy," International Journal of Forecasting, Elsevier, vol. 17(2), pages 171-180.
    10. Kim, Sungil & Kim, Heeyoung, 2016. "A new metric of absolute percentage error for intermittent demand forecasts," International Journal of Forecasting, Elsevier, vol. 32(3), pages 669-679.
    11. Stefan Rayer & Stanley Smith, 2014. "Population Projections by Age for Florida and its Counties: Assessing Accuracy and the Impact of Adjustments," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 33(5), pages 747-770, October.
    12. Park, Jangho & Bayraksan, Güzin, 2023. "A multistage distributionally robust optimization approach to water allocation under climate uncertainty," European Journal of Operational Research, Elsevier, vol. 306(2), pages 849-871.
    13. George Hough & David Swanson, 2006. "An evaluation of the American Community Survey: results from the Oregon test site," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 25(3), pages 257-273, June.
    14. Ji Wu & Xian Cheng & Stephen Shaoyi Liao, 2020. "Tourism forecast combination using the stochastic frontier analysis technique," Tourism Economics, , vol. 26(7), pages 1086-1107, November.
    15. Spiliotis, Evangelos & Nikolopoulos, Konstantinos & Assimakopoulos, Vassilios, 2019. "Tales from tails: On the empirical distributions of forecasting errors and their implication to risk," International Journal of Forecasting, Elsevier, vol. 35(2), pages 687-698.
    16. Jeff Tayman & Stanley Smith & Stefan Rayer, 2011. "Evaluating Population Forecast Accuracy: A Regression Approach Using County Data," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 30(2), pages 235-262, April.
    17. Smith, Stanley K., 1997. "Further thoughts on simplicity and complexity in population projection models," International Journal of Forecasting, Elsevier, vol. 13(4), pages 557-565, December.
    18. Edgar Morgenroth, 2002. "Evaluating Methods for Short to Medium Term County Population Forecasting," Papers WP143, Economic and Social Research Institute (ESRI).
    19. Mario Reinhold & Stephan Thomsen, 2015. "Subnational Population Projections by Age: An Evaluation of Combined Forecast Techniques," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 34(4), pages 593-613, August.
    20. David A. Swanson & Jeff Tayman & T.M. Bryan, 2018. "A Note on Rescaling the Arithmetic Mean for Right-skewed Positive Distributions," Review of Economics & Finance, Better Advances Press, Canada, vol. 14, pages 17-24, November.

    More about this item

    Keywords

    Forecasting; Errors; Summary measure reconciliation;
    All these keywords.

    JEL classification:

    • B4 - Schools of Economic Thought and Methodology - - Economic Methodology
    • C8 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs
    • Z1 - Other Special Topics - - Cultural Economics

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bap:journl:150301. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Carlson (email available below). General contact details of provider: http://www.bapress.ca .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.