IDEAS home Printed from https://ideas.repec.org/a/eee/soceps/v88y2023ics0038012123001702.html
   My bibliography  Save this article

Forecasting small area populations with long short-term memory networks

Author

Listed:
  • Grossman, Irina
  • Wilson, Tom
  • Temple, Jeromey

Abstract

Local and state governments depend on small area population forecasts to make important decisions concerning the development of local infrastructure and services. Despite their importance, current methods often produce highly inaccurate forecasts. Recent years have witnessed promising developments in time series forecasting using Machine Learning across a wide range of social and economic variables. However, limited work has been undertaken to investigate the potential application of Machine Learning methods in demography, particularly for small area population forecasting. In this paper we describe the development of two Long-Short Term Memory network architectures for small area populations. We employ the Keras Tuner to select layer unit numbers, vary the window width of input data, and apply a double training and validation regime which supports work with short time series and prioritises later sequence values for forecasts. These methods are transferable and can be applied to other data sets. Retrospective small area population forecasts for Australia were created for the periods 2006–16 and 2011–16. Model performance was evaluated against actual data and two benchmark methods (LIN/EXP and CSP-VSG). We also evaluated the impact of constraining small area population forecasts to an independent national forecast. Forecast accuracy was influenced by jump-off year, constraining, area size, and remoteness. The LIN/EXP model was the best performing method for the 2011-based forecasts whilst deep learning methods performed best for the 2006-based forecasts, including significant improvements in the accuracy of 10 year forecasts. However, benchmark methods were consistently more accurate for more remote areas and for those with populations <5000.

Suggested Citation

  • Grossman, Irina & Wilson, Tom & Temple, Jeromey, 2023. "Forecasting small area populations with long short-term memory networks," Socio-Economic Planning Sciences, Elsevier, vol. 88(C).
  • Handle: RePEc:eee:soceps:v:88:y:2023:i:c:s0038012123001702
    DOI: 10.1016/j.seps.2023.101658
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0038012123001702
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.seps.2023.101658?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Tom Wilson & Fiona Shalley, 2019. "Subnational population forecasts: Do users want to know about uncertainty?," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 41(13), pages 367-392.
    2. Mathew E. Hauer & Jason M. Evans & Deepak R. Mishra, 2016. "Millions projected to be at risk from sea-level rise in the continental United States," Nature Climate Change, Nature, vol. 6(7), pages 691-695, July.
    3. Sean J. Taylor & Benjamin Letham, 2018. "Forecasting at Scale," The American Statistician, Taylor & Francis Journals, vol. 72(1), pages 37-45, January.
    4. Heather Booth & Rob Hyndman & Leonie Tickle & Piet de Jong, 2006. "Lee-Carter mortality forecasting: a multi-country comparison of variants and extensions," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 15(9), pages 289-310.
    5. Wilson, Thomas & Grossman, Irina & Alexander, Monica & Rees, Philip & Temple, Jeromey, 2021. "Methods for small area population forecasts: state-of-the-art and research needs," SocArXiv sp6me, Center for Open Science.
    6. Tom Wilson & Huw Brokensha & Francisco Rowe & Ludi Simpson, 2018. "Insights from the Evaluation of Past Local Area Population Forecasts," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 37(1), pages 137-155, February.
    7. Spyros Makridakis & Evangelos Spiliotis & Vassilios Assimakopoulos, 2018. "Statistical and Machine Learning forecasting methods: Concerns and ways forward," PLOS ONE, Public Library of Science, vol. 13(3), pages 1-26, March.
    8. Peng, Lu & Wang, Lin & Xia, De & Gao, Qinglu, 2022. "Effective energy consumption forecasting using empirical wavelet transform and long short-term memory," Energy, Elsevier, vol. 238(PB).
    9. Andrea Nigri & Susanna Levantesi & Mario Marino, 2021. "Life expectancy and lifespan disparity forecasting: a long short-term memory approach," Scandinavian Actuarial Journal, Taylor & Francis Journals, vol. 2021(2), pages 110-133, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tom Wilson & Irina Grossman & Monica Alexander & Phil Rees & Jeromey Temple, 2022. "Methods for Small Area Population Forecasts: State-of-the-Art and Research Needs," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 41(3), pages 865-898, June.
    2. Wilson, Tom & Grossman, Irina & Temple, Jeromey, 2023. "Evaluation of the best M4 competition methods for small area population forecasting," International Journal of Forecasting, Elsevier, vol. 39(1), pages 110-122.
    3. Miroslav Navratil & Andrea Kolkova, 2019. "Decomposition and Forecasting Time Series in the Business Economy Using Prophet Forecasting Model," Central European Business Review, Prague University of Economics and Business, vol. 2019(4), pages 26-39.
    4. Junyi Lu & Sebastian Meyer, 2020. "Forecasting Flu Activity in the United States: Benchmarking an Endemic-Epidemic Beta Model," IJERPH, MDPI, vol. 17(4), pages 1-13, February.
    5. Wellens, Arnoud P. & Boute, Robert N. & Udenio, Maximiliano, 2024. "Simplifying tree-based methods for retail sales forecasting with explanatory variables," European Journal of Operational Research, Elsevier, vol. 314(2), pages 523-539.
    6. Tom Wilson, 2022. "Preparing local area population forecasts using a bi-regional cohort-component model without the need for local migration data," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 46(32), pages 919-956.
    7. Kristof Lommers & Ouns El Harzli & Jack Kim, 2021. "Confronting Machine Learning With Financial Research," Papers 2103.00366, arXiv.org, revised Mar 2021.
    8. Paweł Pełka, 2023. "Analysis and Forecasting of Monthly Electricity Demand Time Series Using Pattern-Based Statistical Methods," Energies, MDPI, vol. 16(2), pages 1-22, January.
    9. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    10. Philip Rees & Tom Wilson, 2023. "Accuracy of Local Authority Population Forecasts Produced by a New Minimal Data Model: A Case Study of England," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 42(6), pages 1-30, December.
    11. Quang Hoc Tran & Yao-Min Fang & Tien-Yin Chou & Thanh-Van Hoang & Chun-Tse Wang & Van Truong Vu & Thi Lan Huong Ho & Quang Le & Mei-Hsin Chen, 2022. "Short-Term Traffic Speed Forecasting Model for a Parallel Multi-Lane Arterial Road Using GPS-Monitored Data Based on Deep Learning Approach," Sustainability, MDPI, vol. 14(10), pages 1-17, May.
    12. Mustafa Ozguven & Chong Yan Gao & Mohamed Yacine Si Tayeb, 2021. "The Utilization of Autoregressive Forecasting Models in Strategic Management," International Journal of Science and Business, IJSAB International, vol. 5(7), pages 170-185.
    13. Rajapaksha, Dilini & Bergmeir, Christoph & Hyndman, Rob J., 2023. "LoMEF: A framework to produce local explanations for global model time series forecasts," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1424-1447.
    14. Abinash Bhattachan & Matthew D. Jurjonas & Priscilla R. Morris & Paul J. Taillie & Lindsey S. Smart & Ryan E. Emanuel & Erin L. Seekamp, 2019. "Linking residential saltwater intrusion risk perceptions to physical exposure of climate change impacts in rural coastal communities of North Carolina," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 97(3), pages 1277-1295, July.
    15. Spiliotis, Evangelos & Makridakis, Spyros & Kaltsounis, Anastasios & Assimakopoulos, Vassilios, 2021. "Product sales probabilistic forecasting: An empirical evaluation using the M5 competition data," International Journal of Production Economics, Elsevier, vol. 240(C).
    16. Zhou, Jianguo & Xu, Zhongtian, 2023. "Optimal sizing design and integrated cost-benefit assessment of stand-alone microgrid system with different energy storage employing chameleon swarm algorithm: A rural case in Northeast China," Renewable Energy, Elsevier, vol. 202(C), pages 1110-1137.
    17. Joel A. Martínez-Regalado & Cinthia Leonora Murillo-Avalos & Purificación Vicente-Galindo & Mónica Jiménez-Hernández & José Luis Vicente-Villardón, 2021. "Using HJ-Biplot and External Logistic Biplot as Machine Learning Methods for Corporate Social Responsibility Practices for Sustainable Development," Mathematics, MDPI, vol. 9(20), pages 1-16, October.
    18. Katja Hanewald & Thomas Post & Helmut Gründl, 2011. "Stochastic Mortality, Macroeconomic Risks and Life Insurer Solvency," The Geneva Papers on Risk and Insurance - Issues and Practice, Palgrave Macmillan;The Geneva Association, vol. 36(3), pages 458-475, July.
    19. Huber, Jakob & Stuckenschmidt, Heiner, 2020. "Daily retail demand forecasting using machine learning with emphasis on calendric special days," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1420-1438.
    20. Weronika Ormaniec & Marcin Pitera & Sajad Safarveisi & Thorsten Schmidt, 2022. "Estimating value at risk: LSTM vs. GARCH," Papers 2207.10539, arXiv.org.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:soceps:v:88:y:2023:i:c:s0038012123001702. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/seps .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.