IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v41y2025i1p191-207.html
   My bibliography  Save this article

Boosting domain-specific models with shrinkage: An application in mortality forecasting

Author

Listed:
  • Li, Li
  • Li, Han
  • Panagiotelis, Anastasios

Abstract

This paper extends the technique of gradient boosting with a focus on using domain-specific models instead of trees. The domain of mortality forecasting is considered as an application. The two novel contributions are to use well-known stochastic mortality models as weak learners in gradient boosting rather than trees, and to include a penalty that shrinks mortality forecasts in adjacent age groups and nearby geographical regions closer together. The proposed method demonstrates superior forecasting performance based on US male mortality data from 1969 to 2019. The proposed approach also enables us to interpret and visualize the results. The boosted model with age-based shrinkage yields the most accurate national-level mortality forecast. For state-level forecasts, spatial shrinkage provides further improvement in accuracy in addition to the benefits of age-based shrinkage. This improvement can be attributed to data sharing across states with large and small populations in adjacent regions and states with common risk factors.

Suggested Citation

  • Li, Li & Li, Han & Panagiotelis, Anastasios, 2025. "Boosting domain-specific models with shrinkage: An application in mortality forecasting," International Journal of Forecasting, Elsevier, vol. 41(1), pages 191-207.
    • Handle: RePEc:eee:intfor:v:41:y:2025:i:1:p:191-207
    DOI: 10.1016/j.ijforecast.2024.05.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207024000402
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ijforecast.2024.05.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Tzuling Lin & Cary Chi-Liang Tsai, 2022. "Hierarchical Bayesian modeling of multi-country mortality rates," Scandinavian Actuarial Journal, Taylor & Francis Journals, vol. 2022(5), pages 375-398, May.
    2. Susanna Levantesi & Virginia Pizzorusso, 2019. "Application of Machine Learning to Mortality Modeling and Forecasting," Risks, MDPI, vol. 7(1), pages 1-19, February.
    3. Montero-Manso, Pablo & Hyndman, Rob J., 2021. "Principles and algorithms for forecasting groups of time series: Locality and globality," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1632-1653.
    4. Andrew Cairns & David Blake & Kevin Dowd & Guy Coughlan & David Epstein & Alen Ong & Igor Balevich, 2009. "A Quantitative Comparison of Stochastic Mortality Models Using Data From England and Wales and the United States," North American Actuarial Journal, Taylor & Francis Journals, vol. 13(1), pages 1-35.
    5. Peter R. Hansen & Asger Lunde & James M. Nason, 2011. "The Model Confidence Set," Econometrica, Econometric Society, vol. 79(2), pages 453-497, March.
    6. Han Li & Colin O'hare & Farshid Vahid, 2017. "A Flexible Functional Form Approach To Mortality Modeling: Do We Need Additional Cohort Dummies?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 36(4), pages 357-367, July.
    7. Kuhn, Max, 2008. "Building Predictive Models in R Using the caret Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 28(i05).
    8. Plat, Richard, 2009. "On stochastic mortality modeling," Insurance: Mathematics and Economics, Elsevier, vol. 45(3), pages 393-404, December.
    9. Rob Hyndman & Heather Booth & Farah Yasmeen, 2013. "Coherent Mortality Forecasting: The Product-Ratio Method With Functional Time Series Models," Demography, Springer;Population Association of America (PAA), vol. 50(1), pages 261-283, February.
    10. Benjamin K. Couillard & Christopher L. Foote & Kavish Gandhi & Ellen Meara & Jonathan Skinner, 2021. "Rising Geographic Disparities in US Mortality," Journal of Economic Perspectives, American Economic Association, vol. 35(4), pages 123-146, Fall.
    11. Booth, H. & Tickle, L., 2008. "Mortality Modelling and Forecasting: a Review of Methods," Annals of Actuarial Science, Cambridge University Press, vol. 3(1-2), pages 3-43, September.
    12. Vasil Enchev & Torsten Kleinow & Andrew J. G. Cairns, 2017. "Multi-population mortality models: fitting, forecasting and comparisons," Scandinavian Actuarial Journal, Taylor & Francis Journals, vol. 2017(4), pages 319-342, April.
    13. Hainaut, Donatien, 2018. "A Neural-Network Analyzer for Mortality Forecast," LIDAM Reprints ISBA 2018027, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    14. Zhe Michelle Dong & Han Lin Shang & Aaron Bruhn, 2022. "Air Pollution and Mortality Impacts," Risks, MDPI, vol. 10(6), pages 1-21, June.
    15. Hyndman, Rob J. & Shahid Ullah, Md., 2007. "Robust forecasting of mortality and fertility rates: A functional data approach," Computational Statistics & Data Analysis, Elsevier, vol. 51(10), pages 4942-4956, June.
    16. Wen, Jie & Cairns, Andrew J.G. & Kleinow, Torsten, 2023. "Modelling socio-economic mortality at neighbourhood level," ASTIN Bulletin, Cambridge University Press, vol. 53(2), pages 285-310, May.
    17. Philippe Deprez & Pavel V. Shevchenko & Mario V. Wuthrich, 2017. "Machine Learning Techniques for Mortality Modeling," Papers 1705.03396, arXiv.org.
    18. Carter, Lawrence R. & Lee, Ronald D., 1992. "Modeling and forecasting US sex differentials in mortality," International Journal of Forecasting, Elsevier, vol. 8(3), pages 393-411, November.
    19. Brouhns, Natacha & Denuit, Michel & Vermunt, Jeroen K., 2002. "A Poisson log-bilinear regression approach to the construction of projected lifetables," Insurance: Mathematics and Economics, Elsevier, vol. 31(3), pages 373-393, December.
    20. Huynh, Nhan & Ludkovski, Mike, 2021. "Multi-output Gaussian processes for multi-population longevity modelling," Annals of Actuarial Science, Cambridge University Press, vol. 15(2), pages 318-345, July.
    21. Ahmedin Jemal & Elizabeth Ward & Robert N Anderson & Taylor Murray & Michael J Thun, 2008. "Widening of Socioeconomic Inequalities in U.S. Death Rates, 1993–2001," PLOS ONE, Public Library of Science, vol. 3(5), pages 1-8, May.
    22. Schnürch, Simon & Korn, Ralf, 2022. "Point And Interval Forecasts Of Death Rates Using Neural Networks," ASTIN Bulletin, Cambridge University Press, vol. 52(1), pages 333-360, January.
    23. Richman, Ronald, 2021. "AI in actuarial science – a review of recent advances – part 2," Annals of Actuarial Science, Cambridge University Press, vol. 15(2), pages 230-258, July.
    24. Cupido, Kyran & Jevtić, Petar & Paez, Antonio, 2020. "Spatial patterns of mortality in the United States: A spatial filtering approach," Insurance: Mathematics and Economics, Elsevier, vol. 95(C), pages 28-38.
    25. Januschowski, Tim & Wang, Yuyang & Torkkola, Kari & Erkkilä, Timo & Hasson, Hilaf & Gasthaus, Jan, 2022. "Forecasting with trees," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1473-1481.
    26. Miklos Arato, N. & Dryden, Ian L. & Taylor, Charles C., 2006. "Hierarchical Bayesian modelling of spatial age-dependent mortality," Computational Statistics & Data Analysis, Elsevier, vol. 51(2), pages 1347-1363, November.
    27. Andrew J. G. Cairns & David Blake & Kevin Dowd, 2006. "A Two‐Factor Model for Stochastic Mortality with Parameter Uncertainty: Theory and Calibration," Journal of Risk & Insurance, The American Risk and Insurance Association, vol. 73(4), pages 687-718, December.
    28. Nan Li & Ronald Lee, 2005. "Coherent mortality forecasts for a group of populations: An extension of the lee-carter method," Demography, Springer;Population Association of America (PAA), vol. 42(3), pages 575-594, August.
    29. Bjerre, Dorethe Skovgaard, 2022. "Tree-Based Machine Learning Methods For Modeling And Forecasting Mortality," ASTIN Bulletin, Cambridge University Press, vol. 52(3), pages 765-787, September.
    30. Hainaut, Donatien, 2018. "A Neural-Network Analyzer For Mortality Forecast," ASTIN Bulletin, Cambridge University Press, vol. 48(2), pages 481-508, May.
    31. Gerhard Tutz & Harald Binder, 2006. "Generalized Additive Modeling with Implicit Variable Selection by Likelihood-Based Boosting," Biometrics, The International Biometric Society, vol. 62(4), pages 961-971, December.
    32. Richman, Ronald, 2021. "AI in actuarial science – a review of recent advances – part 1," Annals of Actuarial Science, Cambridge University Press, vol. 15(2), pages 207-229, July.
    33. Anne Case & Angua Deaton, 2015. "Rising morbidity and mortality in midlife among white non-Hispanic Americans in the 21st century," Working Papers 15078.full.pdf, Princeton University, Woodrow Wilson School of Public and International Affairs, Research Program in Development Studies..
    34. SriDaran, Dilan & Sherris, Michael & Villegas, Andrés M. & Ziveyi, Jonathan, 2022. "A Group Regularisation Approach For Constructing Generalised Age-Period-Cohort Mortality Projection Models," ASTIN Bulletin, Cambridge University Press, vol. 52(1), pages 247-289, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Blake, David & Cairns, Andrew J.G., 2021. "Longevity risk and capital markets: The 2019-20 update," Insurance: Mathematics and Economics, Elsevier, vol. 99(C), pages 395-439.
    2. Basellini, Ugofilippo & Camarda, Carlo Giovanni & Booth, Heather, 2023. "Thirty years on: A review of the Lee–Carter method for forecasting mortality," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1033-1049.
    3. Hung-Tsung Hsiao & Chou-Wen Wang & I.-Chien Liu & Ko-Lun Kung, 2024. "Mortality improvement neural-network models with autoregressive effects," The Geneva Papers on Risk and Insurance - Issues and Practice, Palgrave Macmillan;The Geneva Association, vol. 49(2), pages 363-383, April.
    4. Basellini, Ugofilippo & Camarda, Carlo Giovanni & Booth, Heather, 2022. "Thirty years on: A review of the Lee-Carter method for forecasting mortality," SocArXiv 8u34d, Center for Open Science.
    5. repec:osf:socarx:8u34d_v1 is not listed on IDEAS
    6. Francesca Perla & Salvatore Scognamiglio, 2023. "Locally-coherent multi-population mortality modelling via neural networks," Decisions in Economics and Finance, Springer;Associazione per la Matematica, vol. 46(1), pages 157-176, June.
    7. Corsaro, Stefania & Marino, Zelda & Scognamiglio, Salvatore, 2024. "Quantile mortality modelling of multiple populations via neural networks," Insurance: Mathematics and Economics, Elsevier, vol. 116(C), pages 114-133.
    8. Yang Qiao & Chou-Wen Wang & Wenjun Zhu, 2024. "Machine learning in long-term mortality forecasting," The Geneva Papers on Risk and Insurance - Issues and Practice, Palgrave Macmillan;The Geneva Association, vol. 49(2), pages 340-362, April.
    9. Bravo, Jorge M. & Ayuso, Mercedes & Holzmann, Robert & Palmer, Edward, 2021. "Addressing the life expectancy gap in pension policy," Insurance: Mathematics and Economics, Elsevier, vol. 99(C), pages 200-221.
    10. Norkhairunnisa Redzwan & Rozita Ramli, 2022. "A Bibliometric Analysis of Research on Stochastic Mortality Modelling and Forecasting," Risks, MDPI, vol. 10(10), pages 1-17, October.
    11. Boumezoued, Alexandre & Elfassihi, Amal, 2021. "Mortality data correction in the absence of monthly fertility records," Insurance: Mathematics and Economics, Elsevier, vol. 99(C), pages 486-508.
    12. Alexandre Boumezoued & Amal Elfassihi, 2020. "Mortality data correction in the absence of monthly fertility records," Working Papers hal-02634631, HAL.
    13. Jaap Spreeuw & Iqbal Owadally & Muhammad Kashif, 2022. "Projecting Mortality Rates Using a Markov Chain," Mathematics, MDPI, vol. 10(7), pages 1-18, April.
    14. Marie-Pier Bergeron-Boucher & James E. Oeppen & James W. Vaupel & Søren Kjærgaard, 2019. "The impact of the choice of life table statistics when forecasting mortality," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 41(43), pages 1235-1268.
    15. Guibert, Quentin & Lopez, Olivier & Piette, Pierrick, 2019. "Forecasting mortality rate improvements with a high-dimensional VAR," Insurance: Mathematics and Economics, Elsevier, vol. 88(C), pages 255-272.
    16. David Atance & Ana Debón & Eliseo Navarro, 2020. "A Comparison of Forecasting Mortality Models Using Resampling Methods," Mathematics, MDPI, vol. 8(9), pages 1-21, September.
    17. Li, Han & O’Hare, Colin, 2017. "Semi-parametric extensions of the Cairns–Blake–Dowd model: A one-dimensional kernel smoothing approach," Insurance: Mathematics and Economics, Elsevier, vol. 77(C), pages 166-176.
    18. Katrien Antonio & Anastasios Bardoutsos & Wilbert Ouburg, 2015. "Bayesian Poisson log-bilinear models for mortality projections with multiple populations," BAFFI CAREFIN Working Papers 1505, BAFFI CAREFIN, Centre for Applied Research on International Markets Banking Finance and Regulation, Universita' Bocconi, Milano, Italy.
    19. Susanna Levantesi & Matteo Lizzi & Andrea Nigri, 2024. "Enhancing diagnostic of stochastic mortality models leveraging contrast trees: an application on Italian data," Quality & Quantity: International Journal of Methodology, Springer, vol. 58(2), pages 1565-1581, April.
    20. Ayuso, Mercedes & Bravo, Jorge M. & Holzmann, Robert, 2021. "Getting life expectancy estimates right for pension policy: period versus cohort approach," Journal of Pension Economics and Finance, Cambridge University Press, vol. 20(2), pages 212-231, April.
    21. Kenneth Wong & Jackie Li & Sixian Tang, 2020. "A modified common factor model for modelling mortality jointly for both sexes," Journal of Population Research, Springer, vol. 37(2), pages 181-212, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:41:y:2025:i:1:p:191-207. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.