IDEAS home Printed from https://ideas.repec.org/p/saq/wpaper/14-20.html
   My bibliography  Save this paper

Local mortality estimates during the COVID-19 pandemic in Italy

Author

Listed:
  • Augusto Cerqua

    (Department of Social Sciences and Economics, Sapienza University of Rome)

  • Roberta Di Stefano

    (Department of Methods and Models for Economics, Territory and Finance, Sapienza University of Rome)

  • Marco Letta

    (Department of Social Sciences and Economics, Sapienza University of Rome)

  • Sara Miccoli

    (Department of Methods and Models for Economics, Territory and Finance, Sapienza University of Rome)

Abstract

Estimates of the real death toll of the COVID-19 pandemic have proven to be problematic in many countries, and Italy is no exception. Mortality estimates at the local level are even more uncertain as they require strict conditions, such as granularity and accuracy of the data at hand, which are rarely met. The ‘official’ approach adopted by public institutions to estimate the ‘excess of mortality’ during the pandemic is based on a comparison between observed all-cause mortality data for 2020 with an average of mortality figures in the past years for the same period. In this paper, we show that more sophisticated approaches such as counterfactual and machine learning techniques outperform the official method by improving prediction accuracy by up to 18%, thus providing a more realistic picture of local excess mortality. The predictive gain is particularly sizable for small- and medium-sized municipalities. After showing the superiority of data-driven statistical methods, we apply the best-performing algorithms to generate a municipality-level dataset of local excess mortality estimates during the COVID-19 pandemic. This dataset is publicly shared and will be periodically updated as new data become available.

Suggested Citation

  • Augusto Cerqua & Roberta Di Stefano & Marco Letta & Sara Miccoli, 2020. "Local mortality estimates during the COVID-19 pandemic in Italy," Working Papers 14/20, Sapienza University of Rome, DISS.
  • Handle: RePEc:saq:wpaper:14/20
    as

    Download full text from publisher

    File URL: http://www.diss.uniroma1.it/sites/default/files/allegati/DiSSE_Cerquaetal_wp14_2020.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Luca Bonacini & Giovanni Gallo & Fabrizio Patriarca, 2021. "Identifying policy challenges of COVID-19 in hardly reliable data and judging the success of lockdown measures," Journal of Population Economics, Springer;European Society for Population Economics, vol. 34(1), pages 275-301, January.
    2. Jon Kleinberg & Jens Ludwig & Sendhil Mullainathan & Ziad Obermeyer, 2015. "Prediction Policy Problems," American Economic Review, American Economic Association, vol. 105(5), pages 491-495, May.
    3. Antonella Pinnelli & Paola Mancini, 1998. "Mortality Peaks in Italy in the Late 19th and Early 20th Centuries: Trends by Age and Sex," European Journal of Population, Springer;European Association for Population Studies, vol. 14(4), pages 333-365, December.
    4. Jennifer Beam Dowd & Liliana Andriano & David M. Brazel & Valentina Rotondi & Per Block & Xuejie Ding & Yan Liu & Melinda C. Mills, 2020. "Demographic science aids in understanding the spread and fatality rates of COVID-19," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 117(18), pages 9696-9698, May.
    5. Susanna Levantesi & Virginia Pizzorusso, 2019. "Application of Machine Learning to Mortality Modeling and Forecasting," Risks, MDPI, vol. 7(1), pages 1-19, February.
    6. David BENATIA, 2020. "Reaching New Lows? The Pandemic's Consequences for Electricity Markets," Working Papers 2020-12, Center for Research in Economics and Statistics.
    7. Ceriani, Lidia & Verme, Paolo, 2020. "Excess Mortality as a Predictor of Mortality Crises: The Case of COVID-19 in Italy," GLO Discussion Paper Series 618, Global Labor Organization (GLO).
    8. Feiyu Jiang & Zifeng Zhao & Xiaofeng Shao, 2020. "Time Series Analysis of COVID-19 Infection Curve: A Change-Point Perspective," Papers 2007.04553, arXiv.org.
    9. Alberto Abadie & Alexis Diamond & Jens Hainmueller, 2015. "Comparative Politics and the Synthetic Control Method," American Journal of Political Science, John Wiley & Sons, vol. 59(2), pages 495-510, February.
    10. Benatia, David & Billette de Villemeur, Etienne, 2019. "Strategic Reneging in Sequential Imperfect Markets," MPRA Paper 105280, University Library of Munich, Germany, revised Jan 2020.
    11. Steve Cicala, 2017. "Imperfect Markets versus Imperfect Regulation in U.S. Electricity Generation," NBER Working Papers 23053, National Bureau of Economic Research, Inc.
    12. Augusto Cerqua & Roberta Di Stefano, 2022. "When did coronavirus arrive in Europe?," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 31(1), pages 181-195, March.
    13. Jan Abrell & Mirjam Kosch & Sebastian Rausch, 2019. "How Effective Was the UK Carbon Tax? — A Machine Learning Approach to Policy Evaluation," CER-ETH Economics working paper series 19/317, CER-ETH - Center of Economic Research (CER-ETH) at ETH Zurich.
    14. Andrea Ascani & Alessandra Faggian & Sandro Montresor, 2021. "The geography of COVID‐19 and the structure of local economies: The case of Italy," Journal of Regional Science, Wiley Blackwell, vol. 61(2), pages 407-441, March.
    15. Fiona Burlig & Christopher Knittel & David Rapson & Mar Reguant & Catherine Wolfram, 2020. "Machine Learning from Schools about Energy Efficiency," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 7(6), pages 1181-1217.
    16. Christian Dudel & Timothy Riffe & Enrique Acosta & Alyson A. van Raalte & Cosmo Strozza & Mikko Myrskylä, 2020. "Monitoring trends and differences in COVID-19 case-fatality rates using decomposition methods: contributions of age structure and age-specific fatality," MPIDR Working Papers WP-2020-020, Max Planck Institute for Demographic Research, Rostock, Germany.
    17. Domenico Depalo, 2021. "True COVID-19 mortality rates from administrative data," Journal of Population Economics, Springer;European Society for Population Economics, vol. 34(1), pages 253-274, January.
    18. Andini, Monica & Ciani, Emanuele & de Blasio, Guido & D'Ignazio, Alessio & Salvestrini, Viola, 2018. "Targeting with machine learning: An application to a tax rebate program in Italy," Journal of Economic Behavior & Organization, Elsevier, vol. 156(C), pages 86-102.
    19. repec:aei:rpaper:1008560098 is not listed on IDEAS
    20. Lembke B., 1918. "√ a. p," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 111(1), pages 709-712, February.
    21. Li, Shaoran & Linton, Oliver, 2021. "When will the Covid-19 pandemic peak?," Journal of Econometrics, Elsevier, vol. 220(1), pages 130-157.
    22. Hal R. Varian, 2014. "Big Data: New Tricks for Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 28(2), pages 3-28, Spring.
    23. Vandoros, Sotiris, 2020. "Excess mortality during the Covid-19 pandemic: Early evidence from England and Wales," Social Science & Medicine, Elsevier, vol. 258(C).
    24. Abadie, Alberto & Diamond, Alexis & Hainmueller, Jens, 2010. "Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California’s Tobacco Control Program," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 493-505.
    25. Philippe Deprez & Pavel V. Shevchenko & Mario V. Wuthrich, 2017. "Machine Learning Techniques for Mortality Modeling," Papers 1705.03396, arXiv.org.
    26. Paolo Buonanno & Sergio Galletta & Marcello Puca, 2020. "Estimating the severity of COVID-19: Evidence from the Italian epicenter," PLOS ONE, Public Library of Science, vol. 15(10), pages 1-13, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    RePEc Biblio mentions

    As found on the RePEc Biblio, the curated bibliography for Economics:
    1. > Economics of Welfare > Health Economics > Economics of Pandemics > Specific pandemics > Covid-19 > Health > Measurement

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Federico Crudu & Roberta Di Stefano & Giovanni Mellace & Silvia Tiezzi, 2022. "The Gray Zone," Department of Economics University of Siena 874, Department of Economics, University of Siena.
    2. Pietro Perotti & Paola Bertuccio & Stefano Cacitti & Silvia Deandrea & Lorenza Boschetti & Simona Dalle Carbonare & Stefano Marguati & Simona Migliazza & Eleonora Porzio & Simona Riboli & Ennio Cadum , 2022. "Impact of the COVID-19 Pandemic on Total and Cause-Specific Mortality in Pavia, Northern Italy," IJERPH, MDPI, vol. 19(11), pages 1-10, May.
    3. Roy Cerqueti & Raffaella Coppier & Alessandro Girardi & Marco Ventura, 2022. "The sooner the better: lives saved by the lockdown during the COVID-19 outbreak. The case of Italy [Using synthetic controls: Feasibility, data requirements, and methodological aspects]," The Econometrics Journal, Royal Economic Society, vol. 25(1), pages 46-70.
    4. Resce, Giuliano & Vaquero-Piñeiro, Cristina, 2022. "Predicting agri-food quality across space: A Machine Learning model for the acknowledgment of Geographical Indications," Food Policy, Elsevier, vol. 112(C).
    5. Cerqua, Augusto & Letta, Marco, 2022. "Local inequalities of the COVID-19 crisis," Regional Science and Urban Economics, Elsevier, vol. 92(C).
    6. Delogu, Marco & Lagravinese, Raffaele & Paolini, Dimitri & Resce, Giuliano, 2024. "Predicting dropout from higher education: Evidence from Italy," Economic Modelling, Elsevier, vol. 130(C).
    7. Di Stefano, Roberta & Resce, Giuliano, "undated". "The Determinants of Missed Funding: Predicting the Paradox of Increased Need and Reduced Allocation," Economics & Statistics Discussion Papers esdp23092, University of Molise, Department of Economics.
    8. Gert Bijnens & Shyngys Karimov & Jozef Konings, 2023. "Does Automatic Wage Indexation Destroy Jobs? A Machine Learning Approach," De Economist, Springer, vol. 171(1), pages 85-117, March.
    9. Resce, Giuliano & Vaquero-Piñeiro, Cristina, 2023. "Taste of home: Birth town bias in Geographical Indications," Economics & Statistics Discussion Papers esdp23089, University of Molise, Department of Economics.
    10. Resce, Giuliano, 2022. "The impact of political and non-political officials on the financial management of local governments," Journal of Policy Modeling, Elsevier, vol. 44(5), pages 943-962.
    11. Daniel L. Millimet & Christopher F. Parmeter, 2022. "COVID‐19 severity: A new approach to quantifying global cases and deaths," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(3), pages 1178-1215, July.
    12. Andrea Ascani & Alessandra Faggian & Sandro Montresor & Alessandro Palma, 2021. "Moving (within and across) spatial labour markets in times of COVID-19: evidence from Facebook mobility data on Italian labour market areas," Discussion Paper series in Regional Science & Economic Geography 2021-01, Gran Sasso Science Institute, Social Sciences, revised Jan 2021.
    13. Caravaggio, Nicola & Resce, Giuliano, 2023. "Enhancing Healthcare Cost Forecasting: A Machine Learning Model for Resource Allocation in Heterogeneous Regions," Economics & Statistics Discussion Papers esdp23090, University of Molise, Department of Economics.
    14. Augusto Cerqua & Roberta Di Stefano & Marco Letta & Sara Miccoli, 2021. "Was there a COVID-19 harvesting effect in Northern Italy?," Papers 2103.01812, arXiv.org, revised Mar 2021.
    15. Resce, Giuliano, 2022. "Political and Non-Political Officials in Local Government," Economics & Statistics Discussion Papers esdp22079, University of Molise, Department of Economics.
    16. Ascani, Andrea & Faggian, Alessandra & Montresor, Sandro & Palma, Alessandro, 2021. "Mobility in times of pandemics: Evidence on the spread of COVID19 in Italy's labour market areas," Structural Change and Economic Dynamics, Elsevier, vol. 58(C), pages 444-454.
    17. Mauro Caselli & Andrea Fracasso & Sergio Scicchitano, 2022. "From the lockdown to the new normal: individual mobility and local labor market characteristics following the COVID-19 pandemic in Italy," Journal of Population Economics, Springer;European Society for Population Economics, vol. 35(4), pages 1517-1550, October.
    18. Cerqua, Augusto & Letta, Marco, 2020. "Local economies amidst the COVID-19 crisis in Italy: a tale of diverging trajectories," MPRA Paper 104404, University Library of Munich, Germany.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cerqua, Augusto & Letta, Marco, 2022. "Local inequalities of the COVID-19 crisis," Regional Science and Urban Economics, Elsevier, vol. 92(C).
    2. Cerqua, Augusto & Letta, Marco, 2020. "Local economies amidst the COVID-19 crisis in Italy: a tale of diverging trajectories," MPRA Paper 104404, University Library of Munich, Germany.
    3. Nicolaj N. Mühlbach, 2020. "Tree-based Synthetic Control Methods: Consequences of moving the US Embassy," CREATES Research Papers 2020-04, Department of Economics and Business Economics, Aarhus University.
    4. Augusto Cerqua & Roberta Di Stefano, 2022. "When did coronavirus arrive in Europe?," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 31(1), pages 181-195, March.
    5. Fossati, Sebastian & Marchand, Joseph, 2020. "First to $15: Alberta's Minimum Wage Policy on Employment by Wages, Ages, and Places," Working Papers 2020-15, University of Alberta, Department of Economics, revised 27 Jul 2023.
    6. Roy Cerqueti & Raffaella Coppier & Alessandro Girardi & Marco Ventura, 2022. "The sooner the better: lives saved by the lockdown during the COVID-19 outbreak. The case of Italy [Using synthetic controls: Feasibility, data requirements, and methodological aspects]," The Econometrics Journal, Royal Economic Society, vol. 25(1), pages 46-70.
    7. Ainaa, Carmen & Brunetti, Irene & Mussida, Chiara & Scicchitano, Sergio, 2021. "Who lost the most? Distributive effects of COVID-19 pandemic," GLO Discussion Paper Series 829, Global Labor Organization (GLO).
    8. Leroutier, Marion, 2022. "Carbon pricing and power sector decarbonization: Evidence from the UK," Journal of Environmental Economics and Management, Elsevier, vol. 111(C).
    9. Steinkraus, Arne, 2018. "Rethinking Policy Evaluation – Do Simple Neural Nets Bear Comparison with Synthetic Control Method?," EconStor Preprints 177390, ZBW - Leibniz Information Centre for Economics.
    10. Marion Leroutier, 2021. "Carbon Pricing and Power Sector Decarbonisation: Evidence from the UK," Working Papers halshs-03265636, HAL.
    11. Andini, Monica & Boldrini, Michela & Ciani, Emanuele & de Blasio, Guido & D'Ignazio, Alessio & Paladini, Andrea, 2022. "Machine learning in the service of policy targeting: The case of public credit guarantees," Journal of Economic Behavior & Organization, Elsevier, vol. 198(C), pages 434-475.
    12. Jing Liang & Yueming Qiu & Bo Xing, 2021. "Social Versus Private Benefits of Energy Efficiency Under Time-of-Use and Increasing Block Pricing," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 78(1), pages 43-75, January.
    13. Sebastian Fossati & Joseph Marchand, 2024. "First to $15: Alberta’s Minimum Wage Policy on Employment by Wages, Ages, and Places," ILR Review, Cornell University, ILR School, vol. 77(1), pages 119-142, January.
    14. de Blasio, Guido & D'Ignazio, Alessio & Letta, Marco, 2022. "Gotham city. Predicting ‘corrupted’ municipalities with machine learning," Technological Forecasting and Social Change, Elsevier, vol. 184(C).
    15. Andrew Harvey & Stephen Thiele, 2021. "Cointegration and control: Assessing the impact of events using time series data," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(1), pages 71-85, January.
    16. Gert Bijnens & Shyngys Karimov & Jozef Konings, 2023. "Does Automatic Wage Indexation Destroy Jobs? A Machine Learning Approach," De Economist, Springer, vol. 171(1), pages 85-117, March.
    17. Guido de Blasio & Alessio D'Ignazio & Marco Letta, 2020. "Predicting Corruption Crimes with Machine Learning. A Study for the Italian Municipalities," Working Papers 16/20, Sapienza University of Rome, DISS.
    18. Marion Leroutier, 2021. "Carbon Pricing and Power Sector Decarbonisation: Evidence from the UK," CIRED Working Papers halshs-03265636, HAL.
    19. Sophie-Charlotte Klose & Johannes Lederer, 2020. "A Pipeline for Variable Selection and False Discovery Rate Control With an Application in Labor Economics," Papers 2006.12296, arXiv.org, revised Jun 2020.
    20. Echevarría, Cruz A. & Hasancebi, Serhat & García-Enríquez, Javier, 2022. "Economic Effects of Macao’s Integration with Mainland China: A Causal Inference Study," Journal of Economic Integration, Center for Economic Integration, Sejong University, vol. 37(2), pages 179-215.

    More about this item

    Keywords

    COVID-19; coronavirus; mortality estimates; Italy; municipalities;
    All these keywords.

    JEL classification:

    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • I10 - Health, Education, and Welfare - - Health - - - General
    • J11 - Labor and Demographic Economics - - Demographic Economics - - - Demographic Trends, Macroeconomic Effects, and Forecasts

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:saq:wpaper:14/20. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Pierluigi Montalbano (email available below). General contact details of provider: https://edirc.repec.org/data/dtrosit.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.