IDEAS home Printed from https://ideas.repec.org/p/zbw/i4rdps/11.html
   My bibliography  Save this paper

Why Some Acute Health Effects of Air Pollution Could Be Inflated

Author

Listed:
  • Bagilet, Vincent
  • Zabrocki-Hallak, Léo

Abstract

Hundreds of studies have shown that air pollution affects health in the very short-run. This played a key role in setting air quality standards. Yet, estimated effect sizes can vary widely across studies. Analyzing the results published in epidemiology and economics, we find that publication bias and a lack of statistical power could lead some estimates to be inflated. We then run real data simulations to identify the design parameters causing these issues. We show that this exaggeration may be driven by a small numbers of exogenous shocks, instruments with limited strength or sparse outcomes. Other literatures relying on comparable research design could also be affected by these issues. Our paper provides a principled workflow to evaluate and avoid the risk of exaggeration when conducting an observational study.

Suggested Citation

  • Bagilet, Vincent & Zabrocki-Hallak, Léo, 2022. "Why Some Acute Health Effects of Air Pollution Could Be Inflated," I4R Discussion Paper Series 11, The Institute for Replication (I4R).
    • Handle: RePEc:zbw:i4rdps:11
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/266386/1/I4R-DP011.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Tatyana Deryugina & Garth Heutel & Nolan H. Miller & David Molitor & Julian Reif, 2019. "The Mortality and Medical Costs of Air Pollution: Evidence from Changes in Wind Direction," American Economic Review, American Economic Association, vol. 109(12), pages 4178-4219, December.
    2. Jamie Mullins & Prashant Bharadwaj, 2015. "Effects of Short-Term Measures to Curb Air Pollution: Evidence from Santiago, Chile," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 97(4), pages 1107-1134.
    3. Eva Arceo & Rema Hanna & Paulina Oliva, 2016. "Does the Effect of Pollution on Infant Mortality Differ Between Developing and Developed Countries? Evidence from Mexico City," Economic Journal, Royal Economic Society, vol. 126(591), pages 257-280, March.
    4. Ruixue Jia & Hyejin Ku, 2019. "Is China's Pollution the Culprit for the Choking of South Korea? Evidence from the Asian Dust," The Economic Journal, Royal Economic Society, vol. 129(624), pages 3154-3188.
    5. Timothy J Halliday & John Lynham & Áureo de Paula, 2019. "Vog: Using Volcanic Eruptions to Estimate the Health Costs of Particulates," The Economic Journal, Royal Economic Society, vol. 129(620), pages 1782-1816.
    6. Tamara L. Sheldon & Chandini Sankaran, 2017. "The Impact of Indonesian Forest Fires on Singaporean Pollution and Health," American Economic Review, American Economic Association, vol. 107(5), pages 526-529, May.
    7. Giaccherini, Matilde & Kopinska, Joanna & Palma, Alessandro, 2021. "When particulate matter strikes cities: Social disparities and health costs of air pollution," Journal of Health Economics, Elsevier, vol. 78(C).
    8. Avraham Ebenstein & Victor Lavy & Sefi Roth, 2016. "The Long-Run Economic Consequences of High-Stakes Examinations: Evidence from Transitory Variation in Pollution," American Economic Journal: Applied Economics, American Economic Association, vol. 8(4), pages 36-65, October.
    9. Bruna Guidetti & Paula Pereda & Edson Severnini, 2021. ""Placebo Tests" for the Impacts of Air Pollution on Health: The Challenge of Limited Health Care Infrastructure," AEA Papers and Proceedings, American Economic Association, vol. 111, pages 371-375, May.
    10. Emily Oster, 2019. "Unobservable Selection and Coefficient Stability: Theory and Evidence," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(2), pages 187-204, April.
    11. Abel Brodeur & Nikolai Cook & Anthony Heyes, 2020. "Methods Matter: p-Hacking and Publication Bias in Causal Analysis in Economics," American Economic Review, American Economic Association, vol. 110(11), pages 3634-3660, November.
    12. Valentin Amrhein & David Trafimow & Sander Greenland, 2019. "Inferential Statistics as Descriptive Statistics: There Is No Replication Crisis if We Don’t Expect Replication," The American Statistician, Taylor & Francis Journals, vol. 73(S1), pages 262-270, March.
    13. David Romer, 2020. "In Praise of Confidence Intervals," AEA Papers and Proceedings, American Economic Association, vol. 110, pages 55-60, May.
    14. Stefan Bauernschuster & Timo Hener & Helmut Rainer, 2017. "When Labor Disputes Bring Cities to a Standstill: The Impact of Public Transit Strikes on Traffic, Accidents, Air Pollution, and Health," American Economic Journal: Economic Policy, American Economic Association, vol. 9(1), pages 1-37, February.
    15. He, Guojun & Fan, Maoyong & Zhou, Maigeng, 2016. "The effect of air pollution on mortality in China: Evidence from the 2008 Beijing Olympic Games," Journal of Environmental Economics and Management, Elsevier, vol. 79(C), pages 18-39.
    16. Carlos Cinelli & Chad Hazlett, 2020. "Making sense of sensitivity: extending omitted variable bias," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 82(1), pages 39-67, February.
    17. Enrico Moretti & Matthew Neidell, 2011. "Pollution, Health, and Avoidance Behavior: Evidence from the Ports of Los Angeles," Journal of Human Resources, University of Wisconsin Press, vol. 46(1), pages 154-175.
    18. Jans, Jenny & Johansson, Per & Nilsson, J. Peter, 2018. "Economic status, air quality, and child health: Evidence from inversion episodes," Journal of Health Economics, Elsevier, vol. 61(C), pages 220-232.
    19. Fan, Maoyong & He, Guojun & Zhou, Maigeng, 2020. "The winter choke: Coal-Fired heating, air pollution, and mortality in China," Journal of Health Economics, Elsevier, vol. 71(C).
    20. Chen, Siyu & Guo, Chongshan & Huang, Xinfei, 2018. "Air Pollution, Student Health, and School Absences: Evidence from China," Journal of Environmental Economics and Management, Elsevier, vol. 92(C), pages 465-497.
    21. Panle Jia Barwick & Shanjun Li & Deyu Rao & Nahim Bin Zahur, 2018. "The Morbidity Cost of Air Pollution: Evidence from Consumer Spending in China," Working Papers id:12825, eSocialSciences.
    22. Moon Joon Kim, 2021. "Air Pollution, Health, and Avoidance Behavior: Evidence from South Korea," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 79(1), pages 63-91, May.
    23. Nan Zhong & Jing Cao & Yuzhu Wang, 2017. "Traffic Congestion, Ambient Air Pollution, and Health: Evidence from Driving Restrictions in Beijing," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(3), pages 821-856.
    24. Roger D. Peng & Francesca Dominici & Thomas A. Louis, 2006. "Model choice in time series studies of air pollution and mortality," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 169(2), pages 179-203, March.
    25. Cheung, Chun Wai & He, Guojun & Pan, Yuhang, 2020. "Mitigating the air pollution effect? The remarkable decline in the pollution-mortality relationship in Hong Kong," Journal of Environmental Economics and Management, Elsevier, vol. 101(C).
    26. Stefan Bauernschuster & Timo Hener & Helmut Rainer, 2017. "When Labor Disputes Bring Cities to a Standstill: The Impact of Public Transit Strikes on Traffic, Accidents, Air Pollution, and Health," American Economic Journal: Economic Policy, American Economic Association, vol. 9(1), pages 1-37, February.
    27. Wolfram Schlenker & W. Reed Walker, 2016. "Airports, Air Pollution, and Contemporaneous Health," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 83(2), pages 768-809.
    28. Godzinski, Alexandre & Suarez Castillo, Milena, 2021. "Disentangling the effects of air pollutants with many instruments," Journal of Environmental Economics and Management, Elsevier, vol. 109(C).
    29. Xia, Fan & Xing, Jianwei & Xu, Jintao & Pan, Xiaochuan, 2022. "The short-term impact of air pollution on medical expenditures: Evidence from Beijing," Journal of Environmental Economics and Management, Elsevier, vol. 114(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Troccoli, Claudia, 2023. "Does Paid Parental Leave Affect Children's Schooling Outcomes? Replicating Danzer and Lavy (2018)," I4R Discussion Paper Series 21, The Institute for Replication (I4R).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Colmer, Jonathan & Lin, Dajun & Liu, Siying & Shimshack, Jay, 2021. "Why are pollution damages lower in developed countries? Insights from high-Income, high-particulate matter Hong Kong," Journal of Health Economics, Elsevier, vol. 79(C).
    2. He, Guojun & Liu, Tong & Zhou, Maigeng, 2020. "Straw burning, PM2.5, and death: Evidence from China," Journal of Development Economics, Elsevier, vol. 145(C).
    3. Mengna Luan & Zhigang Tao & Hongjie Yuan, 2023. "Alive but not well: The neglected cost of air pollution," Health Economics, John Wiley & Sons, Ltd., vol. 32(11), pages 2535-2567, November.
    4. Xin Zhang & Xun Zhang & Yuehua Liu & Xintong Zhao & Xi Chen, 2023. "The morbidity costs of air pollution through the Lens of Health Spending in China," Journal of Population Economics, Springer;European Society for Population Economics, vol. 36(3), pages 1269-1292, July.
    5. Godzinski, Alexandre & Suarez Castillo, Milena, 2021. "Disentangling the effects of air pollutants with many instruments," Journal of Environmental Economics and Management, Elsevier, vol. 109(C).
    6. Shihe Fu & V. Brian Viard, 2022. "A mayors perspective on tackling air pollution," Chapters, in: Charles K.Y. Leung (ed.), Handbook of Real Estate and Macroeconomics, chapter 16, pages 413-437, Edward Elgar Publishing.
    7. Liao, Liping & Du, Minzhe & Chen, Zhongfei, 2021. "Air pollution, health care use and medical costs: Evidence from China," Energy Economics, Elsevier, vol. 95(C).
    8. Xinming Du, 2023. "Symptom or Culprit? Social Media, Air Pollution, and Violence," CESifo Working Paper Series 10296, CESifo.
    9. Giaccherini, Matilde & Kopinska, Joanna & Palma, Alessandro, 2021. "When particulate matter strikes cities: Social disparities and health costs of air pollution," Journal of Health Economics, Elsevier, vol. 78(C).
    10. Yao, Yao & Li, Xue & Smyth, Russell & Zhang, Lin, 2022. "Air pollution and political trust in local government: Evidence from China," Journal of Environmental Economics and Management, Elsevier, vol. 115(C).
    11. Gillingham, Kenneth & Huang, Pei, 2021. "Racial disparities in the health effects from air pollution: Evidence from ports," ZEW Discussion Papers 21-058, ZEW - Leibniz Centre for European Economic Research.
    12. Wang, Chunchao & Lin, Qianqian & Qiu, Yun, 2022. "Productivity loss amid invisible pollution," Journal of Environmental Economics and Management, Elsevier, vol. 112(C).
    13. Ya‐Ming Liu & Chon‐Kit Ao, 2021. "Effect of air pollution on health care expenditure: Evidence from respiratory diseases," Health Economics, John Wiley & Sons, Ltd., vol. 30(4), pages 858-875, April.
    14. Han, Qing & Liu, Ying & Lu, Zilong, 2020. "Temporary driving restrictions, air pollution, and contemporaneous health: Evidence from China," Regional Science and Urban Economics, Elsevier, vol. 84(C).
    15. Austin M. Williams & Daniel J. Phaneuf, 2019. "The Morbidity Costs of Air Pollution: Evidence from Spending on Chronic Respiratory Conditions," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 74(2), pages 571-603, October.
    16. Beshir, H.A.; & Fichera, E.;, 2022. "“And Breathe Normally†: The Low Emission Zone impacts on health and well-being in England," Health, Econometrics and Data Group (HEDG) Working Papers 22/09, HEDG, c/o Department of Economics, University of York.
    17. Dardati, Evangelina & de Elejalde, Ramiro & Giolito, Eugenio, 2021. "On the Short-Term Impact of Pollution: The Effect of PM 2.5 on Emergency Room Visits," IZA Discussion Papers 14599, Institute of Labor Economics (IZA).
    18. Ordoñez, Pablo J., 2020. "Power Plants, Air Pollution, and Health in Colombia," 2020 Annual Meeting, July 26-28, Kansas City, Missouri 304284, Agricultural and Applied Economics Association.
    19. Kong, Dongmin & Liang, Junwei & Liu, Chenhao, 2022. "Invisible enemy: The health impact of ozone," China Economic Review, Elsevier, vol. 72(C).
    20. Guidetti, Bruna & Pereda, Paula & Severnini, Edson R., 2020. "Health Shocks under Hospital Capacity Constraint: Evidence from Air Pollution in Sao Paulo, Brazil," IZA Discussion Papers 13211, Institute of Labor Economics (IZA).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:i4rdps:11. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://www.i4replication.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.