IDEAS home Printed from https://ideas.repec.org/a/kap/enreec/v86y2023i1d10.1007_s10640-023-00794-2.html
   My bibliography  Save this article

Assessing the Impacts of Birmingham’s Clean Air Zone on Air Quality: Estimates from a Machine Learning and Synthetic Control Approach

Author

Listed:
  • Bowen Liu

    (University of Birmingham
    University of Birmingham)

  • John R. Bryson

    (University of Birmingham)

  • Deniz Sevinc

    (University of Birmingham)

  • Matthew A. Cole

    (University of Birmingham)

  • Robert J. R. Elliott

    (University of Birmingham)

  • Suzanne E. Bartington

    (University of Birmingham)

  • William J. Bloss

    (University of Birmingham)

  • Zongbo Shi

    (University of Birmingham)

Abstract

We apply a two-step data driven approach to determine the causal impact of the clean air zone (CAZ) policy on air quality in Birmingham, UK. Levels of NO2, NOx and PM2.5 before and after CAZ implementation were collected from automatic air quality monitoring sites both within and outside the CAZ. We apply a unique combination of two recent methods: (1) a random forest machine learning method to strip out the effects of meteorological conditions on air pollution levels, and then (2) the Augmented Synthetic Control Method (ASCM) on the de-weathered air pollution data to isolate the causal effect of the CAZ. We find that, during the first year following the formal policy implementation, the CAZ led to significant but modest reductions of NO2 and NOX levels measured at the roadside within (up to 3.4% and 5.4% of NO2 and NOX, respectively) and outside (up to 6.6% and 11.9%) the zone, with no detectable changes at the urban background site outside the CAZ. No significant impacts of the CAZ were found on concentrations of fine particulates (PM2.5). Our analysis demonstrates the short-term effectiveness of CAZ in reducing concentrations of NO2 and NOX.

Suggested Citation

  • Bowen Liu & John R. Bryson & Deniz Sevinc & Matthew A. Cole & Robert J. R. Elliott & Suzanne E. Bartington & William J. Bloss & Zongbo Shi, 2023. "Assessing the Impacts of Birmingham’s Clean Air Zone on Air Quality: Estimates from a Machine Learning and Synthetic Control Approach," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 86(1), pages 203-231, October.
  • Handle: RePEc:kap:enreec:v:86:y:2023:i:1:d:10.1007_s10640-023-00794-2
    DOI: 10.1007/s10640-023-00794-2
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10640-023-00794-2
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10640-023-00794-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Eli Ben-Michael & Avi Feller & Jesse Rothstein, 2021. "The Augmented Synthetic Control Method," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1789-1803, October.
    2. Matthew A. Cole & Robert J R Elliott & Bowen Liu, 2020. "The Impact of the Wuhan Covid-19 Lockdown on Air Pollution and Health: A Machine Learning and Augmented Synthetic Control Approach," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 76(4), pages 553-580, August.
    3. Alberto Abadie & Javier Gardeazabal, 2003. "The Economic Costs of Conflict: A Case Study of the Basque Country," American Economic Review, American Economic Association, vol. 93(1), pages 113-132, March.
    4. Veronika Fensterer & Helmut Küchenhoff & Verena Maier & Heinz-Erich Wichmann & Susanne Breitner & Annette Peters & Jianwei Gu & Josef Cyrys, 2014. "Evaluation of the Impact of Low Emission Zone and Heavy Traffic Ban in Munich (Germany) on the Reduction of PM 10 in Ambient Air," IJERPH, MDPI, vol. 11(5), pages 1-19, May.
    5. Doerr, Luisa & Dorn, Florian & Gaebler, Stefanie & Potrafke, Niklas, 2020. "How new airport infrastructure promotes tourism: evidence from a synthetic control approach in German regions," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 54(10), pages 1402-1412.
    6. Mouhcine Guettabi & Abdul Munasib, 2018. "Stand Your Ground laws, homicides and gun deaths," Regional Studies, Taylor & Francis Journals, vol. 52(9), pages 1250-1260, September.
    7. Sendhil Mullainathan & Jann Spiess, 2017. "Machine Learning: An Applied Econometric Approach," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 87-106, Spring.
    8. Alberto Abadie, 2021. "Using Synthetic Controls: Feasibility, Data Requirements, and Methodological Aspects," Journal of Economic Literature, American Economic Association, vol. 59(2), pages 391-425, June.
    9. Athey, Susan & Imbens, Guido W., 2019. "Machine Learning Methods Economists Should Know About," Research Papers 3776, Stanford University, Graduate School of Business.
    10. Abadie, Alberto & Diamond, Alexis & Hainmueller, Jens, 2010. "Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California’s Tobacco Control Program," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 493-505.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Roy Cerqueti & Raffaella Coppier & Alessandro Girardi & Marco Ventura, 2022. "The sooner the better: lives saved by the lockdown during the COVID-19 outbreak. The case of Italy [Using synthetic controls: Feasibility, data requirements, and methodological aspects]," The Econometrics Journal, Royal Economic Society, vol. 25(1), pages 46-70.
    2. Omid Zamani & Craig Chibanda & Janine Pelikan, 2023. "Unraveling the effects of import bans on domestic poultry production: a case study of Senegal," Agricultural and Food Economics, Springer;Italian Society of Agricultural Economics (SIDEA), vol. 11(1), pages 1-25, December.
    3. Florence Bouvet & Roy Bower & Jason C. Jones, 2022. "Currency Devaluation as a Source of Growth in Africa: A Synthetic Control Approach," Eastern Economic Journal, Palgrave Macmillan;Eastern Economic Association, vol. 48(3), pages 367-389, June.
    4. Hannes Wallimann & Kevin Blattler & Widar von Arx, 2021. "Do price reductions attract customers in urban public transport? A synthetic control approach," Papers 2111.14613, arXiv.org, revised Mar 2022.
    5. Hideki Shimada & Kenji Asano & Yu Nagai & Akito Ozawa, 2022. "Assessing the Impact of Offshore Wind Power Deployment on Fishery: A Synthetic Control Approach," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 83(3), pages 791-829, November.
    6. Zamani, Omid & Gunarathne, Anoma, 2022. "Could Genetic Improvement Policies Boost Milk Production in Senegal? A Synthetic Control Method," 62nd Annual Conference, Stuttgart, Germany, September 7-9, 2022 329603, German Association of Agricultural Economists (GEWISOLA).
    7. Maximiliano Marzetti & Rok Spruk, 2023. "Long-Term Economic Effects of Populist Legal Reforms: Evidence from Argentina," Comparative Economic Studies, Palgrave Macmillan;Association for Comparative Economic Studies, vol. 65(1), pages 60-95, March.
    8. Dennis Shen & Peng Ding & Jasjeet Sekhon & Bin Yu, 2022. "Same Root Different Leaves: Time Series and Cross-Sectional Methods in Panel Data," Papers 2207.14481, arXiv.org, revised Oct 2022.
    9. Michael Funke & Kadri Männasoo & Helery Tasane, 2023. "Regional Economic Impacts of the Øresund Cross-Border Fixed Link: Cui Bono?," CESifo Working Paper Series 10557, CESifo.
    10. Stefano, Roberta di & Mellace, Giovanni, 2020. "The inclusive synthetic control method," Discussion Papers on Economics 14/2020, University of Southern Denmark, Department of Economics.
    11. Florentin Kerschbaumer & Andreas Maschke, 2021. "The Implications of Monetary Union for Income Inequality: An Empirical Assessment," Wirtschaft und Gesellschaft - WuG, Kammer für Arbeiter und Angestellte für Wien, Abteilung Wirtschaftswissenschaft und Statistik, vol. 47(4), pages 537-574.
    12. David Gilchrist & Thomas Emery & Nuno Garoupa & Rok Spruk, 2023. "Synthetic Control Method: A tool for comparative case studies in economic history," Journal of Economic Surveys, Wiley Blackwell, vol. 37(2), pages 409-445, April.
    13. Mónica Amador-Jiménez & Naomi Millner & Charles Palmer & R. Toby Pennington & Lorenzo Sileci, 2020. "The Unintended Impact of Colombia’s Covid-19 Lockdown on Forest Fires," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 76(4), pages 1081-1105, August.
    14. Dennis Shen & Peng Ding & Jasjeet Sekhon & Bin Yu, 2023. "Same Root Different Leaves: Time Series and Cross‐Sectional Methods in Panel Data," Econometrica, Econometric Society, vol. 91(6), pages 2125-2154, November.
    15. Justin Wiltshire, 2021. "allsynth: Synthetic control bias-corrections utilities for Stata," 2021 Stata Conference 15, Stata Users Group.
    16. Pier Basaglia & Sophie Behr & Moritz A. Drupp, 2023. "De-Fueling Externalities: How Tax Salience and Fuel Substitution Mediate Climate and Health Benefits," Discussion Papers of DIW Berlin 2041, DIW Berlin, German Institute for Economic Research.
    17. Bilbao-Goyoaga, Eugenia, 2023. "Perceptions Matter: Quasi-Experimental Evidence on the Effects of Minimum Income on Objective and Subjective Financial Wellbeing in Spain," SocArXiv wv7xt, Center for Open Science.
    18. Kathleen T. Li & Christophe Van den Bulte, 2023. "Augmented Difference-in-Differences," Marketing Science, INFORMS, vol. 42(4), pages 746-767, July.
    19. Alberto Abadie & Jinglong Zhao, 2021. "Synthetic Controls for Experimental Design," Papers 2108.02196, arXiv.org, revised Dec 2023.
    20. Jiafeng Chen, 2023. "Synthetic Control as Online Linear Regression," Econometrica, Econometric Society, vol. 91(2), pages 465-491, March.

    More about this item

    Keywords

    Clean air zone; Air pollution; Machine learning; Synthetic control method;
    All these keywords.

    JEL classification:

    • Q53 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Environmental Economics - - - Air Pollution; Water Pollution; Noise; Hazardous Waste; Solid Waste; Recycling
    • Q58 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Environmental Economics - - - Environmental Economics: Government Policy
    • C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:enreec:v:86:y:2023:i:1:d:10.1007_s10640-023-00794-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.