IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/28735.html
   My bibliography  Save this paper

What’s Missing in Environmental (Self-)Monitoring: Evidence from Strategic Shutdowns of Pollution Monitors

Author

Listed:
  • Yingfei Mu
  • Edward A. Rubin
  • Eric Zou

Abstract

Regulators often rely on regulated entities to self-monitor compliance, potentially creating strategic incentives for endogenous monitoring. This paper builds a framework to detect whether local governments skip air pollution monitoring when they expect air quality to deteriorate. The core of our method tests whether the timing of monitor shutdowns coincides with the counties’ air quality alerts – public advisories based on local governments’ own pollution forecasts. Applying the method to a monitor in Jersey City, NJ, suspected of a deliberate shutdown during the 2013 “Bridgegate” traffic jam, we find a 33% reduction of this monitor’s sampling rate on pollution-alert days. Building on large-scale inference tools, we then apply the method to test more than 1,300 monitors across the U.S., finding 14 metro areas with clusters of monitors showing similar strategic behavior. We assess geometric imputation and remote-sensing technologies as potential solutions to deter future strategic monitoring.

Suggested Citation

  • Yingfei Mu & Edward A. Rubin & Eric Zou, 2021. "What’s Missing in Environmental (Self-)Monitoring: Evidence from Strategic Shutdowns of Pollution Monitors," NBER Working Papers 28735, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:28735
    Note: EEE POL
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w28735.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Anderson, Michael L, 2008. "Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects," Department of Agricultural & Resource Economics, UC Berkeley, Working Paper Series qt15n8j26f, Department of Agricultural & Resource Economics, UC Berkeley.
    2. John A. List & Azeem M. Shaikh & Yang Xu, 2019. "Multiple hypothesis testing in experimental economics," Experimental Economics, Springer;Economic Science Association, vol. 22(4), pages 773-793, December.
    3. James Heckman & Seong Hyeok Moon & Rodrigo Pinto & Peter Savelyev & Adam Yavitz, 2010. "Analyzing social experiments as implemented: evidence from the HighScope Perry Preschool Program," CeMMAP working papers CWP22/10, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    4. Cutter, W. Bowman & Neidell, Matthew, 2009. "Voluntary information programs and environmental regulation: Evidence from 'Spare the Air'," Journal of Environmental Economics and Management, Elsevier, vol. 58(3), pages 253-265, November.
    5. Garret Christensen & Edward Miguel, 2018. "Transparency, Reproducibility, and the Credibility of Economics Research," Journal of Economic Literature, American Economic Association, vol. 56(3), pages 920-980, September.
    6. W. Reed Walker, 2013. "The Transitional Costs of Sectoral Reallocation: Evidence From the Clean Air Act and the Workforce," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(4), pages 1787-1835.
    7. Mathias Reynaert & James M. Sallee, 2021. "Who Benefits When Firms Game Corrective Policies?," American Economic Journal: Economic Policy, American Economic Association, vol. 13(1), pages 372-412, February.
    8. Damon Jones & David Molitor & Julian Reif, 2019. "What do Workplace Wellness Programs do? Evidence from the Illinois Workplace Wellness Study," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(4), pages 1747-1791.
    9. Janet Currie & Matthew Neidell, 2005. "Air Pollution and Infant Health: What Can We Learn from California's Recent Experience?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 120(3), pages 1003-1030.
    10. Esther Duflo & Michael Greenstone & Nicholas Ryan, 2013. "Truth-telling by Third-party Auditors and the Response of Polluting Firms: Experimental Evidence from India," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(4), pages 1499-1545.
    11. Amy Finkelstein & Sarah Taubman & Bill Wright & Mira Bernstein & Jonathan Gruber & Joseph P. Newhouse & Heidi Allen & Katherine Baicker, 2012. "The Oregon Health Insurance Experiment: Evidence from the First Year," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 127(3), pages 1057-1106.
    12. Glaeser, Edward L. & Saks, Raven E., 2006. "Corruption in America," Journal of Public Economics, Elsevier, vol. 90(6-7), pages 1053-1072, August.
    13. Matthew Neidell, 2009. "Information, Avoidance Behavior, and Health: The Effect of Ozone on Asthma Hospitalizations," Journal of Human Resources, University of Wisconsin Press, vol. 44(2).
    14. Wallace E. Oates & Wallace E. Oates, 2004. "A Reconsideration of Environmental Federalism," Chapters, in: Environmental Policy and Fiscal Federalism, chapter 7, pages 125-156, Edward Elgar Publishing.
    15. Ghanem, Dalia & Zhang, Junjie, 2014. "‘Effortless Perfection:’ Do Chinese cities manipulate air pollution data?," Journal of Environmental Economics and Management, Elsevier, vol. 68(2), pages 203-225.
    16. Levinson, Arik, 2003. "Environmental Regulatory Competition: A Status Report and Some New Evidence," National Tax Journal, National Tax Association;National Tax Journal, vol. 56(1), pages 91-106, March.
    17. Mathias Reynaert, 2021. "Abatement Strategies and the Cost of Environmental Regulation: Emission Standards on the European Car Market," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 88(1), pages 454-488.
    18. Chen Yuyu & Jin Ginger Zhe & Kumar Naresh & Shi Guang, 2012. "Gaming in Air Pollution Data? Lessons from China," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 13(3), pages 1-43, December.
    19. Evans, Mary F. & Stafford, Sarah L., 2019. "The Clean Air Act Watch List and federal oversight of state enforcement efforts," Journal of Environmental Economics and Management, Elsevier, vol. 93(C), pages 170-184.
    20. Antonio Bento & Matthew Freedman & Corey Lang, 2015. "Who Benefits from Environmental Regulation? Evidence from the Clean Air Act Amendments," The Review of Economics and Statistics, MIT Press, vol. 97(3), pages 610-622, July.
    21. Jonathan M.V. Davis & Sara B. Heller, 2020. "Rethinking the Benefits of Youth Employment Programs: The Heterogeneous Effects of Summer Jobs," The Review of Economics and Statistics, MIT Press, vol. 102(4), pages 664-677, October.
    22. Millimet, Daniel L., 2013. "Environmental Federalism: A Survey of the Empirical Literature," IZA Discussion Papers 7831, Institute of Labor Economics (IZA).
    23. Peter T. Leeson & Russell S. Sobel, 2008. "Weathering Corruption," Journal of Law and Economics, University of Chicago Press, vol. 51(4), pages 667-681, November.
    24. Michael Greenstone & John A. List & Chad Syverson, 2011. "The Effects of Environmental Regulation on the Competiveness of U.S. Manufacturing," Working Papers 11-03, Center for Economic Studies, U.S. Census Bureau.
    25. Auffhammer, Maximilian & Bento, Antonio M. & Lowe, Scott E., 2009. "Measuring the effects of the Clean Air Act Amendments on ambient PM10 concentrations: The critical importance of a spatially disaggregated analysis," Journal of Environmental Economics and Management, Elsevier, vol. 58(1), pages 15-26, July.
    26. Anderson, Michael L., 2008. "Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1481-1495.
    27. Michael Greenstone & Guojun He & Ruixue Jia & Tong Liu, 2022. "Can Technology Solve the Principal-Agent Problem? Evidence from China's War on Air Pollution," American Economic Review: Insights, American Economic Association, vol. 4(1), pages 54-70, March.
    28. James Heckman & Seong Hyeok Moon & Rodrigo Pinto & Peter Savelyev & Adam Yavitz, 2010. "Analyzing social experiments as implemented: A reexamination of the evidence from the HighScope Perry Preschool Program," Quantitative Economics, Econometric Society, vol. 1(1), pages 1-46, July.
    29. Meredith Fowlie & Edward Rubin & Reed Walker, 2019. "Bringing Satellite-Based Air Quality Estimates Down to Earth," AEA Papers and Proceedings, American Economic Association, vol. 109, pages 283-288, May.
    30. Michael Greenstone & Guojun He & Ruixue Jia & Tong Liu, 2020. "Can Technology Solve the Principal-Agent Problem? Evidence from China’s War on Air Pollution," Working Papers 2020-87, Becker Friedman Institute for Research In Economics.
    31. Wesley Blundell & Gautam Gowrisankaran & Ashley Langer, 2020. "Escalation of Scrutiny: The Gains from Dynamic Enforcement of Environmental Regulations," American Economic Review, American Economic Association, vol. 110(8), pages 2558-2585, August.
    32. Esther Duflo & Michael Greenstone & Rohini Pande & Nicholas Ryan, 2018. "The Value of Regulatory Discretion: Estimates From Environmental Inspections in India," Econometrica, Econometric Society, vol. 86(6), pages 2123-2160, November.
    33. Hagemann, Andreas, 2019. "Placebo inference on treatment effects when the number of clusters is small," Journal of Econometrics, Elsevier, vol. 213(1), pages 190-209.
    34. Malani, Anup & Reif, Julian, 2015. "Interpreting pre-trends as anticipation: Impact on estimated treatment effects from tort reform," Journal of Public Economics, Elsevier, vol. 124(C), pages 1-17.
    35. Wayne B. Gray & Jay P. Shimshack, 2011. "The Effectiveness of Environmental Monitoring and Enforcement: A Review of the Empirical Evidence," Review of Environmental Economics and Policy, Association of Environmental and Resource Economists, vol. 5(1), pages 3-24, Winter.
    36. Young, Alwyn, 2019. "Channeling Fisher: randomization tests and the statistical insignificance of seemingly significant experimental results," LSE Research Online Documents on Economics 101401, London School of Economics and Political Science, LSE Library.
    37. Thomas Barrios & Rebecca Diamond & Guido W. Imbens & Michal Kolesár, 2012. "Clustering, Spatial Correlations, and Randomization Inference," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(498), pages 578-591, June.
    38. Alwyn Young, 2019. "Channeling Fisher: Randomization Tests and the Statistical Insignificance of Seemingly Significant Experimental Results," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(2), pages 557-598.
    39. Graff Zivin, Joshua & Neidell, Matthew, 2009. "Days of haze: Environmental information disclosure and intertemporal avoidance behavior," Journal of Environmental Economics and Management, Elsevier, vol. 58(2), pages 119-128, September.
    40. Grooms, Katherine K., 2015. "Enforcing the Clean Water Act: The effect of state-level corruption on compliance," Journal of Environmental Economics and Management, Elsevier, vol. 73(C), pages 50-78.
    41. Joseph S. Shapiro & Reed Walker, 2020. "Is Air Pollution Regulation Too Lenient? Evidence from US Offset Markets," NBER Working Papers 28199, National Bureau of Economic Research, Inc.
    42. Jay P. Shimshack, 2014. "The Economics of Environmental Monitoring and Enforcement," Annual Review of Resource Economics, Annual Reviews, vol. 6(1), pages 339-360, October.
    43. Thomas Buchmueller & Sarah Miller & Marko Vujicic, 2016. "How Do Providers Respond to Changes in Public Health Insurance Coverage? Evidence from Adult Medicaid Dental Benefits," American Economic Journal: Economic Policy, American Economic Association, vol. 8(4), pages 70-102, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jonathan Colmer & Mary F. Evans & Jay Shimshack, 2023. "Environmental citizen complaints," CEP Discussion Papers dp1903, Centre for Economic Performance, LSE.
    2. Xinming Du, 2023. "Symptom or Culprit? Social Media, Air Pollution, and Violence," CESifo Working Paper Series 10296, CESifo.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zou, Eric, 2017. "Unwatched Pollution: The Effect of Incomplete Monitoring on Air Quality," 2017 Annual Meeting, July 30-August 1, Chicago, Illinois 258274, Agricultural and Applied Economics Association.
    2. Jeffrey D. Michler & Anna Josephson, 2022. "Recent developments in inference: practicalities for applied economics," Chapters, in: A Modern Guide to Food Economics, chapter 11, pages 235-268, Edward Elgar Publishing.
    3. Michael Greenstone & Guojun He & Ruixue Jia & Tong Liu, 2022. "Can Technology Solve the Principal-Agent Problem? Evidence from China's War on Air Pollution," American Economic Review: Insights, American Economic Association, vol. 4(1), pages 54-70, March.
    4. Michael Greenstone & Guojun He & Ruixue Jia & Tong Liu, 2020. "Can Technology Solve the Principal-Agent Problem? Evidence from China’s War on Air Pollution," Working Papers 2020-87, Becker Friedman Institute for Research In Economics.
    5. Sandner, Malte & Cornelissen, Thomas & Jungmann, Tanja & Herrmann, Peggy, 2018. "Evaluating the effects of a targeted home visiting program on maternal and child health outcomes," Journal of Health Economics, Elsevier, vol. 58(C), pages 269-283.
    6. Shihe Fu & V. Brian Viard, 2022. "A mayors perspective on tackling air pollution," Chapters, in: Charles K.Y. Leung (ed.), Handbook of Real Estate and Macroeconomics, chapter 16, pages 413-437, Edward Elgar Publishing.
    7. Tong Liu & Guojun He & Alexis Lau, 2018. "Avoidance behavior against air pollution: evidence from online search indices for anti-PM2.5 masks and air filters in Chinese cities," Environmental Economics and Policy Studies, Springer;Society for Environmental Economics and Policy Studies - SEEPS, vol. 20(2), pages 325-363, April.
    8. Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
    9. Joshua Graff Zivin & Matthew Neidell, 2013. "Environment, Health, and Human Capital," Journal of Economic Literature, American Economic Association, vol. 51(3), pages 689-730, September.
    10. Arouna, Aminou & Michler, Jeffrey D. & Lokossou, Jourdain C., 2021. "Contract farming and rural transformation: Evidence from a field experiment in Benin," Journal of Development Economics, Elsevier, vol. 151(C).
    11. Kastoryano, Stephen & Vollaard, Ben, 2022. "Nautical Patrol and Illegal Fishing Practices," Other publications TiSEM c02852eb-237c-4c6b-af7c-9, Tilburg University, School of Economics and Management.
    12. Shi, Xinzheng & Zhang, Ming-ang, 2023. "Waste import and air pollution: Evidence from China's waste import ban," Journal of Environmental Economics and Management, Elsevier, vol. 120(C).
    13. Lubega, Patrick & Nakakawa, Frances & Narciso, Gaia & Newman, Carol & Kaaya, Archileo N. & Kityo, Cissy & Tumuhimbise, Gaston A., 2021. "Body and mind: Experimental evidence from women living with HIV," Journal of Development Economics, Elsevier, vol. 150(C).
    14. Matthew Gibson, 2019. "Regulation-Induced Pollution Substitution," The Review of Economics and Statistics, MIT Press, vol. 101(5), pages 827-840, December.
    15. Ale-Chilet, Jorge & Chen, Cuicui & Li, Jing & Reynaert, Mathias, 2021. "Colluding Against Environmental Regulation," TSE Working Papers 21-1204, Toulouse School of Economics (TSE).
    16. Kong, Dongmin & Liang, Junwei & Liu, Chenhao, 2022. "Invisible enemy: The health impact of ozone," China Economic Review, Elsevier, vol. 72(C).
    17. Agostinelli, Francesco & Avitabile, Ciro & Bobba, Matteo, 2021. "Enhancing Human Capital in Children: A Case Study on Scaling," TSE Working Papers 21-1196, Toulouse School of Economics (TSE), revised Oct 2023.
    18. Burlig, Fiona, 2018. "Improving transparency in observational social science research: A pre-analysis plan approach," Economics Letters, Elsevier, vol. 168(C), pages 56-60.
    19. Michael J. Kottelenberg & Steven F. Lehrer, 2018. "Does Quebecs subsidized child care policy give boys and girls an equal start?," Canadian Journal of Economics, Canadian Economics Association, vol. 51(2), pages 627-659, May.
    20. Lizhong Peng & Jie Chen & Xiaohui Guo, 2022. "Macroeconomic conditions and health‐related outcomes in the United States: A metropolitan and micropolitan statistical area‐level analysis between 2004 and 2017," Health Economics, John Wiley & Sons, Ltd., vol. 31(1), pages 3-20, January.

    More about this item

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • H77 - Public Economics - - State and Local Government; Intergovernmental Relations - - - Intergovernmental Relations; Federalism
    • Q53 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Environmental Economics - - - Air Pollution; Water Pollution; Noise; Hazardous Waste; Solid Waste; Recycling

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:28735. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.