IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/24903.html
   My bibliography  Save this paper

Quasi-Experimental Methods in Environmental Economics: Opportunities and Challenges

Author

Listed:
  • Olivier Deschenes
  • Kyle C. Meng

Abstract

This paper examines the application of quasi-experimental methods in environmental economics. We begin with two observations: i) standard quasi-experimental methods, first applied in other microeconomic fields, typically assume unit-level treatments that do not spill over across units; (ii) because public goods, such as environmental attributes, exhibit externalities, treatment of one unit often affects other units. To explore the implications of applying standard quasi-experimental methods to public good problems, we extend the potential outcomes framework to explicitly distinguish between unit-level source and the resulting group-level exposure of a public good. This new framework serves as a foundation for reviewing and interpreting key papers from the recent empirical literature. We formally demonstrate that two common quasi-experimental estimators of the marginal social benefit of a public good can be biased due to externality spillovers, even when the source of the public good itself is quasi-randomly assigned. We propose an unbiased estimator for the valuation of local public goods and discuss how it can be implemented in future studies. Finally, we consider how to preserve the advantages of the quasi-experimental approach when valuing global public goods, such as climate change mitigation, for which no control units are available.

Suggested Citation

  • Olivier Deschenes & Kyle C. Meng, 2018. "Quasi-Experimental Methods in Environmental Economics: Opportunities and Challenges," NBER Working Papers 24903, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:24903
    Note: EEE EH PE
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w24903.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Michael Greenstone & Rema Hanna, 2014. "Environmental Regulations, Air and Water Pollution, and Infant Mortality in India," American Economic Review, American Economic Association, vol. 104(10), pages 3038-3072, October.
    2. Lucas W. Davis, 2008. "The Effect of Driving Restrictions on Air Quality in Mexico City," Journal of Political Economy, University of Chicago Press, vol. 116(1), pages 38-81, February.
    3. Stephan Heblich & Alex Trew & Yanos Zylberberg, 2021. "East-Side Story: Historical Pollution and Persistent Neighborhood Sorting," Journal of Political Economy, University of Chicago Press, vol. 129(5), pages 1508-1552.
    4. Anthony C. Fisher & W. Michael Hanemann & Michael J. Roberts & Wolfram Schlenker, 2012. "The Economic Impacts of Climate Change: Evidence from Agricultural Output and Random Fluctuations in Weather: Comment," American Economic Review, American Economic Association, vol. 102(7), pages 3749-3760, December.
    5. Esther Duflo & Michael Greenstone & Nicholas Ryan, 2013. "Truth-telling by Third-party Auditors and the Response of Polluting Firms: Experimental Evidence from India," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(4), pages 1499-1545.
    6. Joshua D. Angrist & Jörn-Steffen Pischke, 2010. "The Credibility Revolution in Empirical Economics: How Better Research Design Is Taking the Con out of Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 3-30, Spring.
    7. Marshall Burke & Kyle Emerick, 2016. "Adaptation to Climate Change: Evidence from US Agriculture," American Economic Journal: Economic Policy, American Economic Association, vol. 8(3), pages 106-140, August.
    8. Alan Barreca & Karen Clay & Olivier Deschênes & Michael Greenstone & Joseph S. Shapiro, 2015. "Convergence in Adaptation to Climate Change: Evidence from High Temperatures and Mortality, 1900-2004," American Economic Review, American Economic Association, vol. 105(5), pages 247-251, May.
    9. Raj Chetty, 2009. "Sufficient Statistics for Welfare Analysis: A Bridge Between Structural and Reduced-Form Methods," Annual Review of Economics, Annual Reviews, vol. 1(1), pages 451-488, May.
    10. Michael Greenstone & Justin Gallagher, 2008. "Does Hazardous Waste Matter? Evidence from the Housing Market and the Superfund Program," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 123(3), pages 951-1003.
    11. Gamper-Rabindran, Shanti & Timmins, Christopher, 2013. "Does cleanup of hazardous waste sites raise housing values? Evidence of spatially localized benefits," Journal of Environmental Economics and Management, Elsevier, vol. 65(3), pages 345-360.
    12. Antonio Bento & Matthew Freedman & Corey Lang, 2015. "Who Benefits from Environmental Regulation? Evidence from the Clean Air Act Amendments," The Review of Economics and Statistics, MIT Press, vol. 97(3), pages 610-622, July.
    13. Olivier Deschênes & Michael Greenstone, 2007. "The Economic Impacts of Climate Change: Evidence from Agricultural Output and Random Fluctuations in Weather," American Economic Review, American Economic Association, vol. 97(1), pages 354-385, March.
    14. Auffhammer, Maximilian & Bento, Antonio M. & Lowe, Scott E., 2009. "Measuring the effects of the Clean Air Act Amendments on ambient PM10 concentrations: The critical importance of a spatially disaggregated analysis," Journal of Environmental Economics and Management, Elsevier, vol. 58(1), pages 15-26, July.
    15. Tatyana Deryugina & Solomon M. Hsiang, 2014. "Does the Environment Still Matter? Daily Temperature and Income in the United States," NBER Working Papers 20750, National Bureau of Economic Research, Inc.
    16. He, Guojun & Fan, Maoyong & Zhou, Maigeng, 2016. "The effect of air pollution on mortality in China: Evidence from the 2008 Beijing Olympic Games," Journal of Environmental Economics and Management, Elsevier, vol. 79(C), pages 18-39.
    17. Melissa Dell & Benjamin F. Jones & Benjamin A. Olken, 2014. "What Do We Learn from the Weather? The New Climate-Economy Literature," Journal of Economic Literature, American Economic Association, vol. 52(3), pages 740-798, September.
    18. Kenneth Y. Chay & Michael Greenstone, 2003. "Air Quality, Infant Mortality, and the Clean Air Act of 1970," Working Papers 0406, Massachusetts Institute of Technology, Center for Energy and Environmental Policy Research.
    19. Meredith Fowlie & Michael Greenstone & Catherine Wolfram, 2018. "Do Energy Efficiency Investments Deliver? Evidence from the Weatherization Assistance Program," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(3), pages 1597-1644.
    20. James J. Heckman, 2010. "Building Bridges between Structural and Program Evaluation Approaches to Evaluating Policy," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 356-398, June.
    21. Diamond, Peter A & Mirrlees, James A, 1971. "Optimal Taxation and Public Production II: Tax Rules," American Economic Review, American Economic Association, vol. 61(3), pages 261-278, June.
    22. Olivier Deschênes & Michael Greenstone, 2011. "Climate Change, Mortality, and Adaptation: Evidence from Annual Fluctuations in Weather in the US," American Economic Journal: Applied Economics, American Economic Association, vol. 3(4), pages 152-185, October.
    23. Olivier Deschênes & Michael Greenstone & Joseph S. Shapiro, 2017. "Defensive Investments and the Demand for Air Quality: Evidence from the NOx Budget Program," American Economic Review, American Economic Association, vol. 107(10), pages 2958-2989, October.
    24. Maximilian Auffhammer & Ryan Kellogg, 2011. "Clearing the Air? The Effects of Gasoline Content Regulation on Air Quality," American Economic Review, American Economic Association, vol. 101(6), pages 2687-2722, October.
    25. Alan Barreca & Karen Clay & Olivier Deschenes & Michael Greenstone & Joseph S. Shapiro, 2016. "Adapting to Climate Change: The Remarkable Decline in the US Temperature-Mortality Relationship over the Twentieth Century," Journal of Political Economy, University of Chicago Press, vol. 124(1), pages 105-159.
    26. Michael Greenstone, 2002. "The Impacts of Environmental Regulations on Industrial Activity: Evidence from the 1970 and 1977 Clean Air Act Amendments and the Census of Manufactures," Journal of Political Economy, University of Chicago Press, vol. 110(6), pages 1175-1219, December.
    27. Janet Currie & Lucas Davis & Michael Greenstone & Reed Walker, 2015. "Environmental Health Risks and Housing Values: Evidence from 1,600 Toxic Plant Openings and Closings," American Economic Review, American Economic Association, vol. 105(2), pages 678-709, February.
    28. Baumol,William J. & Oates,Wallace E., 1988. "The Theory of Environmental Policy," Cambridge Books, Cambridge University Press, number 9780521322249.
    29. Harberger, Arnold C, 1971. "Three Basic Postulates for Applied Welfare Economics: An Interpretive Essay," Journal of Economic Literature, American Economic Association, vol. 9(3), pages 785-797, September.
    30. Grainger, Corbett A., 2012. "The distributional effects of pollution regulations: Do renters fully pay for cleaner air?," Journal of Public Economics, Elsevier, vol. 96(9-10), pages 840-852.
    31. Olivier Deschênes & Michael Greenstone, 2012. "The Economic Impacts of Climate Change: Evidence from Agricultural Output and Random Fluctuations in Weather: Reply," American Economic Review, American Economic Association, vol. 102(7), pages 3761-3773, December.
    32. Greenstone, Michael & Gayer, Ted, 2009. "Quasi-experimental and experimental approaches to environmental economics," Journal of Environmental Economics and Management, Elsevier, vol. 57(1), pages 21-44, January.
    33. Tatyana Deryugina & Solomon Hsiang, 2017. "The Marginal Product of Climate," NBER Working Papers 24072, National Bureau of Economic Research, Inc.
    34. Hunt Allcott & Todd Rogers, 2014. "The Short-Run and Long-Run Effects of Behavioral Interventions: Experimental Evidence from Energy Conservation," American Economic Review, American Economic Association, vol. 104(10), pages 3003-3037, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Michalek, Jerzy, 2022. "Environmental and farm impacts of the EU RDP agri-environmental measures: Evidence from Slovak regions," Land Use Policy, Elsevier, vol. 113(C).
    2. Godzinski, Alexandre & Suarez Castillo, Milena, 2021. "Disentangling the effects of air pollutants with many instruments," Journal of Environmental Economics and Management, Elsevier, vol. 109(C).
    3. Cauê Carrilho & Gabriela Demarchi & Amy Duchelle & Sven Wunder & Carla Morsello, 2022. "Permanence of avoided deforestation in a Transamazon REDD+ initiative (Pará, Brazil)," CEE-M Working Papers hal-03614704, CEE-M, Universtiy of Montpellier, CNRS, INRA, Montpellier SupAgro.
    4. Carrilho, Cauê D. & Demarchi, Gabriela & Duchelle, Amy E. & Wunder, Sven & Morsello, Carla, 2022. "Permanence of avoided deforestation in a Transamazon REDD+ project (Pará, Brazil)," Ecological Economics, Elsevier, vol. 201(C).
    5. Tang, Maogang & Li, Zhen & Hu, Fengxia & Wu, Baijun & Zhang, Ruihan, 2021. "Market failure, tradable discharge permit, and pollution reduction: Evidence from industrial firms in China," Ecological Economics, Elsevier, vol. 189(C).
    6. Dong, Yan & Tian, Jinhuan & Wen, Qiang, 2022. "Environmental regulation and outward foreign direct investment: Evidence from China," China Economic Review, Elsevier, vol. 76(C).
    7. Maogang Tang & Ruihan Zhang & Zhen Li & Baijun Wu, 2021. "Assessing the impact of tradable discharge permit on pollution reduction and innovation: micro-evidence from Chinese industrial enterprises," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 23(11), pages 16911-16933, November.
    8. Hernandez-Cortes, Danae & Meng, Kyle C., 2023. "Do environmental markets cause environmental injustice? Evidence from California’s carbon market," Journal of Public Economics, Elsevier, vol. 217(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Solomon Hsiang & Paulina Oliva & Reed Walker, 2019. "The Distribution of Environmental Damages," Review of Environmental Economics and Policy, Association of Environmental and Resource Economists, vol. 13(1), pages 83-103.
    2. Janet Currie & Reed Walker, 2019. "What Do Economists Have to Say about the Clean Air Act 50 Years after the Establishment of the Environmental Protection Agency?," Journal of Economic Perspectives, American Economic Association, vol. 33(4), pages 3-26, Fall.
    3. Antonio M. Bento & Noah Miller & Mehreen Mookerjee & Edson Severnini, 2023. "Incidental Adaptation: The Role of Non-climate Regulations," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 86(3), pages 305-343, November.
    4. Li, Chengzheng & Cong, Jiajia & Gu, Haiying & Zhang, Peng, 2021. "The non-linear effect of daily weather on economic performance: Evidence from China," China Economic Review, Elsevier, vol. 69(C).
    5. Antonio Bento & Noah S. Miller & Mehreen Mookerjee & Edson R. Severnini, 2020. "A Unifying Approach to Measuring Climate Change Impacts and Adaptation," NBER Working Papers 27247, National Bureau of Economic Research, Inc.
    6. Li, Chengzheng & Cong, Jiajia & Yin, Lijuan, 2021. "Extreme heat and exports: Evidence from Chinese exporters," China Economic Review, Elsevier, vol. 66(C).
    7. Hsing-Hsiang Huang & Michael R. Moore, 2018. "Farming under Weather Risk: Adaptation, Moral Hazard, and Selection on Moral Hazard," NBER Chapters, in: Agricultural Productivity and Producer Behavior, pages 77-124, National Bureau of Economic Research, Inc.
    8. Sam Cosaert & Adrián Nieto & Konstantinos Tatsiramos, 2023. "Temperature and Joint Time Use," CESifo Working Paper Series 10464, CESifo.
    9. Chen, Siyu & Guo, Chongshan & Huang, Xinfei, 2018. "Air Pollution, Student Health, and School Absences: Evidence from China," Journal of Environmental Economics and Management, Elsevier, vol. 92(C), pages 465-497.
    10. Dechezleprêtre, Antoine & Kozluk, Tomasz & Kruse, Tobias & Nachtigall, Daniel & de Serres, Alain, 2019. "Do Environmental and Economic Performance Go Together? A Review of Micro-level Empirical Evidence from the Past Decade or So," International Review of Environmental and Resource Economics, now publishers, vol. 13(1-2), pages 1-118, April.
    11. R. Jisung Park & Joshua Goodman & Michael Hurwitz & Jonathan Smith, 2020. "Heat and Learning," American Economic Journal: Economic Policy, American Economic Association, vol. 12(2), pages 306-339, May.
    12. Chengzheng Li & Jiajia Cong & Haiying Gu, 2020. "Could Weather Fluctuations Affect Local Economic Growth? Evidence from Counties in the People's Republic of China," Asian Development Review, MIT Press, vol. 37(2), pages 201-224, September.
    13. Moritz A. Drupp & Ulrike Kornek & Jasper N. Meya & Lutz Sager, 2021. "Inequality and the Environment: The Economics of a Two-Headed Hydra," CESifo Working Paper Series 9447, CESifo.
    14. Banerjee, Rakesh & Maharaj, Riddhi, 2020. "Heat, infant mortality, and adaptation: Evidence from India," Journal of Development Economics, Elsevier, vol. 143(C).
    15. Newell, Richard G. & Prest, Brian C. & Sexton, Steven E., 2021. "The GDP-Temperature relationship: Implications for climate change damages," Journal of Environmental Economics and Management, Elsevier, vol. 108(C).
    16. Aldy, Joseph E. & Auffhammer, Maximillian & Cropper, Maureen L. & Fraas, Arthur G. & Morgenstern, Richard D., 2020. "Looking Back at Fifty Years of the Clean Air Act," RFF Working Paper Series 20-01, Resources for the Future.
    17. Acevedo, Sebastian & Mrkaic, Mico & Novta, Natalija & Pugacheva, Evgenia & Topalova, Petia, 2020. "The Effects of Weather Shocks on Economic Activity: What are the Channels of Impact?," Journal of Macroeconomics, Elsevier, vol. 65(C).
    18. Chen, Shiyi & Jiang, Lingduo & Liu, Wanlin & Song, Hong, 2022. "Fireworks regulation, air pollution, and public health: Evidence from China," Regional Science and Urban Economics, Elsevier, vol. 92(C).
    19. Kahn, Matthew E. & Zhao, Daxuan, 2018. "The impact of climate change skepticism on adaptation in a market economy," Research in Economics, Elsevier, vol. 72(2), pages 251-262.
    20. Ross Levine & Chen Lin & Zigan Wang, 2018. "Pollution and Human Capital Migration: Evidence from Corporate Executives," NBER Working Papers 24389, National Bureau of Economic Research, Inc.

    More about this item

    JEL classification:

    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • H23 - Public Economics - - Taxation, Subsidies, and Revenue - - - Externalities; Redistributive Effects; Environmental Taxes and Subsidies
    • H41 - Public Economics - - Publicly Provided Goods - - - Public Goods
    • Q50 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Environmental Economics - - - General
    • Q51 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Environmental Economics - - - Valuation of Environmental Effects
    • Q52 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Environmental Economics - - - Pollution Control Adoption and Costs; Distributional Effects; Employment Effects
    • Q53 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Environmental Economics - - - Air Pollution; Water Pollution; Noise; Hazardous Waste; Solid Waste; Recycling
    • Q54 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Environmental Economics - - - Climate; Natural Disasters and their Management; Global Warming

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:24903. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.