IDEAS home Printed from https://ideas.repec.org/a/eee/jeeman/v103y2020ics0095069620300607.html
   My bibliography  Save this article

Causal forest estimation of heterogeneous and time-varying environmental policy effects

Author

Listed:
  • Miller, Steve

Abstract

Empirically evaluating environmental policies requires grappling with impacts that exhibit not only cross-sectional heterogeneity, but also variation across time. Phased policy roll-outs offer opportunities for improvement across cohorts and policy effects can grow or decay, especially when natural processes are involved. Focusing on a subset of these factors can lead to erroneous inference, while considering them jointly magnifies specification challenges. To address these challenges, I extend and apply causal forests, a nonparametric method for estimating heterogeneous treatment effects, to simultaneously examine how effects vary across time. I first adapt causal forests to a panel setting with staggered policy introduction by incorporating dynamic selection assumptions and estimators. After illustrating the method's performance on simulated data, I use it to reanalyze how individual quota programs have affected fisheries catches around the world. Estimates reveal substantial heterogeneity and time dependencies and suggest that longer policy exposure may be less beneficial than previously thought. More generally, the approach has potential value for evaluating impacts of a range of environmental policies as well as environmental shocks.

Suggested Citation

  • Miller, Steve, 2020. "Causal forest estimation of heterogeneous and time-varying environmental policy effects," Journal of Environmental Economics and Management, Elsevier, vol. 103(C).
  • Handle: RePEc:eee:jeeman:v:103:y:2020:i:c:s0095069620300607
    DOI: 10.1016/j.jeem.2020.102337
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0095069620300607
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jeem.2020.102337?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Michael Lechner, 2002. "Program Heterogeneity And Propensity Score Matching: An Application To The Evaluation Of Active Labor Market Policies," The Review of Economics and Statistics, MIT Press, vol. 84(2), pages 205-220, May.
    2. Peter Hall & Qi Li & Jeffrey S. Racine, 2007. "Nonparametric Estimation of Regression Functions in the Presence of Irrelevant Regressors," The Review of Economics and Statistics, MIT Press, vol. 89(4), pages 784-789, November.
    3. Racine, Jeff & Li, Qi, 2004. "Nonparametric estimation of regression functions with both categorical and continuous data," Journal of Econometrics, Elsevier, vol. 119(1), pages 99-130, March.
    4. Steve Martin & Nicholas Rivers, 2018. "Information Provision, Market Incentives, and Household Electricity Consumption: Evidence from a Large-Scale Field Deployment," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 5(1), pages 207-231.
    5. Stefan Wager & Susan Athey, 2018. "Estimation and Inference of Heterogeneous Treatment Effects using Random Forests," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(523), pages 1228-1242, July.
    6. Benjamin Handel & Jonathan Kolstad, 2017. "Wearable Technologies and Health Behaviors: New Data and New Methods to Understand Population Health," American Economic Review, American Economic Association, vol. 107(5), pages 481-485, May.
    7. Grafton, R Quentin & Squires, Dale & Fox, Kevin J, 2000. "Private Property and Economic Efficiency: A Study of a Common-Pool Resource," Journal of Law and Economics, University of Chicago Press, vol. 43(2), pages 679-713, October.
    8. Maximilian Auffhammer & Ryan Kellogg, 2011. "Clearing the Air? The Effects of Gasoline Content Regulation on Air Quality," American Economic Review, American Economic Association, vol. 101(6), pages 2687-2722, October.
    9. Allcott, Hunt, 2011. "Social norms and energy conservation," Journal of Public Economics, Elsevier, vol. 95(9-10), pages 1082-1095, October.
    10. Alan Barreca & Karen Clay & Olivier Deschenes & Michael Greenstone & Joseph S. Shapiro, 2016. "Adapting to Climate Change: The Remarkable Decline in the US Temperature-Mortality Relationship over the Twentieth Century," Journal of Political Economy, University of Chicago Press, vol. 124(1), pages 105-159.
    11. Michael Lechner & Ruth Miquel, 2010. "Identification of the effects of dynamic treatments by sequential conditional independence assumptions," Empirical Economics, Springer, vol. 39(1), pages 111-137, August.
    12. Burlig, Fiona & Preonas, Louis & Woerman, Matt, 2020. "Panel data and experimental design," Journal of Development Economics, Elsevier, vol. 144(C).
    13. Guido W. Imbens, 2015. "Matching Methods in Practice: Three Examples," Journal of Human Resources, University of Wisconsin Press, vol. 50(2), pages 373-419.
    14. Michael C. Knaus & Michael Lechner & Anthony Strittmatter, 2022. "Heterogeneous Employment Effects of Job Search Programs: A Machine Learning Approach," Journal of Human Resources, University of Wisconsin Press, vol. 57(2), pages 597-636.
    15. Lu Tian & Ash A. Alizadeh & Andrew J. Gentles & Robert Tibshirani, 2014. "A Simple Method for Estimating Interactions Between a Treatment and a Large Number of Covariates," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(508), pages 1517-1532, December.
    16. Auffhammer, Maximilian & Bento, Antonio M. & Lowe, Scott E., 2009. "Measuring the effects of the Clean Air Act Amendments on ambient PM10 concentrations: The critical importance of a spatially disaggregated analysis," Journal of Environmental Economics and Management, Elsevier, vol. 58(1), pages 15-26, July.
    17. Christopher Costello & Corbett A. Grainger, 2018. "Property Rights, Regulatory Capture, and Exploitation of Natural Resources," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 5(2), pages 441-479.
    18. Jonathan M.V. Davis & Sara B. Heller, 2017. "Using Causal Forests to Predict Treatment Heterogeneity: An Application to Summer Jobs," American Economic Review, American Economic Association, vol. 107(5), pages 546-550, May.
    19. Reed, William J., 1979. "Optimal escapement levels in stochastic and deterministic harvesting models," Journal of Environmental Economics and Management, Elsevier, vol. 6(4), pages 350-363, December.
    20. Corey White, 2017. "The Dynamic Relationship between Temperature and Morbidity," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(4), pages 1155-1198.
    21. Jason Abrevaya & Yu-Chin Hsu & Robert P. Lieli, 2015. "Estimating Conditional Average Treatment Effects," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(4), pages 485-505, October.
    22. Gallagher, Kelly Sims & Muehlegger, Erich, 2011. "Giving green to get green? Incentives and consumer adoption of hybrid vehicle technology," Journal of Environmental Economics and Management, Elsevier, vol. 61(1), pages 1-15, January.
    23. G. Kapetanios, 2008. "A bootstrap procedure for panel data sets with many cross-sectional units," Econometrics Journal, Royal Economic Society, vol. 11(2), pages 377-395, July.
    24. Sam Asher & Denis Nekipelov & Paul Novosad & Stephen P. Ryan, 2016. "Classification Trees for Heterogeneous Moment-Based Models," NBER Working Papers 22976, National Bureau of Economic Research, Inc.
    25. Hunt Allcott & Todd Rogers, 2014. "The Short-Run and Long-Run Effects of Behavioral Interventions: Experimental Evidence from Energy Conservation," American Economic Review, American Economic Association, vol. 104(10), pages 3003-3037, October.
    26. Grooms, Katherine K., 2015. "Enforcing the Clean Water Act: The effect of state-level corruption on compliance," Journal of Environmental Economics and Management, Elsevier, vol. 73(C), pages 50-78.
    27. Costello, Christopher & Polasky, Stephen, 2008. "Optimal harvesting of stochastic spatial resources," Journal of Environmental Economics and Management, Elsevier, vol. 56(1), pages 1-18, July.
    28. Matt Taddy & Matt Gardner & Liyun Chen & David Draper, 2016. "A Nonparametric Bayesian Analysis of Heterogenous Treatment Effects in Digital Experimentation," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(4), pages 661-672, October.
    29. Pinkerton, Evelyn & Edwards, Danielle N., 2009. "The elephant in the room: The hidden costs of leasing individual transferable fishing quotas," Marine Policy, Elsevier, vol. 33(4), pages 707-713, July.
    30. Allcott, Hunt, 2011. "Social norms and energy conservation," Journal of Public Economics, Elsevier, vol. 95(9), pages 1082-1095.
    31. Elisabeth Thuestad Isaksen & Andries Richter, 2019. "Tragedy, Property Rights, and the Commons: Investigating the Causal Relationship from Institutions to Ecosystem Collapse," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 6(4), pages 741-781.
    32. Paul J. Ferraro & Juan Jose Miranda & Michael K. Price, 2011. "The Persistence of Treatment Effects with Norm-Based Policy Instruments: Evidence from a Randomized Environmental Policy Experiment," American Economic Review, American Economic Association, vol. 101(3), pages 318-322, May.
    33. Meredith Fowlie, 2010. "Emissions Trading, Electricity Restructuring, and Investment in Pollution Abatement," American Economic Review, American Economic Association, vol. 100(3), pages 837-869, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Axenbeck, Janna & Berner, Anne & Kneib, Thomas, 2022. "What drives the relationship between digitalization and industrial energy demand? Exploring firm-level heterogeneity," ZEW Discussion Papers 22-059, ZEW - Leibniz Centre for European Economic Research.
    2. Christian Stetter & Philipp Mennig & Johannes Sauer, 2022. "Using Machine Learning to Identify Heterogeneous Impacts of Agri-Environment Schemes in the EU: A Case Study [The impact of agri-environmental schemes on farm performance in five EU member States: ," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 49(4), pages 723-759.
    3. Hayakawa, Kazunobu & Keola, Souknilanh & Silaphet, Korrakoun & Yamanouchi, Kenta, 2022. "Estimating the impacts of international bridges on foreign firm locations: a machine learning approach," IDE Discussion Papers 847, Institute of Developing Economies, Japan External Trade Organization(JETRO).
    4. Chang Cai & Sandy Dall’Erba, 2021. "On the evaluation of heterogeneous climate change impacts on US agriculture: does group membership matter?," Climatic Change, Springer, vol. 167(1), pages 1-23, July.
    5. Mark Kattenberg & Bas Scheer & Jurre Thiel, 2023. "Causal forests with fixed effects for treatment effect heterogeneity in difference-in-differences," CPB Discussion Paper 452, CPB Netherlands Bureau for Economic Policy Analysis.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kayo Murakami & Hideki Shimada & Yoshiaki Ushifusa & Takanori Ida, 2022. "Heterogeneous Treatment Effects Of Nudge And Rebate: Causal Machine Learning In A Field Experiment On Electricity Conservation," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 63(4), pages 1779-1803, November.
    2. Lechner, Michael, 2018. "Modified Causal Forests for Estimating Heterogeneous Causal Effects," IZA Discussion Papers 12040, Institute of Labor Economics (IZA).
    3. Michael C Knaus & Michael Lechner & Anthony Strittmatter, 2021. "Machine learning estimation of heterogeneous causal effects: Empirical Monte Carlo evidence," The Econometrics Journal, Royal Economic Society, vol. 24(1), pages 134-161.
    4. Michael Lechner & Jana Mareckova, 2022. "Modified Causal Forest," Papers 2209.03744, arXiv.org.
    5. Andor, Mark A. & Gerster, Andreas & Peters, Jörg, 2022. "Information campaigns for residential energy conservation," European Economic Review, Elsevier, vol. 144(C).
    6. Todd D. Gerarden & Richard G. Newell & Robert N. Stavins, 2017. "Assessing the Energy-Efficiency Gap," Journal of Economic Literature, American Economic Association, vol. 55(4), pages 1486-1525, December.
    7. Céline Nauges & Dale Whittington, 2019. "Social Norms Information Treatments in the Municipal Water Supply Sector: Some New Insights on Benefits and Costs," Water Economics and Policy (WEP), World Scientific Publishing Co. Pte. Ltd., vol. 5(03), pages 1-40, July.
    8. Joshua Henkel & Georg Schwesinger, 2020. "Establishing Sustainable Consumption - How Future Policies Can Channel Consumer Preferences," Bremen Papers on Economics & Innovation 2007, University of Bremen, Faculty of Business Studies and Economics.
    9. Cattaneo, Cristina & D’Adda, Giovanna & Tavoni, Massimo & Bonan, Jacopo, 2019. "Can We Make Social Information Programs More Effective? The Role of Identity and Values," RFF Working Paper Series 19-21, Resources for the Future.
    10. Takanori Ida, Kayo Murakami, and Makoto Tanaka, 2016. "Electricity demand response in Japan: Experimental evidence from a residential photovoltaic power-generation system," Economics of Energy & Environmental Policy, International Association for Energy Economics, vol. 0(Number 1).
    11. Denis Hilton & Nicolas Treich & Gaetan Lazzara & Philippe Tendil, 2018. "Designing effective nudges that satisfy ethical constraints: the case of environmentally responsible behaviour," Mind & Society: Cognitive Studies in Economics and Social Sciences, Springer;Fondazione Rosselli, vol. 17(1), pages 27-38, November.
    12. Michael C Knaus, 2022. "Double machine learning-based programme evaluation under unconfoundedness [Econometric methods for program evaluation]," The Econometrics Journal, Royal Economic Society, vol. 25(3), pages 602-627.
    13. Uddin, Main & Wang, Liang Choon & Smyth, Russell, 2021. "Do government-initiated energy comparison sites encourage consumer search and lower prices? Evidence from an online randomized controlled experiment in Australia," Journal of Economic Behavior & Organization, Elsevier, vol. 188(C), pages 167-182.
    14. Bhanot, Syon P., 2017. "Rank and response: A field experiment on peer information and water use behavior," Journal of Economic Psychology, Elsevier, vol. 62(C), pages 155-172.
    15. Jason Delaney & Sarah Jacobson, 2016. "Payments or Persuasion: Common Pool Resource Management with Price and Non-price Measures," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 65(4), pages 747-772, December.
    16. Holladay, Scott & LaRiviere, Jacob & Novgorodsky, David & Price, Michael, 2019. "Prices versus nudges: What matters for search versus purchase of energy investments?," Journal of Public Economics, Elsevier, vol. 172(C), pages 151-173.
    17. Christian Cordes & Joshua Henkel, 2022. "Enhanced "Green Nudging": Tapping the Channels of Cultural Transmission," Bremen Papers on Economics & Innovation 2208, University of Bremen, Faculty of Business Studies and Economics.
    18. Daniel A. Brent & Corey Lott & Michael Taylor & Joseph Cook & Kimberly Rollins & Shawn Stoddard, 2020. "What Causes Heterogeneous Responses to Social Comparison Messages for Water Conservation?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 77(3), pages 503-537, November.
    19. Kandul, Serhiy & Lanz, Bruno, 2021. "Public good provision, in-group cooperation and out-group descriptive norms: A lab experiment," Journal of Economic Psychology, Elsevier, vol. 85(C).
    20. Martine Visser & Matthew Darling & Rebecca A. Klege & Saugato Datta, 2018. "“The Power of Nudging: Using Feedback, Competition and Responsibility Assignment to Save Electricity in a Non-Residential Settingâ€," Working Papers 763, Economic Research Southern Africa.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jeeman:v:103:y:2020:i:c:s0095069620300607. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/622870 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.