IDEAS home Printed from https://ideas.repec.org/a/wly/iecrev/v63y2022i4p1779-1803.html
   My bibliography  Save this article

Heterogeneous Treatment Effects Of Nudge And Rebate: Causal Machine Learning In A Field Experiment On Electricity Conservation

Author

Listed:
  • Kayo Murakami
  • Hideki Shimada
  • Yoshiaki Ushifusa
  • Takanori Ida

Abstract

This study investigates the different impacts of monetary and nonmonetary incentives on energy‐saving behaviors using a field experiment conducted in Japan. We find that the average reduction in electricity consumption from the rebate is 4%, whereas that from the nudge is not significantly different from zero. Applying a novel machine learning method for causal inference (causal forest) to estimate heterogeneous treatment effects at the household level, we demonstrate that the nudge intervention's treatment effects generate greater heterogeneity among households. These findings suggest that selective targeting for treatment increases the policy efficiency of monetary and nonmonetary interventions.

Suggested Citation

  • Kayo Murakami & Hideki Shimada & Yoshiaki Ushifusa & Takanori Ida, 2022. "Heterogeneous Treatment Effects Of Nudge And Rebate: Causal Machine Learning In A Field Experiment On Electricity Conservation," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 63(4), pages 1779-1803, November.
  • Handle: RePEc:wly:iecrev:v:63:y:2022:i:4:p:1779-1803
    DOI: 10.1111/iere.12589
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/iere.12589
    Download Restriction: no

    File URL: https://libkey.io/10.1111/iere.12589?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Hunt Allcott & Judd B. Kessler, 2019. "The Welfare Effects of Nudges: A Case Study of Energy Use Social Comparisons," American Economic Journal: Applied Economics, American Economic Association, vol. 11(1), pages 236-276, January.
    2. Alec Brandon & John A. List & Robert D. Metcalfe & Michael K. Price & Florian Rundhammer, 2019. "Testing for crowd out in social nudges: Evidence from a natural field experiment in the market for electricity," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 116(12), pages 5293-5298, March.
    3. Stefan Wager & Susan Athey, 2018. "Estimation and Inference of Heterogeneous Treatment Effects using Random Forests," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(523), pages 1228-1242, July.
    4. Azarova, Valeriya & Cohen, Jed J. & Kollmann, Andrea & Reichl, Johannes, 2020. "Reducing household electricity consumption during evening peak demand times: Evidence from a field experiment," Energy Policy, Elsevier, vol. 144(C).
    5. Susan Athey & Guido W. Imbens, 2017. "The State of Applied Econometrics: Causality and Policy Evaluation," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 3-32, Spring.
    6. Nicola Lacetera & Mario Macis & Robert Slonim, 2012. "Will There Be Blood? Incentives and Displacement Effects in Pro-social Behavior," American Economic Journal: Economic Policy, American Economic Association, vol. 4(1), pages 186-223, February.
    7. Susan Athey & Julie Tibshirani & Stefan Wager, 2016. "Generalized Random Forests," Papers 1610.01271, arXiv.org, revised Apr 2018.
    8. Carter, Michael R. & Tjernström, Emilia & Toledo, Patricia, 2019. "Heterogeneous impact dynamics of a rural business development program in Nicaragua," Journal of Development Economics, Elsevier, vol. 138(C), pages 77-98.
    9. Buunk, Abraham P. & Gibbons, Frederick X., 2007. "Social comparison: The end of a theory and the emergence of a field," Organizational Behavior and Human Decision Processes, Elsevier, vol. 102(1), pages 3-21, January.
    10. Nadja Dwenger & Henrik Kleven & Imran Rasul & Johannes Rincke, 2016. "Extrinsic and Intrinsic Motivations for Tax Compliance: Evidence from a Field Experiment in Germany," American Economic Journal: Economic Policy, American Economic Association, vol. 8(3), pages 203-232, August.
    11. Victor Chernozhukov & Mert Demirer & Esther Duflo & Iv'an Fern'andez-Val, 2017. "Fisher-Schultz Lecture: Generic Machine Learning Inference on Heterogenous Treatment Effects in Randomized Experiments, with an Application to Immunization in India," Papers 1712.04802, arXiv.org, revised Oct 2023.
    12. Katrina Jessoe & David Rapson, 2014. "Knowledge Is (Less) Power: Experimental Evidence from Residential Energy Use," American Economic Review, American Economic Association, vol. 104(4), pages 1417-1438, April.
    13. Hallsworth, Michael & List, John A. & Metcalfe, Robert D. & Vlaev, Ivo, 2017. "The behavioralist as tax collector: Using natural field experiments to enhance tax compliance," Journal of Public Economics, Elsevier, vol. 148(C), pages 14-31.
    14. Frank A. Wolak, 2011. "Do Residential Customers Respond to Hourly Prices? Evidence from a Dynamic Pricing Experiment," American Economic Review, American Economic Association, vol. 101(3), pages 83-87, May.
    15. Christopher R. Knittel & Samuel Stolper, 2021. "Machine Learning about Treatment Effect Heterogeneity: The Case of Household Energy Use," AEA Papers and Proceedings, American Economic Association, vol. 111, pages 440-444, May.
    16. Steve Martin & Nicholas Rivers, 2018. "Information Provision, Market Incentives, and Household Electricity Consumption: Evidence from a Large-Scale Field Deployment," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 5(1), pages 207-231.
    17. Gérard Biau & Erwan Scornet, 2016. "Rejoinder on: A random forest guided tour," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 25(2), pages 264-268, June.
    18. Meredith Fowlie & Catherine Wolfram & Patrick Baylis & C Anna Spurlock & Annika Todd-Blick & Peter Cappers, 2021. "Default Effects And Follow-On Behaviour: Evidence From An Electricity Pricing Program [The Impact of Presumed Consent Legislation on Cadaveric Oorgan Donation: A Cross-country Study”]," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 88(6), pages 2886-2934.
    19. Dora L. Costa & Matthew E. Kahn, 2013. "Energy Conservation “Nudges” And Environmentalist Ideology: Evidence From A Randomized Residential Electricity Field Experiment," Journal of the European Economic Association, European Economic Association, vol. 11(3), pages 680-702, June.
    20. Allcott, Hunt, 2011. "Social norms and energy conservation," Journal of Public Economics, Elsevier, vol. 95(9-10), pages 1082-1095, October.
    21. Hunt Allcott & Todd Rogers, 2014. "The Short-Run and Long-Run Effects of Behavioral Interventions: Experimental Evidence from Energy Conservation," American Economic Review, American Economic Association, vol. 104(10), pages 3003-3037, October.
    22. Gérard Biau & Erwan Scornet, 2016. "A random forest guided tour," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 25(2), pages 197-227, June.
    23. Jonathan M.V. Davis & Sara B. Heller, 2017. "Rethinking the Benefits of Youth Employment Programs: The Heterogeneous Effects of Summer Jobs," NBER Working Papers 23443, National Bureau of Economic Research, Inc.
    24. Severin Borenstein, 2002. "The Trouble With Electricity Markets: Understanding California's Restructuring Disaster," Journal of Economic Perspectives, American Economic Association, vol. 16(1), pages 191-211, Winter.
    25. Christopher R. Knittel & Samuel Stolper, 2019. "Using Machine Learning to Target Treatment: The Case of Household Energy Use," NBER Working Papers 26531, National Bureau of Economic Research, Inc.
    26. Azarova, Valeriya & Cohen, Jed J. & Kollmann, Andrea & Reichl, Johannes, 2020. "Reducing household electricity consumption during evening peak demand times: Evidence from a field experiment," Munich Reprints in Economics 84731, University of Munich, Department of Economics.
    27. Toshi H. Arimura & Hajime Katayama & Mari Sakudo, 2016. "Do Social Norms Matter to Energy-Saving Behavior? Endogenous Social and Correlated Effects," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 3(3), pages 525-553.
    28. Allcott, Hunt, 2011. "Social norms and energy conservation," Journal of Public Economics, Elsevier, vol. 95(9), pages 1082-1095.
    29. Stefano Carattini & Steffen Kallbekken & Anton Orlov, 2019. "How to win public support for a global carbon tax," Nature, Nature, vol. 565(7739), pages 289-291, January.
    30. Meredith Fowlie & Catherine Wolfram & C. Anna Spurlock & Annika Todd & Patrick Baylis & Peter Cappers, 2017. "Default Effects and Follow-On Behavior: Evidence from an Electricity Pricing Program," NBER Working Papers 23553, National Bureau of Economic Research, Inc.
    31. Noah J. Goldstein & Robert B. Cialdini & Vladas Griskevicius, 2008. "A Room with a Viewpoint: Using Social Norms to Motivate Environmental Conservation in Hotels," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 35(3), pages 472-482, March.
    32. Severin Borenstein, 2005. "The Long-Run Efficiency of Real-Time Electricity Pricing," The Energy Journal, International Association for Energy Economics, vol. 0(Number 3), pages 93-116.
    33. Takanori Ida, Kayo Murakami, and Makoto Tanaka, 2016. "Electricity demand response in Japan: Experimental evidence from a residential photovoltaic power-generation system," Economics of Energy & Environmental Policy, International Association for Energy Economics, vol. 0(Number 1).
    34. Paul J. Ferraro & Juan Jose Miranda & Michael K. Price, 2011. "The Persistence of Treatment Effects with Norm-Based Policy Instruments: Evidence from a Randomized Environmental Policy Experiment," American Economic Review, American Economic Association, vol. 101(3), pages 318-322, May.
    35. O'Neill, E. & Weeks, M., 2018. "Causal Tree Estimation of Heterogeneous Household Response to Time-Of-Use Electricity Pricing Schemes," Cambridge Working Papers in Economics 1865, Faculty of Economics, University of Cambridge.
    36. Koichiro Ito & Takanori Ida & Makoto Tanaka, 2018. "Moral Suasion and Economic Incentives: Field Experimental Evidence from Energy Demand," American Economic Journal: Economic Policy, American Economic Association, vol. 10(1), pages 240-267, February.
    37. Jonathan M.V. Davis & Sara B. Heller, 2017. "Using Causal Forests to Predict Treatment Heterogeneity: An Application to Summer Jobs," American Economic Review, American Economic Association, vol. 107(5), pages 546-550, May.
    38. Ahmad Faruqui & Sanem Sergici, 2010. "Household response to dynamic pricing of electricity: a survey of 15 experiments," Journal of Regulatory Economics, Springer, vol. 38(2), pages 193-225, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Olga Takács & János Vincze, 2023. "Heterogeneous wage structure effects: a partial European East-West comparison," CERS-IE WORKING PAPERS 2305, Institute of Economics, Centre for Economic and Regional Studies.
    2. Harpenau, Franziska & Magalhaes, Katrin Marques & Steffen, Nico & Wiewiorra, Lukas, 2023. "Saving behaviors of private households under varying tariff structures, price levels and incentives - Experimental evidence," WIK Working Papers 7, WIK Wissenschaftliches Institut für Infrastruktur und Kommunikationsdienste GmbH, Bad Honnef.
    3. Ankinée KIRAKOZIAN & Raphaël CHIAPPINI & Nabila ARFAOUI, 2023. "Nudging employees for greener mobility A field experiment," Bordeaux Economics Working Papers 2023-09, Bordeaux School of Economics (BSE).
    4. Patrick Rehill & Nicholas Biddle, 2023. "Fairness Implications of Heterogeneous Treatment Effect Estimation with Machine Learning Methods in Policy-making," Papers 2309.00805, arXiv.org.
    5. Mark Kattenberg & Bas Scheer & Jurre Thiel, 2023. "Causal forests with fixed effects for treatment effect heterogeneity in difference-in-differences," CPB Discussion Paper 452, CPB Netherlands Bureau for Economic Policy Analysis.
    6. Toshi H. Arimura & Elke D. Groh & Miwa Nakai & Andreas Ziegler, 2022. "The causal effect of private and organizational climate-related identity on climate protection activities: Evidence from a framed field experiment in Japan," MAGKS Papers on Economics 202229, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
    7. Al-Ubaydli, Omar & Cassidy, Alecia & Chatterjee, Anomitro & Khalifa, Ahmed & Price, Michael, 2023. "The power to conserve: a field experiment on electricity use in Qatar," LSE Research Online Documents on Economics 121048, London School of Economics and Political Science, LSE Library.
    8. von Zahn, Moritz & Bauer, Kevin & Mihale-Wilson, Cristina & Jagow, Johanna & Speicher, Max & Hinz, Oliver, 2022. "The smart green nudge: Reducing product returns through enriched digital footprints & causal machine learning," SAFE Working Paper Series 363, Leibniz Institute for Financial Research SAFE, revised 2022.
    9. Olga Takács & János Vincze, 2023. "Where is the pain the most acute? The market segments particularly affected by gender wage discrimination in Hungary," CERS-IE WORKING PAPERS 2304, Institute of Economics, Centre for Economic and Regional Studies.
    10. Takanori Ida & Takunori Ishihara & Koichiro Ito & Daido Kido & Toru Kitagawa & Shosei Sakaguchi & Shusaku Sasaki, 2021. "Paternalism, Autonomy, or Both? Experimental Evidence from Energy Saving Programs," Papers 2112.09850, arXiv.org.
    11. Alt, Marius, 2021. "Committing to behave pro-environmentally: An assessment of time and regulatee-size effects on the demand for environmental regulation," VfS Annual Conference 2021 (Virtual Conference): Climate Economics 242419, Verein für Socialpolitik / German Economic Association.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Brülisauer, Marcel & Goette, Lorenz & Jiang, Zhengyi & Schmitz, Jan & Schubert, Renate, 2020. "Appliance-specific feedback and social comparisons: Evidence from a field experiment on energy conservation," Energy Policy, Elsevier, vol. 145(C).
    2. Jessoe, Katrina & Lade, Gabriel E. & Loge, Frank & Spang, Edward, 2021. "Residential water conservation during drought: Experimental evidence from three behavioral interventions," Journal of Environmental Economics and Management, Elsevier, vol. 110(C).
    3. Takanori Ida, Kayo Murakami, and Makoto Tanaka, 2016. "Electricity demand response in Japan: Experimental evidence from a residential photovoltaic power-generation system," Economics of Energy & Environmental Policy, International Association for Energy Economics, vol. 0(Number 1).
    4. Kandul, Serhiy & Lanz, Bruno, 2021. "Public good provision, in-group cooperation and out-group descriptive norms: A lab experiment," Journal of Economic Psychology, Elsevier, vol. 85(C).
    5. Takanori Ida & Kayo Murakami & Makoto Tanaka, 2015. "Electricity demand response in Japan:Experimental evidence from a residential photovoltaic generation system," Discussion papers e-15-006, Graduate School of Economics Project Center, Kyoto University.
    6. Todd D. Gerarden & Richard G. Newell & Robert N. Stavins, 2017. "Assessing the Energy-Efficiency Gap," Journal of Economic Literature, American Economic Association, vol. 55(4), pages 1486-1525, December.
    7. Andor, Mark A. & Gerster, Andreas & Peters, Jörg, 2022. "Information campaigns for residential energy conservation," European Economic Review, Elsevier, vol. 144(C).
    8. John A. List & Robert D. Metcalfe & Michael K. Price & Florian Rundhammer, 2017. "Harnessing Policy Complementarities to Conserve Energy: Evidence from a Natural Field Experiment," NBER Working Papers 23355, National Bureau of Economic Research, Inc.
    9. Holzmeister, Felix & Huber, Jürgen & Kirchler, Michael & Schwaiger, Rene, 2022. "Nudging debtors to pay their debt: Two randomized controlled trials," Journal of Economic Behavior & Organization, Elsevier, vol. 198(C), pages 535-551.
    10. Miller, Steve, 2020. "Causal forest estimation of heterogeneous and time-varying environmental policy effects," Journal of Environmental Economics and Management, Elsevier, vol. 103(C).
    11. Tonke, Sebastian, 2020. "Imperfect Procedural Knowledge: Evidence from a Field Experiment to Encourage Water Conservation," VfS Annual Conference 2020 (Virtual Conference): Gender Economics 224536, Verein für Socialpolitik / German Economic Association.
    12. John A. List & James J. Murphy & Michael K. Price & Alexander G. James, 2019. "Do Appeals to Donor Benefits Raise More Money than Appeals to Recipient Benefits? Evidence from a Natural Field Experiment with Pick.Click.Give," NBER Working Papers 26559, National Bureau of Economic Research, Inc.
    13. Ankinée KIRAKOZIAN & Raphaël CHIAPPINI & Nabila ARFAOUI, 2023. "Nudging employees for greener mobility A field experiment," Bordeaux Economics Working Papers 2023-09, Bordeaux School of Economics (BSE).
    14. Daniel Engler & Gunnar Gutsche & Amantia Simixhiu & Andreas Ziegler, 2022. "Social norms and individual climate protection activities: A framed field experiment for Germany," MAGKS Papers on Economics 202230, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
    15. Werner, Peter & Riedl, Arno, 2018. "The role of experiments for policy design," Research Memorandum 022, Maastricht University, Graduate School of Business and Economics (GSBE).
    16. Spandagos, Constantine & Baark, Erik & Ng, Tze Ling & Yarime, Masaru, 2021. "Social influence and economic intervention policies to save energy at home: Critical questions for the new decade and evidence from air-condition use," Renewable and Sustainable Energy Reviews, Elsevier, vol. 143(C).
    17. Engler, Daniel & Ziegler, Andreas & Gutsche, Gunnar & Simixhiu, Amantia, 2023. "Social Norms and Individual Climate Protection Activities: A Framed Field Experiment for Germany," VfS Annual Conference 2023 (Regensburg): Growth and the "sociale Frage" 277662, Verein für Socialpolitik / German Economic Association.
    18. Joseph,George & Ayling,Sophie Charlotte Emi & Miquel-Florensa,Pepita & Bejarano,Hernán D. & Cardona,Alejandra Quevedo, 2021. "Behavioral Insights in Infrastructure Sectors : A Survey," Policy Research Working Paper Series 9704, The World Bank.
    19. ITO Koichiro & IDA Takanori & TANAKA Makoto, 2015. "The Persistence of Moral Suasion and Economic Incentives: Field experimental evidence from energy demand," Discussion papers 15014, Research Institute of Economy, Trade and Industry (RIETI).
    20. C. Yiwei Zhang & Jeffrey Hemmeter & Judd B. Kessler & Robert D. Metcalfe & Robert Weathers, 2023. "Nudging Timely Wage Reporting: Field Experimental Evidence from the U.S. Supplemental Security Income Program," Management Science, INFORMS, vol. 69(3), pages 1341-1353, March.

    More about this item

    JEL classification:

    • D9 - Microeconomics - - Micro-Based Behavioral Economics
    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • Q4 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:iecrev:v:63:y:2022:i:4:p:1779-1803. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/deupaus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.