IDEAS home Printed from https://ideas.repec.org/p/kue/epaper/e-20-003.html

Heterogeneous Treatment Effects of Nudge and Rebate:Causal Machine Learning in a Field Experiment on Electricity Conservation

Author

Listed:
  • Kayo MURAKAMI
  • Hideki SHIMADA
  • Yoshiaki USHIFUSA
  • Takanori IDA

Abstract

This study investigates the different impacts of monetary and nonmonetary incentives on energy-saving behaviors using a field experiment conducted in Japan. We find that the average reduction in electricity consumption from rebate is 4%, while that from nudge is not significantly different from zero. Applying a novel machine learning method for causal inference (causal forest) to estimate heterogeneous treatment effects at the household level, we demonstrate that the nudge intervention’s treatment effects generate greater heterogeneity among households. These findings suggest that selective targeting for treatment increases the policy efficiency of monetary and nonmonetary interventions.

Suggested Citation

  • Kayo MURAKAMI & Hideki SHIMADA & Yoshiaki USHIFUSA & Takanori IDA, 2020. "Heterogeneous Treatment Effects of Nudge and Rebate:Causal Machine Learning in a Field Experiment on Electricity Conservation," Discussion papers e-20-003, Graduate School of Economics , Kyoto University.
  • Handle: RePEc:kue:epaper:e-20-003
    as

    Download full text from publisher

    File URL: http://www.econ.kyoto-u.ac.jp/dp/papers/e-20-003.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Hunt Allcott & Judd B. Kessler, 2019. "The Welfare Effects of Nudges: A Case Study of Energy Use Social Comparisons," American Economic Journal: Applied Economics, American Economic Association, vol. 11(1), pages 236-276, January.
    2. Stefan Wager & Susan Athey, 2018. "Estimation and Inference of Heterogeneous Treatment Effects using Random Forests," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(523), pages 1228-1242, July.
    3. Azarova, Valeriya & Cohen, Jed J. & Kollmann, Andrea & Reichl, Johannes, 2020. "Reducing household electricity consumption during evening peak demand times: Evidence from a field experiment," Energy Policy, Elsevier, vol. 144(C).
    4. Susan Athey & Guido W. Imbens, 2017. "The State of Applied Econometrics: Causality and Policy Evaluation," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 3-32, Spring.
    5. Nicola Lacetera & Mario Macis & Robert Slonim, 2012. "Will There Be Blood? Incentives and Displacement Effects in Pro-social Behavior," American Economic Journal: Economic Policy, American Economic Association, vol. 4(1), pages 186-223, February.
    6. Buunk, Abraham P. & Gibbons, Frederick X., 2007. "Social comparison: The end of a theory and the emergence of a field," Organizational Behavior and Human Decision Processes, Elsevier, vol. 102(1), pages 3-21, January.
    7. Nadja Dwenger & Henrik Kleven & Imran Rasul & Johannes Rincke, 2016. "Extrinsic and Intrinsic Motivations for Tax Compliance: Evidence from a Field Experiment in Germany," American Economic Journal: Economic Policy, American Economic Association, vol. 8(3), pages 203-232, August.
    8. Victor Chernozhukov & Mert Demirer & Esther Duflo & Iván Fernández‐Val, 2025. "Fisher–Schultz Lecture: Generic Machine Learning Inference on Heterogeneous Treatment Effects in Randomized Experiments, With an Application to Immunization in India," Econometrica, Econometric Society, vol. 93(4), pages 1121-1164, July.
    9. Frank A. Wolak, 2011. "Do Residential Customers Respond to Hourly Prices? Evidence from a Dynamic Pricing Experiment," American Economic Review, American Economic Association, vol. 101(3), pages 83-87, May.
    10. Christopher R. Knittel & Samuel Stolper, 2021. "Machine Learning about Treatment Effect Heterogeneity: The Case of Household Energy Use," AEA Papers and Proceedings, American Economic Association, vol. 111, pages 440-444, May.
    11. Steve Martin & Nicholas Rivers, 2018. "Information Provision, Market Incentives, and Household Electricity Consumption: Evidence from a Large-Scale Field Deployment," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 5(1), pages 207-231.
    12. Alec Brandon & John A. List & Robert D. Metcalfe & Michael K. Price & Florian Rundhammer, 2019. "Testing for crowd out in social nudges: Evidence from a natural field experiment in the market for electricity," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 116(12), pages 5293-5298, March.
    13. Gérard Biau & Erwan Scornet, 2016. "Rejoinder on: A random forest guided tour," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 25(2), pages 264-268, June.
    14. Meredith Fowlie & Catherine Wolfram & Patrick Baylis & C Anna Spurlock & Annika Todd-Blick & Peter Cappers, 2021. "Default Effects And Follow-On Behaviour: Evidence From An Electricity Pricing Program [The Impact of Presumed Consent Legislation on Cadaveric Oorgan Donation: A Cross-country Study”]," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 88(6), pages 2886-2934.
    15. Dora L. Costa & Matthew E. Kahn, 2013. "Energy Conservation “Nudges” And Environmentalist Ideology: Evidence From A Randomized Residential Electricity Field Experiment," Journal of the European Economic Association, European Economic Association, vol. 11(3), pages 680-702, June.
    16. Allcott, Hunt, 2011. "Social norms and energy conservation," Journal of Public Economics, Elsevier, vol. 95(9-10), pages 1082-1095, October.
    17. Hunt Allcott & Todd Rogers, 2014. "The Short-Run and Long-Run Effects of Behavioral Interventions: Experimental Evidence from Energy Conservation," American Economic Review, American Economic Association, vol. 104(10), pages 3003-3037, October.
    18. Gérard Biau & Erwan Scornet, 2016. "A random forest guided tour," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 25(2), pages 197-227, June.
    19. Jonathan M.V. Davis & Sara B. Heller, 2020. "Rethinking the Benefits of Youth Employment Programs: The Heterogeneous Effects of Summer Jobs," The Review of Economics and Statistics, MIT Press, vol. 102(4), pages 664-677, October.
    20. Susan Athey & Julie Tibshirani & Stefan Wager, 2016. "Generalized Random Forests," Papers 1610.01271, arXiv.org, revised Apr 2018.
    21. Severin Borenstein, 2002. "The Trouble With Electricity Markets: Understanding California's Restructuring Disaster," Journal of Economic Perspectives, American Economic Association, vol. 16(1), pages 191-211, Winter.
    22. Christopher R. Knittel & Samuel Stolper, 2019. "Using Machine Learning to Target Treatment: The Case of Household Energy Use," NBER Working Papers 26531, National Bureau of Economic Research, Inc.
    23. Azarova, Valeriya & Cohen, Jed J. & Kollmann, Andrea & Reichl, Johannes, 2020. "Reducing household electricity consumption during evening peak demand times: Evidence from a field experiment," Munich Reprints in Economics 84731, University of Munich, Department of Economics.
    24. Toshi H. Arimura & Hajime Katayama & Mari Sakudo, 2016. "Do Social Norms Matter to Energy-Saving Behavior? Endogenous Social and Correlated Effects," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 3(3), pages 525-553.
    25. Allcott, Hunt, 2011. "Social norms and energy conservation," Journal of Public Economics, Elsevier, vol. 95(9), pages 1082-1095.
    26. Hallsworth, Michael & List, John A. & Metcalfe, Robert D. & Vlaev, Ivo, 2017. "The behavioralist as tax collector: Using natural field experiments to enhance tax compliance," Journal of Public Economics, Elsevier, vol. 148(C), pages 14-31.
    27. Katrina Jessoe & David Rapson, 2014. "Knowledge Is (Less) Power: Experimental Evidence from Residential Energy Use," American Economic Review, American Economic Association, vol. 104(4), pages 1417-1438, April.
    28. Stefano Carattini & Steffen Kallbekken & Anton Orlov, 2019. "How to win public support for a global carbon tax," Nature, Nature, vol. 565(7739), pages 289-291, January.
    29. Meredith Fowlie & Catherine Wolfram & C. Anna Spurlock & Annika Todd & Patrick Baylis & Peter Cappers, 2017. "Default Effects and Follow-On Behavior: Evidence from an Electricity Pricing Program," NBER Working Papers 23553, National Bureau of Economic Research, Inc.
    30. Carter, Michael R. & Tjernström, Emilia & Toledo, Patricia, 2019. "Heterogeneous impact dynamics of a rural business development program in Nicaragua," Journal of Development Economics, Elsevier, vol. 138(C), pages 77-98.
    31. Noah J. Goldstein & Robert B. Cialdini & Vladas Griskevicius, 2008. "A Room with a Viewpoint: Using Social Norms to Motivate Environmental Conservation in Hotels," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 35(3), pages 472-482, March.
    32. repec:aen:journl:2005v26-03-a05 is not listed on IDEAS
    33. repec:aen:eeepjl:eeep5-1-ida is not listed on IDEAS
    34. Paul J. Ferraro & Juan Jose Miranda & Michael K. Price, 2011. "The Persistence of Treatment Effects with Norm-Based Policy Instruments: Evidence from a Randomized Environmental Policy Experiment," American Economic Review, American Economic Association, vol. 101(3), pages 318-322, May.
    35. Eoghan O'Neill & Melvyn Weeks, 2018. "Causal Tree Estimation of Heterogeneous Household Response to Time-Of-Use Electricity Pricing Schemes," Papers 1810.09179, arXiv.org, revised Oct 2019.
    36. Koichiro Ito & Takanori Ida & Makoto Tanaka, 2018. "Moral Suasion and Economic Incentives: Field Experimental Evidence from Energy Demand," American Economic Journal: Economic Policy, American Economic Association, vol. 10(1), pages 240-267, February.
    37. Jonathan M.V. Davis & Sara B. Heller, 2017. "Using Causal Forests to Predict Treatment Heterogeneity: An Application to Summer Jobs," American Economic Review, American Economic Association, vol. 107(5), pages 546-550, May.
    38. Ahmad Faruqui & Sanem Sergici, 2010. "Household response to dynamic pricing of electricity: a survey of 15 experiments," Journal of Regulatory Economics, Springer, vol. 38(2), pages 193-225, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Olga Takács & János Vincze, 2023. "Heterogeneous wage structure effects: a partial European East-West comparison," KRTK-KTI WORKING PAPERS 2305, Institute of Economics, Centre for Economic and Regional Studies.
    2. Kirakozian, Ankinée & Chiappini, Raphaël & Arfaoui, Nabila, 2025. "Nudging employees for greener mobility—A field experiment," Transportation Research Part A: Policy and Practice, Elsevier, vol. 199(C).
    3. Patrick Rehill & Nicholas Biddle, 2023. "Fairness Implications of Heterogeneous Treatment Effect Estimation with Machine Learning Methods in Policy-making," Papers 2309.00805, arXiv.org.
    4. Sasaki, Hiroki & Ito, Nobuhiro, 2024. "Beyond information: The power of personalized nudges in promoting vegetable purchases," Food Policy, Elsevier, vol. 128(C).
    5. Takanori Ida & Takunori Ishihara & Koichiro Ito & Daido Kido & Toru Kitagawa & Shosei Sakaguchi & Shusaku Sasaki, 2021. "Paternalism, Autonomy, or Both? Experimental Evidence from Energy Saving Programs," Papers 2112.09850, arXiv.org.
    6. repec:arx:papers:2411.16552 is not listed on IDEAS
    7. Harpenau, Franziska & Magalhaes, Katrin Marques & Steffen, Nico & Wiewiorra, Lukas, 2023. "Saving behaviors of private households under varying tariff structures, price levels and incentives - Experimental evidence," WIK Working Papers 7, WIK Wissenschaftliches Institut für Infrastruktur und Kommunikationsdienste GmbH, Bad Honnef.
    8. Mark Kattenberg & Bas Scheer & Jurre Thiel, 2023. "Causal forests with fixed effects for treatment effect heterogeneity in difference-in-differences," CPB Discussion Paper 452, CPB Netherlands Bureau for Economic Policy Analysis.
    9. Toshi H. Arimura & Elke D. Groh & Miwa Nakai & Andreas Ziegler, 2022. "The causal effect of private and organizational climate-related identity on climate protection activities: Evidence from a framed field experiment in Japan," MAGKS Papers on Economics 202229, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
    10. Omar Al-Ubaydli & Alecia W. Cassidy & Anomitro Chatterjee & Ahmed Khalifa & Michael K. Price, 2023. "The Power to Conserve: A Field Experiment on Electricity Use in Qatar," NBER Working Papers 31931, National Bureau of Economic Research, Inc.
    11. Erik O. Kimbrough & Erin L. Krupka & Rajnish Kumar & Jennifer M. Murray & Abhijit Ramalingam & Sharon Sánchez-Franco & Olga L. Sarmiento & Frank Kee & Ruth F. Hunter, 2024. "On the stability of norms and norm-following propensity: a cross-cultural panel study with adolescents," Experimental Economics, Springer;Economic Science Association, vol. 27(2), pages 351-378, April.
    12. von Zahn, Moritz & Bauer, Kevin & Mihale-Wilson, Cristina & Jagow, Johanna & Speicher, Max & Hinz, Oliver, 2022. "The smart green nudge: Reducing product returns through enriched digital footprints & causal machine learning," SAFE Working Paper Series 363, Leibniz Institute for Financial Research SAFE, revised 2022.
    13. Olga Takács & János Vincze, 2023. "Where is the pain the most acute? The market segments particularly affected by gender wage discrimination in Hungary," KRTK-KTI WORKING PAPERS 2304, Institute of Economics, Centre for Economic and Regional Studies.
    14. Alt, Marius, 2021. "Committing to behave pro-environmentally: An assessment of time and regulatee-size effects on the demand for environmental regulation," VfS Annual Conference 2021 (Virtual Conference): Climate Economics 242419, Verein für Socialpolitik / German Economic Association.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Brülisauer, Marcel & Goette, Lorenz & Jiang, Zhengyi & Schmitz, Jan & Schubert, Renate, 2020. "Appliance-specific feedback and social comparisons: Evidence from a field experiment on energy conservation," Energy Policy, Elsevier, vol. 145(C).
    2. Kirakozian, Ankinée & Chiappini, Raphaël & Arfaoui, Nabila, 2025. "Nudging employees for greener mobility—A field experiment," Transportation Research Part A: Policy and Practice, Elsevier, vol. 199(C).
    3. Jessoe, Katrina & Lade, Gabriel E. & Loge, Frank & Spang, Edward, 2021. "Residential water conservation during drought: Experimental evidence from three behavioral interventions," Journal of Environmental Economics and Management, Elsevier, vol. 110(C).
    4. repec:aen:eeepjl:eeep5-1-ida is not listed on IDEAS
    5. Raineau, Yann & Giraud-Héraud, Éric & Lecocq, Sébastien, 2025. "Social comparison nudges: What actually happens when we are told what others do?," Ecological Economics, Elsevier, vol. 228(C).
    6. Takanori Ida & Kayo Murakami & Makoto Tanaka, 2015. "Electricity demand response in Japan:Experimental evidence from a residential photovoltaic generation system," Discussion papers e-15-006, Graduate School of Economics Project Center, Kyoto University.
    7. Wu, Libo & Zhou, Yang, 2025. "Social norms and energy conservation in China," Resource and Energy Economics, Elsevier, vol. 82(C).
    8. Kandul, Serhiy & Lanz, Bruno, 2021. "Public good provision, in-group cooperation and out-group descriptive norms: A lab experiment," Journal of Economic Psychology, Elsevier, vol. 85(C).
    9. Tonke, Sebastian, 2020. "Imperfect Procedural Knowledge: Evidence from a Field Experiment to Encourage Water Conservation," VfS Annual Conference 2020 (Virtual Conference): Gender Economics 224536, Verein für Socialpolitik / German Economic Association.
    10. Brick, Kerri & De Martino, Samantha & Visser, Martine, 2023. "Behavioural nudges for water conservation in unequal settings: Experimental evidence from Cape Town," Journal of Environmental Economics and Management, Elsevier, vol. 121(C).
    11. List, John A. & Metcalfe, Robert D. & Price, Michael K. & Rundhammer, Florian, "undated". "Harnessing Policy Complementarities to Conserve Energy: Evidence from a Natural Field Experiment," 2017 Annual Meeting, July 30-August 1, Chicago, Illinois 258139, Agricultural and Applied Economics Association.
    12. Holzmeister, Felix & Huber, Jürgen & Kirchler, Michael & Schwaiger, Rene, 2022. "Nudging debtors to pay their debt: Two randomized controlled trials," Journal of Economic Behavior & Organization, Elsevier, vol. 198(C), pages 535-551.
    13. Hailey Hayeon Joo & Jungmin Lee & Sangkon Park, 2018. "Every Drop Counts: A Water Conservation Experiment With Hotel Guests," Economic Inquiry, Western Economic Association International, vol. 56(3), pages 1788-1808, July.
    14. John A. List & James J. Murphy & Michael K. Price & Alexander G. James, 2019. "Do Appeals to Donor Benefits Raise More Money than Appeals to Recipient Benefits? Evidence from a Natural Field Experiment with Pick.Click.Give," NBER Working Papers 26559, National Bureau of Economic Research, Inc.
    15. Joseph,George & Ayling,Sophie Charlotte Emi & Miquel-Florensa,Pepita & Bejarano,Hernán D. & Cardona,Alejandra Quevedo, 2021. "Behavioral Insights in Infrastructure Sectors : A Survey," Policy Research Working Paper Series 9704, The World Bank.
    16. Fang, Ximeng & Goette, Lorenz & Rockenbach, Bettina & Sutter, Matthias & Tiefenbeck, Verena & Schoeb, Samuel & Staake, Thorsten, 2023. "Complementarities in behavioral interventions: Evidence from a field experiment on resource conservation," Journal of Public Economics, Elsevier, vol. 228(C).
    17. Andor, Mark A. & Gerster, Andreas & Peters, Jörg, 2022. "Information campaigns for residential energy conservation," European Economic Review, Elsevier, vol. 144(C).
    18. Hernández, Francisco & Jaime, Marcela & Vásquez, Felipe, 2024. "Nudges versus prices: Lessons and challenges from a water-savings program," Energy Economics, Elsevier, vol. 134(C).
    19. Miller, Steve, 2020. "Causal forest estimation of heterogeneous and time-varying environmental policy effects," Journal of Environmental Economics and Management, Elsevier, vol. 103(C).
    20. Wang, Yuan & Xu, Huayu & Xu, Xiaoguang & Zhou, Yongmei, 2025. "The power of children in energy conservation: Evidence from a randomized controlled trial," Journal of Development Economics, Elsevier, vol. 174(C).
    21. Daniel Engler & Gunnar Gutsche & Amantia Simixhiu & Andreas Ziegler, 2022. "Social norms and individual climate protection activities: A framed field experiment for Germany," MAGKS Papers on Economics 202230, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • D9 - Microeconomics - - Micro-Based Behavioral Economics
    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • Q4 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kue:epaper:e-20-003. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Graduate School of Economics Project Center (email available below). General contact details of provider: https://edirc.repec.org/data/fekyojp.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.