IDEAS home Printed from https://ideas.repec.org/a/eee/enepol/v137y2020ics030142151930686x.html
   My bibliography  Save this article

The need for impact evaluation in electricity access research

Author

Listed:
  • Bayer, Patrick
  • Kennedy, Ryan
  • Yang, Joonseok
  • Urpelainen, Johannes

Abstract

Universal household electrification is a key component of the United Nations Sustainable Development Goals, but the evidence base for social and economic impacts of electricity access remains unclear. Here we report results from a systematic review of impact evaluations of household electrification based on five key outcome measures. We only find 31 studies that conduct statistical hypothesis tests to assess impacts. Among these, seven draw on a randomized experiment designed for causal inference. The randomized experimental studies generate fewer positive results than observational or quasi-experimental studies, such as correlational, instrumental variable, and difference-in-differences designs. These results call for a reassessment of what we know about the impacts of household electrification. They also call for major investment in impact evaluation of electricity access using randomized controlled trials, with a particular focus on when and how energy access interventions can furnish large benefits to their intended beneficiaries. Large-scale impact evaluations using experimental methods will require close collaboration between policymakers and researchers.

Suggested Citation

  • Bayer, Patrick & Kennedy, Ryan & Yang, Joonseok & Urpelainen, Johannes, 2020. "The need for impact evaluation in electricity access research," Energy Policy, Elsevier, vol. 137(C).
  • Handle: RePEc:eee:enepol:v:137:y:2020:i:c:s030142151930686x
    DOI: 10.1016/j.enpol.2019.111099
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S030142151930686X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.enpol.2019.111099?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Chakravorty, Ujjayant & Pelli, Martino & Ural Marchand, Beyza, 2014. "Does the quality of electricity matter? Evidence from rural India," Journal of Economic Behavior & Organization, Elsevier, vol. 107(PA), pages 228-247.
    2. Joshua D. Angrist & Jörn-Steffen Pischke, 2010. "The Credibility Revolution in Empirical Economics: How Better Research Design Is Taking the Con out of Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 3-30, Spring.
    3. Jörg Peters & Maximiliane Sievert, 2016. "Impacts of rural electrification revisited – the African context," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 8(3), pages 327-345, July.
    4. Peters, Jörg & Vance, Colin & Harsdorff, Marek, 2011. "Grid Extension in Rural Benin: Micro-Manufacturers and the Electrification Trap," World Development, Elsevier, vol. 39(5), pages 773-783, May.
    5. Bensch, Gunther & Peters, Jörg & Schmidt, Christoph M., 2012. "Impact evaluation of productive use—An implementation guideline for electrification projects," Energy Policy, Elsevier, vol. 40(C), pages 186-195.
    6. Rud, Juan Pablo, 2012. "Electricity provision and industrial development: Evidence from India," Journal of Development Economics, Elsevier, vol. 97(2), pages 352-367.
    7. Taryn Dinkelman, 2011. "The Effects of Rural Electrification on Employment: New Evidence from South Africa," American Economic Review, American Economic Association, vol. 101(7), pages 3078-3108, December.
    8. Michael Grimm & Robert Sparrow & Luca Tasciotti, 2015. "Does Electrification Spur the Fertility Transition? Evidence From Indonesia," Demography, Springer;Population Association of America (PAA), vol. 52(5), pages 1773-1796, October.
    9. Lenz, Luciane & Munyehirwe, Anicet & Peters, Jörg & Sievert, Maximiliane, 2017. "Does Large-Scale Infrastructure Investment Alleviate Poverty? Impacts of Rwanda’s Electricity Access Roll-Out Program," World Development, Elsevier, vol. 89(C), pages 88-110.
    10. Molly Lipscomb & A. Mushfiq Mobarak & Tania Barham, 2013. "Development Effects of Electrification: Evidence from the Topographic Placement of Hydropower Plants in Brazil," American Economic Journal: Applied Economics, American Economic Association, vol. 5(2), pages 200-231, April.
    11. Jörg Peters & Jörg Langbein & Gareth Roberts, 2018. "Generalization in the Tropics – Development Policy, Randomized Controlled Trials, and External Validity," The World Bank Research Observer, World Bank, vol. 33(1), pages 34-64.
    12. Dominique van de Walle & Martin Ravallion & Vibhuti Mendiratta & Gayatri Koolwal, 2017. "Long-term Gains from Electrification in Rural India," The World Bank Economic Review, World Bank, vol. 31(2), pages 385-411.
    13. Deaton, Angus & Cartwright, Nancy, 2018. "Understanding and misunderstanding randomized controlled trials," Social Science & Medicine, Elsevier, vol. 210(C), pages 2-21.
    14. Lambert, Jessica G. & Hall, Charles A.S. & Balogh, Stephen & Gupta, Ajay & Arnold, Michelle, 2014. "Energy, EROI and quality of life," Energy Policy, Elsevier, vol. 64(C), pages 153-167.
    15. Shahidur R. Khandker & Hussain A. Samad & Zubair K.M. Sadeque & Mohammed Asaduzzaman & Mohammad Yunus & A.K. Enamul Haque, 2014. "Surge in Solar-Powered Homes : Experience in Off-Grid Rural Bangladesh," World Bank Publications - Books, The World Bank Group, number 20427, December.
    16. Peters, Jörg & Sievert, Maximiliane & Toman, Michael A., 2019. "Rural electrification through mini-grids: Challenges ahead," Energy Policy, Elsevier, vol. 132(C), pages 27-31.
    17. Kanagawa, Makoto & Nakata, Toshihiko, 2008. "Assessment of access to electricity and the socio-economic impacts in rural areas of developing countries," Energy Policy, Elsevier, vol. 36(6), pages 2016-2029, June.
    18. Louise Grogan, 2016. "Household Electrification, Fertility, and Employment: Evidence from Hydroelectric Dam Construction in Colombia," Journal of Human Capital, University of Chicago Press, vol. 10(1), pages 109-158.
    19. Tasciotti, Luca, 2017. "Use of electricity and malaria occurrence: Is there a link? The case of Malawi," Energy Policy, Elsevier, vol. 101(C), pages 310-316.
    20. Yuya Kudo & Abu S Shonchoy & Kazushi Takahashi, 2019. "Can Solar Lanterns Improve Youth Academic Performance? Experimental Evidence from Bangladesh," The World Bank Economic Review, World Bank, vol. 33(2), pages 436-460.
    21. Shahidur R. Khandker, Douglas F. Barnes, and Hussain A. Samad, 2012. "The Welfare Impacts of Rural Electrification in Bangladesh," The Energy Journal, International Association for Energy Economics, vol. 0(Number 1).
    22. Shahidur R. Khandker & Douglas F. Barnes & Hussain A. Samad, 2013. "Welfare Impacts of Rural Electrification: A Panel Data Analysis from Vietnam," Economic Development and Cultural Change, University of Chicago Press, vol. 61(3), pages 659-692.
    23. Rao, Narasimha D., 2013. "Does (better) electricity supply increase household enterprise income in India?," Energy Policy, Elsevier, vol. 57(C), pages 532-541.
    24. Lant Pritchett & Justin Sandefur, 2015. "Learning from Experiments When Context Matters," American Economic Review, American Economic Association, vol. 105(5), pages 471-475, May.
    25. Kristine Bos & Duncan Chaplin & Arif Mamun, "undated". "Benefits and Challenges of Expanding Grid Electricity in Africa: A Review of Rigorous Evidence on Household Impacts in Developing Countries," Mathematica Policy Research Reports 4df837297b3a490e922d53edf, Mathematica Policy Research.
    26. repec:oup:wbrobs:v:27:y:2010:i:1:p:33-51 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Abiodun, Kehinde & Gilbert, Ben, 2022. "Does universal electrification shield firms from productivity loss?," World Development Perspectives, Elsevier, vol. 28(C).
    2. Suryadeepto Nag & David I. Stern, 2023. "Are the benefits of electrification realized only in the long run? Evidence from rural India," Departmental Working Papers 2023-08, The Australian National University, Arndt-Corden Department of Economics.
    3. Bhattacharyya, S.C. & Palit, D., 2021. "A critical review of literature on the nexus between central grid and off-grid solutions for expanding access to electricity in Sub-Saharan Africa and South Asia," Renewable and Sustainable Energy Reviews, Elsevier, vol. 141(C).
    4. Pelz, Setu & Aklin, Michaël & Urpelainen, Johannes, 2021. "Electrification and productive use among micro- and small-enterprises in rural North India," Energy Policy, Elsevier, vol. 156(C).
    5. Adom, Philip Kofi & Nsabimana, Aimable, 2022. "Rural access to electricity and welfare outcomes in Rwanda: Addressing issues of transitional heterogeneities and between and within gender disparities," Resource and Energy Economics, Elsevier, vol. 70(C).
    6. Thomas, Daniel Robert & Harish, S.P. & Kennedy, Ryan & Urpelainen, Johannes, 2020. "The effects of rural electrification in India: An instrumental variable approach at the household level," Journal of Development Economics, Elsevier, vol. 146(C).
    7. Bensch, Gunther & Gotz, Gunnar & Peters, Jörg, 2020. "Effects of rural electrification on employment: A comment on Dinkelman (2011)," Ruhr Economic Papers 840, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    8. Jeuland, Marc & Fetter, T. Robert & Li, Yating & Pattanayak, Subhrendu K. & Usmani, Faraz & Bluffstone, Randall A. & Chávez, Carlos & Girardeau, Hannah & Hassen, Sied & Jagger, Pamela & Jaime, Mónica , 2021. "Is energy the golden thread? A systematic review of the impacts of modern and traditional energy use in low- and middle-income countries," Renewable and Sustainable Energy Reviews, Elsevier, vol. 135(C).
    9. Ankel-Peters, Jörg & Schmidt, Christoph M., 2023. "Rural electrification, the credibility revolution, and the limits of evidence-based policy," Ruhr Economic Papers 1051, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    10. Miranda, Rodolfo Farías & Salgado-Herrera, Nadia Maria & Rodríguez-Hernández, Osvaldo & Rodríguez-Rodríguez, Juan Ramon & Robles, Miguel & Ruiz-Robles, Dante & Venegas-Rebollar, Vicente, 2022. "Distributed generation in low-voltage DC systems by wind energy in the Baja California Peninsula, Mexico," Energy, Elsevier, vol. 242(C).
    11. Enrico Nano, 2022. "Electrifying Nigeria: the Impact of Rural Access to Electricity on Kids' Schooling," IHEID Working Papers 03-2022, Economics Section, The Graduate Institute of International Studies.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Enrico Nano, 2022. "Electrifying Nigeria: the Impact of Rural Access to Electricity on Kids' Schooling," IHEID Working Papers 03-2022, Economics Section, The Graduate Institute of International Studies.
    2. Gupta, Ridhima & Pelli, Martino, 2021. "Electrification and cooking fuel choice in rural India," World Development, Elsevier, vol. 146(C).
    3. Meriggi, Niccolò F. & Bulte, Erwin & Mobarak, Ahmed Mushfiq, 2021. "Subsidies for technology adoption: Experimental evidence from rural Cameroon," Journal of Development Economics, Elsevier, vol. 153(C).
    4. Michael Grimm & Luciane Lenz & Jörg Peters & Maximiliane Sievert, 2020. "Demand for Off-Grid Solar Electricity: Experimental Evidence from Rwanda," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 7(3), pages 417-454.
    5. Simone Tagliapietra & Giovanni Occhiali & Enrico Nano & Robert Kalcik, 2020. "The impact of electrification on labour market outcomes in Nigeria," Economia Politica: Journal of Analytical and Institutional Economics, Springer;Fondazione Edison, vol. 37(3), pages 737-779, October.
    6. Wagner, Natascha & Rieger, Matthias & Bedi, Arjun S. & Vermeulen, Jurgen & Demena, Binyam Afewerk, 2021. "The impact of off-grid solar home systems in Kenya on energy consumption and expenditures," Energy Economics, Elsevier, vol. 99(C).
    7. Obsa Urgessa Ayana & Jima Degaga, 2022. "Effects of rural electrification on household welfare: a meta-regression analysis," International Review of Economics, Springer;Happiness Economics and Interpersonal Relations (HEIRS), vol. 69(2), pages 209-261, June.
    8. Bensch, Gunther & Gotz, Gunnar & Peters, Jörg, 2020. "Effects of rural electrification on employment: A comment on Dinkelman (2011)," Ruhr Economic Papers 840, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    9. Fujii, Tomoki & Shonchoy, Abu S., 2020. "Fertility and rural electrification in Bangladesh," Journal of Development Economics, Elsevier, vol. 143(C).
    10. Pradhan Shrestha, Rosy & Jirakiattikul, Sopin & Lohani, Sunil Prasad & Shrestha, Mandip, 2023. "Perceived impact of electricity on productive end use and its reality: Transition from electricity to income for rural Nepalese women," Energy Policy, Elsevier, vol. 183(C).
    11. Richard S. J. Tol, 2023. "Navigating the energy trilemma during geopolitical and environmental crises," Papers 2301.07671, arXiv.org.
    12. Santosh Kumar & Ganesh Rauniyar, 2018. "The impact of rural electrification on income and education: Evidence from Bhutan," Review of Development Economics, Wiley Blackwell, vol. 22(3), pages 1146-1165, August.
    13. Richmond, Jennifer & Urpelainen, Johannes, 2019. "Electrification and appliance ownership over time: Evidence from rural India," Energy Policy, Elsevier, vol. 133(C).
    14. Pelz, Setu & Aklin, Michaël & Urpelainen, Johannes, 2021. "Electrification and productive use among micro- and small-enterprises in rural North India," Energy Policy, Elsevier, vol. 156(C).
    15. World Bank Group, "undated". "Africa's Pulse, No. 17, April 2018," World Bank Publications - Reports 29667, The World Bank Group.
    16. Ankel-Peters, Jörg & Schmidt, Christoph M., 2023. "Rural electrification, the credibility revolution, and the limits of evidence-based policy," Ruhr Economic Papers 1051, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    17. Peters, Jörg & Sievert, Maximiliane & Toman, Michael A., 2019. "Rural electrification through mini-grids: Challenges ahead," Energy Policy, Elsevier, vol. 132(C), pages 27-31.
    18. Lenz, Luciane & Munyehirwe, Anicet & Peters, Jörg & Sievert, Maximiliane, 2017. "Does Large-Scale Infrastructure Investment Alleviate Poverty? Impacts of Rwanda’s Electricity Access Roll-Out Program," World Development, Elsevier, vol. 89(C), pages 88-110.
    19. Litzow, Erin L. & Pattanayak, Subhrendu K. & Thinley, Tshering, 2019. "Returns to rural electrification: Evidence from Bhutan," World Development, Elsevier, vol. 121(C), pages 75-96.
    20. Michael Grimm & Anicet Munyehirwe & Jörg Peters & Maximiliane Sievert, 2017. "A First Step up the Energy Ladder? Low Cost Solar Kits and Household’s Welfare in Rural Rwanda," The World Bank Economic Review, World Bank, vol. 31(3), pages 631-649.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:enepol:v:137:y:2020:i:c:s030142151930686x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/enpol .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.