IDEAS home Printed from https://ideas.repec.org/p/zbw/zewdip/5415.html
   My bibliography  Save this paper

Evaluating environmental programs: the perspective of modern evaluation research

Author

Listed:
  • Frondel, Manuel
  • Schmidt, Christoph M.

Abstract

Large-scale environmental programs generally commit substantial societal resources, making the evaluation of their actual effects on the relevant outcomes imperative. As the example of the subsidization of energy-saving appliances illustrates, much of the applied environmental economics literature has yet to confront the problem of proper attribution of effects to underlying causes on a convincing methodological basis. This paper argues that recent results in the econometrics and statistics literature on program evaluation could be utilized to advance considerably in this context. In particular, the construction of a credible counterfactual situation is at the heart of the formal statistical evaluation problem. Even when controlled experiments are not a viable option, appropriate approaches might succeed where traditional empirical strategies fail to uncover the effects of environmental interventions.

Suggested Citation

  • Frondel, Manuel & Schmidt, Christoph M., 2001. "Evaluating environmental programs: the perspective of modern evaluation research," ZEW Discussion Papers 01-59, ZEW - Leibniz Centre for European Economic Research.
  • Handle: RePEc:zbw:zewdip:5415
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/24480/1/dp0159.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. J. Daniel Khazzoom, 1987. "Energy Saving Resulting from the Adoption of More Efficient Appliances," The Energy Journal, International Association for Energy Economics, vol. 0(Number 4), pages 85-89.
    2. Amory B. Lovins, 1988. "Energy Saving from the Adoption of More Efficient Appliances: Another View," The Energy Journal, International Association for Energy Economics, vol. 0(Number 2), pages 155-170.
    3. Angrist, Joshua D. & Krueger, Alan B., 1999. "Empirical strategies in labor economics," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 23, pages 1277-1366, Elsevier.
    4. Joseph Eto & Suzie Kito & Leslie Shown & Richard Sonnenblick, 2000. "Where Did the Money Go? The Cost and Performance of the Largest Commercial Sector DSM Programs," The Energy Journal, International Association for Energy Economics, vol. 0(Number 2), pages 23-49.
    5. Schmidt, Christoph M., 1999. "Knowing What Works: The Case for Rigorous Program Evaluation," IZA Discussion Papers 77, Institute of Labor Economics (IZA).
    6. Franz Wirl, 2000. "Lessons from Utility Conservation Programs," The Energy Journal, International Association for Energy Economics, vol. 0(Number 1), pages 87-108.
    7. David S. Loughran and Jonathan Kulick, 2004. "Demand-Side Management and Energy Efficiency in the United States," The Energy Journal, International Association for Energy Economics, vol. 0(Number 1), pages 19-44.
    8. Heckman, James J. & Lalonde, Robert J. & Smith, Jeffrey A., 1999. "The economics and econometrics of active labor market programs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 31, pages 1865-2097, Elsevier.
    9. Paul L. Joskow & Donald B. Marron, 1992. "What Does a Negawatt Really Cost? Evidence from Utility Conservation Programs," The Energy Journal, International Association for Energy Economics, vol. 0(Number 4), pages 41-74.
    10. Joseph Eto & Edward Vine & Leslie Shown & Richard Sonnenblick & Chris Payne, 1996. "The Total Cost and Measured Performance of Utility-Sponsored Energy Efficiency Programs," The Energy Journal, International Association for Energy Economics, vol. 0(Number 1), pages 31-51.
    11. Robert Bartels & Denzil G. Fiebig, 2000. "Residential End-Use Electricity Demand: Results from a Designed Experiment," The Energy Journal, International Association for Energy Economics, vol. 0(Number 2), pages 51-81.
    12. Binswanger, Mathias, 2001. "Technological progress and sustainable development: what about the rebound effect?," Ecological Economics, Elsevier, vol. 36(1), pages 119-132, January.
    13. J. Daniel Khazzoom, 1980. "Economic Implications of Mandated Efficiency in Standards for Household Appliances," The Energy Journal, International Association for Energy Economics, vol. 0(Number 4), pages 21-40.
    14. J. Daniel Khazzoom, 1989. "Energy Savings from More Efficient Appliances: A Rejoinder," The Energy Journal, International Association for Energy Economics, vol. 0(Number 1), pages 157-166.
    15. Joskow, P.L. & Marron, D.B., 1991. "What does a Negawatt Really Cost?," Working papers 596, Massachusetts Institute of Technology (MIT), Department of Economics.
    16. Heckman, James J, 1996. "Randomization as an Instrumental Variable: Notes," The Review of Economics and Statistics, MIT Press, vol. 78(2), pages 336-341, May.
    17. Marvin J. Horowitz, 2001. "Economic Indicators of Market Transformation: Energy Efficient Lighting and EPA's Green Lights," The Energy Journal, International Association for Energy Economics, vol. 0(Number 4), pages 95-122.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Freire-González, Jaume, 2017. "Evidence of direct and indirect rebound effect in households in EU-27 countries," Energy Policy, Elsevier, vol. 102(C), pages 270-276.
    2. Freire-González, Jaume, 2017. "A new way to estimate the direct and indirect rebound effect and other rebound indicators," Energy, Elsevier, vol. 128(C), pages 394-402.
    3. Alcott, Blake, 2005. "Jevons' paradox," Ecological Economics, Elsevier, vol. 54(1), pages 9-21, July.
    4. Jarke-Neuert, Johannes & Perino, Grischa, 2020. "Energy efficiency promotion backfires under cap-and-trade," Resource and Energy Economics, Elsevier, vol. 62(C).
    5. David Font Vivanco & Jaume Freire‐González & Ray Galvin & Tilman Santarius & Hans Jakob Walnum & Tamar Makov & Serenella Sala, 2022. "Rebound effect and sustainability science: A review," Journal of Industrial Ecology, Yale University, vol. 26(4), pages 1543-1563, August.
    6. Michael Huesemann & Joyce Huesemann, 2008. "Will progress in science and technology avert or accelerate global collapse? A critical analysis and policy recommendations," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 10(6), pages 787-825, December.
    7. Gillingham, Kenneth & Newell, Richard G. & Palmer, Karen L., 2004. "Retrospective Examination of Demand-Side Energy Efficiency Policies," Discussion Papers 10477, Resources for the Future.
    8. Stela Rubínová, 2011. "Reakce poptávky domácností po energii na zvyšování energetické účinnosti: teorie a její důsledky pro konstrukci empiricky ověřitelných modelů [Reaction of Household Energy Demand to Improvements in," Politická ekonomie, Prague University of Economics and Business, vol. 2011(3), pages 359-378.
    9. Toshi H. Arimura, Shanjun Li, Richard G. Newell, and Karen Palmer, 2012. "Cost-Effectiveness of Electricity Energy Efficiency Programs," The Energy Journal, International Association for Energy Economics, vol. 0(Number 2).
    10. Figge, Frank & Thorpe, Andrea Stevenson, 2019. "The symbiotic rebound effect in the circular economy," Ecological Economics, Elsevier, vol. 163(C), pages 61-69.
    11. Boogen, Nina & Datta, Souvik & Filippini, Massimo, 2017. "Demand-side management by electric utilities in Switzerland: Analyzing its impact on residential electricity demand," Energy Economics, Elsevier, vol. 64(C), pages 402-414.
    12. Santarius, Tilman & Soland, Martin, 2018. "How Technological Efficiency Improvements Change Consumer Preferences: Towards a Psychological Theory of Rebound Effects," Ecological Economics, Elsevier, vol. 146(C), pages 414-424.
    13. Tugba Somuncu & Christopher Hannum, 2018. "The Rebound Effect of Energy Efficiency Policy in the Presence of Energy Theft," Energies, MDPI, vol. 11(12), pages 1-28, December.
    14. Dulleck, Uwe & Kaufmann, Sylvia, 2004. "Do customer information programs reduce household electricity demand?--the Irish program," Energy Policy, Elsevier, vol. 32(8), pages 1025-1032, June.
    15. STEPHEN J. DeCANIO, 1997. "Economic Modeling And The False Tradeoff Between Environmental Protection And Economic Growth," Contemporary Economic Policy, Western Economic Association International, vol. 15(4), pages 10-27, October.
    16. Saunders, Harry D., 2014. "Toward a neoclassical theory of sustainable consumption: Eight golden age propositions," Ecological Economics, Elsevier, vol. 105(C), pages 220-232.
    17. Jeffrey B. Dahmus, 2014. "Can Efficiency Improvements Reduce Resource Consumption?," Journal of Industrial Ecology, Yale University, vol. 18(6), pages 883-897, December.
    18. Binswanger, Mathias, 2001. "Technological progress and sustainable development: what about the rebound effect?," Ecological Economics, Elsevier, vol. 36(1), pages 119-132, January.
    19. Grepperud, Sverre & Rasmussen, Ingeborg, 2004. "A general equilibrium assessment of rebound effects," Energy Economics, Elsevier, vol. 26(2), pages 261-282, March.
    20. Shiljkut, Vladimir M. & Rajakovic, Nikola Lj., 2015. "Demand response capacity estimation in various supply areas," Energy, Elsevier, vol. 92(P3), pages 476-486.

    More about this item

    Keywords

    Environmental policy; energy-conservation programs; experiments; observational studies; counterfactual;
    All these keywords.

    JEL classification:

    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General
    • C40 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - General
    • H43 - Public Economics - - Publicly Provided Goods - - - Project Evaluation; Social Discount Rate

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:zewdip:5415. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/zemande.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.