IDEAS home Printed from https://ideas.repec.org/p/mlb/wpaper/1180.html
   My bibliography  Save this paper

Tell Me Something I Don’t Already Know:Informedness and External Validity in Information Programs

Author

Listed:
  • David P. Byrne
  • Andrea La Nauze
  • Leslie A.Martin

Abstract

Information programs that leverage peer comparisons are used to encourage pro-social behavior in many contexts. We document how imperfect information generates heterogenous responses to treatments involving personalized feedback and peer comparisons. In our field experiment in retail electricity, we find that most households either overestimate or underestimate their relative energy consumption pre-treatment. Households that overestimated respond to new information by temporarily increasing electricity consumption, whereas households that underestimated take steps that lead to long term energy conservation. We explore the implications of these results for the external validity and design of information programs.

Suggested Citation

  • David P. Byrne & Andrea La Nauze & Leslie A.Martin, 2014. "Tell Me Something I Don’t Already Know:Informedness and External Validity in Information Programs," Department of Economics - Working Papers Series 1180, The University of Melbourne.
  • Handle: RePEc:mlb:wpaper:1180
    as

    Download full text from publisher

    File URL: http://fbe.unimelb.edu.au/__data/assets/pdf_file/0007/1034584/David_Byrne_Tell_me_something_I_dont_already_know.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ferraro, Paul J. & Miranda, Juan José, 2013. "Heterogeneous treatment effects and mechanisms in information-based environmental policies: Evidence from a large-scale field experiment," Resource and Energy Economics, Elsevier, vol. 35(3), pages 356-379.
    2. Yan Chen & F. Maxwell Harper & Joseph Konstan & Sherry Xin Li, 2010. "Social Comparisons and Contributions to Online Communities: A Field Experiment on MovieLens," American Economic Review, American Economic Association, vol. 100(4), pages 1358-1398, September.
    3. John Beshears & James J. Choi & David Laibson & Brigitte C. Madrian & Katherine L. Milkman, 2015. "The Effect of Providing Peer Information on Retirement Savings Decisions," Journal of Finance, American Finance Association, vol. 70(3), pages 1161-1201, June.
    4. Esther Duflo & Emmanuel Saez, 2003. "The Role of Information and Social Interactions in Retirement Plan Decisions: Evidence from a Randomized Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(3), pages 815-842.
    5. Dora L. Costa & Matthew E. Kahn, 2013. "Energy Conservation “Nudges” And Environmentalist Ideology: Evidence From A Randomized Residential Electricity Field Experiment," Journal of the European Economic Association, European Economic Association, vol. 11(3), pages 680-702, June.
    6. Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2008. "Using Randomization in Development Economics Research: A Toolkit," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 61, pages 3895-3962, Elsevier.
    7. Katrina Jessoe & David Rapson, 2014. "Knowledge Is (Less) Power: Experimental Evidence from Residential Energy Use," American Economic Review, American Economic Association, vol. 104(4), pages 1417-1438, April.
    8. Bryan Bollinger & Phillip Leslie & Alan Sorensen, 2011. "Calorie Posting in Chain Restaurants," American Economic Journal: Economic Policy, American Economic Association, vol. 3(1), pages 91-128, February.
    9. Pascaline Dupas, 2011. "Do Teenagers Respond to HIV Risk Information? Evidence from a Field Experiment in Kenya," American Economic Journal: Applied Economics, American Economic Association, vol. 3(1), pages 1-34, January.
    10. Paul J. Ferraro & Michael K. Price, 2013. "Using Nonpecuniary Strategies to Influence Behavior: Evidence from a Large-Scale Field Experiment," The Review of Economics and Statistics, MIT Press, vol. 95(1), pages 64-73, March.
    11. Jalan, Jyotsna & Somanathan, E., 2008. "The importance of being informed: Experimental evidence on demand for environmental quality," Journal of Development Economics, Elsevier, vol. 87(1), pages 14-28, August.
    12. Hunt Allcott & Todd Rogers, 2012. "The Short-Run and Long-Run Effects of Behavioral Interventions: Experimental Evidence from Energy Conservation," NBER Working Papers 18492, National Bureau of Economic Research, Inc.
    13. Mesnard, Alice & Vera-Hernández, Marcos & Fitzsimons, Emla & Malde, Bansi, 2012. "Household Responses to Information on Child Nutrition: Experimental Evidence from Malawi," CEPR Discussion Papers 8915, C.E.P.R. Discussion Papers.
    14. Delmas, Magali A. & Fischlein, Miriam & Asensio, Omar I., 2013. "Information strategies and energy conservation behavior: A meta-analysis of experimental studies from 1975 to 2012," Energy Policy, Elsevier, vol. 61(C), pages 729-739.
    15. James J. Heckman & Jeffrey A. Smith, 1999. "The Pre-Program Earnings Dip and the Determinants of Participation in a Social Program: Implications for Simple Program Evaluation Strategies," NBER Working Papers 6983, National Bureau of Economic Research, Inc.
    16. Steven D. Levitt & John A. List, 2007. "What Do Laboratory Experiments Measuring Social Preferences Reveal About the Real World?," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 153-174, Spring.
    17. Heckman, James J & Smith, Jeffrey A, 1999. "The Pre-programme Earnings Dip and the Determinants of Participation in a Social Programme. Implications for Simple Programme Evaluation Strategies," Economic Journal, Royal Economic Society, vol. 109(457), pages 313-348, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mekonnen, Alemu & Hassen, Sied & Jaime, Marcela & Toman, Michael & Zhang, Xiao-Bing, 2023. "The effect of information and subsidy on adoption of solar lanterns: An application of the BDM bidding mechanism in rural Ethiopia," Energy Economics, Elsevier, vol. 124(C).
    2. Tabellini, Guido & d'Adda, Giovanna & Dufwenberg, Martin & Passarelli, Francesco, 2019. "Partial Norms," CEPR Discussion Papers 13593, C.E.P.R. Discussion Papers.
      • Giovanna d’Adda & Martin Dufwenberg & Francesco Passarelli & Guido Tabellini, 2019. "Partial Norms," Working Papers 643, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
      • Giovanna D'Adda & Martin Dufwenberg & Francesco Passarelli & Guido Tabellini, 2019. "Partial Norms," CESifo Working Paper Series 7568, CESifo.
    3. Lei, Xiaoyan & Song, Guangxiang & Su, Xuejuan, 2021. "Information, Belief, and Health Behavior: Evidence from China," Working Papers 2021-9, University of Alberta, Department of Economics.
    4. Christopher R. Knittel & Samuel Stolper, 2019. "Using Machine Learning to Target Treatment: The Case of Household Energy Use," NBER Working Papers 26531, National Bureau of Economic Research, Inc.
    5. Yichong Zhang & Xin Zheng, 2020. "Quantile treatment effects and bootstrap inference under covariate‐adaptive randomization," Quantitative Economics, Econometric Society, vol. 11(3), pages 957-982, July.
    6. Andor, Mark A. & Gerster, Andreas & Peters, Jörg, 2022. "Information campaigns for residential energy conservation," European Economic Review, Elsevier, vol. 144(C).
    7. Andrea La Nauze, 2023. "Motivation Crowding in Peer Effects: The Effect of Solar Subsidies on Green Power Purchases," The Review of Economics and Statistics, MIT Press, vol. 105(6), pages 1465-1480, November.
    8. Ek, Claes & Söderberg, Magnus, 2021. "Norm-based feedback on household waste: Large-scale field experiments in two Swedish municipalities," Working Papers in Economics 804, University of Gothenburg, Department of Economics.
    9. Wichman, Casey J., 2017. "Information provision and consumer behavior: A natural experiment in billing frequency," Journal of Public Economics, Elsevier, vol. 152(C), pages 13-33.
    10. Brade, Raphael, 2021. "Social Information and Educational Investment – Nudging Remedial Math Course Participation," VfS Annual Conference 2021 (Virtual Conference): Climate Economics 242393, Verein für Socialpolitik / German Economic Association.
    11. Stojanovski, Ognen & Leslie, Gordon W. & Wolak, Frank A. & Huerta Wong, Juan Enrique & Thurber, Mark C., 2020. "Increasing the energy cognizance of electricity consumers in Mexico: Results from a field experiment," Journal of Environmental Economics and Management, Elsevier, vol. 102(C).
    12. Maya Papineau & Nicholas Rivers, "undated". "Visualizing Energy Efficiency: A Picture is Worth More Than 1,022 Words," Carleton Economic Papers 19-10, Carleton University, Department of Economics.
    13. Nicolas Astier, 2016. "Comparative Feedbacks under Incomplete Information," Working Papers hal-01465189, HAL.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Paul Dolan & Robert Metcalfe, 2013. "Neighbors, Knowledge, and Nuggets: Two Natural Field Experiments on the Role of Incentives on Energy Conservation," Natural Field Experiments 00404, The Field Experiments Website.
    2. Jessoe, Katrina & Lade, Gabriel E. & Loge, Frank & Spang, Edward, 2021. "Residential water conservation during drought: Experimental evidence from three behavioral interventions," Journal of Environmental Economics and Management, Elsevier, vol. 110(C).
    3. Cattaneo, Cristina & D’Adda, Giovanna & Tavoni, Massimo & Bonan, Jacopo, 2019. "Can We Make Social Information Programs More Effective? The Role of Identity and Values," RFF Working Paper Series 19-21, Resources for the Future.
    4. Andrea Szabo & Gergely Ujhelyi, 2014. "Can Information Reduce Nonpayment for Public Utilities? Experimental Evidence from South Africa," Working Papers 2014-114-31, Department of Economics, University of Houston.
    5. Holladay, Scott & LaRiviere, Jacob & Novgorodsky, David & Price, Michael, 2019. "Prices versus nudges: What matters for search versus purchase of energy investments?," Journal of Public Economics, Elsevier, vol. 172(C), pages 151-173.
    6. Szabó, Andrea & Ujhelyi, Gergely, 2015. "Reducing nonpayment for public utilities: Experimental evidence from South Africa," Journal of Development Economics, Elsevier, vol. 117(C), pages 20-31.
    7. Delmas, Magali A. & Lessem, Neil, 2014. "Saving power to conserve your reputation? The effectiveness of private versus public information," Journal of Environmental Economics and Management, Elsevier, vol. 67(3), pages 353-370.
    8. John A. List & Michael K. Price, 2016. "Editor's Choice The Use of Field Experiments in Environmental and Resource Economics," Review of Environmental Economics and Policy, Association of Environmental and Resource Economists, vol. 10(2), pages 206-225.
    9. Tonke, Sebastian, 2020. "Imperfect Procedural Knowledge: Evidence from a Field Experiment to Encourage Water Conservation," VfS Annual Conference 2020 (Virtual Conference): Gender Economics 224536, Verein für Socialpolitik / German Economic Association.
    10. John A. List & James J. Murphy & Michael K. Price & Alexander G. James, 2019. "Do Appeals to Donor Benefits Raise More Money than Appeals to Recipient Benefits? Evidence from a Natural Field Experiment with Pick.Click.Give," NBER Working Papers 26559, National Bureau of Economic Research, Inc.
    11. Brent, Daniel A. & Friesen, Lana & Gangadharan, Lata & Leibbrandt, Andreas, 2017. "Behavioral Insights from Field Experiments in Environmental Economics," International Review of Environmental and Resource Economics, now publishers, vol. 10(2), pages 95-143, May.
    12. Gillingham, Kenneth & Tsvetanov, Tsvetan, 2018. "Nudging energy efficiency audits: Evidence from a field experiment," Journal of Environmental Economics and Management, Elsevier, vol. 90(C), pages 303-316.
    13. José A. Pellerano & Michael K. Price & Steven L. Puller & Gonzalo E. Sánchez, 2017. "Do Extrinsic Incentives Undermine Social Norms? Evidence from a Field Experiment in Energy Conservation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 67(3), pages 413-428, July.
    14. Jaime Torres, Mónica Marcela & Carlsson, Fredrik, 2016. "Social Norms and Information Diffusion in Water-saving Programs: Evidence from a Randomized Field Experiment in Colombia," Working Papers in Economics 652, University of Gothenburg, Department of Economics.
    15. Bonan, Jacopo & Cattaneo, Cristina & d’Adda, Giovanna & Tavoni, Massimo, 2021. "Can social information programs be more effective? The role of environmental identity for energy conservation," Journal of Environmental Economics and Management, Elsevier, vol. 108(C).
    16. Hailey Hayeon Joo & Jungmin Lee & Sangkon Park, 2018. "Every Drop Counts: A Water Conservation Experiment With Hotel Guests," Economic Inquiry, Western Economic Association International, vol. 56(3), pages 1788-1808, July.
    17. Brown, Joe & Hamoudi, Amar & Jeuland, Marc & Turrini, Gina, 2017. "Seeing, believing, and behaving: Heterogeneous effects of an information intervention on household water treatment," Journal of Environmental Economics and Management, Elsevier, vol. 86(C), pages 141-159.
    18. Bonan, Jacopo & Battiston, Pietro & Bleck, Jaimie & LeMay-Boucher, Philippe & Pareglio, Stefano & Sarr, Bassirou & Tavoni, Massimo, 2021. "Social interaction and technology adoption: Experimental evidence from improved cookstoves in Mali," World Development, Elsevier, vol. 144(C).
    19. Peters, Jörg & Langbein, Jörg & Roberts, Gareth, 2016. "Policy evaluation, randomized controlled trials, and external validity—A systematic review," Economics Letters, Elsevier, vol. 147(C), pages 51-54.
    20. Daniel A. Brent & Corey Lott & Michael Taylor & Joseph Cook & Kimberly Rollins & Shawn Stoddard, 2020. "What Causes Heterogeneous Responses to Social Comparison Messages for Water Conservation?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 77(3), pages 503-537, November.

    More about this item

    JEL classification:

    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • D12 - Microeconomics - - Household Behavior - - - Consumer Economics: Empirical Analysis
    • D84 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Expectations; Speculations
    • L94 - Industrial Organization - - Industry Studies: Transportation and Utilities - - - Electric Utilities
    • Q41 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy - - - Demand and Supply; Prices

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:mlb:wpaper:1180. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Dandapani Lokanathan (email available below). General contact details of provider: https://edirc.repec.org/data/demelau.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.