IDEAS home Printed from https://ideas.repec.org/p/zbw/rwirep/287767.html
   My bibliography  Save this paper

Using framed field experiments to evaluate real-world policy interventions: A case study on changing environmental preferences

Author

Listed:
  • Reitmann, Ann-Kristin
  • Sievert, Maximiliane

Abstract

Many policy interventions in the environmental sector aim at changing environmental preferences, because these provide the basis for adopting environmental conservation behavior or technologies. To evaluate these changes, standard measurement tools in survey-based impact evaluations have their limitations. We discuss the potential of framed field experiments as an alternative to attain unbiased outcome measures, and present a case study from an impact evaluation in the Colombian coffee sector. While clear advantages exist, we show that indicators from framed field experiments require substantial sample sizes to provide well-powered results. Moreover, preference indicators are highly context specific, which calls for an elaborated framing to attain the intended kind of preferences.

Suggested Citation

  • Reitmann, Ann-Kristin & Sievert, Maximiliane, 2024. "Using framed field experiments to evaluate real-world policy interventions: A case study on changing environmental preferences," Ruhr Economic Papers 1072, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    • Handle: RePEc:zbw:rwirep:287767
    DOI: 10.4419/96973244
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/287767/1/1884511856.pdf
    Download Restriction: no
    File URL: https://libkey.io/10.4419/96973244?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Gautam Rao, 2019. "Familiarity Does Not Breed Contempt: Generosity, Discrimination, and Diversity in Delhi Schools," American Economic Review, American Economic Association, vol. 109(3), pages 774-809, March.
    2. John A. List & Michael K. Price, 2016. "Editor's Choice The Use of Field Experiments in Environmental and Resource Economics," Review of Environmental Economics and Policy, Association of Environmental and Resource Economists, vol. 10(2), pages 206-225.
    3. Karapetyan, Deanna & d'Adda, Giovanna, 2014. "Determinants of conservation among the rural poor: A charitable contribution experiment," Ecological Economics, Elsevier, vol. 99(C), pages 74-87.
    4. Johansson-Stenman, Olof & Svedsäter, Henrik, 2012. "Self-image and valuation of moral goods: Stated versus actual willingness to pay," Journal of Economic Behavior & Organization, Elsevier, vol. 84(3), pages 879-891.
    5. Simone Schaner, 2017. "The Cost of Convenience?: Transaction Costs, Bargaining Power, and Savings Account Use in Kenya," Journal of Human Resources, University of Wisconsin Press, vol. 52(4), pages 919-945.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kai Barron & Heike Harmgart & Steffen Huck & Sebastian O. Schneider & Matthias Sutter, 2023. "Discrimination, Narratives, and Family History: An Experiment with Jordanian Host and Syrian Refugee Children," The Review of Economics and Statistics, MIT Press, vol. 105(4), pages 1008-1016, July.
    2. Zenou, Yves & Boucher, Vincent & Tumen, Semih & Vlassopoulos, Michael & Wahba, Jackline, 2020. "Ethnic Mixing in Early Childhood: Evidence from a Randomized Field Experiment and a Structural Model," CEPR Discussion Papers 15528, C.E.P.R. Discussion Papers.
    3. Bagues, Manuel & Roth, Christopher, 2020. "Interregional Contact and National Identity," CAGE Online Working Paper Series 526, Competitive Advantage in the Global Economy (CAGE).
    4. Carlotta Nani, 2024. "Perceived abilities and gender stereotypes within the household: experimental evidence from Bangladesh," IHEID Working Papers 19-2024, Economics Section, The Graduate Institute of International Studies.
    5. Valerie Michelman & Joseph Price & Seth D Zimmerman, 2023. "Old Boys’ Clubs and Upward Mobility Among the Educational Elite," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 137(2), pages 845-909.
    6. Menapace, Luisa & Raffaelli, Roberta, 2020. "Unraveling hypothetical bias in discrete choice experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 176(C), pages 416-430.
    7. Bjerre-Nielsen, Andreas & Christensen, Lykke Sterll & Gandil, Mikkel Høst & Sievertsen, Hans Henrik, 2023. "Playing the System: Address Manipulation and Access to Schools," IZA Discussion Papers 16197, Institute of Labor Economics (IZA).
    8. Andreas Löschel & Jiansuo Pei & Ran Wang & Bodo Sturm & Wolfgang Buchholz & Zhongxiu Zhao, 2021. "The Demand for Global and Local Environmental Protection: Experimental Evidence from Climate Change Mitigation in Beijing," Land Economics, University of Wisconsin Press, vol. 97(1), pages 137-154.
    9. Simone Schaner, 2018. "The Persistent Power of Behavioral Change: Long-Run Impacts of Temporary Savings Subsidies for the Poor," American Economic Journal: Applied Economics, American Economic Association, vol. 10(3), pages 67-100, July.
    10. Antonela Miho & Alexandra Jarotschkin & Ekaterina Zhuravskaya, 2024. "Diffusion of Gender Norms: Evidence from Stalin’s Ethnic Deportations," Journal of the European Economic Association, European Economic Association, vol. 22(2), pages 475-527.
    11. Juliana Londoño-Vélez, 2022. "The Impact of Diversity on Perceptions of Income Distribution and Preferences for Redistribution," NBER Working Papers 30386, National Bureau of Economic Research, Inc.
    12. repec:rza:wpaper:893 is not listed on IDEAS
    13. Janusch, Nicholas & Palm-Forster, Leah H. & Messer, Kent D. & Ferraro, Paul J., 2017. "Behavioral Insights for Agri-Environmental Program and Policy Design," 2018 Allied Social Sciences Association (ASSA) Annual Meeting, January 5-7, 2018, Philadelphia, Pennsylvania 266299, Agricultural and Applied Economics Association.
    14. Valerie Michelman & Joseph Price & Seth D Zimmerman, 2022. "Old Boys’ Clubs and Upward Mobility Among the Educational Elite [Do Immigrants Assimilate More Slowly Today Than in the Past?]," The Quarterly Journal of Economics, Oxford University Press, vol. 137(2), pages 845-909.
    15. Shikuku, Kelvin Mashisia & Bulte, Erwin & Lagerkvist, Carl Johan & Tran, Nhuong, 2021. "The Formation of Reference Points in Consumer Choice Behavior: Experimental Evidence from a Fish Market in Nigeria," 2021 Conference, August 17-31, 2021, Virtual 314964, International Association of Agricultural Economists.
    16. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part I. Macro-scale analysis of literature and integrative synthesis of empirical evidence from applied economics, experimental psychology and neuroimag," Journal of choice modelling, Elsevier, vol. 41(C).
    17. D'Acunto, Francesco & Ghosh, Pulak & Jain, Rajiv & Rossi, Alberto G., 2022. "How costly are cultural biases?," LawFin Working Paper Series 34, Goethe University, Center for Advanced Studies on the Foundations of Law and Finance (LawFin).
    18. Gershenson, Seth & Lindsay, Constance A. & Papageorge, Nicholas W. & Campbell, Romaine A. & Rendon, Jessica H., 2023. "Spillover Effects of Black Teachers on White Teachers' Racial Competency: Mixed Methods Evidence from North Carolina," IZA Discussion Papers 16258, Institute of Labor Economics (IZA).
    19. Lei Wang & Chuncao Wang & Jiayi Chen & Jingke Chang, 2025. "The hidden crowding out effect: How does local government implicit debt pressure influence enterprise productivity in China?," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 46(1), pages 502-514, January.
    20. Bhargava, Palaash & Chen, Daniel L. & Sutter, Matthias & Terrier, Camille, 2022. "Homophily and Transmission of Behavioral Traits in Social Networks," IZA Discussion Papers 15840, Institute of Labor Economics (IZA).
    21. repec:osf:osfxxx:7d2cu_v1 is not listed on IDEAS
    22. Gian Luca Carniglia & Juan F. Escobar, 2023. "A spatial theory of urban segregation," Journal of Public Economic Theory, Association for Public Economic Theory, vol. 25(4), pages 653-678, August.

    More about this item

    Keywords

    Field experiment; environmental preferences; impact evaluation; lessons learned; behavioral economics;
    All these keywords.

    JEL classification:

    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • O13 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Agriculture; Natural Resources; Environment; Other Primary Products
    • O22 - Economic Development, Innovation, Technological Change, and Growth - - Development Planning and Policy - - - Project Analysis
    • Q20 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Renewable Resources and Conservation - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:rwirep:287767. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/rwiesde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.