IDEAS home Printed from https://ideas.repec.org/p/zbw/rwirep/287767.html

Using framed field experiments to evaluate real-world policy interventions: A case study on changing environmental preferences

Author

Listed:
  • Reitmann, Ann-Kristin
  • Sievert, Maximiliane

Abstract

Many policy interventions in the environmental sector aim at changing environmental preferences, because these provide the basis for adopting environmental conservation behavior or technologies. To evaluate these changes, standard measurement tools in survey-based impact evaluations have their limitations. We discuss the potential of framed field experiments as an alternative to attain unbiased outcome measures, and present a case study from an impact evaluation in the Colombian coffee sector. While clear advantages exist, we show that indicators from framed field experiments require substantial sample sizes to provide well-powered results. Moreover, preference indicators are highly context specific, which calls for an elaborated framing to attain the intended kind of preferences.

Suggested Citation

  • Reitmann, Ann-Kristin & Sievert, Maximiliane, 2024. "Using framed field experiments to evaluate real-world policy interventions: A case study on changing environmental preferences," Ruhr Economic Papers 1072, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    • Handle: RePEc:zbw:rwirep:287767
    DOI: 10.4419/96973244
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/287767/1/1884511856.pdf
    Download Restriction: no
    File URL: https://libkey.io/10.4419/96973244?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Simone Schaner, 2017. "The Cost of Convenience?: Transaction Costs, Bargaining Power, and Savings Account Use in Kenya," Journal of Human Resources, University of Wisconsin Press, vol. 52(4), pages 919-945.
    2. Karapetyan, Deanna & d'Adda, Giovanna, 2014. "Determinants of conservation among the rural poor: A charitable contribution experiment," Ecological Economics, Elsevier, vol. 99(C), pages 74-87.
    3. Ivar Krumpal, 2013. "Determinants of social desirability bias in sensitive surveys: a literature review," Quality & Quantity: International Journal of Methodology, Springer, vol. 47(4), pages 2025-2047, June.
    4. Johansson-Stenman, Olof & Svedsäter, Henrik, 2012. "Self-image and valuation of moral goods: Stated versus actual willingness to pay," Journal of Economic Behavior & Organization, Elsevier, vol. 84(3), pages 879-891.
    5. Gautam Rao, 2019. "Familiarity Does Not Breed Contempt: Generosity, Discrimination, and Diversity in Delhi Schools," American Economic Review, American Economic Association, vol. 109(3), pages 774-809, March.
    6. John A. List & Michael K. Price, 2016. "Editor's Choice The Use of Field Experiments in Environmental and Resource Economics," Review of Environmental Economics and Policy, Association of Environmental and Resource Economists, vol. 10(2), pages 206-225.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hönow, Nils Christian & Bensch, Gunther & Kirk, Michael, 2026. "Introducing and terminating monetary incentives in non-regenerating forests: Insights from a framed field experiment," Ruhr Economic Papers 1209, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    2. Nils Christian Hoenow & Gunther Bensch & Michael Kirk, 2026. "Introducing and Terminating Monetary Incentives in Non-Regenerating Forests: Insights from a Framed Field Experiment," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 89(6), pages 1-22, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. D’Acunto, Francesco & Ghosh, Pulak & Rossi, Alberto G., 2026. "How costly are cultural biases? Evidence from FinTech," Journal of Financial Economics, Elsevier, vol. 175(C).
    2. Aycinena, Diego & Bogliacino, Francesco & Kimbrough, Erik O., 2024. "Measuring norms: Assessing the threat of social desirability bias to the Bicchieri and Xiao elicitation method," Journal of Economic Behavior & Organization, Elsevier, vol. 222(C), pages 225-239.
    3. Schleich, Joachim & Alsheimer, Sven, 2024. "The relationship between willingness to pay and carbon footprint knowledge: Are individuals willing to pay more to offset their carbon footprint if they learn about its size and distance to the 1.5 °C target?," Ecological Economics, Elsevier, vol. 219(C).
    4. Aksoy, Billur & Chadd, Ian & Koh, Boon Han, 2023. "Sexual identity, gender, and anticipated discrimination in prosocial behavior," European Economic Review, Elsevier, vol. 154(C).
    5. Kai Barron & Heike Harmgart & Steffen Huck & Sebastian O. Schneider & Matthias Sutter, 2023. "Discrimination, Narratives, and Family History: An Experiment with Jordanian Host and Syrian Refugee Children," The Review of Economics and Statistics, MIT Press, vol. 105(4), pages 1008-1016, July.
    6. Da Ke, 2021. "Who Wears the Pants? Gender Identity Norms and Intrahousehold Financial Decision‐Making," Journal of Finance, American Finance Association, vol. 76(3), pages 1389-1425, June.
    7. Michael T Gastner & Károly Takács & Máté Gulyás & Zsuzsanna Szvetelszky & Beáta Oborny, 2019. "The impact of hypocrisy on opinion formation: A dynamic model," PLOS ONE, Public Library of Science, vol. 14(6), pages 1-21, June.
    8. Leonardo Bursztyn & Thomas Chaney & Tarek Alexander Hassan & Aakaash Rao, 2021. "The Immigrant Next Door: Long-Term Contact, Generosity, and Prejudice," NBER Working Papers 28448, National Bureau of Economic Research, Inc.
    9. Candelo, Natalia & Gu, Jingping & Li, Sherry Xin, 2026. "Social information, advice and altruistic behavior by underprivileged children: Experimental evidence from Colombia," Journal of Development Economics, Elsevier, vol. 181(C).
    10. Boucher, Vincent & Tumen, Semih & Vlassopoulos, Michael & Wahba, Jackline & Zenou, Yves, 2020. "Ethnic Mixing in Early Childhood: Evidence from a Randomized Field Experiment and a Structural Model," CEPR Discussion Papers 15528, Centre for Economic Policy Research.
    11. Odongo Kodongo, 2024. "Financial inclusion effects of fintech ecosystem engagement," ERSA Working Paper Series 5, Economic Research Southern Africa.
    12. Babette Bühler & Katja Möhring & Andreas P. Weiland, 2022. "Correction to: Assessing dissimilarity of employment history information from survey and administrative data using sequence analysis techniques," Quality & Quantity: International Journal of Methodology, Springer, vol. 56(6), pages 4775-4775, December.
    13. Shrestha, Sujata & Shrestha, Uttam Babu & Shrestha, Bibek Raj & Maharjan, Shirish & Udas, Erica & Aryal, Kamal, 2024. "Determinants of adoption of climate resilient agricultural solutions," Agricultural Systems, Elsevier, vol. 221(C).
    14. Bagues, Manuel & Roth, Christopher, 2020. "Interregional Contact and National Identity," CAGE Online Working Paper Series 526, Competitive Advantage in the Global Economy (CAGE).
    15. Clochard, Gwen-Jirō & Hollard, Guillaume & Sene, Omar, 2026. "Bringing contact interventions to the lab: Effects of brief bilateral discussions on interethnic trust in Senegal," World Development, Elsevier, vol. 199(C).
    16. Sjöstedt, Martin & Sundström, Aksel & Jagers, Sverker C. & Ntuli, Herbert, 2022. "Governance through community policing: What makes citizens report poaching of wildlife to state officials?," World Development, Elsevier, vol. 160(C).
    17. Tricia Koroknay†Palicz & Joao Montalvao, 2020. "Sex, Lies, and Surveys: The Role of Interviewer Characteristics," Economics Bulletin, AccessEcon, vol. 40(4), pages 3313-3324.
    18. Marinho Bertanha & Eunyi Chung, 2023. "Permutation Tests at Nonparametric Rates," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 118(544), pages 2833-2846, October.
    19. Oosterbeek, Hessel & Sóvágó, Sándor & van der Klaauw, Bas, 2021. "Preference heterogeneity and school segregation," Journal of Public Economics, Elsevier, vol. 197(C).
    20. Margarida Frade Santos & Diego Gomez-Baya & Celeste Simões & Ilaria Grazzani & Paula Lebre, 2025. "Do School and Family Well-being Mediate the relationship between Social and Emotional Learning and Subjective Happiness?," Child Indicators Research, Springer;The International Society of Child Indicators (ISCI), vol. 18(5), pages 2309-2330, October.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • O13 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Agriculture; Natural Resources; Environment; Other Primary Products
    • O22 - Economic Development, Innovation, Technological Change, and Growth - - Development Planning and Policy - - - Project Analysis
    • Q20 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Renewable Resources and Conservation - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:rwirep:287767. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/rwiesde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.