IDEAS home Printed from https://ideas.repec.org/a/bla/ajarec/v66y2022i2p280-308.html
   My bibliography  Save this article

Reducing bias in preference elicitation for environmental public goods

Author

Listed:
  • Daniel A. Brent
  • Lata Gangadharan
  • Anke D. Leroux
  • Paul A. Raschky

Abstract

The recent stated preference literature emphasises the importance of incentive compatible elicitation methods, which depend on respondent beliefs that payment can be collected if provision occurs. We investigate this condition in a randomised field experiment where stated choices are incentivised financially. The objective of the treatment was to make choices salient by making each decision financially relevant and to increase the respondents' beliefs that future payments will be enforced. Our results show that the treatment increases estimates of the marginal utility of income, with the effect being economically and statistically significant for low‐income respondents. We develop a stylised theoretical framework that allows us to quantify the bias that is implied by the observed differences between the treated and control groups. We find that failure to account for respondents' doubts about payment coercion in an otherwise well‐designed survey inflates the marginal willingness to pay among low‐income respondents by a factor of at least 1.72.

Suggested Citation

  • Daniel A. Brent & Lata Gangadharan & Anke D. Leroux & Paul A. Raschky, 2022. "Reducing bias in preference elicitation for environmental public goods," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 66(2), pages 280-308, April.
  • Handle: RePEc:bla:ajarec:v:66:y:2022:i:2:p:280-308
    DOI: 10.1111/1467-8489.12463
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/1467-8489.12463
    Download Restriction: no

    File URL: https://libkey.io/10.1111/1467-8489.12463?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Hoffman Elizabeth & McCabe Kevin & Shachat Keith & Smith Vernon, 1994. "Preferences, Property Rights, and Anonymity in Bargaining Games," Games and Economic Behavior, Elsevier, vol. 7(3), pages 346-380, November.
    2. Catherine L. Kling & Daniel J. Phaneuf & Jinhua Zhao, 2012. "From Exxon to BP: Has Some Number Become Better Than No Number?," Journal of Economic Perspectives, American Economic Association, vol. 26(4), pages 3-26, Fall.
    3. Christian A. Vossler & Maurice Doyon & Daniel Rondeau, 2012. "Truth in Consequentiality: Theory and Field Evidence on Discrete Choice Experiments," American Economic Journal: Microeconomics, American Economic Association, vol. 4(4), pages 145-171, November.
    4. Zawojska, Ewa & Bartczak, Anna & Czajkowski, Mikołaj, 2019. "Disentangling the effects of policy and payment consequentiality and risk attitudes on stated preferences," Journal of Environmental Economics and Management, Elsevier, vol. 93(C), pages 63-84.
    5. Richard T. Carson & Theodore Groves & John A. List, 2014. "Consequentiality: A Theoretical and Experimental Exploration of a Single Binary Choice," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 1(1), pages 171-207.
    6. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    7. Carlsson, Fredrik & Martinsson, Peter, 2001. "Do Hypothetical and Actual Marginal Willingness to Pay Differ in Choice Experiments?: Application to the Valuation of the Environment," Journal of Environmental Economics and Management, Elsevier, vol. 41(2), pages 179-192, March.
    8. Greene, William H. & Hensher, David A., 2003. "A latent class model for discrete choice analysis: contrasts with mixed logit," Transportation Research Part B: Methodological, Elsevier, vol. 37(8), pages 681-698, September.
    9. Smith, Vernon L, 1982. "Microeconomic Systems as an Experimental Science," American Economic Review, American Economic Association, vol. 72(5), pages 923-955, December.
    10. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521766555.
    11. Yohei Mitani & Nicholas Flores, 2014. "Hypothetical Bias Reconsidered: Payment and Provision Uncertainties in a Threshold Provision Mechanism," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 59(3), pages 433-454, November.
    12. Todd L. Cherry & Peter Frykblom & Jason F. Shogren, 2002. "Hardnose the Dictator," American Economic Review, American Economic Association, vol. 92(4), pages 1218-1221, September.
    13. David Revelt & Kenneth Train, 1998. "Mixed Logit With Repeated Choices: Households' Choices Of Appliance Efficiency Level," The Review of Economics and Statistics, MIT Press, vol. 80(4), pages 647-657, November.
    14. Patrick Lloyd-Smith & Wiktor Adamowicz & Diane Dupont, 2019. "Incorporating Stated Consequentiality Questions in Stated Preference Research," Land Economics, University of Wisconsin Press, vol. 95(3), pages 293-306.
    15. Rolfe, John & Bennett, Jeff, 2009. "The impact of offering two versus three alternatives in choice modelling experiments," Ecological Economics, Elsevier, vol. 68(4), pages 1140-1148, February.
    16. John List & Craig Gallet, 2001. "What Experimental Protocol Influence Disparities Between Actual and Hypothetical Stated Values?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 20(3), pages 241-254, November.
    17. John A. List, 2011. "Why Economists Should Conduct Field Experiments and 14 Tips for Pulling One Off," Journal of Economic Perspectives, American Economic Association, vol. 25(3), pages 3-16, Summer.
    18. Hausman, Jerry & McFadden, Daniel, 1984. "Specification Tests for the Multinomial Logit Model," Econometrica, Econometric Society, vol. 52(5), pages 1219-1240, September.
    19. Richard T. Carson & Nicholas E. Flores & Kerry M. Martin & Jennifer L. Wright, 1996. "Contingent Valuation and Revealed Preference Methodologies: Comparing the Estimates for Quasi-Public Goods," Land Economics, University of Wisconsin Press, vol. 72(1), pages 80-99.
    20. Cummings, Ronald G & Elliott, Steven & Harrison, Glenn W & Murphy, James, 1997. "Are Hypothetical Referenda Incentive Compatible?," Journal of Political Economy, University of Chicago Press, vol. 105(3), pages 609-621, June.
    21. Peter A. Diamond & Jerry A. Hausman, 1994. "Contingent Valuation: Is Some Number Better than No Number?," Journal of Economic Perspectives, American Economic Association, vol. 8(4), pages 45-64, Fall.
    22. Kenneth E. Train, 1998. "Recreation Demand Models with Taste Differences over People," Land Economics, University of Wisconsin Press, vol. 74(2), pages 230-239.
    23. W. Michael Hanemann, 1994. "Valuing the Environment through Contingent Valuation," Journal of Economic Perspectives, American Economic Association, vol. 8(4), pages 19-43, Fall.
    24. Czajkowski, Mikołaj & Vossler, Christian A. & Budziński, Wiktor & Wiśniewska, Aleksandra & Zawojska, Ewa, 2017. "Addressing empirical challenges related to the incentive compatibility of stated preferences methods," Journal of Economic Behavior & Organization, Elsevier, vol. 142(C), pages 47-63.
    25. Herriges, Joseph & Kling, Catherine & Liu, Chih-Chen & Tobias, Justin, 2010. "What are the consequences of consequentiality?," Journal of Environmental Economics and Management, Elsevier, vol. 59(1), pages 67-81, January.
    26. Katherine Silz Carson & Susan M. Chilton & W. George Hutchinson & Riccardo Scarpa, 2020. "Public resource allocation, strategic behavior, and status quo bias in choice experiments," Public Choice, Springer, vol. 185(1), pages 1-19, October.
    27. Glenn Harrison, 2006. "Experimental Evidence on Alternative Environmental Valuation Methods," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 34(1), pages 125-162, May.
    28. Deaton, Angus & Cartwright, Nancy, 2018. "Understanding and misunderstanding randomized controlled trials," Social Science & Medicine, Elsevier, vol. 210(C), pages 2-21.
    29. Brent, Daniel A. & Friesen, Lana & Gangadharan, Lata & Leibbrandt, Andreas, 2017. "Behavioral Insights from Field Experiments in Environmental Economics," International Review of Environmental and Resource Economics, now publishers, vol. 10(2), pages 95-143, May.
    30. repec:feb:artefa:0110 is not listed on IDEAS
    31. List John A. & Sinha Paramita & Taylor Michael H., 2006. "Using Choice Experiments to Value Non-Market Goods and Services: Evidence from Field Experiments," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 6(2), pages 1-39, January.
    32. Peter A. Groothuis & Tanga M. Mohr & John C. Whitehead & Kristan Cockerill, 2017. "Endogenous Consequentiality in Stated Preference Referendum Data: The Influence of the Randomly Assigned Tax Amount," Land Economics, University of Wisconsin Press, vol. 93(2), pages 258-268.
    33. Charles A. Holt & Susan K. Laury, 2002. "Risk Aversion and Incentive Effects," American Economic Review, American Economic Association, vol. 92(5), pages 1644-1655, December.
    34. Sendhil Mullainathan & Marianne Bertrand, 2001. "Do People Mean What They Say? Implications for Subjective Survey Data," American Economic Review, American Economic Association, vol. 91(2), pages 67-72, May.
    35. Jerry Hausman, 2012. "Contingent Valuation: From Dubious to Hopeless," Journal of Economic Perspectives, American Economic Association, vol. 26(4), pages 43-56, Fall.
    36. Patricia A. Champ & Nicholas E. Flores & Thomas C. Brown & PJames Chivers, 2002. "Contingent Valuation and Incentives," Land Economics, University of Wisconsin Press, vol. 78(4), pages 591-604.
    37. Steffen Andersen & Glenn Harrison & Morten Lau & E. Rutström, 2009. "Elicitation using multiple price list formats," Experimental Economics, Springer;Economic Science Association, vol. 12(3), pages 365-366, September.
    38. Abbie A. Rogers & Michael P. Burton & Jonelle A. Cleland & John C. Rolfe & Jessica J. Meeuwig & David J. Pannell, 2020. "Expert judgements and community values: preference heterogeneity for protecting river ecology in Western Australia," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 64(2), pages 266-293, April.
    39. Tobias Börger & Tenaw G. Abate & Margrethe Aanesen & Ewa Zawojska, 2021. "Payment and Policy Consequentiality in Dichotomous Choice Contingent Valuation: Experimental Design Effects on Self-Reported Perceptions," Land Economics, University of Wisconsin Press, vol. 97(2), pages 407-424.
    40. Bulte, Erwin & Gerking, Shelby & List, John A. & de Zeeuw, Aart, 2005. "The effect of varying the causes of environmental problems on stated WTP values: evidence from a field study," Journal of Environmental Economics and Management, Elsevier, vol. 49(2), pages 330-342, March.
    41. John A. List (ed.), 2006. "Using Experimental Methods in Environmental and Resource Economics," Books, Edward Elgar Publishing, number 4180.
    42. Richard Carson & Theodore Groves, 2007. "Incentive and informational properties of preference questions," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 37(1), pages 181-210, May.
    43. John Loomis, 2011. "What'S To Know About Hypothetical Bias In Stated Preference Valuation Studies?," Journal of Economic Surveys, Wiley Blackwell, vol. 25(2), pages 363-370, April.
    44. Balcombe, Kelvin & Burton, Michael & Rigby, Dan, 2011. "Skew and attribute non-attendance within the Bayesian mixed logit model," Journal of Environmental Economics and Management, Elsevier, vol. 62(3), pages 446-461.
    45. Daniel McFadden & Kenneth Train, 2000. "Mixed MNL models for discrete response," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(5), pages 447-470.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Daniel A. Brent & Lata Gangadharan & Anke Leroux & Paul A. Raschky, 2016. "Putting Your Money Where Your Mouth Is," Monash Economics Working Papers 42-16, Monash University, Department of Economics.
    2. Daniel A. Brent & Lata Gangadharan & Anke Leroux & Paul A. Raschky, 2014. "Putting One's Money Where One's Mouth is: Increasing Saliency in the Field," Monash Economics Working Papers 43-14, Monash University, Department of Economics.
    3. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    4. Sergio Colombo & Wiktor Budziński & Mikołaj Czajkowski & Klaus Glenk, 2022. "The relative performance of ex‐ante and ex‐post measures to mitigate hypothetical and strategic bias in a stated preference study," Journal of Agricultural Economics, Wiley Blackwell, vol. 73(3), pages 845-873, September.
    5. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part II. Conceptualisation of external validity, sources and explanations of bias and effectiveness of mitigation methods," Journal of choice modelling, Elsevier, vol. 41(C).
    6. Zawojska, Ewa & Bartczak, Anna & Czajkowski, Mikołaj, 2019. "Disentangling the effects of policy and payment consequentiality and risk attitudes on stated preferences," Journal of Environmental Economics and Management, Elsevier, vol. 93(C), pages 63-84.
    7. Jie He & Jérôme Dupras & Thomas G. Poder, 2018. "Payment and Provision Consequentiality in Voluntary Contribution Mechanism: Single or Double “Knife-Edge” Evidence?," Cahiers de recherche 18-02, Departement d'économique de l'École de gestion à l'Université de Sherbrooke.
    8. Wei, Xuan & Khachatryan, Hayk, 2023. "How consequential is policy consequentiality? Evidence from online discrete choice experiment with ornamental plants," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 107(C).
    9. Mohammed H. Alemu & Søren B. Olsen, 2017. "Can a Repeated Opt-Out Reminder remove hypothetical bias in discrete choice experiments? An application to consumer valuation of novel food products," IFRO Working Paper 2017/05, University of Copenhagen, Department of Food and Resource Economics.
    10. Tobias Börger & Tenaw G. Abate & Margrethe Aanesen & Ewa Zawojska, 2021. "Payment and Policy Consequentiality in Dichotomous Choice Contingent Valuation: Experimental Design Effects on Self-Reported Perceptions," Land Economics, University of Wisconsin Press, vol. 97(2), pages 407-424.
    11. Sergio Colombo & Wiktor Budziński & Mikołaj Czajkowski & Klaus Glenk, 2020. "Ex-ante and ex-post measures to mitigate hypothetical bias. Are they alternative or complementary tools to increase the reliability and validity of DCE estimates?," Working Papers 2020-20, Faculty of Economic Sciences, University of Warsaw.
    12. Milad Haghani & Michiel C. J. Bliemer & John M. Rose & Harmen Oppewal & Emily Lancsar, 2021. "Hypothetical bias in stated choice experiments: Part II. Macro-scale analysis of literature and effectiveness of bias mitigation methods," Papers 2102.02945, arXiv.org.
    13. Malte Welling & Ewa Zawojska & Julian Sagebiel, 2022. "Information, Consequentiality and Credibility in Stated Preference Surveys: A Choice Experiment on Climate Adaptation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 82(1), pages 257-283, May.
    14. Zawojska, Ewa & Gastineau, Pascal & Mahieu, Pierre-Alexandre & Cheze, Benoit & Paris, Anthony, 2021. "Measuring policy consequentiality perceptions in stated preference surveys," 2021 Annual Meeting, August 1-3, Austin, Texas 313977, Agricultural and Applied Economics Association.
    15. Haghani, Milad & Bliemer, Michiel C.J. & Hensher, David A., 2021. "The landscape of econometric discrete choice modelling research," Journal of choice modelling, Elsevier, vol. 40(C).
    16. Crastes dit Sourd, Romain & Zawojska, Ewa & Mahieu, Pierre-Alexandre & Louviere, Jordan, 2018. "Mitigating strategic misrepresentation of values in open-ended stated preference surveys by using negative reinforcement," Journal of choice modelling, Elsevier, vol. 28(C), pages 153-166.
    17. Dardanoni, Valentino & Guerriero, Carla, 2021. "Young people' s willingness to pay for environmental protection," Ecological Economics, Elsevier, vol. 179(C).
    18. Felix Schläpfer, 2021. "Inadequate Standards in the Valuation of Public Goods and Ecosystem Services: Why Economists, Environmental Scientists and Policymakers Should Care," Sustainability, MDPI, vol. 13(1), pages 1-10, January.
    19. Fifer, Simon & Rose, John M., 2016. "Can you ever be certain? Reducing hypothetical bias in stated choice experiments via respondent reported choice certaintyAuthor-Name: Beck, Matthew J," Transportation Research Part B: Methodological, Elsevier, vol. 89(C), pages 149-167.
    20. Mark A. Andor & Manuel Frondel & Marco Horvath, 2021. "Consequentiality, Elicitation Formats, and the Willingness to Pay for Green Electricity: Evidence from Germany," Land Economics, University of Wisconsin Press, vol. 97(3), pages 626-640.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:ajarec:v:66:y:2022:i:2:p:280-308. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/aaresea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.