IDEAS home Printed from https://ideas.repec.org/p/war/wpaper/2020-20.html
   My bibliography  Save this paper

Ex-ante and ex-post measures to mitigate hypothetical bias. Are they alternative or complementary tools to increase the reliability and validity of DCE estimates?

Author

Listed:
  • Sergio Colombo

    (Department of Agricultural Economics, IFAPA)

  • Wiktor Budziński

    (Faculty of Economic Sciences, University of Warsaw)

  • Mikołaj Czajkowski

    (Faculty of Economic Sciences, University of Warsaw)

  • Klaus Glenk

    (Scotland’s Rural College, SRUC)

Abstract

Hypothetical bias remains at the heart of controversy about the reliability and validity of value estimates from discrete choice experiments (DCEs). This especially applies to environmental valuation, where typically no market value exists for the good under study. This has motivated a large body of literature that investigates possible approaches to test for and mitigate this bias. Our study provides further evidence to this debate by testing whether the use of ex-ante or ex-post mitigation strategies is effective in reducing hypothetical bias in DCEs. Specifically, we use individual and multiple ex-ante reminders along with ex-post data analysis to test whether their individual or joint use improves the quality of the willingness to pay (WTP) estimates. The analysis is carried out with the use of the state-of-the-art mixed logit model, as well as using the innovative semi-parametric logit-mixed-logit, which can capture non-standard heterogeneity distributions. The empirical study focuses on preferences for environmental and social impacts of organic olive production. Comparing three experimental treatments to a control treatment, we test whether cheap talk addressing hypothetical bias, a scale reminder or a combination of both affect stated WTP. In addition, we use ex-post data analysis aimed at correcting WTP estimates. Results show that cheap talk scripts and scale reminders, alone or in conjunction, did not significantly influence the results obtained from a sub-sample with standard budget constraint reminders. The ex-post approach outperforms the ex-ante approach and provides a significant reduction on mean WTP estimates.

Suggested Citation

  • Sergio Colombo & Wiktor Budziński & Mikołaj Czajkowski & Klaus Glenk, 2020. "Ex-ante and ex-post measures to mitigate hypothetical bias. Are they alternative or complementary tools to increase the reliability and validity of DCE estimates?," Working Papers 2020-20, Faculty of Economic Sciences, University of Warsaw.
  • Handle: RePEc:war:wpaper:2020-20
    as

    Download full text from publisher

    File URL: https://www.wne.uw.edu.pl/index.php/download_file/5728/
    File Function: First version, 2020
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Zawojska, Ewa & Bartczak, Anna & Czajkowski, Mikołaj, 2019. "Disentangling the effects of policy and payment consequentiality and risk attitudes on stated preferences," Journal of Environmental Economics and Management, Elsevier, vol. 93(C), pages 63-84.
    2. Christian A. Vossler & Maurice Doyon & Daniel Rondeau, 2012. "Truth in Consequentiality: Theory and Field Evidence on Discrete Choice Experiments," American Economic Journal: Microeconomics, American Economic Association, vol. 4(4), pages 145-171, November.
    3. Jacquemet, Nicolas & Joule, Robert-Vincent & Luchini, Stéphane & Shogren, Jason F., 2013. "Preference elicitation under oath," Journal of Environmental Economics and Management, Elsevier, vol. 65(1), pages 110-132.
    4. Maurice Doyon & Laure Saulais & Bernard Ruffieux & Denise Bweli, 2015. "Hypothetical bias for private goods: does cheap talk make a difference?," Post-Print hal-01254936, HAL.
    5. Glynn T. Tonsor & Robert S. Shupp, 2011. "Cheap Talk Scripts and Online Choice Experiments: "Looking Beyond the Mean"," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 93(4), pages 1015-1031.
    6. James Murphy & P. Allen & Thomas Stevens & Darryl Weatherhead, 2005. "A Meta-analysis of Hypothetical Bias in Stated Preference Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 30(3), pages 313-325, March.
    7. Roe, Brian & Boyle, Kevin J. & Teisl, Mario F., 1996. "Using Conjoint Analysis to Derive Estimates of Compensating Variation," Journal of Environmental Economics and Management, Elsevier, vol. 31(2), pages 145-159, September.
    8. Jeff Bennett (ed.), 2011. "The International Handbook on Non-Market Environmental Valuation," Books, Edward Elgar Publishing, number 13490.
    9. Todd L. Cherry & Peter Frykblom & Jason F. Shogren, 2002. "Hardnose the Dictator," American Economic Review, American Economic Association, vol. 92(4), pages 1218-1221, September.
    10. Claudia Bazzani & Marco A. Palma & Rodolfo M. Nayga, 2018. "On the use of flexible mixing distributions in WTP space: an induced value choice experiment," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 62(2), pages 185-198, April.
    11. Carlsson, Fredrik & Frykblom, Peter & Johan Lagerkvist, Carl, 2005. "Using cheap talk as a test of validity in choice experiments," Economics Letters, Elsevier, vol. 89(2), pages 147-152, November.
    12. Jerrod M Penn & Wuyang Hu, 2018. "Understanding Hypothetical Bias: An Enhanced Meta-Analysis," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 100(4), pages 1186-1206.
    13. John A. Fox & Jason F. Shogren & Dermot J. Hayes & James B. Kliebenstein, 1998. "CVM-X: Calibrating Contingent Values with Experimental Auction Markets," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 80(3), pages 455-465.
    14. Christopher D. Azevedo & Joseph A. Herriges & Catherine L. Kling, 2003. "Combining Revealed and Stated Preferences: Consistency Tests and Their Interpretations," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 85(3), pages 525-537.
    15. Czajkowski, Mikołaj & Vossler, Christian A. & Budziński, Wiktor & Wiśniewska, Aleksandra & Zawojska, Ewa, 2017. "Addressing empirical challenges related to the incentive compatibility of stated preferences methods," Journal of Economic Behavior & Organization, Elsevier, vol. 142(C), pages 47-63.
    16. Glenk, Klaus & Meyerhoff, Jürgen & Akaichi, Faical & Martin-Ortega, Julia, 2019. "Revisiting cost vector effects in discrete choice experiments," Resource and Energy Economics, Elsevier, vol. 57(C), pages 135-155.
    17. Nick Hanley & Mikołaj Czajkowski, 2019. "The Role of Stated Preference Valuation Methods in Understanding Choices and Informing Policy," Review of Environmental Economics and Policy, Association of Environmental and Resource Economists, vol. 13(2), pages 248-266.
    18. Whitehead, John C. & Cherry, Todd L., 2007. "Willingness to pay for a Green Energy program: A comparison of ex-ante and ex-post hypothetical bias mitigation approaches," Resource and Energy Economics, Elsevier, vol. 29(4), pages 247-261, November.
    19. Swait, Joffre, 2001. "A non-compensatory choice model incorporating attribute cutoffs," Transportation Research Part B: Methodological, Elsevier, vol. 35(10), pages 903-928, November.
    20. List John A. & Sinha Paramita & Taylor Michael H., 2006. "Using Choice Experiments to Value Non-Market Goods and Services: Evidence from Field Experiments," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 5(2), pages 1-39, January.
    21. Loomis, John B., 2014. "2013 WAEA Keynote Address: Strategies for Overcoming Hypothetical Bias in Stated Preference Surveys," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 39(1), pages 1-13, April.
    22. Glenn Bush & Sergio Colombo & Nick Hanley, 2009. "Should all Choices Count? Using the Cut-Offs Approach to Edit Responses in a Choice Experiment," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 44(3), pages 397-414, November.
    23. Faccioli, Michela & Czajkowski, Mikołaj & Glenk, Klaus & Martin-Ortega, Julia, 2020. "Environmental attitudes and place identity as determinants of preferences for ecosystem services," Ecological Economics, Elsevier, vol. 174(C).
    24. Liebe, Ulf & Glenk, Klaus & von Meyer-Höfer, Marie & Spiller, Achim, 2019. "A web survey application of real choice experiments," Journal of choice modelling, Elsevier, vol. 33(C).
    25. Sergio Colombo & Klaus Glenk & Beatriz Rocamora-Montiel, 2016. "Analysis of choice inconsistencies in on-line choice experiments: impact on welfare measures," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 43(2), pages 271-302.
    26. Champ, Patricia A. & Moore, Rebecca & Bishop, Richard C., 2009. "A Comparison of Approaches to Mitigate Hypothetical Bias," Agricultural and Resource Economics Review, Cambridge University Press, vol. 38(2), pages 166-180, October.
    27. Richard Carson & Theodore Groves, 2007. "Incentive and informational properties of preference questions," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 37(1), pages 181-210, May.
    28. Dominique Ami & Frédéric Aprahamian & Olivier Chanel & Stéphane Luchini, 2011. "A Test of Cheap Talk in Different Hypothetical Contexts: The Case of Air Pollution," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 50(1), pages 111-130, September.
    29. Daniel McFadden & Kenneth Train, 2000. "Mixed MNL models for discrete response," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(5), pages 447-470.
    30. Jayson L. Lusk & Ted C. Schroeder, 2004. "Are Choice Experiments Incentive Compatible? A Test with Quality Differentiated Beef Steaks," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 86(2), pages 467-482.
    31. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521747387.
    32. Dan Ariely & George Loewenstein & Drazen Prelec, 2003. ""Coherent Arbitrariness": Stable Demand Curves Without Stable Preferences," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(1), pages 73-106.
    33. Ewa Zawojska & Mikołaj Czajkowski, 2017. "Re-examining empirical evidence on stated preferences: importance of incentive compatibility," Journal of Environmental Economics and Policy, Taylor & Francis Journals, vol. 6(4), pages 374-403, October.
    34. Bansal, Prateek & Daziano, Ricardo A. & Achtnicht, Martin, 2018. "Comparison of parametric and semiparametric representations of unobserved preference heterogeneity in logit models," Journal of choice modelling, Elsevier, vol. 27(C), pages 97-113.
    35. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    36. Ladenburg, Jacob & Olsen, Søren Bøye, 2014. "Augmenting short Cheap Talk scripts with a repeated Opt-Out Reminder in Choice Experiment surveys," Resource and Energy Economics, Elsevier, vol. 37(C), pages 39-63.
    37. Grebitus, Carola & Lusk, Jayson L. & Nayga, Rodolfo M., 2013. "Explaining differences in real and hypothetical experimental auctions and choice experiments with personality," Journal of Economic Psychology, Elsevier, vol. 36(C), pages 11-26.
    38. Bosworth Ryan & Taylor Laura O., 2012. "Hypothetical Bias in Choice Experiments: Is Cheap Talk Effective at Eliminating Bias on the Intensive and Extensive Margins of Choice?," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 12(1), pages 1-28, December.
    39. Barrage, Lint & Lee, Min Sok, 2010. "A penny for your thoughts: Inducing truth-telling in stated preference elicitation," Economics Letters, Elsevier, vol. 106(2), pages 140-142, February.
    40. LaRiviere, Jacob & Czajkowski, Mikołaj & Hanley, Nick & Aanesen, Margrethe & Falk-Petersen, Jannike & Tinch, Dugald, 2014. "The value of familiarity: Effects of knowledge and objective signals on willingness to pay for a public good," Journal of Environmental Economics and Management, Elsevier, vol. 68(2), pages 376-389.
    41. Riccardo Scarpa & Cristiano Franceschinis & Mara Thiene, 2017. "A Monte Carlo Evaluation of the Logit-Mixed Logit under Asymmetry and Multimodality," Working Papers in Economics 17/23, University of Waikato.
    42. David Revelt & Kenneth Train, 1998. "Mixed Logit With Repeated Choices: Households' Choices Of Appliance Efficiency Level," The Review of Economics and Statistics, MIT Press, vol. 80(4), pages 647-657, November.
    43. Train, Kenneth, 2016. "Mixed logit with a flexible mixing distribution," Journal of choice modelling, Elsevier, vol. 19(C), pages 40-53.
    44. Kathleen Brooks & Jayson L. Lusk, 2010. "Stated and Revealed Preferences for Organic and Cloned Milk: Combining Choice Experiment and Scanner Data," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 92(4), pages 1229-1241.
    45. Richard C. Bishop & Kevin J. Boyle, 2019. "Reliability and Validity in Nonmarket Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 72(2), pages 559-582, February.
    46. Champ, Patricia A. & Moore, Rebecca & Bishop, Richard C., 2009. "A Comparison of Approaches to Mitigate Hypothetical Bias," Agricultural and Resource Economics Review, Northeastern Agricultural and Resource Economics Association, vol. 38(2), pages 1-15, October.
    47. LaRiviere, Jacob & Czajkowski, Mikolaj & Hanley, Nick & Aanesen, Margrethe & Falk-Peterson, Jannike & Tinch, Dugald, 2014. "Effects of Experience, Knowledge and Signals on Willingness to Pay for a Public Good," SIRE Discussion Papers 2014-008, Scottish Institute for Research in Economics (SIRE).
    48. Sonia Akter & Jeff Bennett, 2013. "Preference uncertainty in stated preference studies: facts and artefacts," Applied Economics, Taylor & Francis Journals, vol. 45(15), pages 2107-2115, May.
    49. Fifer, Simon & Rose, John M., 2016. "Can you ever be certain? Reducing hypothetical bias in stated choice experiments via respondent reported choice certaintyAuthor-Name: Beck, Matthew J," Transportation Research Part B: Methodological, Elsevier, vol. 89(C), pages 149-167.
    50. Richard C. Ready & Patricia A. Champ & Jennifer L. Lawton, 2010. "Using Respondent Uncertainty to Mitigate Hypothetical Bias in a Stated Choice Experiment," Land Economics, University of Wisconsin Press, vol. 86(2), pages 363-381.
    51. Varela, Elsa & Mahieu, Pierre-Alexandre & Giergiczny, Marek & Riera, Pere & Soliño, Mario, 2014. "Testing the single opt-out reminder in choice experiments: An application to fuel break management in Spain," Journal of Forest Economics, Elsevier, vol. 20(3), pages 212-222.
    52. Penn, Jerrod & Hu, Wuyang, 2019. "Cheap talk efficacy under potential and actual Hypothetical Bias: A meta-analysis," Journal of Environmental Economics and Management, Elsevier, vol. 96(C), pages 22-35.
    53. Bansal, Prateek & Daziano, Ricardo A. & Achtnicht, Martin, 2018. "Extending the logit-mixed logit model for a combination of random and fixed parameters," Journal of choice modelling, Elsevier, vol. 27(C), pages 88-96.
    54. Caputo, Vincenzina & Scarpa, Riccardo & Nayga, Rodolfo M. & Ortega, David L., 2018. "Are preferences for food quality attributes really normally distributed? An analysis using flexible mixing distributions," Journal of choice modelling, Elsevier, vol. 28(C), pages 10-27.
    55. David Aadland & Arthur J. Caplan, 2003. "Willingness to Pay for Curbside Recycling with Detection and Mitigation of Hypothetical Bias," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 85(2), pages 492-502.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sergio Colombo & Wiktor Budziński & Mikołaj Czajkowski & Klaus Glenk, 2022. "The relative performance of ex‐ante and ex‐post measures to mitigate hypothetical and strategic bias in a stated preference study," Journal of Agricultural Economics, Wiley Blackwell, vol. 73(3), pages 845-873, September.
    2. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part II. Conceptualisation of external validity, sources and explanations of bias and effectiveness of mitigation methods," Journal of choice modelling, Elsevier, vol. 41(C).
    3. Milad Haghani & Michiel C. J. Bliemer & John M. Rose & Harmen Oppewal & Emily Lancsar, 2021. "Hypothetical bias in stated choice experiments: Part II. Macro-scale analysis of literature and effectiveness of bias mitigation methods," Papers 2102.02945, arXiv.org.
    4. Milad Haghani & Michiel C. J. Bliemer & John M. Rose & Harmen Oppewal & Emily Lancsar, 2021. "Hypothetical bias in stated choice experiments: Part I. Integrative synthesis of empirical evidence and conceptualisation of external validity," Papers 2102.02940, arXiv.org.
    5. Mohammed H. Alemu & Søren B. Olsen, 2017. "Can a Repeated Opt-Out Reminder remove hypothetical bias in discrete choice experiments? An application to consumer valuation of novel food products," IFRO Working Paper 2017/05, University of Copenhagen, Department of Food and Resource Economics.
    6. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part I. Macro-scale analysis of literature and integrative synthesis of empirical evidence from applied economics, experimental psychology and neuroimag," Journal of choice modelling, Elsevier, vol. 41(C).
    7. Penn, Jerrod & Hu, Wuyang, 2019. "Cheap talk efficacy under potential and actual Hypothetical Bias: A meta-analysis," Journal of Environmental Economics and Management, Elsevier, vol. 96(C), pages 22-35.
    8. Fifer, Simon & Rose, John M., 2016. "Can you ever be certain? Reducing hypothetical bias in stated choice experiments via respondent reported choice certaintyAuthor-Name: Beck, Matthew J," Transportation Research Part B: Methodological, Elsevier, vol. 89(C), pages 149-167.
    9. Ladenburg, Jacob & Olsen, Søren Bøye, 2014. "Augmenting short Cheap Talk scripts with a repeated Opt-Out Reminder in Choice Experiment surveys," Resource and Energy Economics, Elsevier, vol. 37(C), pages 39-63.
    10. Ladenburg, Jacob & Skotte, Maria, 2022. "Heterogeneity in willingness to pay for the location of offshore wind power development: An application of the willingness to pay space model," Energy, Elsevier, vol. 241(C).
    11. Crastes dit Sourd, Romain & Zawojska, Ewa & Mahieu, Pierre-Alexandre & Louviere, Jordan, 2018. "Mitigating strategic misrepresentation of values in open-ended stated preference surveys by using negative reinforcement," Journal of choice modelling, Elsevier, vol. 28(C), pages 153-166.
    12. Haghani, Milad & Sarvi, Majid, 2018. "Hypothetical bias and decision-rule effect in modelling discrete directional choices," Transportation Research Part A: Policy and Practice, Elsevier, vol. 116(C), pages 361-388.
    13. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    14. West, Grant H. & Snell, Heather & Kovacs, Kent & Nayga, Rodolfo M., 2020. "Estimation of the preferences for the intertemporal services from groundwater," 2020 Annual Meeting, July 26-28, Kansas City, Missouri 304220, Agricultural and Applied Economics Association.
    15. Penn, Jerrod & Hu, Wuyang, 2016. "Making the Most of Cheap Talk in an Online Survey," 2016 Annual Meeting, July 31-August 2, Boston, Massachusetts 236171, Agricultural and Applied Economics Association.
    16. Lang, Ghislaine & Farsi, Mehdi & Lanz, Bruno & Weber, Sylvain, 2021. "Energy efficiency and heating technology investments: Manipulating financial information in a discrete choice experiment," Resource and Energy Economics, Elsevier, vol. 64(C).
    17. Daniel A. Brent & Lata Gangadharan & Anke D. Leroux & Paul A. Raschky, 2022. "Reducing bias in preference elicitation for environmental public goods," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 66(2), pages 280-308, April.
    18. Stephane Bergeron & Maurice Doyon & Laurent Muller, 2019. "Strategic response: A key to understand how cheap talk works," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 67(1), pages 75-83, March.
    19. Fifer, Simon & Rose, John & Greaves, Stephen, 2014. "Hypothetical bias in Stated Choice Experiments: Is it a problem? And if so, how do we deal with it?," Transportation Research Part A: Policy and Practice, Elsevier, vol. 61(C), pages 164-177.
    20. Jerrod Penn & Wuyang Hu, 2023. "Adjusting and Calibrating Elicited Values Based on Follow-up Certainty Questions: A Meta-analysis," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 84(4), pages 919-946, April.

    More about this item

    Keywords

    Choice experiment; Hypothetical bias; mitigation strategies;
    All these keywords.

    JEL classification:

    • C1 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General
    • Q1 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Agriculture

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:war:wpaper:2020-20. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Marcin Bąba (email available below). General contact details of provider: https://edirc.repec.org/data/fesuwpl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.