IDEAS home Printed from https://ideas.repec.org/p/war/wpaper/2015-31.html
   My bibliography  Save this paper

Addressing empirical challenges related to the incentive compatibility of stated preference methods

Author

Listed:
  • Mikołaj Czajkowski

    (Faculty of Economic Sciences, University of Warsaw)

  • Christian A. Vossler

    (Department of Economics, Howard H. Center for Public Policy, University of Tennessee)

  • Wiktor Budziński

    (Faculty of Economic Sciences, University of Warsaw)

  • Aleksandra Wiśniewska

    (Faculty of Economic Sciences, University of Warsaw)

  • Ewa Zawojska

    (Faculty of Economic Sciences, University of Warsaw)

Abstract

An emerging theoretical literature focused on the incentive compatibility of stated preference surveys offers a new lens through which to view extant evidence on external validity, and provides guidance for practitioners. However, critical theoretical assumptions rest on latent respondent beliefs, such as the belief that respondents view surveys as potentially influencing policy (i.e., policy consequentiality), which gives rise to pressing empirical challenges. In this study, we develop a Hybrid Mixed Logit model capable of integrating multiple latent beliefs, and subjective measures of these beliefs, into discrete choice models of stated preferences. Further, we provide a split-sample test of the effects of exogenous information signals related to policy consequentiality. Our results suggest some potential for researchers to induce desired beliefs through simple information signals and, importantly, that latent beliefs and information signals significantly influence elicited willingness to pay.

Suggested Citation

  • Mikołaj Czajkowski & Christian A. Vossler & Wiktor Budziński & Aleksandra Wiśniewska & Ewa Zawojska, 2015. "Addressing empirical challenges related to the incentive compatibility of stated preference methods," Working Papers 2015-31, Faculty of Economic Sciences, University of Warsaw.
    • Handle: RePEc:war:wpaper:2015-31
    as

    Download full text from publisher

    File URL: http://www.wne.uw.edu.pl/index.php/download_file/1935/
    File Function: First version, 2015
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Trine Hansen, 1997. "The Willingness-to-Pay for the Royal Theatre in Copenhagen as a Public Good," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 21(1), pages 1-28, March.
    2. Vredin Johansson, Maria & Heldt, Tobias & Johansson, Per, 2006. "The effects of attitudes and personality traits on mode choice," Transportation Research Part A: Policy and Practice, Elsevier, vol. 40(6), pages 507-525, July.
    3. Christian A. Vossler & Maurice Doyon & Daniel Rondeau, 2012. "Truth in Consequentiality: Theory and Field Evidence on Discrete Choice Experiments," American Economic Journal: Microeconomics, American Economic Association, vol. 4(4), pages 145-171, November.
    4. Dekker, Thijs & Hess, Stephane & Brouwer, Roy & Hofkes, Marjan, 2016. "Decision uncertainty in multi-attribute stated preference studies," Resource and Energy Economics, Elsevier, vol. 43(C), pages 57-73.
    5. Scarpa, Riccardo & Rose, John M., 2008. "Design efficiency for non-market valuation with choice modelling: how to measure it, what to report and why," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 52(3), pages 1-30.
    6. Drichoutis, Andreas C. & Vassilopoulos, Achilleas & Lusk, Jayson L. & Nayga, Rodolfo M. Jr., 2015. "Reference dependence, consequentiality and social desirability in value elicitation: A study of fair labor labeling," 143rd Joint EAAE/AAEA Seminar, March 25-27, 2015, Naples, Italy 202705, European Association of Agricultural Economists.
    7. Chiou, Lesley & Walker, Joan L., 2007. "Masking identification of discrete choice models under simulation methods," Journal of Econometrics, Elsevier, vol. 141(2), pages 683-703, December.
    8. repec:feb:framed:0073 is not listed on IDEAS
    9. Catherine L. Kling & Daniel J. Phaneuf & Jinhua Zhao, 2012. "From Exxon to BP: Has Some Number Become Better Than No Number?," Journal of Economic Perspectives, American Economic Association, vol. 26(4), pages 3-26, Fall.
    10. Hess, Stephane & Stathopoulos, Amanda, 2013. "Linking response quality to survey engagement: A combined random scale and latent variable approach," Journal of choice modelling, Elsevier, vol. 7(C), pages 1-12.
    11. José Grisolía & Kenneth Willis, 2012. "A latent class model of theatre demand," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 36(2), pages 113-139, May.
    12. Forrest, David & Grime, Keith & Woods, Robert, 2000. "Is It Worth Subsidising Regional Repertory Theatre?," Oxford Economic Papers, Oxford University Press, vol. 52(2), pages 381-397, April.
    13. Herriges, Joseph & Kling, Catherine & Liu, Chih-Chen & Tobias, Justin, 2010. "What are the consequences of consequentiality?," Journal of Environmental Economics and Management, Elsevier, vol. 59(1), pages 67-81, January.
    14. K. Willis & J. Snowball, 2009. "Investigating how the attributes of live theatre productions influence consumption choices using conjoint analysis: the example of the National Arts Festival, South Africa," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 33(3), pages 167-183, August.
    15. Craig E. Landry & John A. List, 2007. "Using Ex Ante Approaches to Obtain Credible Signals for Value in Contingent Markets: Evidence from the Field," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 89(2), pages 420-429.
    16. Carson, Richard T. & Czajkowski, Mikołaj, 2019. "A new baseline model for estimating willingness to pay from discrete choice models," Journal of Environmental Economics and Management, Elsevier, vol. 95(C), pages 57-61.
    17. Johnston, Robert J., 2006. "Is hypothetical bias universal? Validating contingent valuation responses using a binding public referendum," Journal of Environmental Economics and Management, Elsevier, vol. 52(1), pages 469-481, July.
    18. Scarpa, R. & Thiene, M. & Train, K., 2008. "Appendix to Utility in WTP space: a tool to address confounding random scale effects in destination choice to the Alps," American Journal of Agricultural Economics APPENDICES, Agricultural and Applied Economics Association, vol. 90(4), pages 1-9, January.
    19. Bulte, Erwin & Gerking, Shelby & List, John A. & de Zeeuw, Aart, 2005. "The effect of varying the causes of environmental problems on stated WTP values: evidence from a field study," Journal of Environmental Economics and Management, Elsevier, vol. 49(2), pages 330-342, March.
    20. Raveau, Sebastián & Yáñez, María Francisca & Ortúzar, Juan de Dios, 2012. "Practical and empirical identifiability of hybrid discrete choice models," Transportation Research Part B: Methodological, Elsevier, vol. 46(10), pages 1374-1383.
    21. Richard Carson & Theodore Groves, 2007. "Incentive and informational properties of preference questions," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 37(1), pages 181-210, May.
    22. Vij, Akshay & Walker, Joan L., 2016. "How, when and why integrated choice and latent variable models are latently useful," Transportation Research Part B: Methodological, Elsevier, vol. 90(C), pages 192-217.
    23. Arjo Klamer, 2016. "The value-based approach to cultural economics," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 40(4), pages 365-373, November.
    24. K. Willis & J. Snowball & C. Wymer & José Grisolía, 2012. "A count data travel cost model of theatre demand using aggregate theatre booking data," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 36(2), pages 91-112, May.
    25. Collins, Jill P. & Vossler, Christian A., 2009. "Incentive compatibility tests of choice experiment value elicitation questions," Journal of Environmental Economics and Management, Elsevier, vol. 58(2), pages 226-235, September.
    26. Richard T. Carson & Theodore Groves & John A. List, 2014. "Consequentiality: A Theoretical and Experimental Exploration of a Single Binary Choice," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 1(1), pages 171-207.
    27. Stephane Hess & Nesha Beharry-Borg, 2012. "Accounting for Latent Attitudes in Willingness-to-Pay Studies: The Case of Coastal Water Quality Improvements in Tobago," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 52(1), pages 109-131, May.
    28. Hess, Stephane & Hensher, David A. & Daly, Andrew, 2012. "Not bored yet – Revisiting respondent fatigue in stated choice experiments," Transportation Research Part A: Policy and Practice, Elsevier, vol. 46(3), pages 626-644.
    29. David Revelt & Kenneth Train, 1998. "Mixed Logit With Repeated Choices: Households' Choices Of Appliance Efficiency Level," The Review of Economics and Statistics, MIT Press, vol. 80(4), pages 647-657, November.
    30. Vossler, Christian A. & Watson, Sharon B., 2013. "Understanding the consequences of consequentiality: Testing the validity of stated preferences in the field," Journal of Economic Behavior & Organization, Elsevier, vol. 86(C), pages 137-147.
    31. Bhat, Chandra R. & Dubey, Subodh K. & Nagel, Kai, 2015. "Introducing non-normality of latent psychological constructs in choice modeling with an application to bicyclist route choice," Transportation Research Part B: Methodological, Elsevier, vol. 78(C), pages 341-363.
    32. Ben-Akiva, Moshe & McFadden, Daniel & Train, Kenneth & Börsch-Supan, Axel, 2002. "Hybrid Choice Models: Progress and Challenges," Sonderforschungsbereich 504 Publications 02-29, Sonderforschungsbereich 504, Universität Mannheim;Sonderforschungsbereich 504, University of Mannheim.
    33. Vossler, Christian A. & Evans, Mary F., 2009. "Bridging the gap between the field and the lab: Environmental goods, policy maker input, and consequentiality," Journal of Environmental Economics and Management, Elsevier, vol. 58(3), pages 338-345, November.
    34. Kim, Jinhee & Rasouli, Soora & Timmermans, Harry, 2014. "Expanding scope of hybrid choice models allowing for mixture of social influences and latent attitudes: Application to intended purchase of electric cars," Transportation Research Part A: Policy and Practice, Elsevier, vol. 69(C), pages 71-85.
    35. Andrew Daly & Stephane Hess & Bhanu Patruni & Dimitris Potoglou & Charlene Rohr, 2012. "Using ordered attitudinal indicators in a latent variable choice model: a study of the impact of security on rail travel behaviour," Transportation, Springer, vol. 39(2), pages 267-297, March.
    36. Maria Kamargianni & Moshe Ben-Akiva & Amalia Polydoropoulou, 2014. "Incorporating social interaction into hybrid choice models," Transportation, Springer, vol. 41(6), pages 1263-1285, November.
    37. Riccardo Scarpa & Mara Thiene & Kenneth Train, 2008. "Utility in Willingness to Pay Space: A Tool to Address Confounding Random Scale Effects in Destination Choice to the Alps," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 90(4), pages 994-1010.
    38. Malte Oehlmann & Jürgen Meyerhoff, 2017. "Stated preferences towards renewable energy alternatives in Germany – do the consequentiality of the survey and trust in institutions matter?," Journal of Environmental Economics and Policy, Taylor & Francis Journals, vol. 6(1), pages 1-16, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zawojska, Ewa & Bartczak, Anna & Czajkowski, Mikołaj, 2019. "Disentangling the effects of policy and payment consequentiality and risk attitudes on stated preferences," Journal of Environmental Economics and Management, Elsevier, vol. 93(C), pages 63-84.
    2. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    3. Zawojska, Ewa & Bartczak, Anna & Czajkowski, Mikotaj, 2017. "Disentangling impacts of payment and provision consequentiality and risk attitudes on stated preferences," Annual Meeting, 2017, June 18-21, Montreal, Canada 258602, Canadian Agricultural Economics Society.
    4. Malte Welling & Ewa Zawojska & Julian Sagebiel, 2022. "Information, Consequentiality and Credibility in Stated Preference Surveys: A Choice Experiment on Climate Adaptation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 82(1), pages 257-283, May.
    5. Jie He & Jérôme Dupras & Thomas G. Poder, 2018. "Payment and Provision Consequentiality in Voluntary Contribution Mechanism: Single or Double “Knife-Edge” Evidence?," Cahiers de recherche 18-02, Departement d'économique de l'École de gestion à l'Université de Sherbrooke.
    6. Kemper, Nathan & Nayga, Rodolfo M. Jr. & Popp, Jennie & Bazzani, Claudia, 2016. "The Effects of Honesty Oath and Consequentiality in Choice Experiments," 2016 Annual Meeting, July 31-August 2, Boston, Massachusetts 235381, Agricultural and Applied Economics Association.
    7. Chavez, Daniel E. & Palma, Marco A. & Nayga, Rodolfo M. & Mjelde, James W., 2020. "Product availability in discrete choice experiments with private goods," Journal of choice modelling, Elsevier, vol. 36(C).
    8. Malte Oehlmann & Jürgen Meyerhoff, 2017. "Stated preferences towards renewable energy alternatives in Germany – do the consequentiality of the survey and trust in institutions matter?," Journal of Environmental Economics and Policy, Taylor & Francis Journals, vol. 6(1), pages 1-16, January.
    9. Drichoutis, Andreas C. & Vassilopoulos, Achilleas & Lusk, Jayson & Nayga, Rodolfo M., 2015. "Fair farming: Preferences for fair labor certification using four elicitation methods," MPRA Paper 62546, University Library of Munich, Germany.
    10. West, Grant H. & Snell, Heather & Kovacs, Kent & Nayga, Rodolfo M., 2020. "Estimation of the preferences for the intertemporal services from groundwater," 2020 Annual Meeting, July 26-28, Kansas City, Missouri 304220, Agricultural and Applied Economics Association.
    11. Jie He & Jérôme Dupras & Franck Ndefo & Thomas Poder, 2020. "Payment and provision consequentiality in voluntary contribution mechanism: separate or joint effects?," Letters in Spatial and Resource Sciences, Springer, vol. 13(1), pages 11-36, April.
    12. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part II. Conceptualisation of external validity, sources and explanations of bias and effectiveness of mitigation methods," Journal of choice modelling, Elsevier, vol. 41(C).
    13. Anna Bartczak & Wiktor Budziński & Bernadeta Gołębiowska, 2018. "Impact of beliefs about negative effects of wind turbines on preference heterogeneity regarding renewable energy development in Poland," Working Papers 2018-19, Faculty of Economic Sciences, University of Warsaw.
    14. Christian Vossler & J. Scott Holladay, 2016. "Alternative Value Elicitation Formats in Contingent Valuation: A New Hope," Working Papers 2016-02, University of Tennessee, Department of Economics.
    15. Milad Haghani & Michiel C. J. Bliemer & John M. Rose & Harmen Oppewal & Emily Lancsar, 2021. "Hypothetical bias in stated choice experiments: Part II. Macro-scale analysis of literature and effectiveness of bias mitigation methods," Papers 2102.02945, arXiv.org.
    16. Peter A. Groothuis & Tanga M. Mohr & John C. Whitehead & Kristan Cockerill, 2015. "Payment and Policy Consequentiality in Contingent Valuation," Working Papers 15-04, Department of Economics, Appalachian State University.
    17. Vossler, Christian A. & Holladay, J. Scott, 2018. "Alternative value elicitation formats in contingent valuation: Mechanism design and convergent validity," Journal of Public Economics, Elsevier, vol. 165(C), pages 133-145.
    18. Shr, Yau-Huo (Jimmy) & Zhang, Wendong, 2024. "Omitted downstream attributes and the benefits of nutrient reductions: Implications for choice experiments," Ecological Economics, Elsevier, vol. 222(C).
    19. Drichoutis, Andreas C. & Vassilopoulos, Achilleas & Lusk, Jayson L. & Nayga, Rodolfo M. Jr., 2015. "Reference dependence, consequentiality and social desirability in value elicitation: A study of fair labor labeling," 143rd Joint EAAE/AAEA Seminar, March 25-27, 2015, Naples, Italy 202705, European Association of Agricultural Economists.
    20. Interis, Matthew & Petrolia, Daniel, 2014. "The Effects of Consequentiality in Binary- and Multinomial-Choice Surveys," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 39(2), pages 1-16.

    More about this item

    Keywords

    discrete choice experiment; stated preferences; consequentiality; field experiment; hybrid mixed logit model;
    All these keywords.

    JEL classification:

    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • C35 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Discrete Regression and Qualitative Choice Models; Discrete Regressors; Proportions
    • H41 - Public Economics - - Publicly Provided Goods - - - Public Goods
    • Q51 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Environmental Economics - - - Valuation of Environmental Effects

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:war:wpaper:2015-31. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Marcin Bąba (email available below). General contact details of provider: https://edirc.repec.org/data/fesuwpl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.