IDEAS home Printed from https://ideas.repec.org/a/bla/ajarec/v57y2013i2p214-233.html
   My bibliography  Save this article

Effects of alternative elicitation formats in discrete choice experiments

Author

Listed:
  • Gabriela Scheufele
  • Jeff Bennett

Abstract

An elicitation format prevalently applied in DCE is to offer each respondent a sequence of choice tasks containing more than two choice options. However, empirical evidence indicates that repeated choice tasks influence choice behavior through institutional learning, fatigue, value learning, and strategic response. The study reported in this paper employs a split sample approach based on field surveys using a single binary elicitation format with a majority vote implementation as the baseline to expand the research on effects of sequential binary DCE formats. We provide evidence for effects caused by institutional learning and either strategic behavior or value learning after respondents answered repeated choice questions. However, we did not find any indications for strategic behavior caused by awareness of having multiple choices. The choice between a sequential and a single elicitation format may thus imply a trade-off between decreased choice accuracy and potentially increased strategic behavior due to an incentive incompatible mechanism. Further research is needed to explore strategic behavior induced by incentive incompatible elicitation formats using alternative approaches that are not compromised by a confounded baseline, that facilitate the differentiation between value learning and strategic behavior, and that allow the use of less restrictive model specifications. Such research should also investigate the effects of varying incentives induced by the order in which choice questions are presented to respondents.
(This abstract was borrowed from another version of this item.)

Suggested Citation

  • Gabriela Scheufele & Jeff Bennett, 2013. "Effects of alternative elicitation formats in discrete choice experiments," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 57(2), pages 214-233, April.
    • Handle: RePEc:bla:ajarec:v:57:y:2013:i:2:p:214-233
    DOI: 10.1111/ajar.2013.57.issue-2
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1111/10.1111/ajar.2013.57.issue-2
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1111/ajar.2013.57.issue-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. R.J. Aumann & S. Hart (ed.), 2002. "Handbook of Game Theory with Economic Applications," Handbook of Game Theory with Economic Applications, Elsevier, edition 1, volume 3, number 3.
    2. Racevskis, Laila A. & Lupi, Frank, 2008. "Incentive Compatibility in an Attribute-Based Referendum Model," 2008 Annual Meeting, July 27-29, 2008, Orlando, Florida 6477, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    3. Bateman, Ian J. & Day, Brett H. & Georgiou, Stavros & Lake, Iain, 2006. "The aggregation of environmental benefit values: Welfare measures, distance decay and total WTP," Ecological Economics, Elsevier, vol. 60(2), pages 450-460, December.
    4. Ferrini, Silvia & Scarpa, Riccardo, 2007. "Designs with a priori information for nonmarket valuation with choice experiments: A Monte Carlo study," Journal of Environmental Economics and Management, Elsevier, vol. 53(3), pages 342-363, May.
    5. McNair, Ben J. & Bennett, Jeff & Hensher, David A., 2011. "A comparison of responses to single and repeated discrete choice questions," Resource and Energy Economics, Elsevier, vol. 33(3), pages 554-571, September.
    6. Jacinto Braga & Chris Starmer, 2005. "Preference Anomalies, Preference Elicitation and the Discovered Preference Hypothesis," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 32(1), pages 55-89, September.
    7. Eric Maskin, 1999. "Nash Equilibrium and Welfare Optimality," Review of Economic Studies, Oxford University Press, vol. 66(1), pages 23-38.
    8. Mas-Colell, Andreu & Whinston, Michael D. & Green, Jerry R., 1995. "Microeconomic Theory," OUP Catalogue, Oxford University Press, number 9780195102680, Decembrie.
    9. Greene, William H. & Hensher, David A. & Rose, John, 2006. "Accounting for heterogeneity in the variance of unobserved effects in mixed logit models," Transportation Research Part B: Methodological, Elsevier, vol. 40(1), pages 75-92, January.
    10. Swait, Joffre & Adamowicz, Wiktor, 2001. "Choice Environment, Market Complexity, and Consumer Behavior: A Theoretical and Empirical Approach for Incorporating Decision Complexity into Models of Consumer Choice," Organizational Behavior and Human Decision Processes, Elsevier, vol. 86(2), pages 141-167, November.
    11. Satterthwaite, Mark Allen, 1975. "Strategy-proofness and Arrow's conditions: Existence and correspondence theorems for voting procedures and social welfare functions," Journal of Economic Theory, Elsevier, vol. 10(2), pages 187-217, April.
    12. Ready Richard C. & Whitehead John C. & Blomquist Glenn C., 1995. "Contingent Valuation When Respondents Are Ambivalent," Journal of Environmental Economics and Management, Elsevier, vol. 29(2), pages 181-196, September.
    13. Ekin Birol & Phoebe Koundouri (ed.), 2008. "Choice Experiments Informing Environmental Policy," Books, Edward Elgar Publishing, number 4102.
    14. Richard Carson & Theodore Groves, 2007. "Incentive and informational properties of preference questions," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 37(1), pages 181-210, May.
    15. Thomas P. Holmes & Kevin J. Boyle, 2005. "Dynamic Learning and Context-Dependence in Sequential, Attribute-Based, Stated-Preference Valuation Questions," Land Economics, University of Wisconsin Press, vol. 81(1).
    16. Collins, Jill P. & Vossler, Christian A., 2009. "Incentive compatibility tests of choice experiment value elicitation questions," Journal of Environmental Economics and Management, Elsevier, vol. 58(2), pages 226-235, September.
    17. Dan Ariely & George Loewenstein & Drazen Prelec, 2003. ""Coherent Arbitrariness": Stable Demand Curves Without Stable Preferences," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(1), pages 73-106.
    18. Morrison, Gwendolyn C., 2000. "WTP and WTA in repeated trial experiments: Learning or leading?," Journal of Economic Psychology, Elsevier, vol. 21(1), pages 57-72, February.
    19. Day, Brett & Bateman, Ian J. & Carson, Richard T. & Dupont, Diane & Louviere, Jordan J. & Morimoto, Sanae & Scarpa, Riccardo & Wang, Paul, 2012. "Ordering effects and choice set awareness in repeat-response stated preference studies," Journal of Environmental Economics and Management, Elsevier, vol. 63(1), pages 73-91.
    20. Gregory Poe & Jeremy Clark & Daniel Rondeau & William Schulze, 2002. "Provision Point Mechanisms and Field Validity Tests of Contingent Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 23(1), pages 105-131, September.
    21. Krinsky, Itzhak & Robb, A Leslie, 1986. "On Approximating the Statistical Properties of Elasticities," The Review of Economics and Statistics, MIT Press, vol. 68(4), pages 715-719, November.
    22. Hensher, David A. & Rose, John M., 2007. "Development of commuter and non-commuter mode choice models for the assessment of new public transport infrastructure projects: A case study," Transportation Research Part A: Policy and Practice, Elsevier, vol. 41(5), pages 428-443, June.
    23. G. Cornelis van Kooten & Emina Krcmar & Erwin H. Bulte, 2001. "Preference Uncertainty in Non-Market Valuation: A Fuzzy Approach," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 83(3), pages 487-500.
    24. Ariely, Dan & Loewenstein, George & Prelec, Drazen, 2006. "Tom Sawyer and the construction of value," Journal of Economic Behavior & Organization, Elsevier, vol. 60(1), pages 1-10, May.
    25. Gibbard, Allan, 1973. "Manipulation of Voting Schemes: A General Result," Econometrica, Econometric Society, vol. 41(4), pages 587-601, July.
    26. Jeff Bennett & Russell Blamey (ed.), 2001. "The Choice Modelling Approach to Environmental Valuation," Books, Edward Elgar Publishing, number 2028.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Scheufele, Gabriela & Bennett, Jeffrey W., 2010. "Ordering effects and strategic response in discrete choice experiments," Research Reports 107743, Australian National University, Environmental Economics Research Hub.
    2. Ihli, Hanna Julia & Chiputwa, Brian & Musshoff, Oliver, 2013. "Do Changing Probabilities or Payoffs in Lottery-Choice Experiments Matter? Evidence from Rural Uganda," GlobalFood Discussion Papers 158146, Georg-August-Universitaet Goettingen, GlobalFood, Department of Agricultural Economics and Rural Development.
    3. Mikolaj Czajkowski & Anna Barczak & Wiktor Budzinski & Marek Giergiczny & Nick Hanley, 2014. "Within- and between- sample tests of preference stability and willingness to pay for forest management," Discussion Papers in Environment and Development Economics 2014-06, University of St. Andrews, School of Geography and Sustainable Development.
    4. Baker, Rick & Ruting, Brad, 2014. "Environmental Policy Analysis: A Guide to Non‑Market Valuation," 2014 Conference (58th), February 4-7, 2014, Port Macquarie, Australia 165810, Australian Agricultural and Resource Economics Society.
    5. McNair, Ben J. & Bennett, Jeff & Hensher, David A., 2011. "A comparison of responses to single and repeated discrete choice questions," Resource and Energy Economics, Elsevier, vol. 33(3), pages 554-571, September.
    6. Zawojska, Ewa & Gastineau, Pascal & Mahieu, Pierre-Alexandre & Cheze, Benoit & Paris, Anthony, 2021. "Measuring policy consequentiality perceptions in stated preference surveys," 2021 Annual Meeting, August 1-3, Austin, Texas 313977, Agricultural and Applied Economics Association.
    7. Mikołaj Czajkowski & Marek Giergiczny & William H. Greene, 2012. "Learning and Fatigue Effects Revisited. The Impact of Accounting for Unobservable Preference and Scale Heterogeneity on Perceived Ordering Effects in Multiple Choice Task Discrete Choice Experiments," Working Papers 2012-08, Faculty of Economic Sciences, University of Warsaw.
    8. Tomas Badura & Silvia Ferrini & Michael Burton & Amy Binner & Ian J. Bateman, 2020. "Using Individualised Choice Maps to Capture the Spatial Dimensions of Value Within Choice Experiments," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 75(2), pages 297-322, February.
    9. Ihli, Hanna Julia & Musshoff, Oliver, 2013. "Understanding the Investment Behavior of Ugandan Smallholder Farmers: An Experimental Analysis," 2013 Annual Meeting, August 4-6, 2013, Washington, D.C. 150331, Agricultural and Applied Economics Association.
    10. Mikolaj Czajkowski & Marek Giergiczny & William H. Greene, 2014. "Learning and Fatigue Effects Revisited: Investigating the Effects of Accounting for Unobservable Preference and Scale Heterogeneity," Land Economics, University of Wisconsin Press, vol. 90(2), pages 324-351.
    11. Tenaw G. Abate & Morten R. Mørkbak & Søren B. Olsen, 2018. "Inducing value and institutional learning effects in stated choice experiments using advanced disclosure and instructional choice set treatments," Agricultural Economics, International Association of Agricultural Economists, vol. 49(3), pages 339-351, May.
    12. Christian A. Vossler & Ewa Zawojska, 2018. "Toward a better understanding of elicitation effects in stated preference studies," Working Papers 2018-01, University of Tennessee, Department of Economics.
    13. Sang Hyeon Lee & Doo Bong Han & Vincenzina Caputo & Rodolfo M. Nayga Jr., 2015. "Consumers’ Valuation for a Reduced Salt Product: A Nonhypothetical Choice Experiment," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 63(4), pages 563-582, December.
    14. McCartney, Abbie & Cleland, Jonelle, 2010. "Choice Experiment Framing and Incentive Compatibility: observations from public focus groups," Research Reports 107575, Australian National University, Environmental Economics Research Hub.
    15. Ihli, Hanna Julia & Musshoff, Oliver, 2013. "Investment Behavior of Ugandan Smallholder Farmers: An Experimental Analysis," GlobalFood Discussion Papers 154775, Georg-August-Universitaet Goettingen, GlobalFood, Department of Agricultural Economics and Rural Development.
    16. Gabriela Scheufele & Jeff Bennett, 2012. "Response Strategies and Learning in Discrete Choice Experiments," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 52(3), pages 435-453, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gabriela Scheufele & Jeff Bennett, 2012. "Response Strategies and Learning in Discrete Choice Experiments," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 52(3), pages 435-453, July.
    2. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    3. Scheufele, Gabriela & Bennett, Jeffrey W., 2010. "Ordering effects and strategic response in discrete choice experiments," Research Reports 107743, Australian National University, Environmental Economics Research Hub.
    4. Nguyen, Thanh Cong & Le, Hoa Thu & Nguyen, Hang Dieu & Ngo, Mai Thanh & Nguyen, Hong Quang, 2021. "Examining ordering effects and strategic behaviour in a discrete choice experiment," Economic Analysis and Policy, Elsevier, vol. 70(C), pages 394-413.
    5. Day, Brett & Bateman, Ian J. & Carson, Richard T. & Dupont, Diane & Louviere, Jordan J. & Morimoto, Sanae & Scarpa, Riccardo & Wang, Paul, 2012. "Ordering effects and choice set awareness in repeat-response stated preference studies," Journal of Environmental Economics and Management, Elsevier, vol. 63(1), pages 73-91.
    6. Aravena, Claudia & Hutchinson, W. George & Carlsson, Fredrik & Matthews, David I, 2015. "Testing preference formation in learning design contingent valuation (LDCV) using advanced information and repetitivetreatments," Working Papers in Economics 619, University of Gothenburg, Department of Economics.
    7. Tomasz Gajderowicz & Gabriela Grotkowska, 2019. "Polarization of Tastes: Stated Preference Stability in Sequential Discrete Choices," European Research Studies Journal, European Research Studies Journal, vol. 0(4), pages 70-87.
    8. Glenk, Klaus & Meyerhoff, Jürgen & Akaichi, Faical & Martin-Ortega, Julia, 2019. "Revisiting cost vector effects in discrete choice experiments," Resource and Energy Economics, Elsevier, vol. 57(C), pages 135-155.
    9. Zawojska, Ewa & Czajkowski, Mikolaj & Giergiczny, Marek, 2018. "Valuing tap water quality improvements using stated preference methods. Does the number of discrete choice options matter?," 2018 Annual Meeting, August 5-7, Washington, D.C. 274019, Agricultural and Applied Economics Association.
    10. McNair, Ben J. & Hensher, David A. & Bennett, Jeff, 2010. "Modelling heterogeneity in response behaviour towards a sequence of discrete choice questions: a latent class approach," MPRA Paper 23427, University Library of Munich, Germany.
    11. Mikołaj Czajkowski & Anna Bartczak & Wiktor Budziński & Marek Giergiczny, 2014. "Within- and between- sample tests of preference stability and willingness to pay for forest management," Working Papers 2014-24, Faculty of Economic Sciences, University of Warsaw.
    12. repec:sss:wpaper:201406 is not listed on IDEAS
    13. Thijs Dekker & Paul Koster & Roy Brouwer, 2014. "Changing with the Tide: Semiparametric Estimation of Preference Dynamics," Land Economics, University of Wisconsin Press, vol. 90(4), pages 717-745.
    14. Marit Kragt, 2013. "The Effects of Changing Cost Vectors on Choices and Scale Heterogeneity," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 54(2), pages 201-221, February.
    15. Kragt, Marit Ellen, 2013. "Comparing models of unobserved heterogeneity in environmental choice experiments," 2013 Conference (57th), February 5-8, 2013, Sydney, Australia 152198, Australian Agricultural and Resource Economics Society.
    16. Oehlmann, Malte & Meyerhoff, Jürgen & Mariel, Petr & Weller, Priska, 2017. "Uncovering context-induced status quo effects in choice experiments," Journal of Environmental Economics and Management, Elsevier, vol. 81(C), pages 59-73.
    17. Campbell, Danny & Boeri, Marco & Doherty, Edel & George Hutchinson, W., 2015. "Learning, fatigue and preference formation in discrete choice experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 119(C), pages 345-363.
    18. Meyerhoff, Jürgen & Glenk, Klaus, 2015. "Learning how to choose—effects of instructional choice sets in discrete choice experiments," Resource and Energy Economics, Elsevier, vol. 41(C), pages 122-142.
    19. Sergio Colombo & Wiktor Budziński & Mikołaj Czajkowski & Klaus Glenk, 2022. "The relative performance of ex‐ante and ex‐post measures to mitigate hypothetical and strategic bias in a stated preference study," Journal of Agricultural Economics, Wiley Blackwell, vol. 73(3), pages 845-873, September.
    20. Mikolaj Czajkowski & Marek Giergiczny & William H. Greene, 2014. "Learning and Fatigue Effects Revisited: Investigating the Effects of Accounting for Unobservable Preference and Scale Heterogeneity," Land Economics, University of Wisconsin Press, vol. 90(2), pages 324-351.
    21. Mikołaj Czajkowski & Marek Giergiczny & William H. Greene, 2012. "Learning and Fatigue Effects Revisited. The Impact of Accounting for Unobservable Preference and Scale Heterogeneity on Perceived Ordering Effects in Multiple Choice Task Discrete Choice Experiments," Working Papers 2012-08, Faculty of Economic Sciences, University of Warsaw.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:ajarec:v:57:y:2013:i:2:p:214-233. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/aaresea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.