IDEAS home Printed from https://ideas.repec.org/a/kap/enreec/v62y2015i3p433-455.html
   My bibliography  Save this article

Experimental Design Criteria and Their Behavioural Efficiency: An Evaluation in the Field

Author

Listed:
  • Richard Yao
  • Riccardo Scarpa
  • John Rose
  • James Turner

Abstract

Comparative results from an evaluation of inferred attribute non-attendance are provided for experimental designs optimised for three commonly employed statistical criteria, namely: orthogonality, Bayesian D-efficiency and optimal orthogonality in the difference. Survey data are from a choice experiment used to value the conservation of threatened native species in New Zealand’s production forests. In line with recent literature, we argue that attribute non-attendance can be taken as one of the important measures of behavioural efficiency. We focus on how this varies when alternative design criteria are used. Attribute non-attendance is inferred using an approach based on constrained latent classes. Given our proposed criterion to evaluate behavioural efficiency, our data indicate that the Bayesian D-efficiency criterion provides behaviourally more efficient choice tasks compared to the other two criteria. Copyright Springer Science+Business Media Dordrecht 2015

Suggested Citation

  • Richard Yao & Riccardo Scarpa & John Rose & James Turner, 2015. "Experimental Design Criteria and Their Behavioural Efficiency: An Evaluation in the Field," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 62(3), pages 433-455, November.
  • Handle: RePEc:kap:enreec:v:62:y:2015:i:3:p:433-455
    DOI: 10.1007/s10640-014-9823-7
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s10640-014-9823-7
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1007/s10640-014-9823-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kerr, Geoffrey N. & Sharp, Basil M.H., 2010. "Choice experiment adaptive design benefits: a case study," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 54(4), pages 1-14.
    2. Bliemer, Michiel C.J. & Rose, John M., 2010. "Construction of experimental designs for mixed logit models allowing for correlation across choice observations," Transportation Research Part B: Methodological, Elsevier, vol. 44(6), pages 720-734, July.
    3. Ferrini, Silvia & Scarpa, Riccardo, 2007. "Designs with a priori information for nonmarket valuation with choice experiments: A Monte Carlo study," Journal of Environmental Economics and Management, Elsevier, vol. 53(3), pages 342-363, May.
    4. David A. Hensher, 2008. "Joint Estimation of Process and Outcome in Choice Experiments and Implications for Willingness to Pay," Journal of Transport Economics and Policy, University of Bath, vol. 42(2), pages 297-322, May.
    5. Danny Campbell & W. Hutchinson & Riccardo Scarpa, 2008. "Incorporating Discontinuous Preferences into the Analysis of Discrete Choice Experiments," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 41(3), pages 401-417, November.
    6. Scarpa, Riccardo & Rose, John M., 2008. "Design efficiency for non-market valuation with choice modelling: how to measure it, what to report and why," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 52(3), pages 1-30.
    7. Hole, Arne Risa, 2011. "A discrete choice model with endogenous attribute attendance," Economics Letters, Elsevier, vol. 110(3), pages 203-205, March.
    8. Fredrik Carlsson & Mitesh Kataria & Elina Lampi, 2010. "Dealing with Ignored Attributes in Choice Experiments on Valuation of Sweden’s Environmental Quality Objectives," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 47(1), pages 65-89, September.
    9. Riccardo Scarpa & Mara Thiene & David A. Hensher, 2010. "Monitoring Choice Task Attribute Attendance in Nonmarket Valuation of Multiple Park Management Services: Does It Matter?," Land Economics, University of Wisconsin Press, vol. 86(4), pages 817-839.
    10. Riccardo Scarpa & Danny Campbell & W. George Hutchinson, 2007. "Benefit Estimates for Landscape Improvements: Sequential Bayesian Design and Respondents’ Rationality in a Choice Experiment," Land Economics, University of Wisconsin Press, vol. 83(4), pages 617-634.
    11. William H. Greene & David A. Hensher, 2010. "Ordered Choices and Heterogeneity in Attribute Processing," Journal of Transport Economics and Policy, University of Bath, vol. 44(3), pages 331-364, September.
    12. Swait, Joffre, 2001. "A non-compensatory choice model incorporating attribute cutoffs," Transportation Research Part B: Methodological, Elsevier, vol. 35(10), pages 903-928, November.
    13. David Hensher & John Rose & William Greene, 2012. "Inferring attribute non-attendance from stated choice data: implications for willingness to pay estimates and a warning for stated choice experiment design," Transportation, Springer, vol. 39(2), pages 235-245, March.
    14. Zsolt Sándor & Michel Wedel, 2002. "Profile Construction in Experimental Choice Designs for Mixed Logit Models," Marketing Science, INFORMS, vol. 21(4), pages 455-475, February.
    15. John Rose & Michiel Bliemer, 2013. "Sample size requirements for stated choice experiments," Transportation, Springer, vol. 40(5), pages 1021-1041, September.
    16. Puckett, Sean M. & Hensher, David A., 2009. "Revealing the extent of process heterogeneity in choice analysis: An empirical assessment," Transportation Research Part A: Policy and Practice, Elsevier, vol. 43(2), pages 117-126, February.
    17. Balcombe, Kelvin & Burton, Michael & Rigby, Dan, 2011. "Skew and attribute non-attendance within the Bayesian mixed logit model," Journal of Environmental Economics and Management, Elsevier, vol. 62(3), pages 446-461.
    18. Campbell, Danny & Hensher, David A. & Scarpa, Riccardo, 2012. "Cost thresholds, cut-offs and sensitivities in stated choice analysis: Identification and implications," Resource and Energy Economics, Elsevier, vol. 34(3), pages 396-411.
    19. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521747387.
    20. Morten Mørkbak & Tove Christensen & Dorte Gyrd-Hansen, 2010. "Choke Price Bias in Choice Experiments," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 45(4), pages 537-551, April.
    21. Peter Boxall & Wiktor Adamowicz, 2002. "Understanding Heterogeneous Preferences in Random Utility Models: A Latent Class Approach," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 23(4), pages 421-446, December.
    22. Bart Vermeulen & Peter Goos & Riccardo Scarpa & Martina Vandebroek, 2011. "Bayesian Conjoint Choice Designs for Measuring Willingness to Pay," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 48(1), pages 129-149, January.
    23. Riccardo Scarpa & Raffaele Zanoli & Viola Bruschi & Simona Naspetti, 2013. "Inferred and Stated Attribute Non-attendance in Food Choice Experiments," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 95(1), pages 165-180.
    24. Bliemer, Michiel C.J. & Rose, John M., 2011. "Experimental design influences on stated choice outputs: An empirical study in air travel choice," Transportation Research Part A: Policy and Practice, Elsevier, vol. 45(1), pages 63-79, January.
    25. David Hensher & William Greene, 2010. "Non-attendance and dual processing of common-metric attributes in choice analysis: a latent class specification," Empirical Economics, Springer, vol. 39(2), pages 413-426, October.
    26. Víctor Cantillo & Juan de Dios Ortúzar, 2005. "Implications of Thresholds in Discrete Choice Modelling," Transport Reviews, Taylor & Francis Journals, vol. 26(6), pages 667-691, November.
    27. McIntosh, E. & Ryan, M., 2002. "Using discrete choice experiments to derive welfare estimates for the provision of elective surgery: Implications of discontinuous preferences," Journal of Economic Psychology, Elsevier, vol. 23(3), pages 367-382, June.
    28. Kelvin Balcombe & Iain Fraser, 2011. "A general treatment of ‘don't know’ responses from choice experiments," European Review of Agricultural Economics, Foundation for the European Review of Agricultural Economics, vol. 38(2), pages 171-191, June.
    29. Cantillo, Víctor & Heydecker, Benjamin & de Dios Ortúzar, Juan, 2006. "A discrete choice model incorporating thresholds for perception in attribute values," Transportation Research Part B: Methodological, Elsevier, vol. 40(9), pages 807-825, November.
    30. Greene, William H. & Hensher, David A., 2003. "A latent class model for discrete choice analysis: contrasts with mixed logit," Transportation Research Part B: Methodological, Elsevier, vol. 37(8), pages 681-698, September.
    31. Elizabeth Kinter & Thomas Prior & Christopher Carswell & John Bridges, 2012. "A Comparison of Two Experimental Design Approaches in Applying Conjoint Analysis in Patient-Centered Outcomes Research," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 5(4), pages 279-294, December.
    32. John Rose & Iain Black, 2006. "Means matter, but variance matter too: Decomposing response latency influences on variance heterogeneity in stated preference experiments," Marketing Letters, Springer, vol. 17(4), pages 295-310, December.
    33. Emily Lancsar & Jordan Louviere, 2006. "Deleting ‘irrational’ responses from discrete choice experiments: a case of investigating or imposing preferences?," Health Economics, John Wiley & Sons, Ltd., vol. 15(8), pages 797-811, August.
    34. David A. Hensher, 2006. "How do respondents process stated choice experiments? Attribute consideration under varying information load," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(6), pages 861-878.
    35. Geoffrey N. Kerr & Basil M. H. Sharp, 2010. "Choice experiment adaptive design benefits: a case study ," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 54(4), pages 407-420, October.
    36. Jordan J. Louviere & Towhidul Islam & Nada Wasi & Deborah Street & Leonie Burgess, 2008. "Designing Discrete Choice Experiments: Do Optimal Designs Come at a Price?," Journal of Consumer Research, Oxford University Press, vol. 35(2), pages 360-375, March.
    37. Kessels, Roselinde & Goos, Peter & Vandebroek, Martina, 2008. "Optimal designs for conjoint experiments," Computational Statistics & Data Analysis, Elsevier, vol. 52(5), pages 2369-2387, January.
    38. Yao, Richard T. & Scarpa, Riccardo & Turner, James A. & Barnard, Tim D. & Rose, John M. & Palma, João H.N. & Harrison, Duncan R., 2014. "Valuing biodiversity enhancement in New Zealand's planted forests: Socioeconomic and spatial determinants of willingness-to-pay," Ecological Economics, Elsevier, vol. 98(C), pages 90-101.
    39. Louviere, Jordan J & Hensher, David A, 1983. "Using Discrete Choice Models with Experimental Design Data to Forecast Consumer Demand for a Unique Cultural Event," Journal of Consumer Research, Oxford University Press, vol. 10(3), pages 348-361, December.
    40. Rosalie Viney & Elizabeth Savage & Jordan Louviere, 2005. "Empirical investigation of experimental design properties of discrete choice experiments in health care," Health Economics, John Wiley & Sons, Ltd., vol. 14(4), pages 349-362, April.
    41. Riccardo Scarpa & Timothy J. Gilbride & Danny Campbell & David A. Hensher, 2009. "Modelling attribute non-attendance in choice experiments for rural landscape valuation," European Review of Agricultural Economics, Foundation for the European Review of Agricultural Economics, vol. 36(2), pages 151-174, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mariel, Petr & Meyerhoff, Jürgen, 2018. "A More Flexible Model or Simply More Effort? On the Use of Correlated Random Parameters in Applied Choice Studies," Ecological Economics, Elsevier, vol. 154(C), pages 419-429.
    2. DeLong, Karen L. & Syrengelas, Konstantinos G. & Grebitus, Carola & Nayga, Rodolfo M., 2021. "Visual versus Text Attribute Representation in Choice Experiments," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 94(C).
    3. Nicolas Krucien & Nathalie Pelletier-Fleury & Amiram Gafni, 2019. "Measuring Public Preferences for Health Outcomes and Expenditures in a Context of Healthcare Resource Re-Allocation," PharmacoEconomics, Springer, vol. 37(3), pages 407-417, March.
    4. Marcel F. Jonker & Bas Donkers & Esther de Bekker‐Grob & Elly A. Stolk, 2019. "Attribute level overlap (and color coding) can reduce task complexity, improve choice consistency, and decrease the dropout rate in discrete choice experiments," Health Economics, John Wiley & Sons, Ltd., vol. 28(3), pages 350-363, March.
    5. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    6. Richard Yao & David Palmer & Barbara Hock & Duncan Harrison & Tim Payn & Juan Monge, 2019. "Forest Investment Framework as a Support Tool for the Sustainable Management of Planted Forests," Sustainability, MDPI, Open Access Journal, vol. 11(12), pages 1-22, June.
    7. David Throsby & Anita Zednik & Jorge E. Araña, 2021. "Public preferences for heritage conservation strategies: a choice modelling approach," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 45(3), pages 333-358, September.
    8. Sviataslau Valasiuk & Mikołaj Czajkowski & Marek Giergiczny & Tomasz Żylicz & Knut Veisten & Marine Elbakidze & Per Angelstam, 2017. "Are Bilateral Conservation Policies for the Białowieża Forest Unattainable? Analysis of Stated Preferences of Polish and Belarusian Public," Working Papers 2017-09, Faculty of Economic Sciences, University of Warsaw.
    9. Nicolas Krucien & Jonathan Sicsic & Mandy Ryan, 2019. "For better or worse? Investigating the validity of best–worst discrete choice experiments in health," Health Economics, John Wiley & Sons, Ltd., vol. 28(4), pages 572-586, April.
    10. Oehlmann, Malte & Meyerhoff, Jürgen & Mariel, Petr & Weller, Priska, 2017. "Uncovering context-induced status quo effects in choice experiments," Journal of Environmental Economics and Management, Elsevier, vol. 81(C), pages 59-73.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Caputo, Vincenzina & Loo, Ellen J. Van & Scarpa, Riccardo & Nayga, Rodolfo M. Jr & Verbeke, Wim, 2014. "“Using Experiments to Address Attribute Non-attendance in Consumer Food Choices”," 2014 Annual Meeting, July 27-29, 2014, Minneapolis, Minnesota 177173, Agricultural and Applied Economics Association.
    2. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    3. Bliemer, Michiel C.J. & Rose, John M., 2011. "Experimental design influences on stated choice outputs: An empirical study in air travel choice," Transportation Research Part A: Policy and Practice, Elsevier, vol. 45(1), pages 63-79, January.
    4. Macario Rodríguez‐Entrena & Anastasio J. Villanueva & José A. Gómez‐Limón, 2019. "Unraveling determinants of inferred and stated attribute nonattendance: Effects on farmers’ willingness to accept to join agri‐environmental schemes," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 67(1), pages 31-52, March.
    5. Weller, Priska & Oehlmann, Malte & Mariel, Petr & Meyerhoff, Jürgen, 2014. "Stated and inferred attribute non-attendance in a design of designs approach," Journal of choice modelling, Elsevier, vol. 11(C), pages 43-56.
    6. Logar, Ivana & Brouwer, Roy & Campbell, Danny, 2020. "Does attribute order influence attribute-information processing in discrete choice experiments?," Resource and Energy Economics, Elsevier, vol. 60(C).
    7. Campbell, Danny & Hensher, David A. & Scarpa, Riccardo, 2012. "Cost thresholds, cut-offs and sensitivities in stated choice analysis: Identification and implications," Resource and Energy Economics, Elsevier, vol. 34(3), pages 396-411.
    8. Marit E. Kragt, 2013. "Stated and Inferred Attribute Attendance Models: A Comparison with Environmental Choice Experiments," Journal of Agricultural Economics, Wiley Blackwell, vol. 64(3), pages 719-736, September.
    9. Caputo, Vincenzina & Nayga, M. Rodolfo Jr. & Sacchi, Giovanna & Scarpa, Riccardo, 2016. "Attribute non-attendance or attribute-level non-attendance? A choice experiment application on extra virgin olive oil," 2016 Annual Meeting, July 31-August 2, Boston, Massachusetts 236035, Agricultural and Applied Economics Association.
    10. David Hensher, 2014. "Attribute processing as a behavioural strategy in choice making," Chapters, in: Stephane Hess & Andrew Daly (ed.), Handbook of Choice Modelling, chapter 12, pages 268-289, Edward Elgar Publishing.
    11. Sandorf, Erlend Dancke & Crastes dit Sourd, Romain & Mahieu, Pierre-Alexandre, 2018. "The effect of attribute-alternative matrix displays on preferences and processing strategies," Journal of choice modelling, Elsevier, vol. 29(C), pages 113-132.
    12. Mara Thiene & Riccardo Scarpa & Jordan Louviere, 2015. "Addressing Preference Heterogeneity, Multiple Scales and Attribute Attendance with a Correlated Finite Mixing Model of Tap Water Choice," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 62(3), pages 637-656, November.
    13. Kosenius, Anna-Kaisa, 2013. "Preference discontinuity in choice experiment: Determinants and implications," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 45(C), pages 138-145.
    14. Colombo, Sergio & Christie, Michael & Hanley, Nick, 2013. "What are the consequences of ignoring attributes in choice experiments? Implications for ecosystem service valuation," Ecological Economics, Elsevier, vol. 96(C), pages 25-35.
    15. Hole, Arne Risa & Kolstad, Julie Riise & Gyrd-Hansen, Dorte, 2013. "Inferred vs. stated attribute non-attendance in choice experiments: A study of doctors’ prescription behaviour," Journal of Economic Behavior & Organization, Elsevier, vol. 96(C), pages 21-31.
    16. Collins, Andrew T. & Rose, John M. & Hensher, David A., 2013. "Specification issues in a generalised random parameters attribute nonattendance model," Transportation Research Part B: Methodological, Elsevier, vol. 56(C), pages 234-253.
    17. Nguyen, Thanh Cong & Robinson, Jackie & Whitty, Jennifer A. & Kaneko, Shinji & Nguyen, The Chinh, 2015. "Attribute non-attendance in discrete choice experiments: A case study in a developing country," Economic Analysis and Policy, Elsevier, vol. 47(C), pages 22-33.
    18. Gonçalves, Tânia & Lourenço-Gomes, Lina & Pinto, Lígia M. Costa, 2020. "Dealing with ignored attributes through an inferred approach in wine choice experiments," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 87(C).
    19. Haghani, Milad & Sarvi, Majid, 2018. "Hypothetical bias and decision-rule effect in modelling discrete directional choices," Transportation Research Part A: Policy and Practice, Elsevier, vol. 116(C), pages 361-388.
    20. Klaus Glenk & Julia Martin-Ortega & Manuel Pulido-Velazquez & Jacqueline Potts, 2015. "Inferring Attribute Non-attendance from Discrete Choice Experiments: Implications for Benefit Transfer," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 60(4), pages 497-520, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:enreec:v:62:y:2015:i:3:p:433-455. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: http://www.springer.com .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.