IDEAS home Printed from https://ideas.repec.org/a/bla/ajarec/v52y2008i3p253-282.html
   My bibliography  Save this article

Design efficiency for non-market valuation with choice modelling: how to measure it, what to report and why

Author

Listed:
  • Riccardo Scarpa
  • John M. Rose

Abstract

We review the basic principles for the evaluation of design efficiency in discrete choice modelling with a focus on efficiency of WTP estimates from the multinomial logit model. The discussion is developed under the realistic assumption that researchers can plausibly define a prior belief on the range of values for the utility coefficients. D-, A-, B-, S- and C-errors are compared as measures of design performance in applied studies and their rationale is discussed. An empirical example based on the generation and comparison of fifteen separate designs from a common set of assumptions illustrates the relevant considerations to the context of non-market valuation, with particular emphasis placed on C-efficiency. Conclusions are drawn for the practice of reporting in non-market valuation and for future work on design research. Copyright 2008 The Authors. Journal compilation 2008 Australian Agricultural and Resource Economics Society Inc. and Blackwell Publishing Asia Pty Ltd.

Suggested Citation

  • Riccardo Scarpa & John M. Rose, 2008. "Design efficiency for non-market valuation with choice modelling: how to measure it, what to report and why ," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 52(3), pages 253-282, September.
  • Handle: RePEc:bla:ajarec:v:52:y:2008:i:3:p:253-282
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1111/j.1467-8489.2007.00436.x
    File Function: link to full text
    Download Restriction: Access to full text is restricted to subscribers.

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. David Hensher, 2006. "Revealing Differences in Willingness to Pay due to the Dimensionality of Stated Choice Designs: An Initial Assessment," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 34(1), pages 7-44, May.
    2. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521766555, March.
    3. Ferrini, Silvia & Scarpa, Riccardo, 2007. "Designs with a priori information for nonmarket valuation with choice experiments: A Monte Carlo study," Journal of Environmental Economics and Management, Elsevier, vol. 53(3), pages 342-363, May.
    4. DeShazo, J. R. & Fermo, German, 2002. "Designing Choice Sets for Stated Preference Methods: The Effects of Complexity on Choice Consistency," Journal of Environmental Economics and Management, Elsevier, vol. 44(1), pages 123-143, July.
    5. Riccardo Scarpa & Danny Campbell & W. George Hutchinson, 2007. "Benefit Estimates for Landscape Improvements: Sequential Bayesian Design and Respondents’ Rationality in a Choice Experiment," Land Economics, University of Wisconsin Press, vol. 83(4), pages 617-634.
    6. Louviere,Jordan J. & Hensher,David A. & Swait,Joffre D., 2000. "Stated Choice Methods," Cambridge Books, Cambridge University Press, number 9780521788304, May.
    7. Caussade, Sebastián & Ortúzar, Juan de Dios & Rizzi, Luis I. & Hensher, David A., 2005. "Assessing the influence of design dimensions on stated choice experiment estimates," Transportation Research Part B: Methodological, Elsevier, vol. 39(7), pages 621-640, August.
    8. Alberini Anna, 1995. "Optimal Designs for Discrete Choice Contingent Valuation Surveys: Single-Bound, Double-Bound, and Bivariate Models," Journal of Environmental Economics and Management, Elsevier, vol. 28(3), pages 287-306, May.
    9. David A. Hensher, 2004. "Identifying the Influence of Stated Choice Design Dimensionality on Willingness to Pay for Travel Time Savings," Journal of Transport Economics and Policy, University of Bath, vol. 38(3), pages 425-446, September.
    10. William S. Breffle & Robert D. Rowe, 2002. "Comparing Choice Question Formats for Evaluating Natural Resource Tradeoffs," Land Economics, University of Wisconsin Press, vol. 78(2), pages 298-314.
    11. David A. Hensher, 2006. "How do respondents process stated choice experiments? Attribute consideration under varying information load," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(6), pages 861-878.
    12. John Rose & Michiel Bliemer, 2013. "Sample size requirements for stated choice experiments," Transportation, Springer, vol. 40(5), pages 1021-1041, September.
    13. Olivier Toubia & John R. Hauser, 2007. "—On Managerially Efficient Experimental Designs," Marketing Science, INFORMS, vol. 26(6), pages 851-858, 11-12.
    14. Hensher, David A. & Stopher, Peter R. & Louviere, Jordan J., 2001. "An exploratory analysis of the effect of numbers of choice sets in designed choice experiments: an airline choice application," Journal of Air Transport Management, Elsevier, vol. 7(6), pages 373-379.
    15. Barbara J. Kanninen, 1993. "Optimal Experimental Design for Double-Bounded Dichotomous Choice Contingent Valuation," Land Economics, University of Wisconsin Press, vol. 69(2), pages 138-146.
    16. Arentze, Theo & Borgers, Aloys & Timmermans, Harry & DelMistro, Romano, 2003. "Transport stated choice responses: effects of task complexity, presentation format and literacy," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 39(3), pages 229-244, May.
    17. Jayson L. Lusk & F. Bailey Norwood, 2005. "Effect of Experimental Design on Choice-Based Conjoint Valuation Estimates," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 87(3), pages 771-785.
    Full references (including those not matched with items on IDEAS)

    More about this item

    JEL classification:

    • C25 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Discrete Regression and Qualitative Choice Models; Discrete Regressors; Proportions; Probabilities
    • Q51 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Environmental Economics - - - Valuation of Environmental Effects

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:ajarec:v:52:y:2008:i:3:p:253-282. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Wiley-Blackwell Digital Licensing) or (Christopher F. Baum). General contact details of provider: http://edirc.repec.org/data/aaresea.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.