IDEAS home Printed from https://ideas.repec.org/p/wai/econwp/05-08.html
   My bibliography  Save this paper

Experimental Designs for Environmental Valuation with Choice-Experiments: A Monte-Carlo Investigation

Author

Listed:

Abstract

We review the practice of experimental design in the environmental economics literature concerned with choice experiments. We then contrast this with advances in the field of experimental design and present a comparison of statistical efficiency across four different experimental designs evaluated by Monte Carlo experiments. Two different situations are envisaged. First, a correct a priori knowledge of the multinomial logit specification used to derive the design and then an incorrect one. The data generating process is based on estimates from data of a real choice experiment with which preference for rural landscape attributes were studied. Results indicate the D-optimal designs are promising, especially those based on Bayesian algorithms with informative prior. However, if good a priori information is lacking, and if there is strong uncertainty about the real data generating process - conditions which are quite common in environmental valuation - then practitioners might be better off with conventional fractional designs from linear models. Under misspecification, a design of this type produces less biased estimates than its competitors.

Suggested Citation

  • Silvia Ferrini & Riccardo Scarpa, 2005. "Experimental Designs for Environmental Valuation with Choice-Experiments: A Monte-Carlo Investigation," Working Papers in Economics 05/08, University of Waikato.
  • Handle: RePEc:wai:econwp:05/08
    as

    Download full text from publisher

    File URL: https://repec.its.waikato.ac.nz/wai/econwp/0508.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. R.K. Blamey & J.W. Bennett & J.J. Louviere & M.D. Morrison & J.C. Rolfe, 2002. "Attribute Causality in Environmental Choice Modelling," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 23(2), pages 167-186, October.
    2. Nick Hanley & Robert Wright & Vic Adamowicz, 1998. "Using Choice Experiments to Value the Environment," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 11(3), pages 413-428, April.
    3. Carlsson, Fredrik & Martinsson, Peter, 2001. "Do Hypothetical and Actual Marginal Willingness to Pay Differ in Choice Experiments?: Application to the Valuation of the Environment," Journal of Environmental Economics and Management, Elsevier, vol. 41(2), pages 179-192, March.
    4. DeShazo, J. R. & Fermo, German, 2002. "Designing Choice Sets for Stated Preference Methods: The Effects of Complexity on Choice Consistency," Journal of Environmental Economics and Management, Elsevier, vol. 44(1), pages 123-143, July.
    5. Joseph A. Herriges & Daniel J. Phaneuf, 2002. "Inducing Patterns of Correlation and Substitution in Repeated Logit Models of Recreation Demand," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 84(4), pages 1076-1090.
    6. Brownstone, David & Train, Kenneth, 1998. "Forecasting new product penetration with flexible substitution patterns," Journal of Econometrics, Elsevier, vol. 89(1-2), pages 109-129, November.
    7. Arora, Neeraj & Huber, Joel, 2001. "Improving Parameter Estimates and Model Prediction by Aggregate Customization in Choice Experiments," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 28(2), pages 273-283, September.
    8. Riccardo Scarpa & Danny Campbell & W. George Hutchinson, 2007. "Benefit Estimates for Landscape Improvements: Sequential Bayesian Design and Respondents’ Rationality in a Choice Experiment," Land Economics, University of Wisconsin Press, vol. 83(4), pages 617-634.
    9. Caussade, Sebastián & Ortúzar, Juan de Dios & Rizzi, Luis I. & Hensher, David A., 2005. "Assessing the influence of design dimensions on stated choice experiment estimates," Transportation Research Part B: Methodological, Elsevier, vol. 39(7), pages 621-640, August.
    10. Zsolt Sándor & Michel Wedel, 2002. "Profile Construction in Experimental Choice Designs for Mixed Logit Models," Marketing Science, INFORMS, vol. 21(4), pages 455-475, February.
    11. Wattage, Premachandra & Mardle, Simon & Pascoe, Sean, 2005. "Evaluation of the importance of fisheries management objectives using choice-experiments," Ecological Economics, Elsevier, vol. 55(1), pages 85-95, October.
    12. Rolfe, John & Bennett, Jeff & Louviere, Jordan, 2000. "Choice modelling and its potential application to tropical rainforest preservation," Ecological Economics, Elsevier, vol. 35(2), pages 289-302, November.
    13. Herriges, Joseph A. & Phaneuf, Daniel J., 2002. "Inducing Patterns Correlation and Substitution in Repeated Logit Model of Recreation Demand," Staff General Research Papers Archive 5035, Iowa State University, Department of Economics.
    14. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521747387.
    15. Peter Boxall & Wiktor Adamowicz, 2002. "Understanding Heterogeneous Preferences in Random Utility Models: A Latent Class Approach," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 23(4), pages 421-446, December.
    16. Scarpa, Riccardo & Ruto, Eric S. K. & Kristjanson, Patti & Radeny, Maren & Drucker, Adam G. & Rege, John E. O., 2003. "Valuing indigenous cattle breeds in Kenya: an empirical comparison of stated and revealed preference value estimates," Ecological Economics, Elsevier, vol. 45(3), pages 409-426, July.
    17. Vivien Foster & Susana Mourato, 2003. "Elicitation Format and Sensitivity to Scope," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 24(2), pages 141-160, February.
    18. Nick Hanley & Robert Wright & Gary Koop, 2002. "Modelling Recreation Demand Using Choice Experiments: Climbing in Scotland," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 22(3), pages 449-466, July.
    19. Richard T. Carson, 2011. "Contingent Valuation," Books, Edward Elgar Publishing, number 2489.
    20. Kimberly Rollins & Will Wistowsky & Michael Jay, 1997. "Wilderness Canoeing in Ontario: Using Cumulative Results to Update Dichotomous Choice Contingent Valuation Offer Amounts," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 45(2), pages 178-178, July.
    21. Boxall, Peter C. & Adamowicz, Wiktor L. & Swait, Joffre & Williams, Michael & Louviere, Jordan, 1996. "A comparison of stated preference methods for environmental valuation," Ecological Economics, Elsevier, vol. 18(3), pages 243-253, September.
    22. Kelvin J. Lancaster, 1966. "A New Approach to Consumer Theory," Journal of Political Economy, University of Chicago Press, vol. 74(2), pages 132-132.
    23. Jin, Jianjun & Wang, Zhishi & Ran, Shenghong, 2006. "Comparison of contingent valuation and choice experiment in solid waste management programs in Macao," Ecological Economics, Elsevier, vol. 57(3), pages 430-441, May.
    24. Nyquist, Hans, 1992. "Optimal Designs of Discrete Response Experiments in Contingent Valuation Studies," The Review of Economics and Statistics, MIT Press, vol. 74(3), pages 559-563, August.
    25. Alberini Anna, 1995. "Optimal Designs for Discrete Choice Contingent Valuation Surveys: Single-Bound, Double-Bound, and Bivariate Models," Journal of Environmental Economics and Management, Elsevier, vol. 28(3), pages 287-306, May.
    26. Barbara J. Kanninen, 1993. "Optimal Experimental Design for Double-Bounded Dichotomous Choice Contingent Valuation," Land Economics, University of Wisconsin Press, vol. 69(2), pages 138-146.
    27. María Vázquez Rodríguez & Carmelo León, 2004. "Altruism and the Economic Values of Environmental and Social Policies," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 28(2), pages 233-249, June.
    28. Louviere, Jordan J & Hensher, David A, 1983. "Using Discrete Choice Models with Experimental Design Data to Forecast Consumer Demand for a Unique Cultural Event," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 10(3), pages 348-361, December.
    29. Carlsson, Fredrik & Frykblom, Peter & Liljenstolpe, Carolina, 2003. "Valuing wetland attributes: an application of choice experiments," Ecological Economics, Elsevier, vol. 47(1), pages 95-103, November.
    30. Kjartan Sælensminde, 2002. "The Impact of Choice Inconsistencies in Stated Choice Studies," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 23(4), pages 403-420, December.
    31. Jayson L. Lusk & F. Bailey Norwood, 2005. "Effect of Experimental Design on Choice-Based Conjoint Valuation Estimates," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 87(3), pages 771-785.
    32. Fredrik Carlsson & Peter Martinsson, 2003. "Design techniques for stated preference methods in health economics," Health Economics, John Wiley & Sons, Ltd., vol. 12(4), pages 281-294, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Alberto Zanni & Alastair Bailey & Sophia Davidova, 2008. "Analysis of the Vocational and Residential Preferences of a Rural Population: Application of an Experimental Technique to Rural Slovenia," Spatial Economic Analysis, Taylor & Francis Journals, vol. 3(1), pages 89-114.
    2. Campbell, Danny & Hutchinson, W. George & Scarpa, Riccardo, 2006. "Using Discrete Choice Experiments to Derive Individual-Specific WTP Estimates for Landscape Improvements under Agri-Environmental Schemes: Evidence from the Rural Environment Protection Scheme in Irel," Sustainability Indicators and Environmental Valuation Working Papers 12220, Fondazione Eni Enrico Mattei (FEEM).
    3. Grisolía, José M. & Longo, Alberto & Boeri, Marco & Hutchinson, George & Kee, Frank, 2013. "Trading off dietary choices, physical exercise and cardiovascular disease risks," Social Science & Medicine, Elsevier, vol. 93(C), pages 130-138.
    4. Danny Campbell & George Hutchinson & Riccardo Scarpa, 2006. "Using mixed logit models to derive individual-specific WTP estimates for landscape improvements under agri-environmental schemes: evidence from the Rural Environment Protection Scheme in Ireland," Working Papers 0607, Rural Economy and Development Programme,Teagasc.
    5. Danny Campbell & W. George Hutchinson & Riccardo Scarpa, 2006. "Lexicographic Preferences in Discrete Choice Experiments: Consequences on Individual-Specific Willingness to Pay Estimates," Working Papers 2006.128, Fondazione Eni Enrico Mattei.
    6. Danny Campbell & W. George Hutchinson & Riccardo Scarpa, 2006. "Lexicographic Preferences in Discrete Choice Experiments: Consequences on Individual-Specific Willingness to Pay Estimates," Working Papers 2006.128, Fondazione Eni Enrico Mattei.
    7. Danny Campbell & George Hutchinson & Riccardo Scarpa, 2006. "Integrating landscape improvement indices and discrete choice experiments: evidence from the Rural Environment Protection Scheme in Ireland," Working Papers 0609, Rural Economy and Development Programme,Teagasc.
    8. Danny Campbell & George Hutchinson & Riccardo Scarpa, 2006. "Benefit Estimates For Landscape Improvements: Sequential Bayesian Design And Respondents’ Rationality In A Choice Experiment Study," Working Papers 0606, Rural Economy and Development Programme,Teagasc.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ferrini, Silvia & Scarpa, Riccardo, 2007. "Designs with a priori information for nonmarket valuation with choice experiments: A Monte Carlo study," Journal of Environmental Economics and Management, Elsevier, vol. 53(3), pages 342-363, May.
    2. Haghani, Milad & Bliemer, Michiel C.J. & Hensher, David A., 2021. "The landscape of econometric discrete choice modelling research," Journal of choice modelling, Elsevier, vol. 40(C).
    3. Campbell, Danny & Hutchinson, W. George & Scarpa, Riccardo, 2006. "Lexicographic Preferences in Discrete Choice Experiments: Consequences on Individual-Specific Willingness to Pay Estimates," Sustainability Indicators and Environmental Valuation Working Papers 12224, Fondazione Eni Enrico Mattei (FEEM).
    4. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    5. Hoyos, David, 2010. "The state of the art of environmental valuation with discrete choice experiments," Ecological Economics, Elsevier, vol. 69(8), pages 1595-1603, June.
    6. Hoyos Ramos, David, 2010. "Using discrete choice experiments for environmental valuation," BILTOKI 1134-8984, Universidad del País Vasco - Departamento de Economía Aplicada III (Econometría y Estadística).
    7. F Alpizar & F Carlsson & P Martinsson, 2003. "Using Choice Experiments for Non-Market Valuation," Economic Issues Journal Articles, Economic Issues, vol. 8(1), pages 83-110, March.
    8. Scarpa, Riccardo & Rose, John M., 2008. "Design efficiency for non-market valuation with choice modelling: how to measure it, what to report and why," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 52(3), pages 1-30.
    9. Mohammed H. Alemu & Søren Bøye Olsen & Suzanne E. Vedel & John Kinyuru & Kennedy O. Pambo, 2016. "Integrating sensory evaluations in incentivized discrete choice experiments to assess consumer demand for cricket flour buns in Kenya," IFRO Working Paper 2016/02, University of Copenhagen, Department of Food and Resource Economics.
    10. del Saz Salazar, Salvador & Hernandez Sancho, Francesc & Sala Garrido, Ramon, 2009. "Estimación del valor económico de la calidad del agua de un río mediante una doble aproximación: una aplicación de los principios económicos de la Directiva Marco del Agua," Economia Agraria y Recursos Naturales, Spanish Association of Agricultural Economists, vol. 9(01), pages 1-27.
    11. De Valck, Jeremy & Vlaeminck, Pieter & Liekens, Inge & Aertsens, Joris & Chen, Wendy & Vranken, Liesbet, 2012. "The sources of preference heterogeneity for nature restoration scenarios," Working Papers 146522, Katholieke Universiteit Leuven, Centre for Agricultural and Food Economics.
    12. Rombach, Meike & Widmar, Nicole Olynk & Byrd, Elizabeth & Bitsch, Vera, 2018. "Do all roses smell equally sweet? Willingness to pay for flower attributes in specialized retail settings by German consumers," Journal of Retailing and Consumer Services, Elsevier, vol. 40(C), pages 91-99.
    13. Rai, Rajesh Kumar & Scarborough, Helen, 2012. "Estimating the public benefits of mitigating damages caused by invasive plant species in a subsistence economy," 2012 Conference (56th), February 7-10, 2012, Fremantle, Australia 124421, Australian Agricultural and Resource Economics Society.
    14. Stine Broch & Suzanne Vedel, 2012. "Using Choice Experiments to Investigate the Policy Relevance of Heterogeneity in Farmer Agri-Environmental Contract Preferences," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 51(4), pages 561-581, April.
    15. Christian Pfarr & Andreas Schmid & Morten Raun Mørkbak, 2018. "Modelling Heterogeneous Preferences for Income Redistribution–An Application of Continuous and Discrete Distributions," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 64(2), pages 270-294, June.
    16. Catalina M. Torres Figuerola & Antoni Riera Font, 2009. "Defining environmental attributes as external costs in choice experiments: A discussion," CRE Working Papers (Documents de treball del CRE) 2009/1, Centre de Recerca Econòmica (UIB ·"Sa Nostra").
    17. Mat Alipiah, Roseliza & Anang, Zuraini & Abdul Rashid, Noorhaslinda Kulub & Smart, James C. R. & Wan Ibrahim, Wan Noorwatie, 2018. "Aquaculturists Preference Heterogeneity towards Wetland Ecosystem Services: A Latent Class Discrete Choice Model," Jurnal Ekonomi Malaysia, Faculty of Economics and Business, Universiti Kebangsaan Malaysia, vol. 52(2), pages 253-266.
    18. Campbell, Danny, 2007. "Combining mixed logit models and random effects models to identify the determinants of willingness to pay for rural landscape improvements," 81st Annual Conference, April 2-4, 2007, Reading University, UK 7975, Agricultural Economics Society.
    19. Pfarr, Christian & Schmid, Andreas & Mørkbak, Morten Raun, 2015. "Latent characteristics and preferences for income redistribution," VfS Annual Conference 2015 (Muenster): Economic Development - Theory and Policy 113001, Verein für Socialpolitik / German Economic Association.

    More about this item

    Keywords

    logit experimental design; efficiency; Monte Carlo choice experiments; non-market valuation;
    All these keywords.

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • C25 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Discrete Regression and Qualitative Choice Models; Discrete Regressors; Proportions; Probabilities
    • C99 - Mathematical and Quantitative Methods - - Design of Experiments - - - Other
    • Q26 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Renewable Resources and Conservation - - - Recreational Aspects of Natural Resources

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wai:econwp:05/08. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Geua Boe-Gibson (email available below). General contact details of provider: https://edirc.repec.org/data/dewaknz.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.