IDEAS home Printed from https://ideas.repec.org/p/sss/wpaper/2014-07.html
   My bibliography  Save this paper

Incorrectly accounting for preference heterogeneity in choice experiments: what are the implications for welfare measurement?

Author

Listed:
  • Cati Torres

    (Universitat de les Illes Balears, Mallorca, Spain)

  • Sergio Colombo

    (Instituto de Investigación y Formación Agraria y Pesquera (IFAPA), Junta de Andalucia)

  • Nick Hanley

    (School of Geography and Sustainable Development, University of St. Andrews)

Abstract

Gains from the incorporation of monetary values for changes in environmental goods and services within cost-benefit analysis depend on how well researchers can estimate these values. One key problem in both stated and revealed preference approaches is how best to model preference heterogeneity. Researchers have implemented several approaches to represent this heterogeneity, and have shown that the choice of approach can have an effect on welfare estimates. However, the question as to the degree of error in welfare measurement from an inappropriate choice of approach has not been addressed. We use Monte Carlo analysis to investigate this issue in the context of choice modelling of coastal water quality changes, when the researcher chooses between a random parameters and latent class model for representing heterogeneity. This allows us to quantify the errors that emerge from using the wrong model in estimating the benefits of water quality improvements. Our overall conclusion is smaller welfare errors are likely to come from use of a latent class model.

Suggested Citation

  • Cati Torres & Sergio Colombo & Nick Hanley, 2014. "Incorrectly accounting for preference heterogeneity in choice experiments: what are the implications for welfare measurement?," Discussion Papers in Environment and Development Economics 2014-07, University of St. Andrews, School of Geography and Sustainable Development.
    • Handle: RePEc:sss:wpaper:2014-07
    as

    Download full text from publisher

    File URL: http://www.st-andrews.ac.uk/media/dept-of-geography-and-sustainable-development/pdf-s/DP%202014-07%20Torres%20et%20al.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Joseph A. Herriges & Catherine L. Kling, 1997. "The Performance of Nested Logit Models When Welfare Estimation Is the Goal," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 79(3), pages 792-802.
    2. Torres, Cati & Hanley, Nick & Riera, Antoni, 2011. "How wrong can you be? Implications of incorrect utility function specification for welfare measurement in choice experiments," Journal of Environmental Economics and Management, Elsevier, vol. 62(1), pages 111-121, July.
    3. Scarpa, Riccardo & Rose, John M., 2008. "Design efficiency for non-market valuation with choice modelling: how to measure it, what to report and why," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 52(3), pages 1-30.
    4. Alberini Anna, 1995. "Efficiency vs Bias of Willingness-to-Pay Estimates: Bivariate and Interval-Data Models," Journal of Environmental Economics and Management, Elsevier, vol. 29(2), pages 169-180, September.
    5. Mike Burton & Dan Rigby, 2009. "Hurdle and Latent Class Approaches to Serial Non-Participation in Choice Models," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 42(2), pages 211-226, February.
    6. Massey, D. Matthew & Newbold, Stephen C. & Gentner, Brad, 2006. "Valuing water quality changes using a bioeconomic model of a coastal recreational fishery," Journal of Environmental Economics and Management, Elsevier, vol. 52(1), pages 482-500, July.
    7. Kling, Catherine L., 1989. "The Importance Of Functional Form In The Estimation Of Welfare," Western Journal of Agricultural Economics, Western Agricultural Economics Association, vol. 14(1), pages 1-7, July.
    8. Klaus Moeltner & J. Scott Shonkwiler, 2005. "Correcting for On-Site Sampling in Random Utility Models," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 87(2), pages 327-339.
    9. Louviere,Jordan J. & Hensher,David A. & Swait,Joffre D. With contributions by-Name:Adamowicz,Wiktor, 2000. "Stated Choice Methods," Cambridge Books, Cambridge University Press, number 9780521788304, October.
    10. Kling, Catherine L. & Herriges, Joseph A., 1997. "Model Performance of Nested Logit Models when Welfare Estimation is the Goal, The," Staff General Research Papers Archive 12331, Iowa State University, Department of Economics.
    11. Stine Broch & Suzanne Vedel, 2012. "Using Choice Experiments to Investigate the Policy Relevance of Heterogeneity in Farmer Agri-Environmental Contract Preferences," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 51(4), pages 561-581, April.
    12. Dan Rigby & Kelvin Balcombe & Michael Burton, 2009. "Mixed Logit Model Performance and Distributional Assumptions: Preferences and GM foods," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 42(3), pages 279-295, March.
    13. David Hensher & Nina Shore & Kenneth Train, 2005. "Households’ Willingness to Pay for Water Service Attributes," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 32(4), pages 509-531, December.
    14. Murdock, Jennifer, 2006. "Handling unobserved site characteristics in random utility models of recreation demand," Journal of Environmental Economics and Management, Elsevier, vol. 51(1), pages 1-25, January.
    15. Wiktor L. Adamowicz & Jerald J. Fletcher & Theodore Graham-Tomasi, 1989. "Functional Form and the Statistical Properties of Welfare Measures," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 71(2), pages 414-421.
    16. William H. Greene & David A. Hensher, 2013. "Revealing additional dimensions of preference heterogeneity in a latent class mixed multinomial logit model," Applied Economics, Taylor & Francis Journals, vol. 45(14), pages 1897-1902, May.
    17. Nesha Beharry-Borg & David Hensher & Riccardo Scarpa, 2009. "An Analytical Framework for Joint vs Separate Decisions by Couples in Choice Experiments: The Case of Coastal Water Quality in Tobago," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 43(1), pages 95-117, May.
    18. Bruno Lanz & Allan Provins, 2013. "Valuing Local Environmental Amenity with Discrete Choice Experiments: Spatial Scope Sensitivity and Heterogeneous Marginal Utility of Income," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 56(1), pages 105-130, September.
    19. Gorm Kipperberg & Douglas Larson, 2012. "Heterogeneous Preferences for Community Recycling Programs," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 53(4), pages 577-604, December.
    20. Adam Drucker, 2007. "Measuring Heterogeneous Preferences for Cattle Traits among Cattle-Keeping Households in East Africa," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 89(4), pages 1005-1019.
    21. Catherine L. Kling & Cynthia J. Thomson, 1996. "The Implications of Model Specification for Welfare Estimation in Nested Logit Models," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 78(1), pages 103-114.
    22. Riccardo Scarpa & Mara Thiene, 2005. "Destination Choice Models for Rock Climbing in the Northeastern Alps: A Latent-Class Approach Based on Intensity of Preferences," Land Economics, University of Wisconsin Press, vol. 81(3).
    23. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521747387, October.
    24. Manuel Frondel & Colin Vance, 2013. "Heterogeneity in the Effect of Home Energy Audits: Theory and Evidence," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 55(3), pages 407-418, July.
    25. David Hensher & William Greene, 2003. "The Mixed Logit model: The state of practice," Transportation, Springer, vol. 30(2), pages 133-176, May.
    26. Peter Boxall & Wiktor Adamowicz, 2002. "Understanding Heterogeneous Preferences in Random Utility Models: A Latent Class Approach," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 23(4), pages 421-446, December.
    27. Birol, Ekin & Karousakis, Katia & Koundouri, Phoebe, 2006. "Using a choice experiment to account for preference heterogeneity in wetland attributes: The case of Cheimaditida wetland in Greece," Ecological Economics, Elsevier, vol. 60(1), pages 145-156, November.
    28. Stephen Hynes & Nick Hanley & Riccardo Scarpa, 2008. "Effects on Welfare Measures of Alternative Means of Accounting for Preference Heterogeneity in Recreational Demand Models," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 90(4), pages 1011-1027.
    29. Roger Claassen & Daniel Hellerstein & Seung Gyu Kim, 2013. "Using Mixed Logit in Land Use Models: Can Expectation-Maximization (EM) Algorithms Facilitate Estimation?," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 95(2), pages 419-425.
    30. Stephane Hess & Nesha Beharry-Borg, 2012. "Accounting for Latent Attitudes in Willingness-to-Pay Studies: The Case of Coastal Water Quality Improvements in Tobago," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 52(1), pages 109-131, May.
    31. Greene, William H. & Hensher, David A., 2003. "A latent class model for discrete choice analysis: contrasts with mixed logit," Transportation Research Part B: Methodological, Elsevier, vol. 37(8), pages 681-698, September.
    32. Vivien Foster & Susana Mourato, 2003. "Elicitation Format and Sensitivity to Scope," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 24(2), pages 141-160, February.
    33. Beharry-Borg, Nesha & Scarpa, Riccardo, 2010. "Valuing quality changes in Caribbean coastal waters for heterogeneous beach visitors," Ecological Economics, Elsevier, vol. 69(5), pages 1124-1139, March.
    34. Stephane Hess & John Rose, 2012. "Can scale and coefficient heterogeneity be separated in random coefficients models?," Transportation, Springer, vol. 39(6), pages 1225-1239, November.
    35. Kenneth E. Train, 1998. "Recreation Demand Models with Taste Differences over People," Land Economics, University of Wisconsin Press, vol. 74(2), pages 230-239.
    36. Milon, J. Walter & Scrogin, David, 2006. "Latent preferences and valuation of wetland ecosystem restoration," Ecological Economics, Elsevier, vol. 56(2), pages 162-175, February.
    37. Provencher, Bill & Bishop, R.C.Richard C., 2004. "Does accounting for preference heterogeneity improve the forecasting of a random utility model? A case study," Journal of Environmental Economics and Management, Elsevier, vol. 48(1), pages 793-810, July.
    38. Johansson,Per-Olov, 1993. "Cost-Benefit Analysis of Environmental Change," Cambridge Books, Cambridge University Press, number 9780521447928, October.
    39. Junyi Shen & Tatsuyoshi Saijo, 2007. "Does energy efficiency label alter consumers f purchase decision? A latent class approach on Shanghai data," OSIPP Discussion Paper 07E005, Osaka School of International Public Policy, Osaka University.
    40. Catherine L. Kling, 1988. "The Reliability of Estimates of Environmental Benefits from Recreation Demand Models," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 70(4), pages 892-901.
    41. Kling, Catherine L., 1997. "Evaluation of the Gains from Combining Travel Cost and Contingent Valuation Data to Value Nonmarket Goods (An)," Staff General Research Papers Archive 1598, Iowa State University, Department of Economics.
    42. Angel Bujosa & Antoni Riera & Robert Hicks, 2010. "Combining Discrete and Continuous Representations of Preference Heterogeneity: A Latent Class Approach," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 47(4), pages 477-493, December.
    43. William Greene & David Hensher, 2010. "Does scale heterogeneity across individuals matter? An empirical assessment of alternative logit models," Transportation, Springer, vol. 37(3), pages 413-428, May.
    44. Chandra R. Bhat, 1997. "An Endogenous Segmentation Mode Choice Model with an Application to Intercity Travel," Transportation Science, INFORMS, vol. 31(1), pages 34-48, February.
    45. Jayson L. Lusk & F. Bailey Norwood, 2005. "Effect of Experimental Design on Choice-Based Conjoint Valuation Estimates," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 87(3), pages 771-785.
    46. Kling, Catherine L., 1987. "Simulation Approach to Comparing Multiple Site Recreation Demand Models Using Chesapeake Bay Survey Data (A)," Staff General Research Papers Archive 1583, Iowa State University, Department of Economics.
    47. Søren Olsen & Thomas Lundhede & Jette Jacobsen & Bo Thorsen, 2011. "Tough and Easy Choices: Testing the Influence of Utility Difference on Stated Certainty-in-Choice in Choice Experiments," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 49(4), pages 491-510, August.
    48. Riccardo Scarpa & Timothy J. Gilbride & Danny Campbell & David A. Hensher, 2009. "Modelling attribute non-attendance in choice experiments for rural landscape valuation," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 36(2), pages 151-174, June.
    49. Riccardo Scarpa & Ian Bateman, 2000. "Efficiency Gains Afforded by Improved Bid Design versus Follow-up Valuation Questions in Discrete-Choice CV Studies," Land Economics, University of Wisconsin Press, vol. 76(2), pages 299-311.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sagebiel, Julian, 2017. "Preference heterogeneity in energy discrete choice experiments: A review on methods for model selection," Renewable and Sustainable Energy Reviews, Elsevier, vol. 69(C), pages 804-811.
    2. Owusu-Sekyere, E. & Owusu, V. & Donkor, E. & Jordaan, H., 2018. "Welfare estimates of food safety and quality policy changes in Southern Ghana," 2018 Conference, July 28-August 2, 2018, Vancouver, British Columbia 276939, International Association of Agricultural Economists.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:sss:wpaper:201407 is not listed on IDEAS
    2. Catalina M. Torres Figuerola & Nick Hanley & Sergio Colombo, 2011. "Incorrectly accounting for taste heterogeneity in choice experiments: Does it really matter for welfare measurement?," CRE Working Papers (Documents de treball del CRE) 2011/1, Centre de Recerca Econòmica (UIB ·"Sa Nostra").
    3. Torres, Cati & Hanley, Nick & Riera, Antoni, 2011. "How wrong can you be? Implications of incorrect utility function specification for welfare measurement in choice experiments," Journal of Environmental Economics and Management, Elsevier, vol. 62(1), pages 111-121, July.
    4. Catalina M. Torres Figuerola & Nick Hanley & Antoni Riera Font, 2008. "The implications of incorrect utility function specification for welfare measurement in choice experiments," CRE Working Papers (Documents de treball del CRE) 2008/6, Centre de Recerca Econòmica (UIB ·"Sa Nostra").
    5. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    6. Torres, Catalina M. & Colombo, Sergio & Hanley, Nick, 2014. "Incorrectly accounting for preference heterogeneity in choice experiments: Implications for welfare measurement," Economia Agraria y Recursos Naturales, Spanish Association of Agricultural Economists, vol. 14(02), pages 1-25, December.
    7. Angel Bujosa & Antoni Riera & Robert Hicks, 2010. "Combining Discrete and Continuous Representations of Preference Heterogeneity: A Latent Class Approach," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 47(4), pages 477-493, December.
    8. Yoo, James & Ready, Richard C., 2014. "Preference heterogeneity for renewable energy technology," Energy Economics, Elsevier, vol. 42(C), pages 101-114.
    9. Sergio Colombo & Nick Hanley & Jordan Louviere, 2009. "Modeling preference heterogeneity in stated choice data: an analysis for public goods generated by agriculture," Agricultural Economics, International Association of Agricultural Economists, vol. 40(3), pages 307-322, May.
    10. Franceschinis, Cristiano & Thiene, Mara & Scarpa, Riccardo & Rose, John & Moretto, Michele & Cavalli, Raffaele, 2017. "Adoption of renewable heating systems: An empirical test of the diffusion of innovation theory," Energy, Elsevier, vol. 125(C), pages 313-326.
    11. Beharry-Borg, Nesha & Scarpa, Riccardo, 2010. "Valuing quality changes in Caribbean coastal waters for heterogeneous beach visitors," Ecological Economics, Elsevier, vol. 69(5), pages 1124-1139, March.
    12. Varela, Elsa & Jacobsen, Jette Bredahl & Soliño, Mario, 2014. "Understanding the heterogeneity of social preferences for fire prevention management," Ecological Economics, Elsevier, vol. 106(C), pages 91-104.
    13. Doherty, Edel & Campbell, Danny & Hynes, Stephen, 2012. "Exploring cost heterogeneity in recreational demand," Working Papers 148832, National University of Ireland, Galway, Socio-Economic Marine Research Unit.
    14. Sarrias, Mauricio & Daziano, Ricardo, 2017. "Multinomial Logit Models with Continuous and Discrete Individual Heterogeneity in R: The gmnl Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 79(i02).
    15. Kloos, Julia & Tsegai, Daniel W., 2009. "Preferences for domestic water services in the Middle Olifants sub-basin of South Africa," Discussion Papers 49970, University of Bonn, Center for Development Research (ZEF).
    16. Thiene, Mara & Scarpa, Riccardo & Longo, Alberto & Hutchinson, William George, 2018. "Types of front of pack food labels: Do obese consumers care? Evidence from Northern Ireland," Food Policy, Elsevier, vol. 80(C), pages 84-102.
    17. von Haefen, Roger H. & Domanski, Adam, 2018. "Estimation and welfare analysis from mixed logit models with large choice sets," Journal of Environmental Economics and Management, Elsevier, vol. 90(C), pages 101-118.
    18. Stephane Hess, 2014. "Latent class structures: taste heterogeneity and beyond," Chapters, in: Stephane Hess & Andrew Daly (ed.), Handbook of Choice Modelling, chapter 14, pages 311-330, Edward Elgar Publishing.
    19. Sarrias, Mauricio & Daziano, Ricardo A., 2018. "Individual-specific point and interval conditional estimates of latent class logit parameters," Journal of choice modelling, Elsevier, vol. 27(C), pages 50-61.
    20. Balcombe, Kelvin & Chalak, Ali & Fraser, Iain, 2009. "Model selection for the mixed logit with Bayesian estimation," Journal of Environmental Economics and Management, Elsevier, vol. 57(2), pages 226-237, March.
    21. Domanski, Adam, 2009. "Estimating Mixed Logit Recreation Demand Models With Large Choice Sets," 2009 Annual Meeting, July 26-28, 2009, Milwaukee, Wisconsin 49413, Agricultural and Applied Economics Association.

    More about this item

    Keywords

    choice experiments; cost-benefit analysis; Monte Carlo analysis; non-market goods; preference heterogeneity; welfare measurement.;
    All these keywords.

    JEL classification:

    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • Q51 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Environmental Economics - - - Valuation of Environmental Effects

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sss:wpaper:2014-07. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Laure Kuhfuss (email available below). General contact details of provider: https://edirc.repec.org/data/eestauk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.