IDEAS home Printed from https://ideas.repec.org/a/oup/erevae/v49y2022i5p971-1004..html
   My bibliography  Save this article

A calibrated choice experiment method

Author

Listed:
  • Lauren Chenarides
  • Carola Grebitus
  • Jayson L Lusk
  • Iryna Printezis

Abstract

Although choice experiments (CEs) have emerged as the most popular stated preference method in applied economics, the method is not free from biases related to order and presentation effects. This paper introduces a new preference elicitation method referred to as a calibrated CE (CCE), and we explore the ability of the new method to alleviate starting-point bias. The new approach utilises the distribution of preferences from a prior CE to provide real-time feedback to respondents about our best guess of their willingness-to-pay (WTP) for food attributes and allows respondents to adjust and calibrate their values. The analysis utilises data collected in 2017 in two US cities, Phoenix and Detroit, on consumer preferences for local and organic tomatoes sold through supermarkets, urban farms and farmers’ markets to establish a prior preference distribution. We re-conducted the survey in May 2020 and implemented the CCE. Conventional analysis of the 2020 CE data shows that WTP is strongly influenced by a starting point: the higher the initial price respondents encountered, the higher the absolute value of their WTP. Despite this bias, we show that when respondents have the opportunity to update their WTP when presented with the best guess, the resulting calibrated WTP is much less influenced by the random starting point.

Suggested Citation

  • Lauren Chenarides & Carola Grebitus & Jayson L Lusk & Iryna Printezis, 2022. "A calibrated choice experiment method," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 49(5), pages 971-1004.
  • Handle: RePEc:oup:erevae:v:49:y:2022:i:5:p:971-1004.
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1093/erae/jbac011
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jayson L. Lusk & F. Bailey Norwood, 2011. "Animal Welfare Economics," Applied Economic Perspectives and Policy, Agricultural and Applied Economics Association, vol. 33(4), pages 463-483.
    2. David Revelt and Kenneth Train., 2000. "Customer-Specific Taste Parameters and Mixed Logit: Households' Choice of Electricity Supplier," Economics Working Papers E00-274, University of California at Berkeley.
    3. Rebecca Taylor & Sofia B. Villas-Boas, 2016. "Food Store Choices of Poor Households: A Discrete Choice Analysis of the National Household Food Acquisition and Purchase Survey (FoodAPS)," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 98(2), pages 513-532.
    4. Dawn Thilmany & Craig A. Bond & Jennifer K. Bond, 2008. "Going Local: Exploring Consumer Behavior and Motivations for Direct Food Purchases," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 90(5), pages 1303-1309.
    5. Thong Meas & Wuyang Hu & Marvin T. Batte & Timothy A. Woods & Stan Ernst, 2015. "Substitutes or Complements? Consumer Preference for Local and Organic Food Attributes," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 97(4), pages 1044-1071.
    6. DeShazo, J. R. & Fermo, German, 2002. "Designing Choice Sets for Stated Preference Methods: The Effects of Complexity on Choice Consistency," Journal of Environmental Economics and Management, Elsevier, vol. 44(1), pages 123-143, July.
    7. David A Hensher & William H Greene & John M Rose, 2006. "Deriving Willingness-to-Pay Estimates of Travel-Time Savings from Individual-Based Parameters," Environment and Planning A, , vol. 38(12), pages 2365-2376, December.
    8. Norwood, F. Bailey & Lusk, Jayson L., 2011. "A calibrated auction-conjoint valuation method: Valuing pork and eggs produced under differing animal welfare conditions," Journal of Environmental Economics and Management, Elsevier, vol. 62(1), pages 80-94, July.
    9. Herriges, Joseph A. & Shogren, Jason F., 1996. "Starting Point Bias in Dichotomous Choice Valuation with Follow-Up Questioning," Journal of Environmental Economics and Management, Elsevier, vol. 30(1), pages 112-131, January.
    10. Cherry, Todd L. & Crocker, Thomas D. & Shogren, Jason F., 2003. "Rationality spillovers," Journal of Environmental Economics and Management, Elsevier, vol. 45(1), pages 63-84, January.
    11. Douglas Dyer & John H. Kagel, 1996. "Bidding in Common Value Auctions: How the Commercial Construction Industry Corrects for the Winner's Curse," Management Science, INFORMS, vol. 42(10), pages 1463-1475, October.
    12. Jacinto Braga & Chris Starmer, 2005. "Preference Anomalies, Preference Elicitation and the Discovered Preference Hypothesis," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 32(1), pages 55-89, September.
    13. Christopher D. Azevedo & Joseph A. Herriges & Catherine L. Kling, 2003. "Combining Revealed and Stated Preferences: Consistency Tests and Their Interpretations," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 85(3), pages 525-537.
    14. Deacue Fields & Walt Prevatt, 2008. "An Incentive Compatible Conjoint Ranking Mechanism," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 90(2), pages 487-498.
    15. Sarrias, Mauricio, 2020. "Individual-specific posterior distributions from Mixed Logit models: Properties, limitations and diagnostic checks," Journal of choice modelling, Elsevier, vol. 36(C).
    16. Bateman, Ian J. & Burgess, Diane & Hutchinson, W. George & Matthews, David I., 2008. "Learning design contingent valuation (LDCV): NOAA guidelines, preference learning and coherent arbitrariness," Journal of Environmental Economics and Management, Elsevier, vol. 55(2), pages 127-141, March.
    17. Charles R. Plott & Kathryn Zeiler, 2005. "The Willingness to Pay–Willingness to Accept Gap, the "Endowment Effect," Subject Misconceptions, and Experimental Procedures for Eliciting Valuations," American Economic Review, American Economic Association, vol. 95(3), pages 530-545, June.
    18. Riccardo Scarpa & Danny Campbell & W. George Hutchinson, 2007. "Benefit Estimates for Landscape Improvements: Sequential Bayesian Design and Respondents’ Rationality in a Choice Experiment," Land Economics, University of Wisconsin Press, vol. 83(4), pages 617-634.
    19. Thijs Dekker & Paul Koster & Roy Brouwer, 2014. "Changing with the Tide: Semiparametric Estimation of Preference Dynamics," Land Economics, University of Wisconsin Press, vol. 90(4), pages 717-745.
    20. Mikolaj Czajkowski & Marek Giergiczny & William H. Greene, 2014. "Learning and Fatigue Effects Revisited: Investigating the Effects of Accounting for Unobservable Preference and Scale Heterogeneity," Land Economics, University of Wisconsin Press, vol. 90(2), pages 324-351.
    21. Kim Darby & Marvin T. Batte & Stan Ernst & Brian Roe, 2008. "Decomposing Local: A Conjoint Analysis of Locally Produced Foods," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 90(2), pages 476-486.
    22. Cameron, Trudy Ann, 1988. "A new paradigm for valuing non-market goods using referendum data: Maximum likelihood estimation by censored logistic regression," Journal of Environmental Economics and Management, Elsevier, vol. 15(3), pages 355-379, September.
    23. Hess, Stephane & Hensher, David A., 2010. "Using conditioning on observed choices to retrieve individual-specific attribute processing strategies," Transportation Research Part B: Methodological, Elsevier, vol. 44(6), pages 781-790, July.
    24. Su, Lianfan & Adam, Brian D. & Lusk, Jayson L. & Arthur, Frank, 2017. "Anchoring, Information, and Fragility of Choice Experiments: An Application to Consumer Willingness to Pay for Rice with Improved Storage Management," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 42(2), May.
    25. John A. List, 2003. "Does Market Experience Eliminate Market Anomalies?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(1), pages 41-71.
    26. John A. List, 2004. "Neoclassical Theory Versus Prospect Theory: Evidence from the Marketplace," Econometrica, Econometric Society, vol. 72(2), pages 615-625, March.
    27. Adamowicz W. & Louviere J. & Williams M., 1994. "Combining Revealed and Stated Preference Methods for Valuing Environmental Amenities," Journal of Environmental Economics and Management, Elsevier, vol. 26(3), pages 271-292, May.
    28. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521747387.
    29. Morten Mørkbak & Tove Christensen & Dorte Gyrd-Hansen, 2010. "Choke Price Bias in Choice Experiments," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 45(4), pages 537-551, April.
    30. Riccardo Scarpa & Raffaele Zanoli & Viola Bruschi & Simona Naspetti, 2013. "Inferred and Stated Attribute Non-attendance in Food Choice Experiments," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 95(1), pages 165-180.
    31. Valeriia Lobasenko & Daniel Llerena, 2017. "Elicitation of willingness to pay for upgradeable products with calibrated auction-conjoint method," Post-Print halshs-01546300, HAL.
    32. Timothy J. Richards & Stephen F. Hamilton & Miguel Gomez & Elliot Rabinovich, 2017. "Retail Intermediation and Local Foods," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 99(3), pages 637-659.
    33. Jayson L. Lusk, 2017. "Consumer Research with Big Data: Applications from the Food Demand Survey (FooDS)," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 99(2), pages 303-320.
    34. Yongjie Ji & David A. Keiser & Catherine L. Kling, 2020. "Temporal Reliability of Welfare Estimates from Revealed Preferences," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 7(4), pages 659-686.
    35. Greene, William H. & Hensher, David A., 2003. "A latent class model for discrete choice analysis: contrasts with mixed logit," Transportation Research Part B: Methodological, Elsevier, vol. 37(8), pages 681-698, September.
    36. Hensher, David & Louviere, Jordan & Swait, Joffre, 1998. "Combining sources of preference data," Journal of Econometrics, Elsevier, vol. 89(1-2), pages 197-221, November.
    37. Day, Brett & Bateman, Ian J. & Carson, Richard T. & Dupont, Diane & Louviere, Jordan J. & Morimoto, Sanae & Scarpa, Riccardo & Wang, Paul, 2012. "Ordering effects and choice set awareness in repeat-response stated preference studies," Journal of Environmental Economics and Management, Elsevier, vol. 63(1), pages 73-91.
    38. Kristen L. Kovalsky & Jayson L. Lusk, 2013. "Do Consumers Really Know How Much They Are Willing to Pay?," Journal of Consumer Affairs, Wiley Blackwell, vol. 47(1), pages 98-127, April.
    39. Wuyang Hu & Wiktor L. Adamowicz & Michele M. Veeman, 2006. "Labeling Context and Reference Point Effects in Models of Food Attribute Demand," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 88(4), pages 1034-1049.
    40. Peter A. Diamond & Jerry A. Hausman, 1994. "Contingent Valuation: Is Some Number Better than No Number?," Journal of Economic Perspectives, American Economic Association, vol. 8(4), pages 45-64, Fall.
    41. Kathleen Brooks & Jayson L. Lusk, 2010. "Stated and Revealed Preferences for Organic and Cloned Milk: Combining Choice Experiment and Scanner Data," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 92(4), pages 1229-1241.
    42. Grebitus, Carola & Lusk, Jayson L. & Nayga, Rodolfo M., 2013. "Effect of distance of transportation on willingness to pay for food," Ecological Economics, Elsevier, vol. 88(C), pages 67-75.
    43. Krinsky, Itzhak & Robb, A Leslie, 1986. "On Approximating the Statistical Properties of Elasticities," The Review of Economics and Statistics, MIT Press, vol. 68(4), pages 715-719, November.
    44. Hanley, Nick & Adamowicz, Wiktor & Wright, Robert E., 2005. "Price vector effects in choice experiments: an empirical test," Resource and Energy Economics, Elsevier, vol. 27(3), pages 227-234, October.
    45. Robin Dillaway & Kent D. Messer & John C. Bernard & Harry M. Kaiser, 2011. "Do Consumer Responses to Media Food Safety Information Last?," Applied Economic Perspectives and Policy, Agricultural and Applied Economics Association, vol. 33(3), pages 363-383.
    46. Jerry Hausman, 2012. "Contingent Valuation: From Dubious to Hopeless," Journal of Economic Perspectives, American Economic Association, vol. 26(4), pages 43-56, Fall.
    47. Joffre Swait & Rick L. Andrews, 2003. "Enriching Scanner Panel Models with Choice Experiments," Marketing Science, INFORMS, vol. 22(4), pages 442-460, September.
    48. Stephen Toler & Brian C. Briggeman & Jayson L. Lusk & Damian C. Adams, 2009. "Fairness, Farmers Markets, and Local Production," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 91(5), pages 1272-1278.
    49. Gregory L. Poe & Kelly L. Giraud & John B. Loomis, 2005. "Computational Methods for Measuring the Difference of Empirical Distributions," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 87(2), pages 353-365.
    50. Caputo, Vincenzina & Lusk, Jayson L. & Nayga, Rodolfo M., 2018. "Choice experiments are not conducted in a vacuum: The effects of external price information on choice behavior," Journal of Economic Behavior & Organization, Elsevier, vol. 145(C), pages 335-351.
    51. Thijs Dekker & Paul Koster & Roy Brouwer, 2014. "Changing with the Tide: Semiparametric Estimation of Preference Dynamics," Land Economics, University of Wisconsin Press, vol. 90(4), pages 717-745.
    52. Timothy N. Cason & Charles R. Plott, 2014. "Misconceptions and Game Form Recognition: Challenges to Theories of Revealed Preference and Framing," Journal of Political Economy, University of Chicago Press, vol. 122(6), pages 1235-1270.
    53. V. Lobasenko & D. Llerena, 2017. "Elicitation of willingness to pay for upgradeable products with calibrated auction-conjoint method," Journal of Environmental Planning and Management, Taylor & Francis Journals, vol. 60(11), pages 2036-2055, November.
    54. Taylor, Laura O., 1998. "Incentive Compatible Referenda And The Valuation Of Environmental Goods," Agricultural and Resource Economics Review, Northeastern Agricultural and Resource Economics Association, vol. 27(2), pages 1-8, October.
    55. Sarrias, Mauricio & Daziano, Ricardo A., 2018. "Individual-specific point and interval conditional estimates of latent class logit parameters," Journal of choice modelling, Elsevier, vol. 27(C), pages 50-61.
    56. Printezis, Iryna & Grebitus, Carola, 2018. "Marketing Channels for Local Food," Ecological Economics, Elsevier, vol. 152(C), pages 161-171.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ousmane Z. Traoré & Lota D. Tamini & Bernard Korai, 2023. "Willingness to pay for credence attributes associated with agri‐food products—Evidence from Canada," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 71(3-4), pages 303-327, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Maurizio Canavari & Andreas C. Drichoutis & Jayson L. Lusk & Rodolfo M. Nayga, Jr., 2018. "How to run an experimental auction: A review of recent advances," Working Papers 2018-5, Agricultural University of Athens, Department Of Agricultural Economics.
    2. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    3. Bujosa Bestard, Angel & Riera Font, Antoni, 2021. "Attribute range effects: Preference anomaly or unexplained variance?," Journal of choice modelling, Elsevier, vol. 41(C).
    4. Campbell, Danny & Boeri, Marco & Doherty, Edel & George Hutchinson, W., 2015. "Learning, fatigue and preference formation in discrete choice experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 119(C), pages 345-363.
    5. Glenk, Klaus & Meyerhoff, Jürgen & Akaichi, Faical & Martin-Ortega, Julia, 2019. "Revisiting cost vector effects in discrete choice experiments," Resource and Energy Economics, Elsevier, vol. 57(C), pages 135-155.
    6. Richard T. Carson, 2011. "Contingent Valuation," Books, Edward Elgar Publishing, number 2489.
    7. Thijs Dekker & Paul Koster & Roy Brouwer, 2014. "Changing with the Tide: Semiparametric Estimation of Preference Dynamics," Land Economics, University of Wisconsin Press, vol. 90(4), pages 717-745.
    8. Ladenburg, Jacob & Olsen, Søren Bøye, 2008. "Gender-specific starting point bias in choice experiments: Evidence from an empirical study," Journal of Environmental Economics and Management, Elsevier, vol. 56(3), pages 275-285, November.
    9. Aravena, Claudia & Hutchinson, W. George & Carlsson, Fredrik & Matthews, David I, 2015. "Testing preference formation in learning design contingent valuation (LDCV) using advanced information and repetitivetreatments," Working Papers in Economics 619, University of Gothenburg, Department of Economics.
    10. Meyerhoff, Jürgen & Glenk, Klaus, 2015. "Learning how to choose—effects of instructional choice sets in discrete choice experiments," Resource and Energy Economics, Elsevier, vol. 41(C), pages 122-142.
    11. Hoyos, David, 2010. "The state of the art of environmental valuation with discrete choice experiments," Ecological Economics, Elsevier, vol. 69(8), pages 1595-1603, June.
    12. Andersson, Henrik & Hole, Arne Risa & Svensson, Mikael, 2016. "Valuation of small and multiple health risks: A critical analysis of SP data applied to food and water safety," Journal of Environmental Economics and Management, Elsevier, vol. 75(C), pages 41-53.
    13. West, Grant H. & Snell, Heather & Kovacs, Kent & Nayga, Rodolfo M., 2020. "Estimation of the preferences for the intertemporal services from groundwater," 2020 Annual Meeting, July 26-28, Kansas City, Missouri 304220, Agricultural and Applied Economics Association.
    14. Kristen L. Kovalsky & Jayson L. Lusk, 2013. "Do Consumers Really Know How Much They Are Willing to Pay?," Journal of Consumer Affairs, Wiley Blackwell, vol. 47(1), pages 98-127, April.
    15. Mikolaj Czajkowski & Nick Hanley & Jacob LaRiviere, 2015. "The Effects of Experience on Preferences: Theory and Empirics for Environmental Public Goods," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 97(1), pages 333-351.
    16. Hoyos Ramos, David, 2010. "Using discrete choice experiments for environmental valuation," BILTOKI 1134-8984, Universidad del País Vasco - Departamento de Economía Aplicada III (Econometría y Estadística).
    17. Tomas Badura & Silvia Ferrini & Michael Burton & Amy Binner & Ian J. Bateman, 2020. "Using Individualised Choice Maps to Capture the Spatial Dimensions of Value Within Choice Experiments," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 75(2), pages 297-322, February.
    18. repec:sss:wpaper:201405 is not listed on IDEAS
    19. Norwood, F. Bailey & Lusk, Jayson L., 2011. "A calibrated auction-conjoint valuation method: Valuing pork and eggs produced under differing animal welfare conditions," Journal of Environmental Economics and Management, Elsevier, vol. 62(1), pages 80-94, July.
    20. Ortega, David L. & Wang, H. Holly & Wu, Laping & Hong, Soo Jeong, 2015. "Retail channel and consumer demand for food quality in China," China Economic Review, Elsevier, vol. 36(C), pages 359-366.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:oup:erevae:v:49:y:2022:i:5:p:971-1004.. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Oxford University Press (email available below). General contact details of provider: https://edirc.repec.org/data/eaaeeea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.