IDEAS home Printed from https://ideas.repec.org/a/oup/erevae/v49y2022i5p971-1004..html
   My bibliography  Save this article

A calibrated choice experiment method

Author

Listed:
  • Lauren Chenarides
  • Carola Grebitus
  • Jayson L Lusk
  • Iryna Printezis

Abstract

Although choice experiments (CEs) have emerged as the most popular stated preference method in applied economics, the method is not free from biases related to order and presentation effects. This paper introduces a new preference elicitation method referred to as a calibrated CE (CCE), and we explore the ability of the new method to alleviate starting-point bias. The new approach utilises the distribution of preferences from a prior CE to provide real-time feedback to respondents about our best guess of their willingness-to-pay (WTP) for food attributes and allows respondents to adjust and calibrate their values. The analysis utilises data collected in 2017 in two US cities, Phoenix and Detroit, on consumer preferences for local and organic tomatoes sold through supermarkets, urban farms and farmers’ markets to establish a prior preference distribution. We re-conducted the survey in May 2020 and implemented the CCE. Conventional analysis of the 2020 CE data shows that WTP is strongly influenced by a starting point: the higher the initial price respondents encountered, the higher the absolute value of their WTP. Despite this bias, we show that when respondents have the opportunity to update their WTP when presented with the best guess, the resulting calibrated WTP is much less influenced by the random starting point.

Suggested Citation

  • Lauren Chenarides & Carola Grebitus & Jayson L Lusk & Iryna Printezis, 2022. "A calibrated choice experiment method," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 49(5), pages 971-1004.
  • Handle: RePEc:oup:erevae:v:49:y:2022:i:5:p:971-1004.
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1093/erae/jbac011
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Dawn Thilmany & Craig A. Bond & Jennifer K. Bond, 2008. "Going Local: Exploring Consumer Behavior and Motivations for Direct Food Purchases," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 90(5), pages 1303-1309.
    2. Thong Meas & Wuyang Hu & Marvin T. Batte & Timothy A. Woods & Stan Ernst, 2015. "Substitutes or Complements? Consumer Preference for Local and Organic Food Attributes," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 97(4), pages 1044-1071.
    3. David A Hensher & William H Greene & John M Rose, 2006. "Deriving Willingness-to-Pay Estimates of Travel-Time Savings from Individual-Based Parameters," Environment and Planning A, , vol. 38(12), pages 2365-2376, December.
    4. Herriges, Joseph A. & Shogren, Jason F., 1996. "Starting Point Bias in Dichotomous Choice Valuation with Follow-Up Questioning," Journal of Environmental Economics and Management, Elsevier, vol. 30(1), pages 112-131, January.
    5. Deacue Fields & Walt Prevatt, 2008. "An Incentive Compatible Conjoint Ranking Mechanism," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 90(2), pages 487-498.
    6. Mikolaj Czajkowski & Marek Giergiczny & William H. Greene, 2014. "Learning and Fatigue Effects Revisited: Investigating the Effects of Accounting for Unobservable Preference and Scale Heterogeneity," Land Economics, University of Wisconsin Press, vol. 90(2), pages 324-351.
    7. Kim Darby & Marvin T. Batte & Stan Ernst & Brian Roe, 2008. "Decomposing Local: A Conjoint Analysis of Locally Produced Foods," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 90(2), pages 476-486.
    8. Adamowicz W. & Louviere J. & Williams M., 1994. "Combining Revealed and Stated Preference Methods for Valuing Environmental Amenities," Journal of Environmental Economics and Management, Elsevier, vol. 26(3), pages 271-292, May.
    9. Rebecca Taylor & Sofia B. Villas-Boas, 2016. "Food Store Choices of Poor Households: A Discrete Choice Analysis of the National Household Food Acquisition and Purchase Survey (FoodAPS)," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 98(2), pages 513-532.
    10. Timothy J. Richards & Stephen F. Hamilton & Miguel Gomez & Elliot Rabinovich, 2017. "Retail Intermediation and Local Foods," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 99(3), pages 637-659.
    11. Jayson L. Lusk, 2017. "Consumer Research with Big Data: Applications from the Food Demand Survey (FooDS)," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 99(2), pages 303-320.
    12. Greene, William H. & Hensher, David A., 2003. "A latent class model for discrete choice analysis: contrasts with mixed logit," Transportation Research Part B: Methodological, Elsevier, vol. 37(8), pages 681-698, September.
    13. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521766555.
    14. Wuyang Hu & Wiktor L. Adamowicz & Michele M. Veeman, 2006. "Labeling Context and Reference Point Effects in Models of Food Attribute Demand," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 88(4), pages 1034-1049.
    15. Kathleen Brooks & Jayson L. Lusk, 2010. "Stated and Revealed Preferences for Organic and Cloned Milk: Combining Choice Experiment and Scanner Data," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 92(4), pages 1229-1241.
    16. Grebitus, Carola & Lusk, Jayson L. & Nayga, Rodolfo M., 2013. "Effect of distance of transportation on willingness to pay for food," Ecological Economics, Elsevier, vol. 88(C), pages 67-75.
    17. Gregory L. Poe & Kelly L. Giraud & John B. Loomis, 2005. "Computational Methods for Measuring the Difference of Empirical Distributions," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 87(2), pages 353-365.
    18. Caputo, Vincenzina & Lusk, Jayson L. & Nayga, Rodolfo M., 2018. "Choice experiments are not conducted in a vacuum: The effects of external price information on choice behavior," Journal of Economic Behavior & Organization, Elsevier, vol. 145(C), pages 335-351.
    19. Thijs Dekker & Paul Koster & Roy Brouwer, 2014. "Changing with the Tide: Semiparametric Estimation of Preference Dynamics," Land Economics, University of Wisconsin Press, vol. 90(4), pages 717-745.
    20. Taylor, Laura O., 1998. "Incentive Compatible Referenda And The Valuation Of Environmental Goods," Agricultural and Resource Economics Review, Northeastern Agricultural and Resource Economics Association, vol. 27(2), pages 1-8, October.
    21. John A. List, 2004. "Neoclassical Theory Versus Prospect Theory: Evidence from the Marketplace," Econometrica, Econometric Society, vol. 72(2), pages 615-625, March.
    22. Jayson L. Lusk & F. Bailey Norwood, 2011. "Animal Welfare Economics," Applied Economic Perspectives and Policy, Agricultural and Applied Economics Association, vol. 33(4), pages 463-483.
    23. David Revelt and Kenneth Train., 2000. "Customer-Specific Taste Parameters and Mixed Logit: Households' Choice of Electricity Supplier," Economics Working Papers E00-274, University of California at Berkeley.
    24. DeShazo, J. R. & Fermo, German, 2002. "Designing Choice Sets for Stated Preference Methods: The Effects of Complexity on Choice Consistency," Journal of Environmental Economics and Management, Elsevier, vol. 44(1), pages 123-143, July.
    25. Norwood, F. Bailey & Lusk, Jayson L., 2011. "A calibrated auction-conjoint valuation method: Valuing pork and eggs produced under differing animal welfare conditions," Journal of Environmental Economics and Management, Elsevier, vol. 62(1), pages 80-94, July.
    26. Christopher D. Azevedo & Joseph A. Herriges & Catherine L. Kling, 2003. "Combining Revealed and Stated Preferences: Consistency Tests and Their Interpretations," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 85(3), pages 525-537.
    27. Bateman, Ian J. & Burgess, Diane & Hutchinson, W. George & Matthews, David I., 2008. "Learning design contingent valuation (LDCV): NOAA guidelines, preference learning and coherent arbitrariness," Journal of Environmental Economics and Management, Elsevier, vol. 55(2), pages 127-141, March.
    28. Hess, Stephane & Hensher, David A., 2010. "Using conditioning on observed choices to retrieve individual-specific attribute processing strategies," Transportation Research Part B: Methodological, Elsevier, vol. 44(6), pages 781-790, July.
    29. John A. List, 2003. "Does Market Experience Eliminate Market Anomalies?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(1), pages 41-71.
    30. Cherry, Todd L. & Crocker, Thomas D. & Shogren, Jason F., 2003. "Rationality spillovers," Journal of Environmental Economics and Management, Elsevier, vol. 45(1), pages 63-84, January.
    31. Valeriia Lobasenko & Daniel Llerena, 2017. "Elicitation of willingness to pay for upgradeable products with calibrated auction-conjoint method," Post-Print halshs-01546300, HAL.
    32. Hensher, David & Louviere, Jordan & Swait, Joffre, 1998. "Combining sources of preference data," Journal of Econometrics, Elsevier, vol. 89(1-2), pages 197-221, November.
    33. Peter A. Diamond & Jerry A. Hausman, 1994. "Contingent Valuation: Is Some Number Better than No Number?," Journal of Economic Perspectives, American Economic Association, vol. 8(4), pages 45-64, Fall.
    34. Krinsky, Itzhak & Robb, A Leslie, 1986. "On Approximating the Statistical Properties of Elasticities," The Review of Economics and Statistics, MIT Press, vol. 68(4), pages 715-719, November.
    35. Robin Dillaway & Kent D. Messer & John C. Bernard & Harry M. Kaiser, 2011. "Do Consumer Responses to Media Food Safety Information Last?," Applied Economic Perspectives and Policy, Agricultural and Applied Economics Association, vol. 33(3), pages 363-383.
    36. V. Lobasenko & D. Llerena, 2017. "Elicitation of willingness to pay for upgradeable products with calibrated auction-conjoint method," Journal of Environmental Planning and Management, Taylor & Francis Journals, vol. 60(11), pages 2036-2055, November.
    37. Sarrias, Mauricio, 2020. "Individual-specific posterior distributions from Mixed Logit models: Properties, limitations and diagnostic checks," Journal of choice modelling, Elsevier, vol. 36(C).
    38. Riccardo Scarpa & Danny Campbell & W. George Hutchinson, 2007. "Benefit Estimates for Landscape Improvements: Sequential Bayesian Design and Respondents’ Rationality in a Choice Experiment," Land Economics, University of Wisconsin Press, vol. 83(4), pages 617-634.
    39. Cameron, Trudy Ann, 1988. "A new paradigm for valuing non-market goods using referendum data: Maximum likelihood estimation by censored logistic regression," Journal of Environmental Economics and Management, Elsevier, vol. 15(3), pages 355-379, September.
    40. Su, Lianfan & Adam, Brian D. & Lusk, Jayson L. & Arthur, Frank, 2017. "Anchoring, Information, and Fragility of Choice Experiments: An Application to Consumer Willingness to Pay for Rice with Improved Storage Management," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 42(2), May.
    41. Riccardo Scarpa & Raffaele Zanoli & Viola Bruschi & Simona Naspetti, 2013. "Inferred and Stated Attribute Non-attendance in Food Choice Experiments," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 95(1), pages 165-180.
    42. Kristen L. Kovalsky & Jayson L. Lusk, 2013. "Do Consumers Really Know How Much They Are Willing to Pay?," Journal of Consumer Affairs, Wiley Blackwell, vol. 47(1), pages 98-127, April.
    43. Hanley, Nick & Adamowicz, Wiktor & Wright, Robert E., 2005. "Price vector effects in choice experiments: an empirical test," Resource and Energy Economics, Elsevier, vol. 27(3), pages 227-234, October.
    44. Joffre Swait & Rick L. Andrews, 2003. "Enriching Scanner Panel Models with Choice Experiments," Marketing Science, INFORMS, vol. 22(4), pages 442-460, September.
    45. Printezis, Iryna & Grebitus, Carola, 2018. "Marketing Channels for Local Food," Ecological Economics, Elsevier, vol. 152(C), pages 161-171.
    46. Douglas Dyer & John H. Kagel, 1996. "Bidding in Common Value Auctions: How the Commercial Construction Industry Corrects for the Winner's Curse," Management Science, INFORMS, vol. 42(10), pages 1463-1475, October.
    47. Jacinto Braga & Chris Starmer, 2005. "Preference Anomalies, Preference Elicitation and the Discovered Preference Hypothesis," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 32(1), pages 55-89, September.
    48. Charles R. Plott & Kathryn Zeiler, 2005. "The Willingness to Pay–Willingness to Accept Gap, the "Endowment Effect," Subject Misconceptions, and Experimental Procedures for Eliciting Valuations," American Economic Review, American Economic Association, vol. 95(3), pages 530-545, June.
    49. Morten Mørkbak & Tove Christensen & Dorte Gyrd-Hansen, 2010. "Choke Price Bias in Choice Experiments," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 45(4), pages 537-551, April.
    50. Yongjie Ji & David A. Keiser & Catherine L. Kling, 2020. "Temporal Reliability of Welfare Estimates from Revealed Preferences," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 7(4), pages 659-686.
    51. Day, Brett & Bateman, Ian J. & Carson, Richard T. & Dupont, Diane & Louviere, Jordan J. & Morimoto, Sanae & Scarpa, Riccardo & Wang, Paul, 2012. "Ordering effects and choice set awareness in repeat-response stated preference studies," Journal of Environmental Economics and Management, Elsevier, vol. 63(1), pages 73-91.
    52. Thijs Dekker & Paul Koster & Roy Brouwer, 2014. "Changing with the Tide: Semiparametric Estimation of Preference Dynamics," Land Economics, University of Wisconsin Press, vol. 90(4), pages 717-745.
    53. Jerry Hausman, 2012. "Contingent Valuation: From Dubious to Hopeless," Journal of Economic Perspectives, American Economic Association, vol. 26(4), pages 43-56, Fall.
    54. Stephen Toler & Brian C. Briggeman & Jayson L. Lusk & Damian C. Adams, 2009. "Fairness, Farmers Markets, and Local Production," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 91(5), pages 1272-1278.
    55. Timothy N. Cason & Charles R. Plott, 2014. "Misconceptions and Game Form Recognition: Challenges to Theories of Revealed Preference and Framing," Journal of Political Economy, University of Chicago Press, vol. 122(6), pages 1235-1270.
    56. Sarrias, Mauricio & Daziano, Ricardo A., 2018. "Individual-specific point and interval conditional estimates of latent class logit parameters," Journal of choice modelling, Elsevier, vol. 27(C), pages 50-61.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ousmane Z. Traoré & Lota D. Tamini & Bernard Korai, 2023. "Willingness to pay for credence attributes associated with agri‐food products—Evidence from Canada," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 71(3-4), pages 303-327, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Maurizio Canavari & Andreas C. Drichoutis & Jayson L. Lusk & Rodolfo M. Nayga, Jr., 2018. "How to run an experimental auction: A review of recent advances," Working Papers 2018-5, Agricultural University of Athens, Department Of Agricultural Economics.
    2. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    3. Glenk, Klaus & Meyerhoff, Jürgen & Akaichi, Faical & Martin-Ortega, Julia, 2019. "Revisiting cost vector effects in discrete choice experiments," Resource and Energy Economics, Elsevier, vol. 57(C), pages 135-155.
    4. Bujosa Bestard, Angel & Riera Font, Antoni, 2021. "Attribute range effects: Preference anomaly or unexplained variance?," Journal of choice modelling, Elsevier, vol. 41(C).
    5. Campbell, Danny & Boeri, Marco & Doherty, Edel & George Hutchinson, W., 2015. "Learning, fatigue and preference formation in discrete choice experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 119(C), pages 345-363.
    6. Richard T. Carson, 2011. "Contingent Valuation," Books, Edward Elgar Publishing, number 2489.
    7. Ladenburg, Jacob & Olsen, Søren Bøye, 2008. "Gender-specific starting point bias in choice experiments: Evidence from an empirical study," Journal of Environmental Economics and Management, Elsevier, vol. 56(3), pages 275-285, November.
    8. Meyerhoff, Jürgen & Glenk, Klaus, 2015. "Learning how to choose—effects of instructional choice sets in discrete choice experiments," Resource and Energy Economics, Elsevier, vol. 41(C), pages 122-142.
    9. Thijs Dekker & Paul Koster & Roy Brouwer, 2014. "Changing with the Tide: Semiparametric Estimation of Preference Dynamics," Land Economics, University of Wisconsin Press, vol. 90(4), pages 717-745.
    10. Aravena, Claudia & Hutchinson, W. George & Carlsson, Fredrik & Matthews, David I, 2015. "Testing preference formation in learning design contingent valuation (LDCV) using advanced information and repetitivetreatments," Working Papers in Economics 619, University of Gothenburg, Department of Economics.
    11. Hoyos, David, 2010. "The state of the art of environmental valuation with discrete choice experiments," Ecological Economics, Elsevier, vol. 69(8), pages 1595-1603, June.
    12. Andersson, Henrik & Hole, Arne Risa & Svensson, Mikael, 2016. "Valuation of small and multiple health risks: A critical analysis of SP data applied to food and water safety," Journal of Environmental Economics and Management, Elsevier, vol. 75(C), pages 41-53.
    13. Hoyos Ramos, David, 2010. "Using discrete choice experiments for environmental valuation," BILTOKI 1134-8984, Universidad del País Vasco - Departamento de Economía Aplicada III (Econometría y Estadística).
    14. West, Grant H. & Snell, Heather & Kovacs, Kent & Nayga, Rodolfo M., 2020. "Estimation of the preferences for the intertemporal services from groundwater," 2020 Annual Meeting, July 26-28, Kansas City, Missouri 304220, Agricultural and Applied Economics Association.
    15. Kristen L. Kovalsky & Jayson L. Lusk, 2013. "Do Consumers Really Know How Much They Are Willing to Pay?," Journal of Consumer Affairs, Wiley Blackwell, vol. 47(1), pages 98-127, April.
    16. Mikolaj Czajkowski & Nick Hanley & Jacob LaRiviere, 2015. "The Effects of Experience on Preferences: Theory and Empirics for Environmental Public Goods," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 97(1), pages 333-351.
    17. Tomas Badura & Silvia Ferrini & Michael Burton & Amy Binner & Ian J. Bateman, 2020. "Using Individualised Choice Maps to Capture the Spatial Dimensions of Value Within Choice Experiments," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 75(2), pages 297-322, February.
    18. repec:sss:wpaper:201405 is not listed on IDEAS
    19. Norwood, F. Bailey & Lusk, Jayson L., 2011. "A calibrated auction-conjoint valuation method: Valuing pork and eggs produced under differing animal welfare conditions," Journal of Environmental Economics and Management, Elsevier, vol. 62(1), pages 80-94, July.
    20. Ortega, David L. & Wang, H. Holly & Wu, Laping & Hong, Soo Jeong, 2015. "Retail channel and consumer demand for food quality in China," China Economic Review, Elsevier, vol. 36(C), pages 359-366.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:oup:erevae:v:49:y:2022:i:5:p:971-1004.. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Oxford University Press (email available below). General contact details of provider: https://edirc.repec.org/data/eaaeeea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.