IDEAS home Printed from https://ideas.repec.org/a/eee/eejocm/v36y2020ics1755534520300312.html
   My bibliography  Save this article

Using eye-tracking as an aid to design on-screen choice experiments

Author

Listed:
  • Dudinskaya, Emilia Cubero
  • Naspetti, Simona
  • Zanoli, Raffaele

Abstract

Researchers using discrete choice experiments (DCE) are often faced with the difficult decision of selecting which are the key attributes that must be included into their analysis. Previous literature on methods for attribute selection is not particularly well documented, frequently leaving researchers with a wide choice of attributes that could lead to complex choice tasks. Moreover, selecting attributes that might be ignored by the respondents might generate biased results, especially if attribute non-attendance is not taken into consideration. In this paper, we offer a framework for the selection of key attributes using eye-tracking software. Our main objective is to investigate if eye movements during the completion of a choice experiment can provide additional information to select the attributes in designing a DCE. Pretesting the DCE by an on-screen survey tool and eye-tracking, we implemented three multinomial logit models (MNL) to compare the stated preferences of the respondents, the self-reported statements on non-attendance and their visual attention to each attribute. The eye-tracking data revealed that all respondents looked at most attributes for most of the time. However, attention is different from attendance. Results show that eye-tracking can be a complementary method to self-reported statements by providing key information for reducing task complexity and potential attribute non-attendance in designing a DCE (one from seven attributes was dropped).

Suggested Citation

  • Dudinskaya, Emilia Cubero & Naspetti, Simona & Zanoli, Raffaele, 2020. "Using eye-tracking as an aid to design on-screen choice experiments," Journal of choice modelling, Elsevier, vol. 36(C).
  • Handle: RePEc:eee:eejocm:v:36:y:2020:i:c:s1755534520300312
    DOI: 10.1016/j.jocm.2020.100232
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1755534520300312
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jocm.2020.100232?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Mohammed Alemu & Morten Mørkbak & Søren Olsen & Carsten Jensen, 2013. "Attending to the Reasons for Attribute Non-attendance in Choice Experiments," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 54(3), pages 333-359, March.
    2. Riccardo Scarpa & Mara Thiene & David A. Hensher, 2010. "Monitoring Choice Task Attribute Attendance in Nonmarket Valuation of Multiple Park Management Services: Does It Matter?," Land Economics, University of Wisconsin Press, vol. 86(4), pages 817-839.
    3. Joanna Coast & Hareth Al‐Janabi & Eileen J. Sutton & Susan A. Horrocks & A. Jane Vosper & Dawn R. Swancutt & Terry N. Flynn, 2012. "Using qualitative methods for attribute development for discrete choice experiments: issues and recommendations," Health Economics, John Wiley & Sons, Ltd., vol. 21(6), pages 730-741, June.
    4. Sebastian Heidenreich & Verity Watson & Mandy Ryan & Euan Phimister, 2018. "Decision heuristic or preference? Attribute non‐attendance in discrete choice problems," Health Economics, John Wiley & Sons, Ltd., vol. 27(1), pages 157-171, January.
    5. Puckett, Sean M. & Hensher, David A., 2009. "Revealing the extent of process heterogeneity in choice analysis: An empirical assessment," Transportation Research Part A: Policy and Practice, Elsevier, vol. 43(2), pages 117-126, February.
    6. Caputo, Vincenzina & Nayga, M. Rodolfo Jr. & Sacchi, Giovanna & Scarpa, Riccardo, 2016. "Attribute non-attendance or attribute-level non-attendance? A choice experiment application on extra virgin olive oil," 2016 Annual Meeting, July 31-August 2, Boston, Massachusetts 236035, Agricultural and Applied Economics Association.
    7. Riccardo Scarpa & Raffaele Zanoli & Viola Bruschi & Simona Naspetti, 2013. "Inferred and Stated Attribute Non-attendance in Food Choice Experiments," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 95(1), pages 165-180.
    8. Jordan Louviere & Kenneth Train & Moshe Ben-Akiva & Chandra Bhat & David Brownstone & Trudy Cameron & Richard Carson & J. Deshazo & Denzil Fiebig & William Greene & David Hensher & Donald Waldman, 2005. "Recent Progress on Endogeneity in Choice Modeling," Marketing Letters, Springer, vol. 16(3), pages 255-265, December.
    9. Uggeldahl, Kennet & Jacobsen, Catrine & Lundhede, Thomas Hedemark & Olsen, Søren Bøye, 2016. "Choice certainty in Discrete Choice Experiments: Will eye tracking provide useful measures?," Journal of choice modelling, Elsevier, vol. 20(C), pages 35-48.
    10. Van Wezemael, Lynn & Caputo, Vincenzina & Nayga, Rodolfo M. & Chryssochoidis, George & Verbeke, Wim, 2014. "European consumer preferences for beef with nutrition and health claims: A multi-country investigation using discrete choice experiments," Food Policy, Elsevier, vol. 44(C), pages 167-176.
    11. Kelvin J. Lancaster, 1966. "A New Approach to Consumer Theory," Journal of Political Economy, University of Chicago Press, vol. 74, pages 132-132.
    12. Van Loo, Ellen J. & Caputo, Vincenzina & Nayga, Rodolfo M. & Seo, Han-Seok & Zhang, Baoyue & Verbeke, Wim, 2015. "Sustainability labels on coffee: Consumer preferences, willingness-to-pay and visual attention to attributes," Ecological Economics, Elsevier, vol. 118(C), pages 215-225.
    13. Colin Green & Karen Gerard, 2009. "Exploring the social value of health‐care interventions: a stated preference discrete choice experiment," Health Economics, John Wiley & Sons, Ltd., vol. 18(8), pages 951-976, August.
    14. Hess, Stephane & Palma, David, 2019. "Apollo: A flexible, powerful and customisable freeware package for choice model estimation and application," Journal of choice modelling, Elsevier, vol. 32(C), pages 1-1.
    15. Axel C. Mühlbacher & John F. P. Bridges & Susanne Bethge & Ch.-Markos Dintsios & Anja Schwalm & Andreas Gerber-Grote & Matthias Nübling, 2017. "Preferences for antiviral therapy of chronic hepatitis C: a discrete choice experiment," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 18(2), pages 155-165, March.
    16. Marit E. Kragt, 2013. "Stated and Inferred Attribute Attendance Models: A Comparison with Environmental Choice Experiments," Journal of Agricultural Economics, Wiley Blackwell, vol. 64(3), pages 719-736, September.
    17. Kelvin Balcombe & Iain Fraser & Eugene McSorley, 2015. "Visual Attention and Attribute Attendance in Multi‐Attribute Choice Experiments," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(3), pages 447-467, April.
    18. Mørkbak, Morten Raun & Olsen, Søren Bøye & Campbell, Danny, 2014. "Behavioral implications of providing real incentives in stated choice experiments," Journal of Economic Psychology, Elsevier, vol. 45(C), pages 102-116.
    19. Sandorf, Erlend Dancke & Campbell, Danny & Hanley, Nick, 2017. "Disentangling the influence of knowledge on attribute non-attendance," Journal of choice modelling, Elsevier, vol. 24(C), pages 36-50.
    20. Russo, J Edward & Leclerc, France, 1994. "An Eye-Fixation Analysis of Choice Processes for Consumer Nondurables," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 21(2), pages 274-290, September.
    21. Ellen J Van Loo & Rodolfo M NaygaJr & Danny Campbell & Han-Seok Seo & Wim Verbeke, 2018. "Using eye tracking to account for attribute non-attendance in choice experiments," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 45(3), pages 333-365.
    22. Guevara, C. Angelo, 2015. "Critical assessment of five methods to correct for endogeneity in discrete-choice models," Transportation Research Part A: Policy and Practice, Elsevier, vol. 82(C), pages 240-254.
    23. Ellen M. Janssen & Jodi B. Segal & John F. P. Bridges, 2016. "A Framework for Instrument Development of a Choice Experiment: An Application to Type 2 Diabetes," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 9(5), pages 465-479, October.
    24. Laura O. Taylor & Ronald G. Cummings, 1999. "Unbiased Value Estimates for Environmental Goods: A Cheap Talk Design for the Contingent Valuation Method," American Economic Review, American Economic Association, vol. 89(3), pages 649-665, June.
    25. Carlsson, Fredrik & Frykblom, Peter & Johan Lagerkvist, Carl, 2005. "Using cheap talk as a test of validity in choice experiments," Economics Letters, Elsevier, vol. 89(2), pages 147-152, November.
    26. Rasch, Carsten & Louviere, Jordan J. & Teichert, Thorsten, 2015. "Using facial EMG and eye tracking to study integral affect in discrete choice experiments," Journal of choice modelling, Elsevier, vol. 14(C), pages 32-47.
    27. Lussier, Denis A & Olshavsky, Richard W, 1979. "Task Complexity and Contingent Processing in Brand Choice," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 6(2), pages 154-165, Se.
    28. Stephane Hess & David Hensher, 2013. "Making use of respondent reported processing information to understand attribute importance: a latent variable scaling approach," Transportation, Springer, vol. 40(2), pages 397-412, February.
    29. David Hensher & John Rose & William Greene, 2012. "Inferring attribute non-attendance from stated choice data: implications for willingness to pay estimates and a warning for stated choice experiment design," Transportation, Springer, vol. 39(2), pages 235-245, March.
    30. Apostolidis, Chrysostomos & McLeay, Fraser, 2016. "Should we stop meating like this? Reducing meat consumption through substitution," Food Policy, Elsevier, vol. 65(C), pages 74-89.
    31. Hess, Stephane & Hensher, David A., 2010. "Using conditioning on observed choices to retrieve individual-specific attribute processing strategies," Transportation Research Part B: Methodological, Elsevier, vol. 44(6), pages 781-790, July.
    32. Erdem, Seda & Rigby, Dan & Wossink, Ada, 2012. "Using best–worst scaling to explore perceptions of relative responsibility for ensuring food safety," Food Policy, Elsevier, vol. 37(6), pages 661-670.
    33. Balcombe, Kelvin & Fraser, Iain & Williams, Louis & McSorley, Eugene, 2017. "Examining the relationship between visual attention and stated preferences: A discrete choice experiment using eye-tracking," Journal of Economic Behavior & Organization, Elsevier, vol. 144(C), pages 238-257.
    34. Danny Campbell & David A. Hensher & Riccardo Scarpa, 2011. "Non-attendance to attributes in environmental choice analysis: a latent class specification," Journal of Environmental Planning and Management, Taylor & Francis Journals, vol. 54(8), pages 1061-1076, December.
    35. David A. Hensher, 2006. "How do respondents process stated choice experiments? Attribute consideration under varying information load," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(6), pages 861-878.
    36. Jordan J. Louviere & Towhidul Islam & Nada Wasi & Deborah Street & Leonie Burgess, 2008. "Designing Discrete Choice Experiments: Do Optimal Designs Come at a Price?," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 35(2), pages 360-375, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Edenbrandt, Anna Kristina & Lagerkvist, Carl-Johan & Lüken, Malte & Orquin, Jacob L., 2022. "Seen but not considered? Awareness and consideration in choice analysis," Journal of choice modelling, Elsevier, vol. 45(C).
    2. Tobias Holmsgaard Larsen & Thomas Lundhede & Søren Bøye Olsen, 2020. "Assessing the value of surface water and groundwater quality improvements when time lags and outcome uncertainty exist: Results from a choice experiment survey across four different countries," IFRO Working Paper 2020/12, University of Copenhagen, Department of Food and Resource Economics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gonçalves, Tânia & Lourenço-Gomes, Lina & Pinto, Lígia M. Costa, 2022. "The role of attribute non-attendance on consumer decision-making: Theoretical insights and empirical evidence," Economic Analysis and Policy, Elsevier, vol. 76(C), pages 788-805.
    2. Logar, Ivana & Brouwer, Roy & Campbell, Danny, 2020. "Does attribute order influence attribute-information processing in discrete choice experiments?," Resource and Energy Economics, Elsevier, vol. 60(C).
    3. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    4. Shiwen Quan & Yinchu Zeng & Xiaohua Yu & Te Bao, 2018. "WTP for baby milk formula in China: Using attribute nonattendance as a priori information to select attributes in choice experiment," Agribusiness, John Wiley & Sons, Ltd., vol. 34(2), pages 300-320, March.
    5. Sandorf, Erlend Dancke & Crastes dit Sourd, Romain & Mahieu, Pierre-Alexandre, 2018. "The effect of attribute-alternative matrix displays on preferences and processing strategies," Journal of choice modelling, Elsevier, vol. 29(C), pages 113-132.
    6. Genie, Mesfin G. & Ryan, Mandy & Krucien, Nicolas, 2021. "To pay or not to pay? Cost information processing in the valuation of publicly funded healthcare," Social Science & Medicine, Elsevier, vol. 276(C).
    7. Erlend Dancke Sandorf & Danny Campbell, 2019. "Accommodating satisficing behaviour in stated choice experiments," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 46(1), pages 133-162.
    8. Chen, Xuqi & Shen, Meng & Gao, Zhifeng, 2017. "Impact of Intra-respondent Variations in Attribute Attendance on Consumer Preference in Food Choice," 2017 Annual Meeting, July 30-August 1, Chicago, Illinois 258509, Agricultural and Applied Economics Association.
    9. Caputo, Vincenzina & Loo, Ellen J. Van & Scarpa, Riccardo & Nayga, Rodolfo M. Jr & Verbeke, Wim, 2014. "“Using Experiments to Address Attribute Non-attendance in Consumer Food Choices”," 2014 Annual Meeting, July 27-29, 2014, Minneapolis, Minnesota 177173, Agricultural and Applied Economics Association.
    10. Ellen J Van Loo & Carola Grebitus & Rodolfo M Nayga & Wim Verbeke & Jutta Roosen, 2018. "On the Measurement of Consumer Preferences and Food Choice Behavior: The Relation Between Visual Attention and Choices," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 40(4), pages 538-562, December.
    11. Sandra Notaro & Maria De Salvo & Roberta Raffaelli, 2022. "Estimating Willingness to Pay for Alpine Pastures: A Discrete Choice Experiment Accounting for Attribute Non-Attendance," Sustainability, MDPI, vol. 14(7), pages 1-15, March.
    12. Yegoryan, Narine & Guhl, Daniel & Klapper, Daniel, 2018. "Inferring Attribute Non-Attendance Using Eye Tracking in Choice-Based Conjoint Analysis," Rationality and Competition Discussion Paper Series 111, CRC TRR 190 Rationality and Competition.
    13. Mohammed H. Alemu & Søren B. Olsen, 2017. "Can a Repeated Opt-Out Reminder remove hypothetical bias in discrete choice experiments? An application to consumer valuation of novel food products," IFRO Working Paper 2017/05, University of Copenhagen, Department of Food and Resource Economics.
    14. Espinosa-Goded, María & Rodriguez-Entrena, Macario & Salazar-Ordóñez, Melania, 2021. "A straightforward diagnostic tool to identify attribute non-attendance in discrete choice experiments," Economic Analysis and Policy, Elsevier, vol. 71(C), pages 211-226.
    15. Nguyen, Thanh Cong & Robinson, Jackie & Whitty, Jennifer A. & Kaneko, Shinji & Nguyen, The Chinh, 2015. "Attribute non-attendance in discrete choice experiments: A case study in a developing country," Economic Analysis and Policy, Elsevier, vol. 47(C), pages 22-33.
    16. Kelvin Balcombe & Michail Bitzios & Iain Fraser & Janet Haddock-Fraser, 2014. "Using Attribute Importance Rankings Within Discrete Choice Experiments: An Application to Valuing Bread Attributes," Journal of Agricultural Economics, Wiley Blackwell, vol. 65(2), pages 446-462, June.
    17. Chavez, Daniel E. & Palma, Marco A. & Nayga Jr., Rodolfo M., 2017. "When does real become consequential in non-hypothetical choice experiments?," 2018 Annual Meeting, February 2-6, 2018, Jacksonville, Florida 266327, Southern Agricultural Economics Association.
    18. Jourdain, Damien & Lairez, Juliette & Striffler, Bruno & Lundhede, Thomas, 2022. "A choice experiment approach to evaluate maize farmers’ decision-making processes in Lao PDR," Journal of choice modelling, Elsevier, vol. 44(C).
    19. Kemper, Nathan & Popp, Jennie & Nayga, Jr., Rodolfo M. & Bazzani, Claudia, 2024. "A Query Approach to Modeling Attendance to Attributes in Discrete Choice Experiments," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 0(Preprint), January.
    20. DeLong, Karen L. & Syrengelas, Konstantinos G. & Grebitus, Carola & Nayga, Rodolfo M., 2021. "Visual versus Text Attribute Representation in Choice Experiments," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 94(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:eejocm:v:36:y:2020:i:c:s1755534520300312. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/journal-of-choice-modelling .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.