IDEAS home Printed from https://ideas.repec.org/a/eee/eejocm/v40y2021ics1755534521000373.html
   My bibliography  Save this article

Joint modelling of choice and rating data: Theory and examples

Author

Listed:
  • Webb, Edward J.D.
  • Hess, Stephane

Abstract

In many cases, ordinal data, for example rating objects on a scale from 1 to 5, is observed only for those objects that have been chosen from a set of discrete alternatives, with no ratings for unchosen objects. An example is customer ratings of goods sold by online retailers. The joint modelling of choice and rating is made difficult by the missing ratings for unchosen alternatives. A method of jointly modelling choice and rating data termed a choice-ordered logit (COL) model is presented. Two types of COL model are defined: two-step, which places a positive probability on the chosen alternative not having the highest rating, and one-step, where the highest rated alternative is always chosen. Three case studies exemplifying the use of COL models are given. One uses simulated data and two use data from discrete choice experiments. It is shown that COL models can produce robust estimates. Two-step models provided a better fit than one-step, and most participants seemed to use two-step decision-making. However, a sizeable minority used one-step decision-making in one case study. It is argued that COL models have benefits over standard approaches, in particular adding information on strength-of-preference to discrete choices.

Suggested Citation

  • Webb, Edward J.D. & Hess, Stephane, 2021. "Joint modelling of choice and rating data: Theory and examples," Journal of choice modelling, Elsevier, vol. 40(C).
    • Handle: RePEc:eee:eejocm:v:40:y:2021:i:c:s1755534521000373
    DOI: 10.1016/j.jocm.2021.100304
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1755534521000373
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jocm.2021.100304?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Rose, John M. & Beck, Matthew J. & Hensher, David A., 2015. "The joint estimation of respondent-reported certainty and acceptability with choice," Transportation Research Part A: Policy and Practice, Elsevier, vol. 71(C), pages 141-152.
    2. Vikas Soekhai & Esther W. Bekker-Grob & Alan R. Ellis & Caroline M. Vass, 2019. "Discrete Choice Experiments in Health Economics: Past, Present and Future," PharmacoEconomics, Springer, vol. 37(2), pages 201-226, February.
    3. Matteo Mattmann & Ivana Logar & Roy Brouwer, 2019. "Choice certainty, consistency, and monotonicity in discrete choice experiments," Journal of Environmental Economics and Policy, Taylor & Francis Journals, vol. 8(2), pages 109-127, April.
    4. Bansback, Nick & Brazier, John & Tsuchiya, Aki & Anis, Aslam, 2012. "Using a discrete choice experiment to estimate health state utility values," Journal of Health Economics, Elsevier, vol. 31(1), pages 306-318.
    5. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521766555.
    6. Wendy W. Moe & David A. Schweidel, 2012. "Online Product Opinions: Incidence, Evaluation, and Evolution," Marketing Science, INFORMS, vol. 31(3), pages 372-386, May.
    7. Stephane Hess, 2014. "Latent class structures: taste heterogeneity and beyond," Chapters, in: Stephane Hess & Andrew Daly (ed.), Handbook of Choice Modelling, chapter 14, pages 311-330, Edward Elgar Publishing.
    8. David A. Hensher & John M. Rose, 2012. "The Influence of Alternative Acceptability, Attribute Thresholds and Choice Response Certainty on Automobile Purchase Preferences," Journal of Transport Economics and Policy, University of Bath, vol. 46(3), pages 451-468, September.
    9. Fifer, Simon & Rose, John M., 2016. "Can you ever be certain? Reducing hypothetical bias in stated choice experiments via respondent reported choice certaintyAuthor-Name: Beck, Matthew J," Transportation Research Part B: Methodological, Elsevier, vol. 89(C), pages 149-167.
    10. Hess, Stephane & Palma, David, 2019. "Apollo: A flexible, powerful and customisable freeware package for choice model estimation and application," Journal of choice modelling, Elsevier, vol. 32(C), pages 1-1.
    11. Monic Sun, 2012. "How Does the Variance of Product Ratings Matter?," Management Science, INFORMS, vol. 58(4), pages 696-707, April.
    12. Beck, Matthew J. & Rose, John M. & Hensher, David A., 2013. "Consistently inconsistent: The role of certainty, acceptability and scale in choice," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 56(C), pages 81-93.
    13. Regier, Dean A. & Watson, Verity & Burnett, Heather & Ungar, Wendy J., 2014. "Task complexity and response certainty in discrete choice experiments: An application to drug treatments for juvenile idiopathic arthritis," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 50(C), pages 40-49.
    14. Brendan Mulhern & Nick Bansback & Arne Risa Hole & Aki Tsuchiya, 2017. "Using Discrete Choice Experiments with Duration to Model EQ-5D-5L Health State Preferences," Medical Decision Making, , vol. 37(3), pages 285-297, April.
    15. Nancy J. Devlin & Koonal K. Shah & Yan Feng & Brendan Mulhern & Ben van Hout, 2018. "Valuing health‐related quality of life: An EQ‐5D‐5L value set for England," Health Economics, John Wiley & Sons, Ltd., vol. 27(1), pages 7-22, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mokas, Ilias & Lizin, Sebastien & Brijs, Tom & Witters, Nele & Malina, Robert, 2021. "Can immersive virtual reality increase respondents’ certainty in discrete choice experiments? A comparison with traditional presentation formats," Journal of Environmental Economics and Management, Elsevier, vol. 109(C).
    2. Haghani, Milad & Sarvi, Majid, 2018. "Hypothetical bias and decision-rule effect in modelling discrete directional choices," Transportation Research Part A: Policy and Practice, Elsevier, vol. 116(C), pages 361-388.
    3. Edward J. D. Webb & John O’Dwyer & David Meads & Paul Kind & Penny Wright, 2020. "Transforming discrete choice experiment latent scale values for EQ-5D-3L using the visual analogue scale," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 21(5), pages 787-800, July.
    4. Regier, Dean A. & Sicsic, Jonathan & Watson, Verity, 2019. "Choice certainty and deliberative thinking in discrete choice experiments. A theoretical and empirical investigation," Journal of Economic Behavior & Organization, Elsevier, vol. 164(C), pages 235-255.
    5. Roy Brouwer & Solomon Tarfasa, 2020. "Testing hypothetical bias in a framed field experiment," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 68(3), pages 343-357, September.
    6. John Buckell & Vrinda Vasavada & Sarah Wordsworth & Dean A. Regier & Matthew Quaife, 2022. "Utility maximization versus regret minimization in health choice behavior: Evidence from four datasets," Health Economics, John Wiley & Sons, Ltd., vol. 31(2), pages 363-381, February.
    7. Fraser, Iain & Balcombe, Kelvin & Williams, Louis & McSorley, Eugene, 2021. "Preference stability in discrete choice experiments. Some evidence using eye-tracking," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 94(C).
    8. Hensher, David A. & Ho, Chinh, 2015. "The role of perceived acceptability of alternatives in identifying and assessing choice set processing strategies in stated choice settings: The case of road pricing reform," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 83(C), pages 225-237.
    9. Kim, Sung Hoo & Mokhtarian, Patricia L., 2023. "Finite mixture (or latent class) modeling in transportation: Trends, usage, potential, and future directions," Transportation Research Part B: Methodological, Elsevier, vol. 172(C), pages 134-173.
    10. Oehlmann, Malte & Glenk, Klaus & Lloyd-Smith, Patrick & Meyerhoff, Jürgen, 2021. "Quantifying landscape externalities of renewable energy development: Implications of attribute cut-offs in choice experiments," Resource and Energy Economics, Elsevier, vol. 65(C).
    11. Tinessa, Fiore & Marzano, Vittorio & Papola, Andrea, 2020. "Mixing distributions of tastes with a Combination of Nested Logit (CoNL) kernel: Formulation and performance analysis," Transportation Research Part B: Methodological, Elsevier, vol. 141(C), pages 1-23.
    12. Uggeldahl, Kennet & Jacobsen, Catrine & Lundhede, Thomas Hedemark & Olsen, Søren Bøye, 2016. "Choice certainty in Discrete Choice Experiments: Will eye tracking provide useful measures?," Journal of choice modelling, Elsevier, vol. 20(C), pages 35-48.
    13. Lehmann, Nico & Sloot, Daniel & Ardone, Armin & Fichtner, Wolf, 2021. "The limited potential of regional electricity marketing – Results from two discrete choice experiments in Germany," Energy Economics, Elsevier, vol. 100(C).
    14. Zabala, José A. & Martínez-Paz, José M. & Alcon, Francisco, 2021. "Integrated valuation of semiarid Mediterranean agroecosystem services and disservices," Ecological Economics, Elsevier, vol. 184(C).
    15. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part II. Conceptualisation of external validity, sources and explanations of bias and effectiveness of mitigation methods," Journal of choice modelling, Elsevier, vol. 41(C).
    16. Ladenburg, Jacob & Skotte, Maria, 2022. "Heterogeneity in willingness to pay for the location of offshore wind power development: An application of the willingness to pay space model," Energy, Elsevier, vol. 241(C).
    17. Hess, Stephane & Lancsar, Emily & Mariel, Petr & Meyerhoff, Jürgen & Song, Fangqing & van den Broek-Altenburg, Eline & Alaba, Olufunke A. & Amaris, Gloria & Arellana, Julián & Basso, Leonardo J. & Ben, 2022. "The path towards herd immunity: Predicting COVID-19 vaccination uptake through results from a stated choice study across six continents," Social Science & Medicine, Elsevier, vol. 298(C).
    18. Jia, Wenjian & Chen, T. Donna, 2023. "Investigating heterogeneous preferences for plug-in electric vehicles: Policy implications from different choice models," Transportation Research Part A: Policy and Practice, Elsevier, vol. 173(C).
    19. Enni Ruokamo & Mikołaj Czajkowski & Nick Hanley & Artti Juutinen & Rauli Svento, 2016. "Linking perceived choice complexity with scale heterogeneity in discrete choice experiments: home heating in Finland," Working Papers 2016-30, Faculty of Economic Sciences, University of Warsaw.
    20. Fifer, Simon & Rose, John M., 2016. "Can you ever be certain? Reducing hypothetical bias in stated choice experiments via respondent reported choice certaintyAuthor-Name: Beck, Matthew J," Transportation Research Part B: Methodological, Elsevier, vol. 89(C), pages 149-167.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:eejocm:v:40:y:2021:i:c:s1755534521000373. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/journal-of-choice-modelling .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.