IDEAS home Printed from https://ideas.repec.org/a/spr/stmapp/v33y2024i2d10.1007_s10260-023-00732-y.html
   My bibliography  Save this article

Multinomial Thompson sampling for rating scales and prior considerations for calibrating uncertainty

Author

Listed:
  • Nina Deliu

    (Sapienza Università di Roma
    University of Cambridge)

Abstract

Bandit algorithms such as Thompson sampling (TS) have been put forth for decades as useful tools for conducting adaptively-randomised experiments. By skewing the allocation toward superior arms, they can substantially improve particular outcomes of interest for both participants and investigators. For example, they may use participants’ ratings for continuously optimising their experience with a program. However, most of the bandit and TS variants are based on either binary or continuous outcome models, leading to suboptimal performances in rating scale data. Guided by behavioural experiments we conducted online, we address this problem by introducing Multinomial-TS for rating scales. After assessing its improved empirical performance in unique optimal arm scenarios, we explore potential considerations (including prior’s role) for calibrating uncertainty and balancing arm allocation in scenarios with no unique optimal arms.

Suggested Citation

  • Nina Deliu, 2024. "Multinomial Thompson sampling for rating scales and prior considerations for calibrating uncertainty," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 33(2), pages 439-469, April.
    • Handle: RePEc:spr:stmapp:v:33:y:2024:i:2:d:10.1007_s10260-023-00732-y
    DOI: 10.1007/s10260-023-00732-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10260-023-00732-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10260-023-00732-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. S. Faye Williamson & Sofía S. Villar, 2020. "A response‐adaptive randomization procedure for multi‐armed clinical trials with normally distributed outcomes," Biometrics, The International Biometric Society, vol. 76(1), pages 197-209, March.
    2. Domenico Piccolo & Rosaria Simone, 2019. "The class of cub models: statistical foundations, inferential issues and empirical evidence," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 28(3), pages 389-435, September.
    3. Roberto Colombi & Sabrina Giordano & Anna Gottard & Maria Iannario, 2019. "Hierarchical marginal models with latent uncertainty," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 46(2), pages 595-620, June.
    4. Arthur Charpentier & Romuald Élie & Carl Remlinger, 2023. "Reinforcement Learning in Economics and Finance," Computational Economics, Springer;Society for Computational Economics, vol. 62(1), pages 425-462, June.
    5. Domenico Piccolo & Rosaria Simone, 2019. "Rejoinder to the discussion of “The class of cub models: statistical foundations, inferential issues and empirical evidence”," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 28(3), pages 477-493, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ryan H. L. Ip & K. Y. K. Wu, 2024. "A mixture distribution for modelling bivariate ordinal data," Statistical Papers, Springer, vol. 65(7), pages 4453-4488, September.
    2. Roberto Colombi & Sabrina Giordano & Gerhard Tutz, 2021. "A Rating Scale Mixture Model to Account for the Tendency to Middle and Extreme Categories," Journal of Educational and Behavioral Statistics, , vol. 46(6), pages 682-716, December.
    3. Stefania Capecchi & Francesca Di Iorio & Nunzia Nappo, 2024. "A mixture model for self-assessed stress at work across EU 163," RIEDS - Rivista Italiana di Economia, Demografia e Statistica - The Italian Journal of Economic, Demographic and Statistical Studies, SIEDS Societa' Italiana di Economia Demografia e Statistica, vol. 78(2), pages 163-174, April-Jun.
    4. Corduas, Marcella, 2022. "Gender differences in the perception of inflation," Journal of Economic Psychology, Elsevier, vol. 90(C).
    5. repec:osf:socarx:v7u3h_v1 is not listed on IDEAS
    6. Gerhard Tutz, 2022. "Ordinal Trees and Random Forests: Score-Free Recursive Partitioning and Improved Ensembles," Journal of Classification, Springer;The Classification Society, vol. 39(2), pages 241-263, July.
    7. Rosaria Simone, 2023. "Uncertainty Diagnostics of Binomial Regression Trees for Ordered Rating Data," Journal of Classification, Springer;The Classification Society, vol. 40(1), pages 79-105, April.
    8. Stefania Capecchi & Romina Gambacorta & Rosaria Simone & Domenico Piccolo, 2024. "Modelling cognitive response patterns to survey questions using the class of CUB models," Questioni di Economia e Finanza (Occasional Papers) 885, Bank of Italy, Economic Research and International Relations Area.
    9. Beatriz Tovar & David Boto-García & José Francisco Baños Pino, 2024. "Meeting externalities: The effects of educational training on support for tourism activities," Tourism Economics, , vol. 30(3), pages 785-805, May.
    10. Antonio Calcagnì & Luigi Lombardi, 2022. "Modeling random and non-random decision uncertainty in ratings data: a fuzzy beta model," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 106(1), pages 145-173, March.
    11. Rosaria Simone & Marcella Corduas & Domenico Piccolo, 2023. "Dynamic modelling of price expectations and judgments," METRON, Springer;Sapienza Università di Roma, vol. 81(3), pages 323-342, December.
    12. Rosaria Simone, 2022. "On finite mixtures of Discretized Beta model for ordered responses," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 31(3), pages 828-855, September.
    13. Manisera, Marica & Zuccolotto, Paola, 2022. "A mixture model for ordinal variables measured on semantic differential scales," Econometrics and Statistics, Elsevier, vol. 22(C), pages 98-123.
    14. Heng Xu & Nan Zhang, 2022. "From Contextualizing to Context Theorizing: Assessing Context Effects in Privacy Research," Management Science, INFORMS, vol. 68(10), pages 7383-7401, October.
    15. Cantone, Giulio Giacomo & Tomaselli, Venera, 2023. "Quasi-experimental network-based design for semantic analysis of small clusters of bi-polar online reviews," SocArXiv v7u3h, Center for Open Science.
    16. Ribecco, Nunziata & D'Uggento, Angela Maria & Labarile, Angela, 2022. "What influences the perception of immigration in Italian adolescents? An analysis with CUB models for rating data," Socio-Economic Planning Sciences, Elsevier, vol. 82(PB).
    17. Gerhard Tutz, 2020. "Modelling heterogeneity: on the problem of group comparisons with logistic regression and the potential of the heterogeneous choice model," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 14(3), pages 517-542, September.
    18. Roberto Colombi & Sabrina Giordano, 2025. "Markov switching stereotype logit models for longitudinal ordinal data affected by unobserved heterogeneity in responding behavior," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 109(1), pages 117-147, March.
    19. Farwah Ali Syed & Kwo-Ting Fang & Adiqa Kausar Kiani & Muhammad Shoaib & Muhammad Asif Zahoor Raja, 2025. "Design of Neuro-Stochastic Bayesian Networks for Nonlinear Chaotic Differential Systems in Financial Mathematics," Computational Economics, Springer;Society for Computational Economics, vol. 65(1), pages 241-270, January.
    20. Capecchi, Stefania & Amato, Mario & Sodano, Valeria & Verneau, Fabio, 2019. "Understanding beliefs and concerns towards palm oil: Empirical evidence and policy implications," Food Policy, Elsevier, vol. 89(C).
    21. Venera Tomaselli & Giulio Giacomo Cantone, 2024. "Evaluating Rank-Coherence of Crowd Rating in Customer Satisfaction," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 173(1), pages 283-303, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:stmapp:v:33:y:2024:i:2:d:10.1007_s10260-023-00732-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.