IDEAS home Printed from https://ideas.repec.org/a/pal/jorapm/v20y2021i3d10.1057_s41272-021-00314-1.html
   My bibliography  Save this article

A note on the advantage of context in Thompson sampling

Author

Listed:
  • Michael Byrd

    (Yum! Brands)

  • Ross Darrow

Abstract

Personalization has become a focal point of modern revenue management. However, it is often the case that minimal data are available to appropriately make suggestions tailored to each customer. This has led to many products making use of reinforcement learning-based algorithms to explore sets of offerings to find the best suggestions to improve conversion and revenue. Arguably the most popular of these algorithms are built on the foundation of the multi-arm bandit framework, which has shown great success across a variety of use cases. A general multi-arm bandit algorithm aims to trade-off adaptively exploring available, but under observed, recommendations, with the current known best offering. While much success has been achieved with these relatively understandable procedures, much of the airline industry is losing out on better personalized offers by ignoring the context of the transaction, as is the case in the traditional multi-arm bandit setup. Here, we explore a popular exploration heuristic, Thompson sampling, and note implementation details for multi-arm and contextual bandit variants. While the contextual bandit requires greater computational and technical complexity to include contextual features in the decision process, we illustrate the value it brings by the improvement in overall expected

Suggested Citation

  • Michael Byrd & Ross Darrow, 2021. "A note on the advantage of context in Thompson sampling," Journal of Revenue and Pricing Management, Palgrave Macmillan, vol. 20(3), pages 316-321, June.
    • Handle: RePEc:pal:jorapm:v:20:y:2021:i:3:d:10.1057_s41272-021-00314-1
    DOI: 10.1057/s41272-021-00314-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1057/s41272-021-00314-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1057/s41272-021-00314-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Nicholas G. Polson & James G. Scott & Jesse Windle, 2013. "Bayesian Inference for Logistic Models Using Pólya--Gamma Latent Variables," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 108(504), pages 1339-1349, December.
    2. Paul E. Green & Abba M. Krieger & Yoram Wind, 2001. "Thirty Years of Conjoint Analysis: Reflections and Prospects," Interfaces, INFORMS, vol. 31(3_supplem), pages 56-73, June.
    3. Ben Vinod & Richard Ratliff & Vikram Jayaram, 2018. "An approach to offer management: maximizing sales with fare products and ancillaries," Journal of Revenue and Pricing Management, Palgrave Macmillan, vol. 17(2), pages 91-101, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Buddhavarapu, Prasad & Bansal, Prateek & Prozzi, Jorge A., 2021. "A new spatial count data model with time-varying parameters," Transportation Research Part B: Methodological, Elsevier, vol. 150(C), pages 566-586.
    2. Merja Halme & Kari Linden & Kimmo Kääriä, 2009. "Patients’ Preferences for Generic and Branded Over-the-Counter Medicines," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 2(4), pages 243-255, December.
    3. Niko Hauzenberger & Florian Huber, 2020. "Model instability in predictive exchange rate regressions," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(2), pages 168-186, March.
    4. Bertrand, Marianne & Karlan, Dean S. & Mullainathan, Sendhil & Shafir, Eldar & Zinman, Jonathan, 2005. "What's Psychology Worth? A Field Experiment in the Consumer Credit Market," Center Discussion Papers 28441, Yale University, Economic Growth Center.
    5. Atallah, Shadi S. & Huang, Ju-Chin & Leahy, Jessica & Bennett, Karen, 2020. "Preference Heterogeneity and Neighborhood Effect in Invasive Species Control: The Case of Glossy Buckthorn in New Hampshire and Maine Forests," 2020 Annual Meeting, July 26-28, Kansas City, Missouri 304623, Agricultural and Applied Economics Association.
    6. Anindya Bhadra & Arvind Rao & Veerabhadran Baladandayuthapani, 2018. "Inferring network structure in non†normal and mixed discrete†continuous genomic data," Biometrics, The International Biometric Society, vol. 74(1), pages 185-195, March.
    7. Haoying Wang & Guohui Wu, 2022. "Modeling discrete choices with large fine-scale spatial data: opportunities and challenges," Journal of Geographical Systems, Springer, vol. 24(3), pages 325-351, July.
    8. Yoon, Moon Gil & Yoon, Duk Young & Yang, Tae Won, 2006. "Impact of e-business on air travel markets: Distribution of airline tickets in Korea," Journal of Air Transport Management, Elsevier, vol. 12(5), pages 253-260.
    9. Norbert Bajkó & Zsolt Fülöp & Kinga Nagyné Pércsi, 2022. "Changes in the Innovation- and Marketing-Habits of Family SMEs in the Foodstuffs Industry, Caused by the Coronavirus Pandemic in Hungary," Sustainability, MDPI, vol. 14(5), pages 1-17, March.
    10. Heap, Shaun P. Hargreaves & Koop, Christel & Matakos, Konstantinos & Unan, Asli & Weber, Nina Sophie, 2021. "We Cannot Disagree Forever! Reality Polarization and Citizens’ Post-Pandemic Fiscal Adjustment Preferences," SocArXiv 69tup, Center for Open Science.
    11. Emmanuel Olateju Oyatoye & Sulaimon Olanrewaju Adebiyi & Bilqis Bolanle Amole, 2013. "An Application of Conjoint Analysis to Consumer Preference for Beverage Products in Nigeria," Acta Universitatis Danubius. OEconomica, Danubius University of Galati, issue 9(6), pages 43-56, December.
    12. Krieger, Abba M. & Green, Paul E., 2006. "A tactical model for resource allocation and its application to advertising budgeting," European Journal of Operational Research, Elsevier, vol. 170(3), pages 935-949, May.
    13. John Liechty & Duncan Fong & Eelko Huizingh & Arnaud Bruyn, 2008. "Hierarchical Bayesian conjoint models incorporating measurement uncertainty," Marketing Letters, Springer, vol. 19(2), pages 141-155, June.
    14. Christian P Theurer & Andranik Tumasjan & Isabell M Welpe, 2018. "Contextual work design and employee innovative work behavior: When does autonomy matter?," PLOS ONE, Public Library of Science, vol. 13(10), pages 1-35, October.
    15. Matthew W. Wheeler, 2019. "Bayesian additive adaptive basis tensor product models for modeling high dimensional surfaces: an application to high‐throughput toxicity testing," Biometrics, The International Biometric Society, vol. 75(1), pages 193-201, March.
    16. Shakila Yasmin & Khaled Mahmud & Farzan Afrin, 2016. "Job Attribute Preference of Executives: A Conjoint Analysis," Asian Social Science, Canadian Center of Science and Education, vol. 12(2), pages 1-68, February.
    17. Toryn L. J. Schafer & Christopher K. Wikle & Jay A. VonBank & Bart M. Ballard & Mitch D. Weegman, 2020. "A Bayesian Markov Model with Pólya-Gamma Sampling for Estimating Individual Behavior Transition Probabilities from Accelerometer Classifications," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 25(3), pages 365-382, September.
    18. Kick, Markus & Littich, Martina, 2015. "Brand and Reputation as Quality Signals on Regulated Markets," EconStor Preprints 182503, ZBW - Leibniz Information Centre for Economics.
    19. Dean A. Shepherd & Holger Patzelt, 2015. "Harsh Evaluations of Entrepreneurs Who Fail: The Role of Sexual Orientation, Use of Environmentally Friendly Technologies, and Observers' Perspective Taking," Journal of Management Studies, Wiley Blackwell, vol. 52(2), pages 253-284, March.
    20. Meixner, Oliver & Haas, Rainer & Pochtrager, Siegfried, 2007. "Importance and Relevance of Quality Labels in the Austrian Meat Supply Chain," 2007 1st Forum, February 15-17, 2007, Innsbruck, Austria 6598, International European Forum on System Dynamics and Innovation in Food Networks.

    More about this item

    Keywords

    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pal:jorapm:v:20:y:2021:i:3:d:10.1057_s41272-021-00314-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.palgrave.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.