IDEAS home Printed from https://ideas.repec.org/a/inm/ormksc/v42y2023i2p271-292.html
   My bibliography  Save this article

A Multiarmed Bandit Approach for House Ads Recommendations

Author

Listed:
  • Nicolás Aramayo

    (I2B Technologies, Santiago 7500010, Chile)

  • Mario Schiappacasse

    (I2B Technologies, Santiago 7500010, Chile)

  • Marcel Goic

    (Department of Industrial Engineering, University of Chile, Santiago 8370456, Chile)

Abstract

Nowadays, websites use a variety of recommendation systems to decide the content to display to their visitors. In this work, we use a multiarmed bandit approach to dynamically select the combination of house ads to exhibit to a heterogeneous set of customers visiting the website of a large retailer. House ads correspond to promotional information displayed on the website to highlight some specific products and are an important marketing tool for online retailers. As the number of clicks they receive not only depends on their own attractiveness but also on how attractive are other products displayed around them, we decide about complete collections of ads that capture those interactions. Moreover, as ads can wear out, in our recommendations we allow for nonstationary rewards. Furthermore, considering the sparsity of customer-level information, we embed a deep neural network to provide personalized recommendations within a bandit scheme. We tested our methods in controlled experiments where we compared them against decisions made by an experienced team of managers and the recommendations of a variety of other bandit policies. Our results show a more active exploration of the decision space and a significant increment in click-through and add-to-cart rates.

Suggested Citation

  • Nicolás Aramayo & Mario Schiappacasse & Marcel Goic, 2023. "A Multiarmed Bandit Approach for House Ads Recommendations," Marketing Science, INFORMS, vol. 42(2), pages 271-292, March.
    • Handle: RePEc:inm:ormksc:v:42:y:2023:i:2:p:271-292
    DOI: 10.1287/mksc.2022.1378
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mksc.2022.1378
    Download Restriction: no
    File URL: https://libkey.io/10.1287/mksc.2022.1378?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Peter E. Rossi & Robert E. McCulloch & Greg M. Allenby, 1996. "The Value of Purchase History Data in Target Marketing," Marketing Science, INFORMS, vol. 15(4), pages 321-340.
    2. Bleier, Alexander & Eisenbeiss, Maik, 2015. "The Importance of Trust for Personalized Online Advertising," Journal of Retailing, Elsevier, vol. 91(3), pages 390-409.
    3. Felipe Caro & Jérémie Gallien, 2007. "Dynamic Assortment with Demand Learning for Seasonal Consumer Goods," Management Science, INFORMS, vol. 53(2), pages 276-292, February.
    4. Goic, Marcel & Rojas, Andrea & Saavedra, Ignacio, 2021. "The Effectiveness of Triggered Email Marketing in Addressing Browse Abandonments," Journal of Interactive Marketing, Elsevier, vol. 55(C), pages 118-145.
    5. Eric M. Schwartz & Eric T. Bradlow & Peter S. Fader, 2017. "Customer Acquisition via Display Advertising Using Multi-Armed Bandit Experiments," Marketing Science, INFORMS, vol. 36(4), pages 500-522, July.
    6. Jiemiao Chen & Xiaojing Yang & Robert E. Smith, 2016. "The effects of creativity on advertising wear-in and wear-out," Journal of the Academy of Marketing Science, Springer, vol. 44(3), pages 334-349, May.
    7. Kahn, Barbara E & Wansink, Brian, 2004. "The Influence of Assortment Structure on Perceived Variety and Consumption Quantities," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 30(4), pages 519-533, March.
    8. Michael Braun & Wendy W. Moe, 2013. "Online Display Advertising: Modeling the Effects of Multiple Creatives and Individual Impression Histories," Marketing Science, INFORMS, vol. 32(5), pages 753-767, September.
    9. Dirk Bergemann & Ulrigh Hege, 2005. "The Financing of Innovation: Learning and Stopping," RAND Journal of Economics, The RAND Corporation, vol. 36(4), pages 719-752, Winter.
    10. Dimitris Bertsimas & Adam J. Mersereau, 2007. "A Learning Approach for Interactive Marketing to a Customer Segment," Operations Research, INFORMS, vol. 55(6), pages 1120-1135, December.
    11. Verhoef, Peter C. & Kannan, P.K. & Inman, J. Jeffrey, 2015. "From Multi-Channel Retailing to Omni-Channel Retailing," Journal of Retailing, Elsevier, vol. 91(2), pages 174-181.
    12. Goic, Marcel & Álvarez, Rodolfo & Montoya, Ricardo, 2018. "The Effect of House Ads on Multichannel Sales," Journal of Interactive Marketing, Elsevier, vol. 42(C), pages 32-45.
    13. Oliver Rutz & Randolph Bucklin, 2012. "Does banner advertising affect browsing for brands? clickstream choice model says yes, for some," Quantitative Marketing and Economics (QME), Springer, vol. 10(2), pages 231-257, June.
    14. Kireyev, Pavel & Pauwels, Koen & Gupta, Sunil, 2016. "Do display ads influence search? Attribution and dynamics in online advertising," International Journal of Research in Marketing, Elsevier, vol. 33(3), pages 475-490.
    15. Chang Hee Park & Young-Hoon Park, 2016. "Investigating Purchase Conversion by Uncovering Online Visit Patterns," Marketing Science, INFORMS, vol. 35(6), pages 894-914, November.
    16. Goić, Marcel & Jerath, Kinshuk & Kalyanam, Kirthi, 2022. "The roles of multiple channels in predicting website visits and purchases: Engagers versus closers," International Journal of Research in Marketing, Elsevier, vol. 39(3), pages 656-677.
    17. Dirk Bergemann & Juuso Valimaki, 2002. "Information Acquisition and Efficient Mechanism Design," Econometrica, Econometric Society, vol. 70(3), pages 1007-1033, May.
    18. Daniel Russo & Benjamin Van Roy, 2014. "Learning to Optimize via Posterior Sampling," Mathematics of Operations Research, INFORMS, vol. 39(4), pages 1221-1243, November.
    19. Breuer, Ralph & Brettel, Malte, 2012. "Short- and Long-term Effects of Online Advertising: Differences between New and Existing Customers," Journal of Interactive Marketing, Elsevier, vol. 26(3), pages 155-166.
    20. Amos Tversky & Itamar Simonson, 1993. "Context-Dependent Preferences," Management Science, INFORMS, vol. 39(10), pages 1179-1189, October.
    21. Montgomery, Alan L. & Smith, Michael D., 2009. "Prospects for Personalization on the Internet," Journal of Interactive Marketing, Elsevier, vol. 23(2), pages 130-137.
    22. Marszałkowski, Jakub & Drozdowski, Maciej, 2013. "Optimization of column width in website layout for advertisement fit," European Journal of Operational Research, Elsevier, vol. 226(3), pages 592-601.
    23. W. R. Gilks & P. Wild, 1992. "Adaptive Rejection Sampling for Gibbs Sampling," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 41(2), pages 337-348, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Goic, Marcel & Rojas, Andrea & Saavedra, Ignacio, 2021. "The Effectiveness of Triggered Email Marketing in Addressing Browse Abandonments," Journal of Interactive Marketing, Elsevier, vol. 55(C), pages 118-145.
    2. Hana Choi & Carl F. Mela & Santiago R. Balseiro & Adam Leary, 2020. "Online Display Advertising Markets: A Literature Review and Future Directions," Information Systems Research, INFORMS, vol. 31(2), pages 556-575, June.
    3. Goić, Marcel & Jerath, Kinshuk & Kalyanam, Kirthi, 2022. "The roles of multiple channels in predicting website visits and purchases: Engagers versus closers," International Journal of Research in Marketing, Elsevier, vol. 39(3), pages 656-677.
    4. Goic, Marcel & Álvarez, Rodolfo & Montoya, Ricardo, 2018. "The Effect of House Ads on Multichannel Sales," Journal of Interactive Marketing, Elsevier, vol. 42(C), pages 32-45.
    5. Eric M. Schwartz & Eric T. Bradlow & Peter S. Fader, 2017. "Customer Acquisition via Display Advertising Using Multi-Armed Bandit Experiments," Marketing Science, INFORMS, vol. 36(4), pages 500-522, July.
    6. Schreiner, Timo & Rese, Alexandra & Baier, Daniel, 2019. "Multichannel personalization: Identifying consumer preferences for product recommendations in advertisements across different media channels," Journal of Retailing and Consumer Services, Elsevier, vol. 48(C), pages 87-99.
    7. Neslin, Scott A., 2022. "The omnichannel continuum: Integrating online and offline channels along the customer journey," Journal of Retailing, Elsevier, vol. 98(1), pages 111-132.
    8. Santiago R. Balseiro & David B. Brown & Chen Chen, 2021. "Dynamic Pricing of Relocating Resources in Large Networks," Management Science, INFORMS, vol. 67(7), pages 4075-4094, July.
    9. Cai, Ya-Jun & Lo, Chris K.Y., 2020. "Omni-channel management in the new retailing era: A systematic review and future research agenda," International Journal of Production Economics, Elsevier, vol. 229(C).
    10. Flor, Christian Riis & Grell, Kevin Berg, 2013. "Venture capital budgeting — Carry and correlation," Journal of Corporate Finance, Elsevier, vol. 21(C), pages 216-234.
    11. Nasim Mousavi & Panagiotis Adamopoulos & Jesse Bockstedt, 2023. "The Decoy Effect and Recommendation Systems," Information Systems Research, INFORMS, vol. 34(4), pages 1533-1553, December.
    12. Shiri Melumad & Rhonda Hadi & Christian Hildebrand & Adrian F. Ward, 2020. "Technology-Augmented Choice: How Digital Innovations Are Transforming Consumer Decision Processes," Customer Needs and Solutions, Springer;Institute for Sustainable Innovation and Growth (iSIG), vol. 7(3), pages 90-101, October.
    13. Lena Steinhoff & Denni Arli & Scott Weaven & Irina V. Kozlenkova, 2019. "Online relationship marketing," Journal of the Academy of Marketing Science, Springer, vol. 47(3), pages 369-393, May.
    14. Vasu Unnava & Ashwin Aravindakshan, 2021. "How does consumer engagement evolve when brands post across multiple social media?," Journal of the Academy of Marketing Science, Springer, vol. 49(5), pages 864-881, September.
    15. Jacko, Peter & Niño Mora, José, 2009. "An index for dynamic product promotion and the knapsack problem for perishable items," DES - Working Papers. Statistics and Econometrics. WS ws093111, Universidad Carlos III de Madrid. Departamento de Estadística.
    16. Stephen Chick & Martin Forster & Paolo Pertile, 2017. "A Bayesian decision theoretic model of sequential experimentation with delayed response," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(5), pages 1439-1462, November.
    17. Gaetano Miceli & Maria Antonietta Raimondo, 2020. "Creativity in the marketing and consumer behavior literature: a structured review and a research agenda," Italian Journal of Marketing, Springer, vol. 2020(1), pages 85-124, March.
    18. Grosso, Monica & Castaldo, Sandro & Li, Hua (Ariel) & Larivière, Bart, 2020. "What Information Do Shoppers Share? The Effect of Personnel-, Retailer-, and Country-Trust on Willingness to Share Information," Journal of Retailing, Elsevier, vol. 96(4), pages 524-547.
    19. Garrett Johnson & Julian Runge & Eric Seufert, 2022. "Privacy-Centric Digital Advertising: Implications for Research," Customer Needs and Solutions, Springer;Institute for Sustainable Innovation and Growth (iSIG), vol. 9(1), pages 49-54, June.
    20. William K. Darley & Jeen-Su Lim, 2023. "Advertising creativity and its effects: a meta-analysis of the moderating role of modality," Marketing Letters, Springer, vol. 34(1), pages 99-111, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormksc:v:42:y:2023:i:2:p:271-292. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.