IDEAS home Printed from https://ideas.repec.org/a/inm/ormsom/v25y2023i4p1285-1303.html

Ancillary Services in Targeted Advertising: From Prediction to Prescription

Author

Listed:
  • Alison Borenstein

    (Wayfair, Boston, Massachusetts 02116)

  • Ankit Mangal

    (Wayfair, Boston, Massachusetts 02116)

  • Georgia Perakis

    (Operations Management, Sloan School of Management, Massachusetts Institute of Technology, Cambridge, Massachusetts 02142)

  • Stefan Poninghaus

    (Wayfair, Boston, Massachusetts 02116)

  • Divya Singhvi

    (Stern School of Business, New York University, New York, New York 10012)

  • Omar Skali Lami

    (Operations Research Center, Massachusetts Institute of Technology, Cambridge, Massachusetts 02142)

  • Jiong Wei Lua

    (Wayfair, Boston, Massachusetts 02116)

Abstract

Problem definition : Online retailers provide recommendations of ancillary services when a customer is making a purchase. Our goal is to predict the net present value (NPV) of these services, estimate the probability of a customer subscribing to each of them depending on what services are offered to them, and ultimately prescribe the optimal personalized service recommendation that maximizes the expected long-term revenue. Methodology/results : We propose a novel method called cluster-while-classify (CWC), which jointly groups observations into clusters (segments) and learns a distinct classification model within each of these segments to predict the sign-up propensity of services based on customer, product, and session-level features. This method is competitive with the industry state of the art and can be represented in a simple decision tree. This makes CWC interpretable and easily actionable. We then use double machine learning (DML) and causal forests to estimate the NPV for each service and, finally, propose an iterative optimization strategy—that is, scalable and efficient—to solve the personalized ancillary service recommendation problem. CWC achieves a competitive 74% out-of-sample accuracy over four possible outcomes and seven different combinations of services for the propensity predictions. This, alongside the rest of the personalized holistic optimization framework, can potentially result in an estimated 2.5%–3.5% uplift in the revenue based on our numerical study. Managerial implications : The proposed solution allows online retailers in general and Wayfair in particular to curate their service offerings and optimize and personalize their service recommendations for the stakeholders. This results in a simplified, streamlined process and a significant long-term revenue uplift.

Suggested Citation

  • Alison Borenstein & Ankit Mangal & Georgia Perakis & Stefan Poninghaus & Divya Singhvi & Omar Skali Lami & Jiong Wei Lua, 2023. "Ancillary Services in Targeted Advertising: From Prediction to Prescription," Manufacturing & Service Operations Management, INFORMS, vol. 25(4), pages 1285-1303, July.
  • Handle: RePEc:inm:ormsom:v:25:y:2023:i:4:p:1285-1303
    DOI: 10.1287/msom.2020.0491
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/msom.2020.0491
    Download Restriction: no

    File URL: https://libkey.io/10.1287/msom.2020.0491?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Stefan Wager & Susan Athey, 2018. "Estimation and Inference of Heterogeneous Treatment Effects using Random Forests," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(523), pages 1228-1242, July.
    2. Victor Chernozhukov & Denis Chetverikov & Mert Demirer & Esther Duflo & Christian Hansen & Whitney Newey & James Robins, 2018. "Double/debiased machine learning for treatment and structural parameters," Econometrics Journal, Royal Economic Society, vol. 21(1), pages 1-68, February.
    3. Vermunt, Jeroen K. & Magidson, Jay, 2003. "Latent class models for classification," Computational Statistics & Data Analysis, Elsevier, vol. 41(3-4), pages 531-537, January.
    4. Ruxian Wang & Maqbool Dada & Ozge Sahin, 2019. "Pricing Ancillary Service Subscriptions," Management Science, INFORMS, vol. 65(10), pages 4712-4732, October.
    5. Matt Goldman & Brian Quistorff, 2018. "Pricing Engine: Estimating Causal Impacts in Real World Business Settings," Papers 1806.03285, arXiv.org, revised Jun 2018.
    6. Negin Golrezaei & Hamid Nazerzadeh & Paat Rusmevichientong, 2014. "Real-Time Optimization of Personalized Assortments," Management Science, INFORMS, vol. 60(6), pages 1532-1551, June.
    7. A. Gürhan Kök & Marshall L. Fisher & Ramnath Vaidyanathan, 2008. "Assortment Planning: Review of Literature and Industry Practice," International Series in Operations Research & Management Science, in: Narendra Agrawal & Stephen A. Smith (ed.), Retail Supply Chain Management, chapter 0, pages 99-153, Springer.
    8. Victor Chernozhukov & Denis Chetverikov & Mert Demirer & Esther Duflo & Christian Hansen & Whitney Newey, 2017. "Double/Debiased/Neyman Machine Learning of Treatment Effects," American Economic Review, American Economic Association, vol. 107(5), pages 261-265, May.
    9. Guillermo Gallego & Anran Li & Van-Anh Truong & Xinshang Wang, 2020. "Approximation Algorithms for Product Framing and Pricing," Operations Research, INFORMS, vol. 68(1), pages 134-160, January.
    10. Monica Johar & Vijay Mookerjee & Sumit Sarkar, 2014. "Selling vs. Profiling: Optimizing the Offer Set in Web-Based Personalization," Information Systems Research, INFORMS, vol. 25(2), pages 285-306, June.
    11. David C. Schmittlein & Donald G. Morrison & Richard Colombo, 1987. "Counting Your Customers: Who-Are They and What Will They Do Next?," Management Science, INFORMS, vol. 33(1), pages 1-24, January.
    12. Peter S. Fader & Bruce G. S. Hardie & Ka Lok Lee, 2005. "“Counting Your Customers” the Easy Way: An Alternative to the Pareto/NBD Model," Marketing Science, INFORMS, vol. 24(2), pages 275-284, August.
    13. Markus Ettl & Pavithra Harsha & Anna Papush & Georgia Perakis, 2020. "A Data-Driven Approach to Personalized Bundle Pricing and Recommendation," Manufacturing & Service Operations Management, INFORMS, vol. 22(3), pages 461-480, May.
    14. Serguei Netessine & Sergei Savin & Wenqiang Xiao, 2006. "Revenue Management Through Dynamic Cross Selling in E-Commerce Retailing," Operations Research, INFORMS, vol. 54(5), pages 893-913, October.
    15. Gallego, Guillermo & Li, Anran & Truong, Van-Anh & Wang, Xinshang, 2020. "Approximation algorithms for product framing and pricing," LSE Research Online Documents on Economics 101983, London School of Economics and Political Science, LSE Library.
    16. David C. Schmittlein & Robert A. Peterson, 1994. "Customer Base Analysis: An Industrial Purchase Process Application," Marketing Science, INFORMS, vol. 13(1), pages 41-67.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ruoxuan Xiong & Allison Koenecke & Michael Powell & Zhu Shen & Joshua T. Vogelstein & Susan Athey, 2021. "Federated Causal Inference in Heterogeneous Observational Data," Papers 2107.11732, arXiv.org, revised Apr 2023.
    2. Jerath, Kinshuk & Fader, Peter S. & Hardie, Bruce G.S., 2016. "Customer-base analysis using repeated cross-sectional summary (RCSS) data," European Journal of Operational Research, Elsevier, vol. 249(1), pages 340-350.
    3. Miruna Oprescu & Vasilis Syrgkanis & Zhiwei Steven Wu, 2018. "Orthogonal Random Forest for Causal Inference," Papers 1806.03467, arXiv.org, revised Sep 2019.
    4. Mark Kattenberg & Bas Scheer & Jurre Thiel, 2023. "Causal forests with fixed effects for treatment effect heterogeneity in difference-in-differences," CPB Discussion Paper 452, CPB Netherlands Bureau for Economic Policy Analysis.
    5. Yanzhe (Murray) Lei & Stefanus Jasin & Joline Uichanco & Andrew Vakhutinsky, 2022. "Joint Product Framing (Display, Ranking, Pricing) and Order Fulfillment Under the Multinomial Logit Model for E-Commerce Retailers," Manufacturing & Service Operations Management, INFORMS, vol. 24(3), pages 1529-1546, May.
    6. Park, Chang Hee & Park, Young-Hoon & Schweidel, David A., 2014. "A multi-category customer base analysis," International Journal of Research in Marketing, Elsevier, vol. 31(3), pages 266-279.
    7. Guido W. Imbens, 2020. "Potential Outcome and Directed Acyclic Graph Approaches to Causality: Relevance for Empirical Practice in Economics," Journal of Economic Literature, American Economic Association, vol. 58(4), pages 1129-1179, December.
    8. Jushan Bai & Sung Hoon Choi & Yuan Liao, 2021. "Feasible generalized least squares for panel data with cross-sectional and serial correlations," Empirical Economics, Springer, vol. 60(1), pages 309-326, January.
    9. Ricardo P. Masini & Marcelo C. Medeiros & Eduardo F. Mendes, 2023. "Machine learning advances for time series forecasting," Journal of Economic Surveys, Wiley Blackwell, vol. 37(1), pages 76-111, February.
    10. KabirMamdouh, Alireza & Kök, A. Gürhan, 2025. "A personalized content-based method to predict customers’ preferences in an online apparel retailer," International Journal of Production Economics, Elsevier, vol. 280(C).
    11. Valente, Marica, 2023. "Policy evaluation of waste pricing programs using heterogeneous causal effect estimation," Journal of Environmental Economics and Management, Elsevier, vol. 117(C).
    12. Xiaohui Liu & Sean Qian & Hock-Hai Teo & Wei Ma, 2024. "Estimating and Mitigating the Congestion Effect of Curbside Pick-ups and Drop-Offs: A Causal Inference Approach," Transportation Science, INFORMS, vol. 58(2), pages 355-376, March.
    13. Falco J. Bargagli Stoffi & Kenneth De Beckker & Joana E. Maldonado & Kristof De Witte, 2021. "Assessing Sensitivity of Machine Learning Predictions.A Novel Toolbox with an Application to Financial Literacy," Papers 2102.04382, arXiv.org.
    14. Romero, Jaime & van der Lans, Ralf & Wierenga, Berend, 2013. "A Partially Hidden Markov Model of Customer Dynamics for CLV Measurement," Journal of Interactive Marketing, Elsevier, vol. 27(3), pages 185-208.
    15. Ruxian Wang, 2022. "The Threshold Effects on Consumer Choice and Pricing Decisions," Manufacturing & Service Operations Management, INFORMS, vol. 24(1), pages 448-466, January.
    16. Jeonghwan Lee & Cong Ma, 2025. "Learning bounds for doubly-robust covariate shift adaptation," Papers 2511.11003, arXiv.org.
    17. Anna Baiardi & Andrea A. Naghi, 2021. "The Value Added of Machine Learning to Causal Inference: Evidence from Revisited Studies," Papers 2101.00878, arXiv.org.
    18. Ganesh Karapakula, 2023. "Stable Probability Weighting: Large-Sample and Finite-Sample Estimation and Inference Methods for Heterogeneous Causal Effects of Multivalued Treatments Under Limited Overlap," Papers 2301.05703, arXiv.org, revised Jan 2023.
    19. Glady, Nicolas & Lemmens, Aurélie & Croux, Christophe, 2015. "Unveiling the relationship between the transaction timing, spending and dropout behavior of customers," International Journal of Research in Marketing, Elsevier, vol. 32(1), pages 78-93.
    20. Hoppe, Daniel & Wagner, Udo, 2014. "The role of lifetime activity cues in customer base analysis," Journal of Business Research, Elsevier, vol. 67(5), pages 983-989.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormsom:v:25:y:2023:i:4:p:1285-1303. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.