IDEAS home Printed from https://ideas.repec.org/a/wsi/ijitdm/v18y2019i03ns0219622019500172.html
   My bibliography  Save this article

Conversion Uplift in E-Commerce: A Systematic Benchmark of Modeling Strategies

Author

Listed:
  • Robin Gubela

    (School of Business and Economics, Humboldt-University of Berlin, Unter den Linden 6, 10099 Berlin, Germany)

  • Artem Bequé

    (School of Business and Economics, Humboldt-University of Berlin, Unter den Linden 6, 10099 Berlin, Germany)

  • Stefan Lessmann

    (School of Business and Economics, Humboldt-University of Berlin, Unter den Linden 6, 10099 Berlin, Germany)

  • Fabian Gebert

    (Data Science Department, Akanoo GmbH, Mittelweg 121, 20148 Hamburg, Germany)

Abstract

Uplift modeling combines machine learning and experimental strategies to estimate the differential effect of a treatment on individuals’ behavior. The paper considers uplift models in the scope of marketing campaign targeting. Literature on uplift modeling strategies is fragmented across academic disciplines and lacks an overarching empirical comparison. Using data from online retailers, we fill this gap and contribute to literature through consolidating prior work on uplift modeling and systematically comparing the predictive performance and utility of available uplift modeling strategies. Our empirical study includes three experiments in which we examine the interaction between an uplift modeling strategy and the underlying machine learning algorithm to implement the strategy, quantify model performance in terms of business value and demonstrate the advantages of uplift models over response models, which are widely used in marketing. The results facilitate making specific recommendations how to deploy uplift models in e-commerce applications.

Suggested Citation

  • Robin Gubela & Artem Bequé & Stefan Lessmann & Fabian Gebert, 2019. "Conversion Uplift in E-Commerce: A Systematic Benchmark of Modeling Strategies," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 18(03), pages 747-791, May.
  • Handle: RePEc:wsi:ijitdm:v:18:y:2019:i:03:n:s0219622019500172
    DOI: 10.1142/S0219622019500172
    as

    Download full text from publisher

    File URL: http://www.worldscientific.com/doi/abs/10.1142/S0219622019500172
    Download Restriction: Access to full text is restricted to subscribers

    File URL: https://libkey.io/10.1142/S0219622019500172?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lan Zhao & Jishan Zhu, 2010. "Internet Marketing Budget Allocation: From Practitioner'S Perspective," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 9(05), pages 779-797.
    2. B Baesens & T Van Gestel & S Viaene & M Stepanova & J Suykens & J Vanthienen, 2003. "Benchmarking state-of-the-art classification algorithms for credit scoring," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 54(6), pages 627-635, June.
    3. Victor Chernozhukov & Mert Demirer & Esther Duflo & Iván Fernández-Val, 2018. "Generic Machine Learning Inference on Heterogeneous Treatment Effects in Randomized Experiments, with an Application to Immunization in India," NBER Working Papers 24678, National Bureau of Economic Research, Inc.
    4. Gabor Melli & Xindong Wu & Paul Beinat & Francesco Bonchi & Longbing Cao & Rong Duan & Christos Faloutsos & Rayid Ghani & Brendan Kitts & Bart Goethals & Geoff Mclachlan & Jian Pei & Ashok Srivastava , 2012. "Top-10 Data Mining Case Studies," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 11(02), pages 389-400.
    5. Amy Wenxuan Ding & Shibo Li & Patrali Chatterjee, 2015. "Learning User Real-Time Intent for Optimal Dynamic Web Page Transformation," Information Systems Research, INFORMS, vol. 26(2), pages 339-359, June.
    6. Eugenia Y. Huang & Chia-jung Tsui, 2016. "Assessing customer retention in B2C electronic commerce: an empirical study," Journal of Marketing Analytics, Palgrave Macmillan, vol. 4(4), pages 172-185, December.
    7. Philippe Baecke & Dirk Van Den Poel, 2010. "Improving Purchasing Behavior Predictions By Data Augmentation With Situational Variables," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 9(06), pages 853-872.
    8. Lu Tian & Ash A. Alizadeh & Andrew J. Gentles & Robert Tibshirani, 2014. "A Simple Method for Estimating Interactions Between a Treatment and a Large Number of Covariates," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(508), pages 1517-1532, December.
    9. Shaowen Hua, 2016. "WhatMakes Underwriting and Non-Underwriting Clients of Brokerage Firms Receive Different Recommendations? An Application of Uplift Random Forest Model," International Journal of Finance & Banking Studies, Center for the Strategic Studies in Business and Finance, vol. 5(3), pages 42-56, April.
    10. Ballings, Michel & Van den Poel, Dirk, 2015. "CRM in social media: Predicting increases in Facebook usage frequency," European Journal of Operational Research, Elsevier, vol. 244(1), pages 248-260.
    11. Van den Poel, Dirk & Buckinx, Wouter, 2005. "Predicting online-purchasing behaviour," European Journal of Operational Research, Elsevier, vol. 166(2), pages 557-575, October.
    12. Susan Athey & Guido W. Imbens, 2017. "The State of Applied Econometrics: Causality and Policy Evaluation," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 3-32, Spring.
    13. Zhengxin Chen, 2006. "From Data Mining To Behavior Mining," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 5(04), pages 703-711.
    14. Lessmann, Stefan & Coussement, Kristof & De Bock, Koen W. & Haupt, Johannes, 2018. "Targeting customers for profit: An ensemble learning framework to support marketing decision making," IRTG 1792 Discussion Papers 2018-012, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    15. Dost, Florian & Wilken, Robert & Eisenbeiss, Maik & Skiera, Bernd, 2014. "On the Edge of Buying: A Targeting Approach for Indecisive Buyers Based on Willingness-to-Pay Ranges," Journal of Retailing, Elsevier, vol. 90(3), pages 393-407.
    16. Eva Ascarza & Peter S. Fader & Bruce G. S. Hardie, 2017. "Marketing Models for the Customer-Centric Firm," International Series in Operations Research & Management Science, in: Berend Wierenga & Ralf van der Lans (ed.), Handbook of Marketing Decision Models, edition 2, chapter 0, pages 297-329, Springer.
    17. Lessmann, Stefan & Baesens, Bart & Seow, Hsin-Vonn & Thomas, Lyn C., 2015. "Benchmarking state-of-the-art classification algorithms for credit scoring: An update of research," European Journal of Operational Research, Elsevier, vol. 247(1), pages 124-136.
    18. Tarek Ben Rhouma & Georges Zaccour, 2018. "Optimal Marketing Strategies for the Acquisition and Retention of Service Subscriber," Management Science, INFORMS, vol. 64(6), pages 2609-2627, June.
    19. Kallol Bagchi & Somnath Mukhopadhyay, 2006. "Predicting Global Internet Growth Using Augmented Diffusion, Fuzzy Regression And Neural Network Models," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 5(01), pages 155-171.
    20. Ieva, M. & De Canio, F. & Ziliani, C., 2018. "Daily deal shoppers: What drives social couponing?," Journal of Retailing and Consumer Services, Elsevier, vol. 40(C), pages 299-303.
    21. Kristof Coussement & Paul Harrigan & Dries Benoit, 2015. "Improving direct mail targeting through customer response modeling," Post-Print hal-02990995, HAL.
    22. Leo Guelman & Montserrat Guillen & Ana M. Pérez-Marín, 2014. "Optimal personalized treatment rules for marketing interventions: A review of methods, a new proposal, and an insurance case study," Working Papers 2014-06, Universitat de Barcelona, UB Riskcenter.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gubela, Robin M. & Lessmann, Stefan & Jaroszewicz, Szymon, 2020. "Response transformation and profit decomposition for revenue uplift modeling," European Journal of Operational Research, Elsevier, vol. 283(2), pages 647-661.
    2. Haupt, Johannes & Lessmann, Stefan, 2022. "Targeting customers under response-dependent costs," European Journal of Operational Research, Elsevier, vol. 297(1), pages 369-379.
    3. Haupt, Johannes & Lessmann, Stefan, 2020. "Targeting Cutsomers Under Response-Dependent Costs," IRTG 1792 Discussion Papers 2020-005, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    4. Haupt, Johannes & Jacob, Daniel & Gubela, Robin M. & Lessmann, Stefan, 2019. "Affordable Uplift: Supervised Randomization in Controlled Exprtiments," IRTG 1792 Discussion Papers 2019-026, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    5. Johannes Haupt & Stefan Lessmann, 2020. "Targeting customers under response-dependent costs," Papers 2003.06271, arXiv.org, revised Aug 2021.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gubela, Robin & Bequé, Artem & Gebert, Fabian & Lessmann, Stefan, 2018. "Conversion uplift in e-commerce: A systematic benchmark of modeling strategies," IRTG 1792 Discussion Papers 2018-062, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    2. Matthias Bogaert & Lex Delaere, 2023. "Ensemble Methods in Customer Churn Prediction: A Comparative Analysis of the State-of-the-Art," Mathematics, MDPI, vol. 11(5), pages 1-28, February.
    3. Arno de Caigny & Kristof Coussement & Koen de Bock, 2020. "Leveraging fine-grained transaction data for customer life event predictions," Post-Print hal-02507998, HAL.
    4. Lessmann, Stefan & Coussement, Kristof & De Bock, Koen W. & Haupt, Johannes, 2018. "Targeting customers for profit: An ensemble learning framework to support marketing decision making," IRTG 1792 Discussion Papers 2018-012, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    5. Gubela, Robin M. & Lessmann, Stefan & Jaroszewicz, Szymon, 2020. "Response transformation and profit decomposition for revenue uplift modeling," European Journal of Operational Research, Elsevier, vol. 283(2), pages 647-661.
    6. Dangxing Chen & Weicheng Ye & Jiahui Ye, 2022. "Interpretable Selective Learning in Credit Risk," Papers 2209.10127, arXiv.org.
    7. Lechner, Michael, 2018. "Modified Causal Forests for Estimating Heterogeneous Causal Effects," IZA Discussion Papers 12040, Institute of Labor Economics (IZA).
    8. Michael C Knaus & Michael Lechner & Anthony Strittmatter, 2021. "Machine learning estimation of heterogeneous causal effects: Empirical Monte Carlo evidence," The Econometrics Journal, Royal Economic Society, vol. 24(1), pages 134-161.
    9. Petru Crudu, 2023. "Long-term effects of early adverse labour market conditions: A Causal Machine Learning approach," Working Papers 2023:21, Department of Economics, University of Venice "Ca' Foscari".
    10. Gunnarsson, Björn Rafn & vanden Broucke, Seppe & Baesens, Bart & Óskarsdóttir, María & Lemahieu, Wilfried, 2021. "Deep learning for credit scoring: Do or don’t?," European Journal of Operational Research, Elsevier, vol. 295(1), pages 292-305.
    11. De Caigny, Arno & Coussement, Kristof & De Bock, Koen W., 2018. "A new hybrid classification algorithm for customer churn prediction based on logistic regression and decision trees," European Journal of Operational Research, Elsevier, vol. 269(2), pages 760-772.
    12. Mark Kattenberg & Bas Scheer & Jurre Thiel, 2023. "Causal forests with fixed effects for treatment effect heterogeneity in difference-in-differences," CPB Discussion Paper 452, CPB Netherlands Bureau for Economic Policy Analysis.
    13. Michael C Knaus, 2022. "Double machine learning-based programme evaluation under unconfoundedness [Econometric methods for program evaluation]," The Econometrics Journal, Royal Economic Society, vol. 25(3), pages 602-627.
    14. Bart H. L. Overes & Michel van der Wel, 2021. "Modelling Sovereign Credit Ratings: Evaluating the Accuracy and Driving Factors using Machine Learning Techniques," Papers 2101.12684, arXiv.org, revised Jul 2021.
    15. Teply, Petr & Polena, Michal, 2020. "Best classification algorithms in peer-to-peer lending," The North American Journal of Economics and Finance, Elsevier, vol. 51(C).
    16. Dumitrescu, Elena & Hué, Sullivan & Hurlin, Christophe & Tokpavi, Sessi, 2022. "Machine learning for credit scoring: Improving logistic regression with non-linear decision-tree effects," European Journal of Operational Research, Elsevier, vol. 297(3), pages 1178-1192.
    17. Chengbin Wang & Kuangnan Fang & Chenlu Zheng & Hechao Xu & Zewei Li, 2021. "Credit scoring of micro and small entrepreneurial firms in China," International Entrepreneurship and Management Journal, Springer, vol. 17(1), pages 29-43, March.
    18. Juan Laborda & Seyong Ryoo, 2021. "Feature Selection in a Credit Scoring Model," Mathematics, MDPI, vol. 9(7), pages 1-22, March.
    19. Phillip Heiler & Michael C. Knaus, 2021. "Effect or Treatment Heterogeneity? Policy Evaluation with Aggregated and Disaggregated Treatments," Papers 2110.01427, arXiv.org, revised Aug 2023.
    20. Elena Ivona DUMITRESCU & Sullivan HUE & Christophe HURLIN & Sessi TOKPAVI, 2020. "Machine Learning or Econometrics for Credit Scoring: Let’s Get the Best of Both Worlds," LEO Working Papers / DR LEO 2839, Orleans Economics Laboratory / Laboratoire d'Economie d'Orleans (LEO), University of Orleans.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wsi:ijitdm:v:18:y:2019:i:03:n:s0219622019500172. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Tai Tone Lim (email available below). General contact details of provider: http://www.worldscinet.com/ijitdm/ijitdm.shtml .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.