IDEAS home Printed from https://ideas.repec.org/p/ecl/stabus/3761.html
   My bibliography  Save this paper

Causally Driven Incremental Multi Touch Attribution Using a Recurrent Neural Network

Author

Listed:
  • Du, Ruihuan
  • Zhong, Yu
  • Nair, Harikesh S.

    (Stanford University Graduate School of Business)

  • Cui, Bo
  • Shou, Ruyang

Abstract

This paper describes a practical system for Multi Touch Attribution (MTA) for use by a publisher of digital ads. We developed this system for JD.com, an eCommerce company, which is also a publisher of digital ads in China. The approach has two steps. The first step (“response modeling†) fits a user-level model for purchase of a product as a function of the user’s exposure to ads. The second (“credit allocation†) uses the fitted model to allocate the incremental part of the observed purchase due to advertising, to the ads the user is exposed to over the previous T days. To implement step one, we train a Recurrent Neural Network (RNN) on user-level conversion and exposure data. The RNN has the advantage of flexibly handling the sequential dependence in the data in a semi-parametric way. The specific RNN formulation we implement captures the impact of advertising intensity, timing, competition, and user-heterogeneity, which are known to be relevant to ad-response. To implement step two, we compute Shapley Values, which have the advantage of having axiomatic foundations and satisfying fairness considerations. The specific formulation of the Shapley Value we implement respects incrementality by allocating the overall incremental improvement in conversion to the exposed ads, while handling the sequence-dependence of exposures on the observed outcomes. The system is under production at JD.com, and scales to handle the high dimensionality of the problem on the platform (attribution of the orders of about 300M users, for roughly 160K brands, across 200+ ad-types, served about 80B ad-impressions over a typical 15-day period).

Suggested Citation

  • Du, Ruihuan & Zhong, Yu & Nair, Harikesh S. & Cui, Bo & Shou, Ruyang, 2019. "Causally Driven Incremental Multi Touch Attribution Using a Recurrent Neural Network," Research Papers 3761, Stanford University, Graduate School of Business.
  • Handle: RePEc:ecl:stabus:3761
    as

    Download full text from publisher

    File URL: https://arxiv.org/abs/1902.00215
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Joel Barajas & Ram Akella & Marius Holtan & Aaron Flores, 2016. "Experimental Designs and Estimation for Online Display Advertising Attribution in Marketplaces," Marketing Science, INFORMS, vol. 35(3), pages 465-483, May.
    2. Prasad A. Naik & Murali K. Mantrala & Alan G. Sawyer, 1998. "Planning Media Schedules in the Presence of Dynamic Advertising Quality," Marketing Science, INFORMS, vol. 17(3), pages 214-235.
    3. Navdeep S. Sahni, 2015. "Effect of temporal spacing between advertising exposures: Evidence from online field experiments," Quantitative Marketing and Economics (QME), Springer, vol. 13(3), pages 203-247, September.
    4. Harikesh S. Nair & Sanjog Misra & William J. Hornbuckle IV & Ranjan Mishra & Anand Acharya, 2017. "Big Data and Marketing Analytics in Gaming: Combining Empirical Models and Field Experimentation," Marketing Science, INFORMS, vol. 36(5), pages 699-725, September.
    5. Ron Berman, 2018. "Beyond the Last Touch: Attribution in Online Advertising," Marketing Science, INFORMS, vol. 37(5), pages 771-792, September.
    6. de Haan, Evert & Wiesel, Thorsten & Pauwels, Koen, 2016. "The effectiveness of different forms of online advertising for purchase conversion in a multiple-channel attribution framework," International Journal of Research in Marketing, Elsevier, vol. 33(3), pages 491-507.
    7. Navdeep S. Sahni, 2015. "Erratum to: Effect of temporal spacing between advertising exposures: Evidence from online field experiments," Quantitative Marketing and Economics (QME), Springer, vol. 13(3), pages 249-250, September.
    8. Kireyev, Pavel & Pauwels, Koen & Gupta, Sunil, 2016. "Do display ads influence search? Attribution and dynamics in online advertising," International Journal of Research in Marketing, Elsevier, vol. 33(3), pages 475-490.
    9. Nikhil Agarwal & Susan Athey & David Yang, 2009. "Skewed Bidding in Pay-per-Action Auctions for Online Advertising," American Economic Review, American Economic Association, vol. 99(2), pages 441-447, May.
    10. Navdeep Sahni, 2015. "Effect of temporal spacing between advertising exposures: Evidence from online field experiments," Quantitative Marketing and Economics (QME), Springer, vol. 13(3), pages 203-247, September.
    11. Prasad A. Naik & Kalyan Raman & Russell S. Winer, 2005. "Planning Marketing-Mix Strategies in the Presence of Interaction Effects," Marketing Science, INFORMS, vol. 24(1), pages 25-34, June.
    12. Daniel Zantedeschi & Eleanor McDonnell Feit & Eric T. Bradlow, 2017. "Measuring Multichannel Advertising Response," Management Science, INFORMS, vol. 63(8), pages 2706-2728, August.
    13. Yu (Jeffrey) Hu & Jiwoong Shin & Zhulei Tang, 2016. "Incentive Problems in Performance-Based Online Advertising Pricing: Cost per Click vs. Cost per Action," Management Science, INFORMS, vol. 62(7), pages 2022-2038, July.
    14. Anderl, Eva & Becker, Ingo & von Wangenheim, Florian & Schumann, Jan Hendrik, 2016. "Mapping the customer journey: Lessons learned from graph-based online attribution modeling," International Journal of Research in Marketing, Elsevier, vol. 33(3), pages 457-474.
    15. Jean-Pierre Dubé & Günter Hitsch & Puneet Manchanda, 2005. "An Empirical Model of Advertising Dynamics," Quantitative Marketing and Economics (QME), Springer, vol. 3(2), pages 107-144, June.
    16. Frank M. Bass & Norris Bruce & Sumit Majumdar & B. P. S. Murthi, 2007. "Wearout Effects of Different Advertising Themes: A Dynamic Bayesian Model of the Advertising-Sales Relationship," Marketing Science, INFORMS, vol. 26(2), pages 179-195, 03-04.
    17. Lizhen Xu & Jason A. Duan & Andrew Whinston, 2014. "Path to Purchase: A Mutually Exciting Point Process Model for Online Advertising and Conversion," Management Science, INFORMS, vol. 60(6), pages 1392-1412, June.
    18. Bagwell, Kyle, 2007. "The Economic Analysis of Advertising," Handbook of Industrial Organization, in: Mark Armstrong & Robert Porter (ed.), Handbook of Industrial Organization, edition 1, volume 3, chapter 28, pages 1701-1844, Elsevier.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Brett R. Gordon & Robert Moakler & Florian Zettelmeyer, 2023. "Close Enough? A Large-Scale Exploration of Non-Experimental Approaches to Advertising Measurement," Marketing Science, INFORMS, vol. 42(4), pages 768-793, July.
    2. Brett R Gordon & Kinshuk Jerath & Zsolt Katona & Sridhar Narayanan & Jiwoong Shin & Kenneth C Wilbur, 2019. "Inefficiencies in Digital Advertising Markets," Papers 1912.09012, arXiv.org, revised Feb 2020.
    3. Kanishka Misra & Vishal Singh & Qianyun (Poppy) Zhang, 2022. "Frontiers: Impact of Stay-at-Home-Orders and Cost-of-Living on Stimulus Response: Evidence from the CARES Act," Marketing Science, INFORMS, vol. 41(2), pages 211-229, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Brett R Gordon & Kinshuk Jerath & Zsolt Katona & Sridhar Narayanan & Jiwoong Shin & Kenneth C Wilbur, 2019. "Inefficiencies in Digital Advertising Markets," Papers 1912.09012, arXiv.org, revised Feb 2020.
    2. Hana Choi & Carl F. Mela & Santiago R. Balseiro & Adam Leary, 2020. "Online Display Advertising Markets: A Literature Review and Future Directions," Information Systems Research, INFORMS, vol. 31(2), pages 556-575, June.
    3. Försch, Steffen & de Haan, Evert, 2018. "Targeting online display ads: Choosing their frequency and spacing," International Journal of Research in Marketing, Elsevier, vol. 35(4), pages 661-672.
    4. Omid Rafieian, 2023. "Optimizing User Engagement Through Adaptive Ad Sequencing," Marketing Science, INFORMS, vol. 42(5), pages 910-933, September.
    5. Landry, Peter, 2022. "Pricing, advertising, and endogenous consideration of an “insistent” product," International Journal of Industrial Organization, Elsevier, vol. 80(C).
    6. Jialie Chen & Vithala R. Rao, 2021. "Measuring the Effects of Marketing Solicitations," Customer Needs and Solutions, Springer;Institute for Sustainable Innovation and Growth (iSIG), vol. 8(4), pages 111-122, December.
    7. Thomas W. Frick & Rodrigo Belo & Rahul Telang, 2023. "Incentive Misalignments in Programmatic Advertising: Evidence from a Randomized Field Experiment," Management Science, INFORMS, vol. 69(3), pages 1665-1686, March.
    8. Wesley R. Hartmann & Daniel Klapper, 2018. "Super Bowl Ads," Marketing Science, INFORMS, vol. 37(1), pages 78-96, January.
    9. Ron Berman, 2018. "Beyond the Last Touch: Attribution in Online Advertising," Marketing Science, INFORMS, vol. 37(5), pages 771-792, September.
    10. Daniel Zantedeschi & Eleanor McDonnell Feit & Eric T. Bradlow, 2017. "Measuring Multichannel Advertising Response," Management Science, INFORMS, vol. 63(8), pages 2706-2728, August.
    11. Navdeep Sahni, 2015. "Effect of temporal spacing between advertising exposures: Evidence from online field experiments," Quantitative Marketing and Economics (QME), Springer, vol. 13(3), pages 203-247, September.
    12. Chen He & Tobias J. Klein, 2023. "Advertising as a Reminder: Evidence from the Dutch State Lottery," Marketing Science, INFORMS, vol. 42(5), pages 892-909, September.
    13. Ruichang Lu & Qiaowei Shen & Tenghui Wang & Xiaojun Zhang, 2022. "Frenemies: Corporate Advertising Under Common Ownership," Management Science, INFORMS, vol. 68(6), pages 4645-4669, June.
    14. Weijia Dai & Hyunjin Kim & Michael Luca, 2023. "Frontiers: Which Firms Gain from Digital Advertising? Evidence from a Field Experiment," Marketing Science, INFORMS, vol. 42(3), pages 429-439, May.
    15. Li, Xiaolin & Singh Rao, Raghunath & Narasimhan, Om & Gao, Xing, 2022. "Stay positive or go negative? Memory imperfections and messaging strategy," LSE Research Online Documents on Economics 113556, London School of Economics and Political Science, LSE Library.
    16. Stephan Seiler & Song Yao & Wenbo Wang, 2017. "Does Online Word of Mouth Increase Demand? (And How?) Evidence from a Natural Experiment," Marketing Science, INFORMS, vol. 36(6), pages 838-861, November.
    17. Bart J. Bronnenberg & Jean-Pierre Dubé & Robert E. Sanders, 2020. "Consumer Misinformation and the Brand Premium: A Private Label Blind Taste Test," Marketing Science, INFORMS, vol. 39(2), pages 382-406, March.
    18. Johannes Hermle & Giorgio Martini, 2022. "Valid and Unobtrusive Measurement of Returns to Advertising through Asymmetric Budget Split," Papers 2207.00206, arXiv.org.
    19. Chadwick J. Miller & Daniel C. Brannon & Jim Salas & Martha Troncoza, 2021. "Advertising, incentives, and the upsell: how advertising differentially moderates customer- vs. retailer-directed price incentives’ impact on consumers’ preferences for premium products," Journal of the Academy of Marketing Science, Springer, vol. 49(6), pages 1043-1064, November.
    20. Beltran-Royo, C. & Zhang, H. & Blanco, L.A. & Almagro, J., 2013. "Multistage multiproduct advertising budgeting," European Journal of Operational Research, Elsevier, vol. 225(1), pages 179-188.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ecl:stabus:3761. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/gsstaus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.