IDEAS home Printed from https://ideas.repec.org/a/das/njaigs/v8y2025i02p348-383id424.html

Optimizing Micro-Targeted Ad Delivery Through Multi-Armed Bandit Algorithms and Neural Networks

Author

Listed:
  • Cameron Batt

Abstract

Digital advertising suffers from persistent inefficiencies despite a $600+ billion global market, with mistargeted campaigns wasting substantial budgets by optimizing for correlation rather than causal impact. This research presents a novel framework combining neural contextual bandits with causal inference for micro-targeted ad delivery at enterprise scale. We formulate real-time ad selection as a contextual multi-armed bandit problem, deploying deep neural networks for reward prediction while maintaining sub-50ms latency constraints required for programmatic advertising. Three primary contributions are demonstrated: (1) a distributed architecture with hierarchical action space reduction achieving 18× computational speedup, enabling real-time inference across thousands of concurrent advertisements; (2) integration of uplift modeling and doubly robust causal estimation to distinguish incremental conversions from organic user behavior; and (3) adaptive exploration-exploitation strategies balancing performance optimization with advertiser fairness. The AppCapy platform, built on Next.js and Supabase, was evaluated on 8.2 billion impressions across 52 publishers over 90 days. Results show 10-12% improvement in conversion rates versus production baselines, with 28% reduction in cost-per-incremental-conversion through causal optimization. The system achieves 95th percentile latency of 47ms while processing 12,300 requests per second, with near-logarithmic regret growth validating theoretical bandit properties. Causal analysis reveals that 74% of conversions represent incremental lift, demonstrating that traditional correlation-based metrics substantially misattribute advertising effectiveness. This work bridges the gap between bandit theory and production deployment, offering a scalable solution for causally-informed programmatic advertising.

Suggested Citation

  • Cameron Batt, 2025. "Optimizing Micro-Targeted Ad Delivery Through Multi-Armed Bandit Algorithms and Neural Networks," Journal of Artificial Intelligence General science (JAIGS) ISSN:3006-4023, Open Knowledge, vol. 8(02), pages 348-383.
  • Handle: RePEc:das:njaigs:v:8:y:2025:i:02:p:348-383:id:424
    as

    Download full text from publisher

    File URL: https://newjaigs.com/index.php/JAIGS/article/view/424
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Zhengyuan Zhou & Susan Athey & Stefan Wager, 2023. "Offline Multi-Action Policy Learning: Generalization and Optimization," Operations Research, INFORMS, vol. 71(1), pages 148-183, January.
    2. Joshua D. Angrist & Jörn-Steffen Pischke, 2009. "Mostly Harmless Econometrics: An Empiricist's Companion," Economics Books, Princeton University Press, edition 1, number 8769, December.
    3. Heejung Bang & James M. Robins, 2005. "Doubly Robust Estimation in Missing Data and Causal Inference Models," Biometrics, The International Biometric Society, vol. 61(4), pages 962-973, December.
    4. Imbens,Guido W. & Rubin,Donald B., 2015. "Causal Inference for Statistics, Social, and Biomedical Sciences," Cambridge Books, Cambridge University Press, number 9780521885881.
    5. Donald B. Rubin, 2005. "Causal Inference Using Potential Outcomes: Design, Modeling, Decisions," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 322-331, March.
    6. Randall A. Lewis & Justin M. Rao, 2015. "The Unfavorable Economics of Measuring the Returns to Advertising," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 130(4), pages 1941-1973.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mark Kattenberg & Bas Scheer & Jurre Thiel, 2023. "Causal forests with fixed effects for treatment effect heterogeneity in difference-in-differences," CPB Discussion Paper 452, CPB Netherlands Bureau for Economic Policy Analysis.
    2. Wei, Wei & Young, Alex, 2025. "Beyond Russell reconstitution: A re-examination of methodologies for natural experiments," Journal of Corporate Finance, Elsevier, vol. 91(C).
    3. Lin, Zhexiao & Han, Fang, 2025. "On regression-adjusted imputation estimators of average treatment effects," Journal of Econometrics, Elsevier, vol. 251(C).
    4. Markku Maula & Wouter Stam, 2020. "Enhancing Rigor in Quantitative Entrepreneurship Research," Entrepreneurship Theory and Practice, , vol. 44(6), pages 1059-1090, November.
    5. Graham, Bryan S. & Pinto, Cristine Campos de Xavier, 2022. "Semiparametrically efficient estimation of the average linear regression function," Journal of Econometrics, Elsevier, vol. 226(1), pages 115-138.
    6. Joshua B. Gilbert & Zachary Himmelsbach & James Soland & Mridul Joshi & Benjamin W. Domingue, 2024. "Estimating Heterogeneous Treatment Effects with Item-Level Outcome Data: Insights from Item Response Theory," Papers 2405.00161, arXiv.org, revised Jan 2025.
    7. Ashesh Rambachan & Neil Shephard, 2019. "When do common time series estimands have nonparametric causal meaning?," Papers 1903.01637, arXiv.org, revised Jan 2025.
    8. Fukui Hideki, 2023. "Evaluating Different Covariate Balancing Methods: A Monte Carlo Simulation," Statistics, Politics and Policy, De Gruyter, vol. 14(2), pages 205-326, June.
    9. Peter Z. Schochet, 2022. "Statistical Power for Estimating Treatment Effects Using Difference-in-Differences and Comparative Interrupted Time Series Estimators With Variation in Treatment Timing," Journal of Educational and Behavioral Statistics, , vol. 47(4), pages 367-405, August.
    10. Peter Z. Schochet, "undated". "Statistical Theory for the RCT-YES Software: Design-Based Causal Inference for RCTs," Mathematica Policy Research Reports a0c005c003c242308a92c02dc, Mathematica Policy Research.
    11. Joshua B. Gilbert & Zachary Himmelsbach & James Soland & Mridul Joshi & Benjamin W. Domingue, 2025. "Estimating heterogeneous treatment effects with item‐level outcome data: Insights from Item Response Theory," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 44(4), pages 1417-1449, September.
    12. Yang Cai & Alkis Kalavasis & Katerina Mamali & Anay Mehrotra & Manolis Zampetakis, 2025. "What Makes Treatment Effects Identifiable? Characterizations and Estimators Beyond Unconfoundedness," Papers 2506.04194, arXiv.org, revised Jun 2025.
    13. Shira Mitchell & Andrew Gelman & Rebecca Ross & Joyce Chen & Sehrish Bari & Uyen Kim Huynh & Matthew W. Harris & Sonia Ehrlich Sachs & Elizabeth A. Stuart & Avi Feller & Susanna Makela & Alan M. Zasla, "undated". "The Millennium Villages Project: A Retrospective, Observational, Endline Evaluation," Mathematica Policy Research Reports 8376cf28448b40f69543be760, Mathematica Policy Research.
    14. Sokolov, Boris, 2025. "Causal Estimands for Policy Evaluation and Beyond," SocArXiv 4vtpk_v1, Center for Open Science.
    15. Antonio R. Linero, 2023. "Prior and posterior checking of implicit causal assumptions," Biometrics, The International Biometric Society, vol. 79(4), pages 3153-3164, December.
    16. Zhexiao Lin & Fang Han, 2022. "On regression-adjusted imputation estimators of the average treatment effect," Papers 2212.05424, arXiv.org, revised Jan 2023.
    17. Sant’Anna, Pedro H.C. & Zhao, Jun, 2020. "Doubly robust difference-in-differences estimators," Journal of Econometrics, Elsevier, vol. 219(1), pages 101-122.
    18. Hairu Wang & Yukun Liu & Haiying Zhou, 2025. "Score test for unconfoundedness under a logistic treatment assignment model," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 77(4), pages 517-533, August.
    19. Art B. Owen & Hal Varian, 2018. "Optimizing the tie-breaker regression discontinuity design," Papers 1808.07563, arXiv.org, revised Jul 2020.
    20. Colnet Bénédicte & Josse Julie & Varoquaux Gaël & Scornet Erwan, 2022. "Causal effect on a target population: A sensitivity analysis to handle missing covariates," Journal of Causal Inference, De Gruyter, vol. 10(1), pages 372-414, January.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:das:njaigs:v:8:y:2025:i:02:p:348-383:id:424. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Open Knowledge (email available below). General contact details of provider: https://newjaigs.com/index.php/JAIGS/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.