IDEAS home Printed from https://ideas.repec.org/a/inm/ormksc/v44y2025i2p327-352.html

Personalizing Ad Load to Optimize Subscription and Ad Revenues: Product Strategies Constructed from Experiments on Pandora

Author

Listed:
  • Ali Goli

    (University of Washington, Seattle, Washington 98195)

  • David H. Reiley

    (SiriusXM Pandora, Oakland, California 94612)

  • Hongkai Zhang

    (SiriusXM Pandora, Oakland, California 94612)

Abstract

The role of advertising as an implicit price has long been recognized in economics and marketing, yet the effects of personalizing these implicit prices on firm profits and consumer welfare have not been explored. Using a large-scale field experiment on Pandora, we exogenously changed the ad load—the number of ads played per hour—for more than seven million users over 18 months. We find that the impact of ad load on consumption takes more than a year to stabilize, whereas subscription responses stabilize in less than six months. Using a machine-learning model, we analyze the heterogeneous effects of changing ad load on ad and subscription revenues. We then show that reallocating ads across users can enhance subscription profits by 7% without decreasing overall advertising profits. To achieve the same subscription rate with a uniform ad allocation policy, the firm would need to increase ad load by more than 22%. Our results show that, on average, consumer welfare drops by 2% with the proposed personalization strategy, and the effect seems to be more pronounced for users who have a higher willingness to pay.

Suggested Citation

  • Ali Goli & David H. Reiley & Hongkai Zhang, 2025. "Personalizing Ad Load to Optimize Subscription and Ad Revenues: Product Strategies Constructed from Experiments on Pandora," Marketing Science, INFORMS, vol. 44(2), pages 327-352, March.
  • Handle: RePEc:inm:ormksc:v:44:y:2025:i:2:p:327-352
    DOI: 10.1287/mksc.2022.0357
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mksc.2022.0357
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mksc.2022.0357?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Steven Salop, 1977. "The Noisy Monopolist: Imperfect Information, Price Dispersion and Price Discrimination," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 44(3), pages 393-406.
    2. Omid Rafieian, 2023. "Optimizing User Engagement Through Adaptive Ad Sequencing," Marketing Science, INFORMS, vol. 42(5), pages 910-933, September.
    3. Duncan Simester & Artem Timoshenko & Spyros I. Zoumpoulis, 2020. "Efficiently Evaluating Targeting Policies: Improving on Champion vs. Challenger Experiments," Management Science, INFORMS, vol. 66(8), pages 3412-3424, August.
    4. Peter E. Rossi & Robert E. McCulloch & Greg M. Allenby, 1996. "The Value of Purchase History Data in Target Marketing," Marketing Science, INFORMS, vol. 15(4), pages 321-340.
    5. Randall Lewis & David Reiley, 2014. "Online ads and offline sales: measuring the effect of retail advertising via a controlled experiment on Yahoo!," Quantitative Marketing and Economics (QME), Springer, vol. 12(3), pages 235-266, September.
    6. Max H. Farrell & Tengyuan Liang & Sanjog Misra, 2021. "Deep Neural Networks for Estimation and Inference," Econometrica, Econometric Society, vol. 89(1), pages 181-213, January.
    7. Tetsuya Kaji & Elena Manresa & Guillaume Pouliot, 2023. "An Adversarial Approach to Structural Estimation," Econometrica, Econometric Society, vol. 91(6), pages 2041-2063, November.
    8. Stefan Wager & Susan Athey, 2018. "Estimation and Inference of Heterogeneous Treatment Effects using Random Forests," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(523), pages 1228-1242, July.
    9. Gary S. Becker & Kevin M. Murphy, 1993. "A Simple Theory of Advertising as a Good or Bad," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 108(4), pages 941-964.
    10. Navdeep S. Sahni & S. Christian Wheeler & Pradeep Chintagunta, 2018. "Personalization in Email Marketing: The Role of Noninformative Advertising Content," Marketing Science, INFORMS, vol. 37(2), pages 236-258, March.
    11. Song Lin, 2020. "Two-Sided Price Discrimination by Media Platforms," Marketing Science, INFORMS, vol. 39(2), pages 317-338, March.
    12. Varian, Hal R, 1985. "Price Discrimination and Social Welfare," American Economic Review, American Economic Association, vol. 75(4), pages 870-875, September.
    13. William J. Allender & Jura Liaukonyte & Sherif Nasser & Timothy J. Richards, 2021. "Price Fairness and Strategic Obfuscation," Marketing Science, INFORMS, vol. 40(1), pages 122-146, January.
    14. Simon P. Anderson & Stephen Coate, 2005. "Market Provision of Broadcasting: A Welfare Analysis," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(4), pages 947-972.
    15. Stefano DellaVigna & Matthew Gentzkow, 2019. "Uniform Pricing in U.S. Retail Chains," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(4), pages 2011-2084.
    16. Kumar, Subodha & Sethi, Suresh P., 2009. "Dynamic pricing and advertising for web content providers," European Journal of Operational Research, Elsevier, vol. 197(3), pages 924-944, September.
    17. Hema Yoganarasimhan, 2020. "Search Personalization Using Machine Learning," Management Science, INFORMS, vol. 66(3), pages 1045-1070, March.
    18. Jean-Charles Rochet & Jean Tirole, 2003. "Platform Competition in Two-Sided Markets," Journal of the European Economic Association, MIT Press, vol. 1(4), pages 990-1029, June.
    19. Kenneth C. Wilbur, 2008. "A Two-Sided, Empirical Model of Television Advertising and Viewing Markets," Marketing Science, INFORMS, vol. 27(3), pages 356-378, 05-06.
    20. Omid Rafieian & Hema Yoganarasimhan, 2021. "Targeting and Privacy in Mobile Advertising," Marketing Science, INFORMS, vol. 40(2), pages 193-218, March.
    21. Krista J. Li & Sanjay Jain, 2016. "Behavior-Based Pricing: An Analysis of the Impact of Peer-Induced Fairness," Management Science, INFORMS, vol. 62(9), pages 2705-2721, September.
    22. Mark Aguiar & Erik Hurst & Loukas Karabarbounis, 2013. "Time Use during the Great Recession," American Economic Review, American Economic Association, vol. 103(5), pages 1664-1696, August.
    23. Thomas Blake & Chris Nosko & Steven Tadelis, 2015. "Consumer Heterogeneity and Paid Search Effectiveness: A Large‐Scale Field Experiment," Econometrica, Econometric Society, vol. 83, pages 155-174, January.
    24. Ali Goli & Anja Lambrecht & Hema Yoganarasimhan, 2024. "A Bias Correction Approach for Interference in Ranking Experiments," Marketing Science, INFORMS, vol. 43(3), pages 590-614, May.
    25. Simon Cowan, 2012. "Third-Degree Price Discrimination and Consumer Surplus," Journal of Industrial Economics, Wiley Blackwell, vol. 60(2), pages 333-345, June.
    26. Simon P. Anderson & Joshua S. Gans, 2011. "Platform Siphoning: Ad-Avoidance and Media Content," American Economic Journal: Microeconomics, American Economic Association, vol. 3(4), pages 1-34, November.
    27. Günter J. Hitsch & Ali Hortaçsu & Xiliang Lin, 2021. "Prices and promotions in U.S. retail markets," Quantitative Marketing and Economics (QME), Springer, vol. 19(3), pages 289-368, December.
    28. Mussa, Michael & Rosen, Sherwin, 1978. "Monopoly and product quality," Journal of Economic Theory, Elsevier, vol. 18(2), pages 301-317, August.
    29. Anja Lambrecht & Kanishka Misra, 2017. "Fee or Free: When Should Firms Charge for Online Content?," Management Science, INFORMS, vol. 63(4), pages 1150-1165, April.
    30. David Godes & Elie Ofek & Miklos Sarvary, 2009. "Content vs. Advertising: The Impact of Competition on Media Firm Strategy," Marketing Science, INFORMS, vol. 28(1), pages 20-35, 01-02.
    31. Jean-Pierre Dubé & Sanjog Misra, 2023. "Personalized Pricing and Consumer Welfare," Journal of Political Economy, University of Chicago Press, vol. 131(1), pages 131-189.
    32. Matthew Gentzkow, 2007. "Valuing New Goods in a Model with Complementarity: Online Newspapers," American Economic Review, American Economic Association, vol. 97(3), pages 713-744, June.
    33. Simon P. Anderson & Øystein Foros & Hans Jarle Kind, 2018. "Competition for Advertisers and for Viewers in Media Markets," Economic Journal, Royal Economic Society, vol. 128(608), pages 34-54, February.
    34. Sato, Susumu, 2019. "Freemium as optimal menu pricing," International Journal of Industrial Organization, Elsevier, vol. 63(C), pages 480-510.
    35. Kenneth C. Wilbur & Linli Xu & David Kempe, 2013. "Correcting Audience Externalities in Television Advertising," Marketing Science, INFORMS, vol. 32(6), pages 892-912, November.
    36. Raymond Chiang & Chester S. Spatt, 1982. "Imperfect Price Discrimination and Welfare," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 49(2), pages 155-181.
    37. Chiou, Lesley & Tucker, Catherine, 2013. "Paywalls and the demand for news," Information Economics and Policy, Elsevier, vol. 25(2), pages 61-69.
    38. Kahneman, Daniel & Knetsch, Jack L & Thaler, Richard, 1986. "Fairness as a Constraint on Profit Seeking: Entitlements in the Market," American Economic Review, American Economic Association, vol. 76(4), pages 728-741, September.
    39. David Holtz & Ruben Lobel & Inessa Liskovich & Sinan Aral, 2020. "Reducing Interference Bias in Online Marketplace Pricing Experiments," Papers 2004.12489, arXiv.org.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Beknazar-Yuzbashev, George & Jimenez-Duran, Rafael & Simonov, Andrey & Mateusz Stalinsk, Mateusz, 2026. "Social Media Advertising Loads as Prices," The Warwick Economics Research Paper Series (TWERPS) 1602, University of Warwick, Department of Economics.
    2. Beknazar-Yuzbashev, George & Jiménez-Durán, Rafael & Simonov, Andrey & Stalinski, Mateusz, 2026. "Social Media Advertising Loads as Prices," CAGE Online Working Paper Series 792, Competitive Advantage in the Global Economy (CAGE).
    3. Ian N. Weaver & Vineet Kumar & Lalit Jain, 2025. "Nonparametric Pricing Bandits Leveraging Informational Externalities to Learn the Demand Curve," Marketing Science, INFORMS, vol. 44(6), pages 1299-1320, November.
    4. Bergantiños, Gustavo & Moreno-Ternero, Juan D., 2025. "The Shapley index for music streaming platforms," Information Economics and Policy, Elsevier, vol. 71(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ali Goli & Jason Huang & David Reiley & Nickolai M. Riabov, 2025. "Measuring consumer sensitivity to audio advertising: a long-run field experiment on Pandora internet radio," Quantitative Marketing and Economics (QME), Springer, vol. 23(3), pages 347-377, September.
    2. repec:arx:papers:2411.16552 is not listed on IDEAS
    3. Ali Goli & Jason Huang & David Reiley & Nickolai M. Riabov, 2024. "Measuring Consumer Sensitivity to Audio Advertising: A Long-Run Field Experiment on Pandora Internet Radio," Papers 2412.05516, arXiv.org.
    4. Lalit Jain & Zhaoqi Li & Erfan Loghmani & Blake Mason & Hema Yoganarasimhan, 2024. "Effective Adaptive Exploration of Prices and Promotions in Choice-Based Demand Models," Marketing Science, INFORMS, vol. 43(5), pages 1002-1030, September.
    5. Chutian Wang & Bo Zhou & Yogesh V. Joshi, 2024. "Endogenous Consumption and Metered Paywalls," Marketing Science, INFORMS, vol. 43(1), pages 158-177, January.
    6. Omid Rafieian & Anuj Kapoor & Amitt Sharma, 2025. "Multiobjective Personalization of Marketing Interventions," Marketing Science, INFORMS, vol. 44(2), pages 457-477, March.
    7. Anthony Dukes & Qihong Liu & Jie Shuai, 2022. "Skippable Ads: Interactive Advertising on Digital Media Platforms," Marketing Science, INFORMS, vol. 41(3), pages 528-547, May.
    8. Zennyo, Yusuke, 2020. "Freemium competition among ad-sponsored platforms," Information Economics and Policy, Elsevier, vol. 50(C).
    9. Wilfred Amaldoss & Jinzhao Du & Woochoel Shin, 2024. "Pricing Strategy of Competing Media Platforms," Marketing Science, INFORMS, vol. 43(3), pages 488-505, May.
    10. Tåg, Joacim, 2009. "Paying to remove advertisements," Information Economics and Policy, Elsevier, vol. 21(4), pages 245-252, November.
    11. Alexander Erlei & Mattheus Brenig & Nils Engelbrecht, 2024. "Consumer Behavior under Benevolent Price Discrimination," Papers 2404.03581, arXiv.org.
    12. Anderson, Simon P. & Peitz, Martin, 2020. "Media see-saws: Winners and losers in platform markets," Journal of Economic Theory, Elsevier, vol. 186(C).
    13. Omid Rafieian, 2023. "Optimizing User Engagement Through Adaptive Ad Sequencing," Marketing Science, INFORMS, vol. 42(5), pages 910-933, September.
    14. Simon P. Anderson & Bruno Jullien, 2015. "The advertising-financed business model in two-sided media markets," Post-Print hal-02866192, HAL.
    15. Song Lin, 2024. "Media Formats of Advertising," Marketing Science, INFORMS, vol. 43(5), pages 1031-1051, September.
    16. Attila Ambrus & Emilio Calvano & Markus Reisinger, 2016. "Either or Both Competition: A "Two-Sided" Theory of Advertising with Overlapping Viewerships," American Economic Journal: Microeconomics, American Economic Association, vol. 8(3), pages 189-222, August.
    17. Song Lin, 2020. "Two-Sided Price Discrimination by Media Platforms," Marketing Science, INFORMS, vol. 39(2), pages 317-338, March.
    18. Levi DeValve & Saša Pekeč, 2022. "Optimal Price/Advertising Menus for Two-Sided Media Platforms," Operations Research, INFORMS, vol. 70(3), pages 1629-1645, May.
    19. Peitz, Martin & Reisinger, Markus, 2014. "The Economics of Internet Media," Working Papers 14-23, University of Mannheim, Department of Economics.
    20. Haihao Lu & Duncan Simester & Yuting Zhu, 2025. "Optimizing Scalable Targeted Marketing Policies with Constraints," Marketing Science, INFORMS, vol. 44(5), pages 1082-1103, September.
    21. Calvano, Emilio & Polo, Michele, 2021. "Market power, competition and innovation in digital markets: A survey," Information Economics and Policy, Elsevier, vol. 54(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormksc:v:44:y:2025:i:2:p:327-352. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.