IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2403.14862.html
   My bibliography  Save this paper

The Power of Linear Programming in Sponsored Listings Ranking: Evidence from a Large-Scale Field Experiment

Author

Listed:
  • Haihao Lu
  • Luyang Zhang
  • Yuting Zhu

Abstract

Sponsored product advertisements constitute a major revenue source for online marketplaces such as Amazon, Walmart, and Alibaba. A key operational challenge in these systems lies in the Sponsored Listings Ranking (SLR) problem, that is, determining which items to include and how to rank them to balance short-term revenue with long-term relevance and user experience. Industry practice predominantly relies on score-based algorithms, which construct heuristic composite scores to rank items efficiently within strict real-time latency constraints. However, such methods offer limited control over objective trade-offs and cannot readily accommodate additional operational constraints. We propose and evaluate a Linear Programming (LP)-based algorithm as a principled alternative to score-based approaches. We first formulate the SLR problem as a constrained mixed integer programming (MIP) model and develop a dual-based algorithm that approximately solves its LP relaxation within 0.1 second, satisfying production-level latency requirements. In collaboration with a leading online marketplace, we conduct a 19-day field experiment encompassing approximately 329 million impressions. The LP-based algorithm significantly outperforms the industry-standard benchmark in key marketplace metrics, demonstrating both higher revenue and maintained relevance. Mechanism analyses reveal that the performance gains are most pronounced when the revenue-relevance tradeoff is stronger. Our framework also generalizes to settings with inventory, sales, or fairness constraints, offering a flexible and deployable optimization paradigm. The LP-based algorithm was deployed in production at our partner marketplace in January 2023, marking a rare large-scale implementation of a mathematically grounded ranking algorithm in real-world online advertising.

Suggested Citation

  • Haihao Lu & Luyang Zhang & Yuting Zhu, 2024. "The Power of Linear Programming in Sponsored Listings Ranking: Evidence from a Large-Scale Field Experiment," Papers 2403.14862, arXiv.org, revised Nov 2025.
  • Handle: RePEc:arx:papers:2403.14862
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2403.14862
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Guillermo Gallego & Richard Ratliff & Sergey Shebalov, 2015. "A General Attraction Model and Sales-Based Linear Program for Network Revenue Management Under Customer Choice," Operations Research, INFORMS, vol. 63(1), pages 212-232, February.
    2. Guillermo Gallego & Huseyin Topaloglu, 2019. "Revenue Management and Pricing Analytics," International Series in Operations Research and Management Science, Springer, number 978-1-4939-9606-3, March.
    3. Paat Rusmevichientong & Huseyin Topaloglu, 2012. "Robust Assortment Optimization in Revenue Management Under the Multinomial Logit Choice Model," Operations Research, INFORMS, vol. 60(4), pages 865-882, August.
    4. Kalyan Talluri & Garrett van Ryzin, 2004. "Revenue Management Under a General Discrete Choice Model of Consumer Behavior," Management Science, INFORMS, vol. 50(1), pages 15-33, January.
    5. Zikun Ye & Dennis J. Zhang & Heng Zhang & Renyu Zhang & Xin Chen & Zhiwei Xu, 2023. "Cold Start to Improve Market Thickness on Online Advertising Platforms: Data-Driven Algorithms and Field Experiments," Management Science, INFORMS, vol. 69(7), pages 3838-3860, July.
    6. Anindya Ghose & Panagiotis G. Ipeirotis & Beibei Li, 2014. "Examining the Impact of Ranking on Consumer Behavior and Search Engine Revenue," Management Science, INFORMS, vol. 60(7), pages 1632-1654, July.
    7. Kris J. Ferreira & Sunanda Parthasarathy & Shreyas Sekar, 2022. "Learning to Rank an Assortment of Products," Management Science, INFORMS, vol. 68(3), pages 1828-1848, March.
    8. Felipe Caro & Jérémie Gallien, 2007. "Dynamic Assortment with Demand Learning for Seasonal Consumer Goods," Management Science, INFORMS, vol. 53(2), pages 276-292, February.
    9. Harvey M. Salkin & Cornelis A. De Kluyver, 1975. "The knapsack problem: A survey," Naval Research Logistics Quarterly, John Wiley & Sons, vol. 22(1), pages 127-144, March.
    10. Mika Sumida & Guillermo Gallego & Paat Rusmevichientong & Huseyin Topaloglu & James Davis, 2021. "Revenue-Utility Tradeoff in Assortment Optimization Under the Multinomial Logit Model with Totally Unimodular Constraints," Management Science, INFORMS, vol. 67(5), pages 2845-2869, May.
    11. Pentico, David W., 2007. "Assignment problems: A golden anniversary survey," European Journal of Operational Research, Elsevier, vol. 176(2), pages 774-793, January.
    12. Guillermo Gallego & Anran Li & Van-Anh Truong & Xinshang Wang, 2020. "Approximation Algorithms for Product Framing and Pricing," Operations Research, INFORMS, vol. 68(1), pages 134-160, January.
    13. Paat Rusmevichientong & Zuo-Jun Max Shen & David B. Shmoys, 2010. "Dynamic Assortment Optimization with a Multinomial Logit Choice Model and Capacity Constraint," Operations Research, INFORMS, vol. 58(6), pages 1666-1680, December.
    14. repec:bla:econom:v:56:y:1989:i:222:p:187-98 is not listed on IDEAS
    15. Gediminas Adomavicius & YoungOk Kwon, 2014. "Optimization-Based Approaches for Maximizing Aggregate Recommendation Diversity," INFORMS Journal on Computing, INFORMS, vol. 26(2), pages 351-369, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ali Aouad & Danny Segev, 2021. "Display Optimization for Vertically Differentiated Locations Under Multinomial Logit Preferences," Management Science, INFORMS, vol. 67(6), pages 3519-3550, June.
    2. Santiago R. Balseiro & Antoine Désir, 2023. "Incentive-Compatible Assortment Optimization for Sponsored Products," Management Science, INFORMS, vol. 69(8), pages 4668-4684, August.
    3. Julia Heger & Robert Klein, 2024. "Assortment optimization: a systematic literature review," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 46(4), pages 1099-1161, December.
    4. Kameng Nip & Zhenbo Wang & Zizhuo Wang, 2021. "Assortment Optimization under a Single Transition Choice Model," Production and Operations Management, Production and Operations Management Society, vol. 30(7), pages 2122-2142, July.
    5. Nan Liu & Yuhang Ma & Huseyin Topaloglu, 2020. "Assortment Optimization Under the Multinomial Logit Model with Sequential Offerings," INFORMS Journal on Computing, INFORMS, vol. 32(3), pages 835-853, July.
    6. Qiu, Jiaqing & Li, Xiangyong & Duan, Yongrui & Chen, Mengxi & Tian, Peng, 2020. "Dynamic assortment in the presence of brand heterogeneity," Journal of Retailing and Consumer Services, Elsevier, vol. 56(C).
    7. Meng Qi & Ho‐Yin Mak & Zuo‐Jun Max Shen, 2020. "Data‐driven research in retail operations—A review," Naval Research Logistics (NRL), John Wiley & Sons, vol. 67(8), pages 595-616, December.
    8. Kris Johnson Ferreira & Joel Goh, 2021. "Assortment Rotation and the Value of Concealment," Management Science, INFORMS, vol. 67(3), pages 1489-1507, March.
    9. Jacob Feldman & Puping Jiang, 2023. "Display optimization under the multinomial logit choice model: Balancing revenue and customer satisfaction," Production and Operations Management, Production and Operations Management Society, vol. 32(11), pages 3374-3393, November.
    10. Guillermo Gallego & Gerardo Berbeglia, 2021. "The Limits of Personalization in Assortment Optimization," Papers 2109.14861, arXiv.org, revised Jun 2024.
    11. C. I. Chiang, 2023. "Availability control under online reviews in hospitality," Journal of Revenue and Pricing Management, Palgrave Macmillan, vol. 22(5), pages 385-398, October.
    12. Strauss, Arne K. & Klein, Robert & Steinhardt, Claudius, 2018. "A review of choice-based revenue management: Theory and methods," European Journal of Operational Research, Elsevier, vol. 271(2), pages 375-387.
    13. Xi Chen & Chao Shi & Yining Wang & Yuan Zhou, 2021. "Dynamic Assortment Planning Under Nested Logit Models," Production and Operations Management, Production and Operations Management Society, vol. 30(1), pages 85-102, January.
    14. Flores, Alvaro & Berbeglia, Gerardo & Van Hentenryck, Pascal, 2019. "Assortment optimization under the Sequential Multinomial Logit Model," European Journal of Operational Research, Elsevier, vol. 273(3), pages 1052-1064.
    15. Zhang, Le & Azadeh, Shadi Sharif & Jiang, Hai, 2025. "Exact and heuristic algorithms for cardinality-constrained assortment optimization problem under the cross-nested logit model," European Journal of Operational Research, Elsevier, vol. 324(1), pages 183-199.
    16. Aydın Alptekinoğlu & John H. Semple, 2016. "The Exponomial Choice Model: A New Alternative for Assortment and Price Optimization," Operations Research, INFORMS, vol. 64(1), pages 79-93, February.
    17. Felipe Caro & Victor Martínez-de-Albéniz & Paat Rusmevichientong, 2014. "The Assortment Packing Problem: Multiperiod Assortment Planning for Short-Lived Products," Management Science, INFORMS, vol. 60(11), pages 2701-2721, November.
    18. Antoine Désir & Vineet Goyal & Danny Segev & Chun Ye, 2020. "Constrained Assortment Optimization Under the Markov Chain–based Choice Model," Management Science, INFORMS, vol. 66(2), pages 698-721, February.
    19. Mika Sumida & Guillermo Gallego & Paat Rusmevichientong & Huseyin Topaloglu & James Davis, 2021. "Revenue-Utility Tradeoff in Assortment Optimization Under the Multinomial Logit Model with Totally Unimodular Constraints," Management Science, INFORMS, vol. 67(5), pages 2845-2869, May.
    20. Chenhao Wang & Yao Wang & Shaojie Tang, 2025. "Advertising meets assortment planning: joint advertising and assortment optimization under multinomial logit model," Journal of Combinatorial Optimization, Springer, vol. 49(2), pages 1-35, March.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2403.14862. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.