IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2605.23703.html

Dynamic Consumer Demand at Large Scale

Author

Listed:
  • Daniel Brunner
  • Florian Heiss
  • Anna B. Schmidt

Abstract

We study consumer demand in large-scale retail settings with many products, multiple categories and repeated purchase behavior. While inertia and brand loyalty are well documented, existing discrete choice models typically focus on single categories or become computationally infeasible in high-dimensional environments. We propose a dynamic product-level factor model that captures heterogeneity in baseline preferences, price sensitivity and inertia through a shared latent factor structure. By factorizing individual-product coefficients, the model pools information across individuals and categories and allows for correlated heterogeneity. We estimate the model using Bayesian variational inference, enabling scalable estimation with tens of thousands of parameters. In a simulation study calibrated to realistic retail data, we show that the dynamic factor model substantially improves predictive performance relative to static factor models and mixed logit benchmarks, particularly when individual purchase histories are sparse. Accounting for inertia also leads to more elastic demand estimates, underscoring the importance of dynamics for measuring consumer responsiveness. Our results highlight dynamic factor models as a scalable and flexible approach for demand estimation in modern, high-dimensional retail markets.

Suggested Citation

  • Daniel Brunner & Florian Heiss & Anna B. Schmidt, 2026. "Dynamic Consumer Demand at Large Scale," Papers 2605.23703, arXiv.org.
  • Handle: RePEc:arx:papers:2605.23703
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2605.23703
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Martin O'Connell & Pierre Dubois & Rachel Griffith, 2022. "The Use of Scanner Data for Economics Research," Annual Review of Economics, Annual Reviews, vol. 14(1), pages 723-745, August.
    2. Peter M. Guadagni & John D. C. Little, 1983. "A Logit Model of Brand Choice Calibrated on Scanner Data," Marketing Science, INFORMS, vol. 2(3), pages 203-238.
    3. David M. Blei & Alp Kucukelbir & Jon D. McAuliffe, 2017. "Variational Inference: A Review for Statisticians," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(518), pages 859-877, April.
    4. Kleibergen, Frank & Zivot, Eric, 2003. "Bayesian and classical approaches to instrumental variable regression," Journal of Econometrics, Elsevier, vol. 114(1), pages 29-72, May.
    5. Jean‐Pierre Dubé & Günter J. Hitsch & Peter E. Rossi, 2010. "State dependence and alternative explanations for consumer inertia," RAND Journal of Economics, RAND Corporation, vol. 41(3), pages 417-445, September.
    6. Carpenter, Bob & Gelman, Andrew & Hoffman, Matthew D. & Lee, Daniel & Goodrich, Ben & Betancourt, Michael & Brubaker, Marcus & Guo, Jiqiang & Li, Peter & Riddell, Allen, 2017. "Stan: A Probabilistic Programming Language," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 76(i01).
    7. Sofia Berto Villas-Boas, 2007. "Vertical Relationships between Manufacturers and Retailers: Inference with Limited Data," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 74(2), pages 625-652.
    8. Bart J. Bronnenberg & Jean-Pierre H. Dube & Matthew Gentzkow, 2012. "The Evolution of Brand Preferences: Evidence from Consumer Migration," American Economic Review, American Economic Association, vol. 102(6), pages 2472-2508, October.
    9. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521766555, August.
    10. Ali Hortaçsu & Seyed Ali Madanizadeh & Steven L. Puller, 2017. "Power to Choose? An Analysis of Consumer Inertia in the Residential Electricity Market," American Economic Journal: Economic Policy, American Economic Association, vol. 9(4), pages 192-226, November.
    11. Robert Donnelly & Francisco J.R. Ruiz & David Blei & Susan Athey, 2021. "Counterfactual inference for consumer choice across many product categories," Quantitative Marketing and Economics (QME), Springer, vol. 19(3), pages 369-407, December.
    12. Aviv Nevo, 2000. "Mergers with Differentiated Products: The Case of the Ready-to-Eat Cereal Industry," RAND Journal of Economics, The RAND Corporation, vol. 31(3), pages 395-421, Autumn.
    13. Sylvia Hristakeva, 2022. "Vertical Contracts with Endogenous Product Selection: An Empirical Analysis of Vendor Allowance Contracts," Journal of Political Economy, University of Chicago Press, vol. 130(12), pages 3202-3252.
    14. Ackerberg, Daniel A, 2001. "Empirically Distinguishing Informative and Prestige Effects of Advertising," RAND Journal of Economics, The RAND Corporation, vol. 32(2), pages 316-333, Summer.
    15. Keane, Michael P, 1997. "Modeling Heterogeneity and State Dependence in Consumer Choice Behavior," Journal of Business & Economic Statistics, American Statistical Association, vol. 15(3), pages 310-327, July.
    16. Daniel McFadden & Kenneth Train, 2000. "Mixed MNL models for discrete response," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(5), pages 447-470.
    17. Hendrik Döpper & Alexander MacKay & Nathan H. Miller & Joel Stiebale, 2025. "Rising Markups and the Role of Consumer Preferences," Journal of Political Economy, University of Chicago Press, vol. 133(8), pages 2462-2505.
    18. Susan Athey & David Blei & Robert Donnelly & Francisco Ruiz & Tobias Schmidt, 2018. "Estimating Heterogeneous Consumer Preferences for Restaurants and Travel Time Using Mobile Location Data," AEA Papers and Proceedings, American Economic Association, vol. 108, pages 64-67, May.
    19. Florian Heiss & Daniel McFadden & Joachim Winter & Amelie Wuppermann & Bo Zhou, 2021. "Inattention and Switching Costs as Sources of Inertia in Medicare Part D," American Economic Review, American Economic Association, vol. 111(9), pages 2737-2781, September.
    20. Berry, Steven & Levinsohn, James & Pakes, Ariel, 1995. "Automobile Prices in Market Equilibrium," Econometrica, Econometric Society, vol. 63(4), pages 841-890, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Robert Donnelly & Francisco J. R. Ruiz & David Blei & Susan Athey, 2021. "Correction to: Counterfactual inference for consumer choice across many product categories," Quantitative Marketing and Economics (QME), Springer, vol. 19(3), pages 409-409, December.
    2. Martin O'Connell & Pierre Dubois & Rachel Griffith, 2022. "The Use of Scanner Data for Economics Research," Annual Review of Economics, Annual Reviews, vol. 14(1), pages 723-745, August.
    3. Luo, Jinjing & Moschini, GianCarlo & Perry, Edward D., 2023. "Switching costs in the US seed industry: Technology adoption and welfare impacts," International Journal of Industrial Organization, Elsevier, vol. 89(C).
    4. Michael P. Keane, 2013. "Panel data discrete choice models of consumer demand," Economics Papers 2013-W08, Economics Group, Nuffield College, University of Oxford.
    5. Andrew T. Ching & Tülin Erdem & Michael P. Keane, 2020. "How much do consumers know about the quality of products? Evidence from the diaper market," The Japanese Economic Review, Springer, vol. 71(4), pages 541-569, October.
    6. Bonnet, Céline & Richards, Timothy J., 2016. "Models of Consumer Demand for Differentiated Products," TSE Working Papers 16-741, Toulouse School of Economics (TSE).
    7. Roozbeh Irani-Kermani & Edward C. Jaenicke & Ardalan Mirshani, 2023. "Accommodating heterogeneity in brand loyalty estimation: application to the U.S. beer retail market," Journal of Marketing Analytics, Palgrave Macmillan, vol. 11(4), pages 820-835, December.
    8. Guhl, Daniel, 2024. "Tracking time-varying brand equity using household panel data," Journal of Business Research, Elsevier, vol. 182(C).
    9. Rachel Griffith & Lars Nesheim & Martin O'Connell, 2018. "Income effects and the welfare consequences of tax in differentiated product oligopoly," Quantitative Economics, Econometric Society, vol. 9(1), pages 305-341, March.
    10. Wang, Ao, 2023. "Sieve BLP: A semi-nonparametric model of demand for differentiated products," Journal of Econometrics, Elsevier, vol. 235(2), pages 325-351.
    11. Olga Novikova & Dmitriy B. Potapov, 2015. "Empirical Analysis of Consumer Purchase Behavior: Interaction between State Dependence and Sensitivity to Marketing-Mix Variables," HSE Working papers WP BRP 48/MAN/2015, National Research University Higher School of Economics.
    12. Hovhannisyan, Vardges & Stiegert, Kyle W., 2011. "Vertical Channel Analysis of the U.S. Milk Market," 2011 Annual Meeting, July 24-26, 2011, Pittsburgh, Pennsylvania 103631, Agricultural and Applied Economics Association.
    13. Bonnet, Céline & Réquillart, Vincent, 2013. "Sugar Policy Reform, Tax Policy and Price Transmission in the Soft Drink Industry," TSE Working Papers 13-373, Toulouse School of Economics (TSE).
    14. Adithya Pattabhiramaiah & S. Sriram & Shrihari Sridhar, 2018. "Rising Prices Under Declining Preferences: The Case of the U.S. Print Newspaper Industry," Marketing Science, INFORMS, vol. 37(1), pages 97-122, January.
    15. Jerome Foncel & Marc Ivaldi & Jrisy Motis, 2008. "An Econometric Workbench for Comparing the Substantive and Dominance Tests in Horizontal Merger Analysis," Working Papers 0833, University of Crete, Department of Economics.
    16. Ito, Yuki & Hara, Konan & Kobayashi, Yasuki, 2020. "The effect of inertia on brand-name versus generic drug choices," Journal of Economic Behavior & Organization, Elsevier, vol. 172(C), pages 364-379.
    17. Kiesel Kristin & Villas-Boas Sofia B, 2007. "Got Organic Milk? Consumer Valuations of Milk Labels after the Implementation of the USDA Organic Seal," Journal of Agricultural & Food Industrial Organization, De Gruyter, vol. 5(1), pages 1-40, April.
    18. Keane, Michael P. & Wasi, Nada, 2016. "How to model consumer heterogeneity? Lessons from three case studies on SP and RP data," Research in Economics, Elsevier, vol. 70(2), pages 197-231.
    19. Draganska, Michaela & Klapper, Daniel, 2010. "Choice Set Heterogeneity and the Role of Advertising: An Analysis with Micro and Macro Data," Research Papers 2063, Stanford University, Graduate School of Business.
    20. Bruno Jacobs & Dennis Fok & Bas Donkers, 2021. "Understanding Large-Scale Dynamic Purchase Behavior," Marketing Science, INFORMS, vol. 40(5), pages 844-870, September.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2605.23703. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.