IDEAS home Printed from https://ideas.repec.org/a/eee/ijrema/v40y2023i4p781-800.html
   My bibliography  Save this article

DEPART: Decomposing prices using atheoretical regression trees

Author

Listed:
  • Lu, Huidi
  • van der Lans, Ralf
  • Helsen, Kristiaan
  • Gauri, Dinesh K.

Abstract

Regular prices and temporary discounts are important elements for retailers’ and brands’ pricing decisions. These two variables need to be considered separately because consumer sensitivities to their changes typically differ. Although the scope and richness of retail datasets have grown rapidly in recent years, most of them only record actual prices paid by customers and lack direct information about regular prices and discounts. A systematic review involving close to five hundred publications that investigated pricing variables using retail scanner data confirms this, as 63% of them only observed actual prices. To solve this missing data problem, these studies often adopted heuristics to decompose actual prices into regular prices and discount depths. However, there are many such heuristics and their accuracies have not been assessed. This research introduces DEPART, a new machine learning approach based on regression trees with a publicly available R package and benchmarks it against previously used heuristics in two different datasets. The results show that on average the proposed method outperforms previously used heuristics by 26.5% or more. Additional analyses illustrate the potential economic benefits of adopting DEPART to improve pricing decisions.

Suggested Citation

  • Lu, Huidi & van der Lans, Ralf & Helsen, Kristiaan & Gauri, Dinesh K., 2023. "DEPART: Decomposing prices using atheoretical regression trees," International Journal of Research in Marketing, Elsevier, vol. 40(4), pages 781-800.
  • Handle: RePEc:eee:ijrema:v:40:y:2023:i:4:p:781-800
    DOI: 10.1016/j.ijresmar.2023.08.009
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167811623000630
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijresmar.2023.08.009?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Daniel Hosken & David Reiffen, 2004. "Patterns of Retail Price Variation," RAND Journal of Economics, The RAND Corporation, vol. 35(1), pages 128-146, Spring.
    2. Cieslak, Anna & Schrimpf, Andreas, 2019. "Non-monetary news in central bank communication," Journal of International Economics, Elsevier, vol. 118(C), pages 293-315.
    3. Igal Hendel & Aviv Nevo, 2006. "Measuring the Implications of Sales and Consumer Inventory Behavior," Econometrica, Econometric Society, vol. 74(6), pages 1637-1673, November.
    4. Igal Hendel & Aviv Nevo, 2006. "Sales and consumer inventory," RAND Journal of Economics, RAND Corporation, vol. 37(3), pages 543-561, September.
    5. Yao Zhang & Eric T. Bradlow & Dylan S. Small, 2015. "Predicting Customer Value Using Clumpiness: From RFM to RFMC," Marketing Science, INFORMS, vol. 34(2), pages 195-208, March.
    6. Ram C. Rao & Ramesh V. Arjunji & B. P. S. Murthi, 1995. "Game Theory and Empirical Generalizations Concerning Competitive Promotions," Marketing Science, INFORMS, vol. 14(3_supplem), pages 89-100.
    7. Minnema, Alec & Bijmolt, Tammo H.A. & Non, Mariёlle C., 2017. "The impact of instant reward programs and bonus premiums on consumer purchase behavior," International Journal of Research in Marketing, Elsevier, vol. 34(1), pages 194-211.
    8. Jan-Benedict E. M. Steenkamp & Vincent R. Nijs & Dominique M. Hanssens & Marnik G. Dekimpe, 2005. "Competitive Reactions to Advertising and Promotion Attacks," Marketing Science, INFORMS, vol. 24(1), pages 35-54, September.
    9. Cortiñas, Mónica & Elorz, Margarita & Múgica, José Miguel, 2008. "The use of loyalty-cards databases: Differences in regular price and discount sensitivity in the brand choice decision between card and non-card holders," Journal of Retailing and Consumer Services, Elsevier, vol. 15(1), pages 52-62.
    10. van Lin, Arjen & Gijsbrechts, Els, 2016. "The battle for health and beauty: What drives supermarket and drugstore category-promotion lifts?," International Journal of Research in Marketing, Elsevier, vol. 33(3), pages 557-577.
    11. Guyt, Jonne & Gijsbrechts, Els, 2018. "On consumer choice patterns and the net impact of feature promotions," International Journal of Research in Marketing, Elsevier, vol. 35(3), pages 490-508.
    12. Blakeley B. McShane & Chaoqun Chen & Eric T. Anderson & Duncan I. Simester, 2016. "Decision Stages and Asymmetries in Regular Retail Price Pass-Through," Marketing Science, INFORMS, vol. 35(4), pages 619-639, July.
    13. Anderson, Eric & Malin, Benjamin A. & Nakamura, Emi & Simester, Duncan & Steinsson, Jón, 2017. "Informational rigidities and the stickiness of temporary Sales," Journal of Monetary Economics, Elsevier, vol. 90(C), pages 64-83.
    14. Vincent R. Nijs & Marnik G. Dekimpe & Jan-Benedict E.M. Steenkamps & Dominique M. Hanssens, 2001. "The Category-Demand Effects of Price Promotions," Marketing Science, INFORMS, vol. 20(1), pages 1-22, September.
    15. Hill, R Carter & Cartwright, P A, 1994. "The Statistical Properties of the Equity Estimator," Journal of Business & Economic Statistics, American Statistical Association, vol. 12(2), pages 141-147, April.
    16. Jushan Bai & Pierre Perron, 1998. "Estimating and Testing Linear Models with Multiple Structural Changes," Econometrica, Econometric Society, vol. 66(1), pages 47-78, January.
    17. Jagmohan S. Raju, 1992. "The Effect of Price Promotions on Variability in Product Category Sales," Marketing Science, INFORMS, vol. 11(3), pages 207-220.
    18. Magid M. Abraham & Leonard M. Lodish, 1993. "An Implemented System for Improving Promotion Productivity Using Store Scanner Data," Marketing Science, INFORMS, vol. 12(3), pages 248-269.
    19. Yan Liu & Subramanian Balachander, 2014. "How long has it been since the last deal? Consumer promotion timing expectations and promotional response," Quantitative Marketing and Economics (QME), Springer, vol. 12(1), pages 85-126, March.
    20. Igal Hendel & Aviv Nevo, 2006. "Sales and Consumer Inventory," RAND Journal of Economics, The RAND Corporation, vol. 37(3), pages 543-561, Autumn.
    21. Peter M. Guadagni & John D. C. Little, 1983. "A Logit Model of Brand Choice Calibrated on Scanner Data," Marketing Science, INFORMS, vol. 2(3), pages 203-238.
    22. Kusum L. Ailawadi & Praveen K. Kopalle & Scott A. Neslin, 2005. "Predicting Competitive Response to a Major Policy Change: Combining Game-Theoretic and Empirical Analyses," Marketing Science, INFORMS, vol. 24(1), pages 12-24, September.
    23. Gerard J. Tellis & Fred S. Zufryden, 1995. "Tackling the Retailer Decision Maze: Which Brands to Discount, How Much, When and Why?," Marketing Science, INFORMS, vol. 14(3), pages 271-299.
    24. Conner Mullally & Jayson L Lusk, 2018. "The Impact of Farm Animal Housing Restrictions on Egg Prices, Consumer Welfare, and Production in California," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 100(3), pages 649-669.
    25. Hill, R Carter & Cartwright, P A, 1994. "The Statistical Properties of the Equity Estimator: A Rejoinder," Journal of Business & Economic Statistics, American Statistical Association, vol. 12(2), pages 155-155, April.
    26. William Rea & Marco Reale & Carmela Cappelli & Jennifer Brown, 2010. "Identification of Changes in Mean with Regression Trees: An Application to Market Research," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 754-777.
    27. Lamey, Lien & Deleersnyder, Barbara & Steenkamp, Jan-Benedict E.M. & Dekimpe, Marnik G., 2018. "New product success in the consumer packaged goods industry: A shopper marketing approach," International Journal of Research in Marketing, Elsevier, vol. 35(3), pages 432-452.
    28. Cappelli, Carmela & Penny, Richard N. & Rea, William S. & Reale, Marco, 2008. "Detecting multiple mean breaks at unknown points in official time series," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 78(2), pages 351-356.
    29. Yao Zhang & Eric T. Bradlow & Dylan S. Small, 2013. "New measures of clumpiness for incidence data," Journal of Applied Statistics, Taylor & Francis Journals, vol. 40(11), pages 2533-2548, November.
    30. Adam N. Smith & Peter E. Rossi & Greg M. Allenby, 2019. "Inference for Product Competition and Separable Demand," Marketing Science, INFORMS, vol. 38(4), pages 690-710, July.
    31. Gauri, Dinesh K. & Ratchford, Brian & Pancras, Joseph & Talukdar, Debabrata, 2017. "An Empirical Analysis of the Impact of Promotional Discounts on Store Performance," Journal of Retailing, Elsevier, vol. 93(3), pages 283-303.
    32. Jushan Bai & Pierre Perron, 2003. "Computation and analysis of multiple structural change models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 18(1), pages 1-22.
    33. Yi Qian & Hui Xie, 2011. "No Customer Left Behind: A Distribution-Free Bayesian Approach to Accounting for Missing Xs in Marketing Models," Marketing Science, INFORMS, vol. 30(4), pages 717-736, July.
    34. Christian Gillitzer & Nalini Prasad, 2018. "The Effect of Consumer Sentiment on Consumption: Cross-Sectional Evidence from Elections," American Economic Journal: Macroeconomics, American Economic Association, vol. 10(4), pages 234-269, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Deer, Lachlan & Adler, Susanne Jana & Datta, Hannes & Mizik, Natalie & Sarstedt, Marko, 2024. "Toward Open Science in Marketing Research," OSF Preprints f7a8c, Center for Open Science.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Vincent R. Nijs & Shuba Srinivasan & Koen Pauwels, 2007. "Retail-Price Drivers and Retailer Profits," Marketing Science, INFORMS, vol. 26(4), pages 473-487, 07-08.
    2. Dawes, John G., 2012. "Brand-Pack Size Cannibalization Arising from Temporary Price Promotions," Journal of Retailing, Elsevier, vol. 88(3), pages 343-355.
    3. Février, Philippe & Wilner, Lionel, 2016. "Do consumers correctly expect price reductions? Testing dynamic behavior," International Journal of Industrial Organization, Elsevier, vol. 44(C), pages 25-40.
    4. Christopher Hansman & Harrison Hong & Áureo de Paula & Vishal Singh, 2020. "A Sticky-Price View of Hoarding," NBER Working Papers 27051, National Bureau of Economic Research, Inc.
    5. Berck, Peter & Brown, Jennifer & Perloff, Jeffrey M. & Villas-Boas, Sofia Berto, 2008. "Sales: Tests of theories on causality and timing," International Journal of Industrial Organization, Elsevier, vol. 26(6), pages 1257-1273, November.
    6. Kim, Hyunchul & Lee, Dongwon, 2023. "Tax incidence for menthol cigarettes by race: Evidence from Nielsen Homescan data," Journal of Health Economics, Elsevier, vol. 92(C).
    7. Victor Aguirregabiria & Margaret Slade, 2017. "Empirical models of firms and industries," Canadian Journal of Economics, Canadian Economics Association, vol. 50(5), pages 1445-1488, December.
    8. Guofang Huang & Ahmed Khwaja & K. Sudhir, 2012. "Short Run Needs and Long Term Goals: A Dynamic Model of Thirst Management," Cowles Foundation Discussion Papers 1856, Cowles Foundation for Research in Economics, Yale University.
    9. Andrew T. Ching & Tülin Erdem & Michael P. Keane, 2013. "Invited Paper ---Learning Models: An Assessment of Progress, Challenges, and New Developments," Marketing Science, INFORMS, vol. 32(6), pages 913-938, November.
    10. Kevin J, Fox. & Iqbal A. Syed, 2016. "Price Discounts and the Measurement of Inflation: Further Results," Discussion Papers 2016-05, School of Economics, The University of New South Wales.
    11. Andrew T. Ching & Tülin Erdem & Michael P. Keane, 2013. "Learning Models: An Assessment of Progress, Challenges and New Developments," Economics Papers 2013-W07, Economics Group, Nuffield College, University of Oxford.
    12. Csilla Horváth & Dennis Fok, 2013. "Moderating Factors of Immediate, Gross, and Net Cross-Brand Effects of Price Promotions," Marketing Science, INFORMS, vol. 32(1), pages 127-152, July.
    13. Fox, Kevin J. & Syed, Iqbal A., 2016. "Price discounts and the measurement of inflation," Journal of Econometrics, Elsevier, vol. 191(2), pages 398-406.
    14. Tenn, Steven & Froeb, Luke & Tschantz, Steven, 2010. "Mergers when firms compete by choosing both price and promotion," International Journal of Industrial Organization, Elsevier, vol. 28(6), pages 695-707, November.
    15. Giulietti, Monica & Otero, Jesús & Waterson, Michael, 2020. "Rigidities and adjustments of daily prices to costs: Evidence from supermarket data," Journal of Economic Dynamics and Control, Elsevier, vol. 116(C).
    16. Maarten Dossche & Freddy Heylen & Dirk Van den Poel, 2010. "The Kinked Demand Curve and Price Rigidity: Evidence from Scanner Data," Scandinavian Journal of Economics, Wiley Blackwell, vol. 112(4), pages 723-752, December.
    17. Rezgar Mohammed & Olga Murova, 2019. "The Effect of Price Reduction on Consumer's Buying Behavior in the U.S. Differentiated Yogurt Market," Applied Economics and Finance, Redfame publishing, vol. 6(2), pages 32-42, March.
    18. Pradeep K. Chintagunta & Harikesh S. Nair, 2011. "Structural Workshop Paper --Discrete-Choice Models of Consumer Demand in Marketing," Marketing Science, INFORMS, vol. 30(6), pages 977-996, November.
    19. Boute, Robert N. & Disney, Stephen M. & Lambrecht, Marc R. & Houdt, Benny Van, 2014. "Coordinating lead times and safety stocks under autocorrelated demand," European Journal of Operational Research, Elsevier, vol. 232(1), pages 52-63.
    20. Venkatesh Shankar & Ruth N. Bolton, 2004. "An Empirical Analysis of Determinants of Retailer Pricing Strategy," Marketing Science, INFORMS, vol. 23(1), pages 28-49, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ijrema:v:40:y:2023:i:4:p:781-800. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/international-journal-of-research-in-marketing/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.