IDEAS home Printed from https://ideas.repec.org/a/inm/ormksc/v30y2011i6p1079-1097.html
   My bibliography  Save this article

Identifying Causal Marketing Mix Effects Using a Regression Discontinuity Design

Author

Listed:
  • Wesley Hartmann

    (Stanford Graduate School of Business, Stanford University, Stanford, California 94305)

  • Harikesh S. Nair

    (Stanford Graduate School of Business, Stanford University, Stanford, California 94305)

  • Sridhar Narayanan

    (Stanford Graduate School of Business, Stanford University, Stanford, California 94305)

Abstract

We discuss how regression discontinuity designs arise naturally in settings where firms target marketing activity at consumers, and we illustrate how this aspect may be exploited for econometric inference of causal effects of marketing effort. Our main insight is to use commonly observed discontinuities and kinks in the heuristics by which firms target such marketing activity to consumers for nonparametric identification. Such kinks, along with continuity restrictions that are typically satisfied in marketing and industrial organization applications, are sufficient for identification of local treatment effects. We review the theory of regression discontinuity estimation in the context of targeting and explore its applicability to several marketing settings. We discuss identifiability of causal marketing effects using the design and show that consideration of an underlying model of strategic consumer behavior reveals how identification hinges on model features such as the specification and value of structural parameters as well as belief structures. We emphasize the role of selection for identification. We present two empirical applications: the first measures the effect of casino e-mail promotions targeted to customers based on ranges of their expected profitability, and the second measures the effect of direct mail targeted by a business-to-consumer company to zip codes based on cutoffs of expected response. In both cases, we illustrate that exploiting the regression discontinuity design reveals negative effects of the marketing campaigns that would not have been uncovered using other approaches. Our results are nonparametric, easy to compute, and control for the endogeneity induced by the targeting rule.

Suggested Citation

  • Wesley Hartmann & Harikesh S. Nair & Sridhar Narayanan, 2011. "Identifying Causal Marketing Mix Effects Using a Regression Discontinuity Design," Marketing Science, INFORMS, vol. 30(6), pages 1079-1097, November.
  • Handle: RePEc:inm:ormksc:v:30:y:2011:i:6:p:1079-1097
    DOI: 10.1287/mksc.1110.0670
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mksc.1110.0670
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mksc.1110.0670?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Peter E. Rossi & Robert E. McCulloch & Greg M. Allenby, 1996. "The Value of Purchase History Data in Target Marketing," Marketing Science, INFORMS, vol. 15(4), pages 321-340.
    2. Sandra E. Black, 1999. "Do Better Schools Matter? Parental Valuation of Elementary Education," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(2), pages 577-599.
    3. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    4. Imbens, Guido W. & Lemieux, Thomas, 2008. "Regression discontinuity designs: A guide to practice," Journal of Econometrics, Elsevier, vol. 142(2), pages 615-635, February.
    5. Wilbert Van Der Klaauw, 2008. "Regression–Discontinuity Analysis: A Survey of Recent Developments in Economics," LABOUR, CEIS, vol. 22(2), pages 219-245, June.
    6. Ahmed Khwaja & Gabriel Picone & Martin Salm & Justin G. Trogdon, 2011. "A comparison of treatment effects estimators using a structural model of AMI treatment choices and severity of illness information from hospital charts," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(5), pages 825-853, August.
    7. Ke-Wei Huang, 2009. "Optimal criteria for selecting price discrimination metrics when buyers have log-normally distributed willingness-to-pay," Quantitative Marketing and Economics (QME), Springer, vol. 7(3), pages 321-341, September.
    8. Joel Sobel, 1984. "The Timing of Sales," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 51(3), pages 353-368.
    9. Hahn, Jinyong & Todd, Petra & Van der Klaauw, Wilbert, 2001. "Identification and Estimation of Treatment Effects with a Regression-Discontinuity Design," Econometrica, Econometric Society, vol. 69(1), pages 201-209, January.
    10. Kenneth Y. Chay & Michael Greenstone, 2005. "Does Air Quality Matter? Evidence from the Housing Market," Journal of Political Economy, University of Chicago Press, vol. 113(2), pages 376-424, April.
    11. Meghan Busse & Jorge Silva-Risso & Florian Zettelmeyer, 2006. "$1,000 Cash Back: The Pass-Through of Auto Manufacturer Promotions," American Economic Review, American Economic Association, vol. 96(4), pages 1253-1270, September.
    12. David S. Lee & Enrico Moretti & Matthew J. Butler, 2004. "Do Voters Affect or Elect Policies? Evidence from the U. S. House," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(3), pages 807-859.
    13. Thomas Otter & Timothy J. Gilbride & Greg M. Allenby, 2011. "Testing Models of Strategic Behavior Characterized by Conditional Likelihoods," Marketing Science, INFORMS, vol. 30(4), pages 686-701, July.
    14. Lee, David S., 2008. "Randomized experiments from non-random selection in U.S. House elections," Journal of Econometrics, Elsevier, vol. 142(2), pages 675-697, February.
    15. Joshua D. Angrist & Victor Lavy, 1999. "Using Maimonides' Rule to Estimate the Effect of Class Size on Scholastic Achievement," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(2), pages 533-575.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sungho Park & Sachin Gupta, 2012. "Handling Endogenous Regressors by Joint Estimation Using Copulas," Marketing Science, INFORMS, vol. 31(4), pages 567-586, July.
    2. Wooyong Jo & Sarang Sunder & Jeonghye Choi & Minakshi Trivedi, 2020. "Protecting Consumers from Themselves: Assessing Consequences of Usage Restriction Laws on Online Game Usage and Spending," Marketing Science, INFORMS, vol. 39(1), pages 117-133, January.
    3. Hyung Sup (Zack) Bhan & Eric T. Anderson, 2023. "Multiyear Impact of Backorder Delays: A Quasi-Experimental Approach," Marketing Science, INFORMS, vol. 42(2), pages 314-335, March.
    4. Pradeep K. Chintagunta & Harikesh S. Nair, 2011. "Structural Workshop Paper --Discrete-Choice Models of Consumer Demand in Marketing," Marketing Science, INFORMS, vol. 30(6), pages 977-996, November.
    5. Harikesh S. Nair & Sanjog Misra & William J. Hornbuckle IV & Ranjan Mishra & Anand Acharya, 2017. "Big Data and Marketing Analytics in Gaming: Combining Empirical Models and Field Experimentation," Marketing Science, INFORMS, vol. 36(5), pages 699-725, September.
    6. Arun Gopalakrishnan & Eric T. Bradlow & Peter S. Fader, 2017. "A Cross-Cohort Changepoint Model for Customer-Base Analysis," Marketing Science, INFORMS, vol. 36(2), pages 195-213, March.
    7. Sridhar Narayanan & Kirthi Kalyanam, 2015. "Position Effects in Search Advertising and their Moderators: A Regression Discontinuity Approach," Marketing Science, INFORMS, vol. 34(3), pages 388-407, May.
    8. Jura Liaukonyte & Thales Teixeira & Kenneth C. Wilbur, 2015. "Television Advertising and Online Shopping," Marketing Science, INFORMS, vol. 34(3), pages 311-330, May.
    9. Anindya Ghose & Panagiotis G. Ipeirotis & Beibei Li, 2012. "Designing Ranking Systems for Hotels on Travel Search Engines by Mining User-Generated and Crowdsourced Content," Marketing Science, INFORMS, vol. 31(3), pages 493-520, May.
    10. Xitong Li, 2018. "Impact of Average Rating on Social Media Endorsement: The Moderating Role of Rating Dispersion and Discount Threshold," Information Systems Research, INFORMS, vol. 29(3), pages 739-754, September.
    11. Makoto Mizuno & Hideaki Aoyama & Yoshi Fujiwara, 2020. "Untangling the complexity of market competition in consumer goods -A complex Hilbert PCA analysis," Papers 2008.11327, arXiv.org.
    12. Puneet Manchanda & Grant Packard & Adithya Pattabhiramaiah, 2015. "Social Dollars: The Economic Impact of Customer Participation in a Firm-Sponsored Online Customer Community," Marketing Science, INFORMS, vol. 34(3), pages 367-387, May.
    13. MIZUNO Makoto & AOYAMA Hideaki & FUJIWARA Yoshi, 2020. "Constructing the Customer Journey Map of Competitive Brands: A Complex Time-series Analysis," Discussion papers 20070, Research Institute of Economy, Trade and Industry (RIETI).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    2. Mauricio Villamizar‐Villegas & Freddy A. Pinzon‐Puerto & Maria Alejandra Ruiz‐Sanchez, 2022. "A comprehensive history of regression discontinuity designs: An empirical survey of the last 60 years," Journal of Economic Surveys, Wiley Blackwell, vol. 36(4), pages 1130-1178, September.
    3. Frandsen, Brigham R. & Frölich, Markus & Melly, Blaise, 2012. "Quantile treatment effects in the regression discontinuity design," Journal of Econometrics, Elsevier, vol. 168(2), pages 382-395.
    4. Lecce, Steven & Lepone, Andrew & McKenzie, Michael D. & Segara, Reuben, 2012. "The impact of naked short selling on the securities lending and equity market," Journal of Financial Markets, Elsevier, vol. 15(1), pages 81-107.
    5. Del Bono, Emilia & Francesconi, Marco & G. Best, Nicky, 2011. "Health information and health outcomes: an application of the regression discontinuity design to the 1995 UK contraceptive pill scare case," ISER Working Paper Series 2011-16, Institute for Social and Economic Research.
    6. Del Bono, Emilia & Francesconi, Marco & Best, Nicky G., 2011. "Health information and health outcomes: an application of the regression discontinuity design to the 1995 UK contraceptive pill scare case," ISER Working Paper Series 2011-16, Institute for Social and Economic Research.
    7. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    8. Bauer, Thomas K. & Bender, Stefan & Paloyo, Alfredo R. & Schmidt, Christoph M., 2012. "Evaluating the labor-market effects of compulsory military service," European Economic Review, Elsevier, vol. 56(4), pages 814-829.
    9. Marcos Chamon & João Manoel Pinho de Mello & Sergio Firpo, 2008. "Electoral rules, political competition and fiscal spending : regression discontinuity evidence from Brazilian municipalities," Textos para discussão 559, Department of Economics PUC-Rio (Brazil).
    10. Blaise Melly & Rafael Lalive, 2020. "Estimation, Inference, and Interpretation in the Regression Discontinuity Design," Diskussionsschriften dp2016, Universitaet Bern, Departement Volkswirtschaft.
    11. Susan Athey & Guido W. Imbens, 2017. "The State of Applied Econometrics: Causality and Policy Evaluation," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 3-32, Spring.
    12. Steven F. Koch & Jeffrey S. Racine, 2016. "Healthcare facility choice and user fee abolition: regression discontinuity in a multinomial choice setting," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 179(4), pages 927-950, October.
    13. Marcos Chamon & Sergio Firpo & João M. P. de Mello & Renan Pieri, 2019. "Electoral Rules, Political Competition and Fiscal Expenditures: Regression Discontinuity Evidence from Brazilian Municipalities," Journal of Development Studies, Taylor & Francis Journals, vol. 55(1), pages 19-38, January.
    14. Jan Palguta, 2015. "Political Rent-Seeking in Public Procurement: Evidence from the Entry of Political Challengers at Electoral Thresholds," CERGE-EI Working Papers wp549, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    15. repec:wiw:wiwrsa:ersa13p303 is not listed on IDEAS
    16. Raffaello Bronzini & Eleonora Iachini, 2014. "Are Incentives for R&D Effective? Evidence from a Regression Discontinuity Approach," American Economic Journal: Economic Policy, American Economic Association, vol. 6(4), pages 100-134, November.
    17. Guido de Blasio & Samuele Poy, 2014. "The impact of local minimum wages on employment: evidence from Italy in the 1950s," Temi di discussione (Economic working papers) 953, Bank of Italy, Economic Research and International Relations Area.
    18. Sieger, Philip, 2012. "Incumbency Effects in Germany: Federal and Mayoral Elections," VfS Annual Conference 2012 (Goettingen): New Approaches and Challenges for the Labor Market of the 21st Century 62084, Verein für Socialpolitik / German Economic Association.
    19. Guido Imbens & Stefan Wager, 2019. "Optimized Regression Discontinuity Designs," The Review of Economics and Statistics, MIT Press, vol. 101(2), pages 264-278, May.
    20. Yoichi Arai & Hidehiko Ichimura, 2018. "Simultaneous selection of optimal bandwidths for the sharp regression discontinuity estimator," Quantitative Economics, Econometric Society, vol. 9(1), pages 441-482, March.
    21. Ferraz, Claudio & Finan, Frederico S., 2008. "Motivating Politicians: The Impacts of Monetary Incentives on Quality and Performance," IZA Discussion Papers 3411, Institute of Labor Economics (IZA).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormksc:v:30:y:2011:i:6:p:1079-1097. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.