IDEAS home Printed from https://ideas.repec.org/a/inm/ormksc/v41y2022i5p941-965.html
   My bibliography  Save this article

Writing More Compelling Creative Appeals: A Deep Learning-Based Approach

Author

Listed:
  • Jiyeon Hong

    (University of Wisconsin-Madison, Madison, Wisconsin 53706)

  • Paul R. Hoban

    (Amazon.com, Inc., Seattle, Washington 98109)

Abstract

We present a deep learning algorithm to provide personalized feedback on creative appeals, written content intended to persuade readers to undertake some action. Such appeals are widespread in marketing, including advertising copy, RFP responses, call center scripts, product descriptions, and many others. Although marketing research has produced several tools to help managers glean insights from online word-of-mouth, less attention has been paid to creating tools to assist the innumerable marketers responsible for crafting effective marketing messages. Our approach leverages the hierarchical structure of written works, associating words with sentences and sentences with documents, and the linguistic relationships developed therein. We score each sentence in an appeal by its expected contribution to success accounting for its substance and persuasive impact. The sentences with the lowest scores make the appeal less compelling and are the most effective points to focus a revision. The approach has proved effective in a randomized control trial, with subjects rating essays revised with the aid of algorithmic feedback as being 4.5% more likely to achieve their objectives. In addition to providing automated feedback to authors, we leverage the model’s output to derive substantive insights into what makes an appeal compelling.

Suggested Citation

  • Jiyeon Hong & Paul R. Hoban, 2022. "Writing More Compelling Creative Appeals: A Deep Learning-Based Approach," Marketing Science, INFORMS, vol. 41(5), pages 941-965, September.
  • Handle: RePEc:inm:ormksc:v:41:y:2022:i:5:p:941-965
    DOI: 10.1287/mksc.2022.1351
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mksc.2022.1351
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mksc.2022.1351?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Artem Timoshenko & John R. Hauser, 2019. "Identifying Customer Needs from User-Generated Content," Marketing Science, INFORMS, vol. 38(1), pages 1-20, January.
    2. Oded Netzer & Ronen Feldman & Jacob Goldenberg & Moshe Fresko, 2012. "Mine Your Own Business: Market-Structure Surveillance Through Text Mining," Marketing Science, INFORMS, vol. 31(3), pages 521-543, May.
    3. Nikolay Archak & Anindya Ghose & Panagiotis G. Ipeirotis, 2011. "Deriving the Pricing Power of Product Features by Mining Consumer Reviews," Management Science, INFORMS, vol. 57(8), pages 1485-1509, August.
    4. Olivier Toubia & Jonah Berger & Jehoshua Eliashberg, 2021. "How quantifying the shape of stories predicts their success," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 118(26), pages 2011695118-, June.
    5. Jonah Berger & Yoon Duk Kim & Robert Meyer & J. Jeffrey Inman & Andrew T Stephen, 2021. "What Makes Content Engaging? How Emotional Dynamics Shape Success," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 48(2), pages 235-250.
    6. Joachim Büschken & Greg M. Allenby, 2020. "Improving Text Analysis Using Sentence Conjunctions and Punctuation," Marketing Science, INFORMS, vol. 39(4), pages 727-742, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Roelen-Blasberg, Tobias & Habel, Johannes & Klarmann, Martin, 2023. "Automated inference of product attributes and their importance from user-generated content: Can we replace traditional market research?," International Journal of Research in Marketing, Elsevier, vol. 40(1), pages 164-188.
    2. Jonah Berger & Grant Packard & Reihane Boghrati & Ming Hsu & Ashlee Humphreys & Andrea Luangrath & Sarah Moore & Gideon Nave & Christopher Olivola & Matthew Rocklage, 2022. "Marketing insights from text analysis," Marketing Letters, Springer, vol. 33(3), pages 365-377, September.
    3. Venkatesh Shankar & Sohil Parsana, 2022. "An overview and empirical comparison of natural language processing (NLP) models and an introduction to and empirical application of autoencoder models in marketing," Journal of the Academy of Marketing Science, Springer, vol. 50(6), pages 1324-1350, November.
    4. Mengxia Zhang & Lan Luo, 2023. "Can Consumer-Posted Photos Serve as a Leading Indicator of Restaurant Survival? Evidence from Yelp," Management Science, INFORMS, vol. 69(1), pages 25-50, January.
    5. Hasmat Malik & Asyraf Afthanorhan & Noor Aina Amirah & Nuzhat Fatema, 2021. "Machine Learning Approach for Targeting and Recommending a Product for Project Management," Mathematics, MDPI, vol. 9(16), pages 1-29, August.
    6. Ishita Chakraborty & Minkyung Kim & K. Sudhir, 2019. "Attribute Sentiment Scoring With Online Text Reviews : Accounting for Language Structure and Attribute Self-Selection," Cowles Foundation Discussion Papers 2176R2, Cowles Foundation for Research in Economics, Yale University, revised Jun 2021.
    7. Dinesh Puranam & Vrinda Kadiyali & Vishal Narayan, 2021. "The Impact of Increase in Minimum Wages on Consumer Perceptions of Service: A Transformer Model of Online Restaurant Reviews," Marketing Science, INFORMS, vol. 40(5), pages 985-1004, September.
    8. Villarroel Ordenes, Francisco & Silipo, Rosaria, 2021. "Machine learning for marketing on the KNIME Hub: The development of a live repository for marketing applications," Journal of Business Research, Elsevier, vol. 137(C), pages 393-410.
    9. Schneider, Matthew J. & Gupta, Sachin, 2016. "Forecasting sales of new and existing products using consumer reviews: A random projections approach," International Journal of Forecasting, Elsevier, vol. 32(2), pages 243-256.
    10. Dominik Gutt & Jürgen Neumann & Steffen Zimmermann & Dennis Kundisch & Jianqing Chen, 2018. "Design of Review Systems - A Strategic Instrument to shape Online Review Behavior and Economic Outcomes," Working Papers Dissertations 42, Paderborn University, Faculty of Business Administration and Economics.
    11. Uttara Ananthakrishnan & Davide Proserpio & Siddhartha Sharma, 2023. "I Hear You: Does Quality Improve with Customer Voice?," Marketing Science, INFORMS, vol. 42(6), pages 1143-1161, November.
    12. Carlson, Keith & Kopalle, Praveen K. & Riddell, Allen & Rockmore, Daniel & Vana, Prasad, 2023. "Complementing human effort in online reviews: A deep learning approach to automatic content generation and review synthesis," International Journal of Research in Marketing, Elsevier, vol. 40(1), pages 54-74.
    13. Li, Xi & Shi, Mengze & Wang, Xin (Shane), 2019. "Video mining: Measuring visual information using automatic methods," International Journal of Research in Marketing, Elsevier, vol. 36(2), pages 216-231.
    14. Laura Toschi & Elisa Ughetto & Andrea Fronzetti Colladon, 2023. "The identity of social impact venture capitalists: exploring social linguistic positioning and linguistic distinctiveness through text mining," Small Business Economics, Springer, vol. 60(3), pages 1249-1280, March.
    15. Hyowon Kim & Greg M. Allenby, 2022. "Integrating Textual Information into Models of Choice and Scaled Response Data," Marketing Science, INFORMS, vol. 41(4), pages 815-830, July.
    16. Xiao Liu & Param Vir Singh & Kannan Srinivasan, 2016. "A Structured Analysis of Unstructured Big Data by Leveraging Cloud Computing," Marketing Science, INFORMS, vol. 35(3), pages 363-388, May.
    17. Ishita Chakraborty & Minkyung Kim & K. Sudhir, 2019. "Attribute Sentiment Scoring With Online Text Reviews : Accounting for Language Structure and Attribute Self-Selection," Cowles Foundation Discussion Papers 2176R, Cowles Foundation for Research in Economics, Yale University, revised Sep 2020.
    18. Marc R. Dotson & Joachim Büschken & Greg M. Allenby, 2020. "Explaining Preference Heterogeneity with Mixed Membership Modeling," Marketing Science, INFORMS, vol. 39(2), pages 407-426, March.
    19. Shivaji Alaparthi & Manit Mishra, 2021. "BERT: a sentiment analysis odyssey," Journal of Marketing Analytics, Palgrave Macmillan, vol. 9(2), pages 118-126, June.
    20. Christof Naumzik & Stefan Feuerriegel & Markus Weinmann, 2022. "I Will Survive: Predicting Business Failures from Customer Ratings," Marketing Science, INFORMS, vol. 41(1), pages 188-207, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormksc:v:41:y:2022:i:5:p:941-965. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.