IDEAS home Printed from https://ideas.repec.org/a/inm/ormsom/v23y2021i6p1354-1372.html

Service Quality Using Text Mining: Measurement and Consequences

Author

Listed:
  • Jorge Mejia

    (Kelley School of Business, Indiana University, Bloomington, Indiana 47405)

  • Shawn Mankad

    (Samuel Curtis Johnson Graduate School of Management, Cornell University, Ithaca, New York 14853)

  • Anandasivam Gopal

    (Robert H. Smith School of Business, University of Maryland, College Park, Maryland 20742)

Abstract

Problem description : Measuring quality in the service industry remains a challenge. Existing methodologies are often costly and unscalable. Furthermore, understanding how elements of service quality contribute to the performance of service providers continues to be a concern in the service industry. In this paper, we address these challenges in the restaurant sector, a vital component of the service industry. Academic/practical relevance : Our work provides a scalable methodology for measuring the quality of service providers using the vast amount of text in social media. The quality metrics proposed are associated with economic outcomes for restaurants and can help predict future restaurant performance. Methodology : We use text present in online reviews on Yelp.com to identify and extract service dimensions using nonnegative matrix factorization for a large set of restaurants located in a major city in the United States. We subsequently validate these service dimensions as proxies for service quality using external data sources and a series of laboratory experiments. Finally, we use econometrics to test the relationship between these dimensions and restaurant survival as additional validation. Results : We find that our proposed service quality dimensions are scalable, match industry standards, and are correctly identified by subjects in a controlled setting. Furthermore, we show that specific service dimensions are significantly correlated with the survival of merchants, even after controlling for competition and other factors. Managerial implications : This work has implications for the strategic use of text analytics in the context of service operations, where an increasingly large text corpus is available. We discuss the benefits of this work for service providers and platforms, such as Yelp and OpenTable.

Suggested Citation

  • Jorge Mejia & Shawn Mankad & Anandasivam Gopal, 2021. "Service Quality Using Text Mining: Measurement and Consequences," Manufacturing & Service Operations Management, INFORMS, vol. 23(6), pages 1354-1372, November.
  • Handle: RePEc:inm:ormsom:v:23:y:2021:i:6:p:1354-1372
    DOI: 10.1287/msom.2020.0883
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/msom.2020.0883
    Download Restriction: no

    File URL: https://libkey.io/10.1287/msom.2020.0883?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Andreas C. Soteriou & Richard B. Chase, 2000. "A Robust Optimization Approach for Improving Service Quality," Manufacturing & Service Operations Management, INFORMS, vol. 2(3), pages 264-286, May.
    2. Shawn Mankad & Hyunjeong Spring Han & Joel Goh & Srinagesh Gavirneni, 2016. "Understanding Online Hotel Reviews Through Automated Text Analysis," Post-Print hal-02311939, HAL.
    3. Shawn Mankad & Hyunjeong “Spring” Han & Joel Goh & Srinagesh Gavirneni, 2016. "Understanding Online Hotel Reviews Through Automated Text Analysis," Service Science, INFORMS, vol. 8(2), pages 124-138, June.
    4. Michael Anderson & Jeremy Magruder, 2012. "Learning from the Crowd: Regression Discontinuity Estimates of the Effects of an Online Review Database," Economic Journal, Royal Economic Society, vol. 122(563), pages 957-989, September.
    5. Ryan W. Buell & Dennis Campbell & Frances X. Frei, 2016. "How Do Customers Respond to Increased Service Quality Competition?," Manufacturing & Service Operations Management, INFORMS, vol. 18(4), pages 585-607, October.
    6. Daniel D. Lee & H. Sebastian Seung, 1999. "Learning the parts of objects by non-negative matrix factorization," Nature, Nature, vol. 401(6755), pages 788-791, October.
    7. Berry, Michael W. & Browne, Murray & Langville, Amy N. & Pauca, V. Paul & Plemmons, Robert J., 2007. "Algorithms and applications for approximate nonnegative matrix factorization," Computational Statistics & Data Analysis, Elsevier, vol. 52(1), pages 155-173, September.
    8. Arturs Kalnins & Kyle J. Mayer, 2004. "Franchising, Ownership, and Experience: A Study of Pizza Restaurant Survival," Management Science, INFORMS, vol. 50(12), pages 1716-1728, December.
    9. Michael Luca, 2011. "Reviews, Reputation, and Revenue: The Case of Yelp.com," Harvard Business School Working Papers 12-016, Harvard Business School, revised Mar 2016.
    10. Oded Netzer & Ronen Feldman & Jacob Goldenberg & Moshe Fresko, 2012. "Mine Your Own Business: Market-Structure Surveillance Through Text Mining," Marketing Science, INFORMS, vol. 31(3), pages 521-543, May.
    11. Xianghua Lu & Sulin Ba & Lihua Huang & Yue Feng, 2013. "Promotional Marketing or Word-of-Mouth? Evidence from Online Restaurant Reviews," Information Systems Research, INFORMS, vol. 24(3), pages 596-612, September.
    12. Aleda V. Roth & William E. Jackson, III, 1995. "Strategic Determinants of Service Quality and Performance: Evidence from the Banking Industry," Management Science, INFORMS, vol. 41(11), pages 1720-1733, November.
    13. Iacus, Stefano & King, Gary & Porro, Giuseppe, 2009. "cem: Software for Coarsened Exact Matching," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 30(i09).
    14. Joseph Hall & Evan Porteus, 2000. "Customer Service Competition in Capacitated Systems," Manufacturing & Service Operations Management, INFORMS, vol. 2(2), pages 144-165, November.
    15. David Godes & Dina Mayzlin, 2004. "Using Online Conversations to Study Word-of-Mouth Communication," Marketing Science, INFORMS, vol. 23(4), pages 545-560, June.
    16. Ruomeng Cui & Jun Li & Dennis J. Zhang, 2020. "Reducing Discrimination with Reviews in the Sharing Economy: Evidence from Field Experiments on Airbnb," Management Science, INFORMS, vol. 66(3), pages 1071-1094, March.
    17. Song-Hee Kim & Ward Whitt, 2014. "Are Call Center and Hospital Arrivals Well Modeled by Nonhomogeneous Poisson Processes?," Manufacturing & Service Operations Management, INFORMS, vol. 16(3), pages 464-480, July.
    18. Dellarocas, Chrysanthos, 2003. "The Digitization of Word-of-mouth: Promise and Challenges of Online Feedback Mechanisms," Working papers 4296-03, Massachusetts Institute of Technology (MIT), Sloan School of Management.
    19. Chrysanthos Dellarocas, 2003. "The Digitization of Word of Mouth: Promise and Challenges of Online Feedback Mechanisms," Management Science, INFORMS, vol. 49(10), pages 1407-1424, October.
    20. Sunil Gupta & Valarie Zeithaml, 2006. "Customer Metrics and Their Impact on Financial Performance," Marketing Science, INFORMS, vol. 25(6), pages 718-739, 11-12.
    21. Rajeev H. Dehejia & Sadek Wahba, 2002. "Propensity Score-Matching Methods For Nonexperimental Causal Studies," The Review of Economics and Statistics, MIT Press, vol. 84(1), pages 151-161, February.
    22. Nikolay Archak & Anindya Ghose & Panagiotis G. Ipeirotis, 2011. "Deriving the Pricing Power of Product Features by Mining Consumer Reviews," Management Science, INFORMS, vol. 57(8), pages 1485-1509, August.
    23. Yubo Chen & Jinhong Xie, 2008. "Online Consumer Review: Word-of-Mouth as a New Element of Marketing Communication Mix," Management Science, INFORMS, vol. 54(3), pages 477-491, March.
    24. Chris Forman & Anindya Ghose & Batia Wiesenfeld, 2008. "Examining the Relationship Between Reviews and Sales: The Role of Reviewer Identity Disclosure in Electronic Markets," Information Systems Research, INFORMS, vol. 19(3), pages 291-313, September.
    25. Kamalini Ramdas & Jonathan Williams & Marc Lipson, 2013. "Can Financial Markets Inform Operational Improvement Efforts? Evidence from the Airline Industry," Manufacturing & Service Operations Management, INFORMS, vol. 15(3), pages 405-422, July.
    26. Iacus, Stefano M. & King, Gary & Porro, Giuseppe, 2012. "Causal Inference without Balance Checking: Coarsened Exact Matching," Political Analysis, Cambridge University Press, vol. 20(1), pages 1-24, January.
    27. Andreas Soteriou & Stavros A. Zenios, 1999. "Operations, Quality, and Profitability in the Provision of Banking Services," Management Science, INFORMS, vol. 45(9), pages 1221-1238, September.
    28. Kuang Xu & Carri W. Chan, 2016. "Using Future Information to Reduce Waiting Times in the Emergency Department via Diversion," Manufacturing & Service Operations Management, INFORMS, vol. 18(3), pages 314-331, July.
    29. Oualid Jouini & Zeynep Akşin & Yves Dallery, 2011. "Call Centers with Delay Information: Models and Insights," Manufacturing & Service Operations Management, INFORMS, vol. 13(4), pages 534-548, October.
    30. Mor Armony & Constantinos Maglaras, 2004. "Contact Centers with a Call-Back Option and Real-Time Delay Information," Operations Research, INFORMS, vol. 52(4), pages 527-545, August.
    31. Jing Dong & Elad Yom-Tov & Galit B. Yom-Tov, 2019. "The Impact of Delay Announcements on Hospital Network Coordination and Waiting Times," Management Science, INFORMS, vol. 67(5), pages 1969-1994, May.
    32. Decker, Reinhold & Trusov, Michael, 2010. "Estimating aggregate consumer preferences from online product reviews," International Journal of Research in Marketing, Elsevier, vol. 27(4), pages 293-307.
    33. Oualid Jouini & Zeynep Aksin & Yves Dallery, 2011. "Call Centers with Delay Information: Models and Insights," Post-Print hal-00680769, HAL.
    34. Robert J. Batt & Christian Terwiesch, 2015. "Waiting Patiently: An Empirical Study of Queue Abandonment in an Emergency Department," Management Science, INFORMS, vol. 61(1), pages 39-59, January.
    35. Xinxin Li & Lorin M. Hitt, 2008. "Self-Selection and Information Role of Online Product Reviews," Information Systems Research, INFORMS, vol. 19(4), pages 456-474, December.
    36. Michael Luca & Georgios Zervas, 2016. "Fake It Till You Make It: Reputation, Competition, and Yelp Review Fraud," Management Science, INFORMS, vol. 62(12), pages 3412-3427, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dominik Gutt & Jürgen Neumann & Steffen Zimmermann & Dennis Kundisch & Jianqing Chen, 2018. "Design of Review Systems - A Strategic Instrument to shape Online Review Behavior and Economic Outcomes," Working Papers Dissertations 42, Paderborn University, Faculty of Business Administration and Economics.
    2. Kick, Markus, 2015. "Social Media Research: A Narrative Review," EconStor Preprints 182506, ZBW - Leibniz Information Centre for Economics.
    3. Hallie S. Cho & Manuel E. Sosa & Sameer Hasija, 2022. "Reading Between the Stars: Understanding the Effects of Online Customer Reviews on Product Demand," Manufacturing & Service Operations Management, INFORMS, vol. 24(4), pages 1977-1996, July.
    4. Jorge Mejia & Shawn Mankad & Anandasivam Gopal, 2019. "A for Effort? Using the Crowd to Identify Moral Hazard in New York City Restaurant Hygiene Inspections," Information Systems Research, INFORMS, vol. 30(4), pages 1363-1386, December.
    5. Heeseung Andrew Lee & Angela Aerry Choi & Tianshu Sun & Wonseok Oh, 2021. "Reviewing Before Reading? An Empirical Investigation of Book-Consumption Patterns and Their Effects on Reviews and Sales," Information Systems Research, INFORMS, vol. 32(4), pages 1368-1389, December.
    6. Pei-Yu Chen & Yili Hong & Ying Liu, 2018. "The Value of Multidimensional Rating Systems: Evidence from a Natural Experiment and Randomized Experiments," Management Science, INFORMS, vol. 64(10), pages 4629-4647, October.
    7. Dominik Gutt & Philipp Herrmann & Mohammad S. Rahman, 2018. "Crowd-Driven Competitive Intelligence: Understanding the Relationship Between Local Market Competition and Online Rating Distributions," Working Papers Dissertations 41, Paderborn University, Faculty of Business Administration and Economics.
    8. Floyd, Kristopher & Freling, Ryan & Alhoqail, Saad & Cho, Hyun Young & Freling, Traci, 2014. "How Online Product Reviews Affect Retail Sales: A Meta-analysis," Journal of Retailing, Elsevier, vol. 90(2), pages 217-232.
    9. Young Kwark & Gene Moo Lee & Paul A. Pavlou & Liangfei Qiu, 2021. "On the Spillover Effects of Online Product Reviews on Purchases: Evidence from Clickstream Data," Information Systems Research, INFORMS, vol. 32(3), pages 895-913, September.
    10. Christoph Schneider & Markus Weinmann & Peter N.C. Mohr & Jan vom Brocke, 2021. "When the Stars Shine Too Bright: The Influence of Multidimensional Ratings on Online Consumer Ratings," Management Science, INFORMS, vol. 67(6), pages 3871-3898, June.
    11. Dominik Gutt & Philipp Herrmann & Mohammad S. Rahman, 2019. "Crowd-Driven Competitive Intelligence: Understanding the Relationship Between Local Market Competition and Online Rating Distributions," Information Systems Research, INFORMS, vol. 30(3), pages 980-994, September.
    12. Peiyu Chen & Lorin M. Hitt & Yili Hong & Shinyi Wu, 2021. "Measuring Product Type and Purchase Uncertainty with Online Product Ratings: A Theoretical Model and Empirical Application," Information Systems Research, INFORMS, vol. 32(4), pages 1470-1489, December.
    13. Daniel Kaimann & Joe Cox, 2014. "The Interaction of Signals: A Fuzzy set Analysis of the Video Game Industry," Working Papers Dissertations 13, Paderborn University, Faculty of Business Administration and Economics.
    14. Daniel Kaimann & Joe Cox, 2014. "The Interaction of Signals: A Fuzzy set Analysis of the Video Game Industry," Working Papers CIE 84, Paderborn University, CIE Center for International Economics.
    15. Tao Lu & May Yuan & Chong (Alex) Wang & Xiaoquan (Michael) Zhang, 2022. "Histogram Distortion Bias in Consumer Choices," Management Science, INFORMS, vol. 68(12), pages 8963-8978, December.
    16. Bin Gu & Jaehong Park & Prabhudev Konana, 2012. "Research Note ---The Impact of External Word-of-Mouth Sources on Retailer Sales of High-Involvement Products," Information Systems Research, INFORMS, vol. 23(1), pages 182-196, March.
    17. Steffen Zimmermann & Philipp Herrmann & Dennis Kundisch & Barrie R. Nault, 2018. "Decomposing the Variance of Consumer Ratings and the Impact on Price and Demand," Information Systems Research, INFORMS, vol. 29(4), pages 984-1002, December.
    18. Anindya Ghose & Panagiotis G. Ipeirotis & Beibei Li, 2012. "Designing Ranking Systems for Hotels on Travel Search Engines by Mining User-Generated and Crowdsourced Content," Marketing Science, INFORMS, vol. 31(3), pages 493-520, May.
    19. Balázs Kovács, 2024. "The Turing test of online reviews: Can we tell the difference between human-written and GPT-4-written online reviews?," Marketing Letters, Springer, vol. 35(4), pages 651-666, December.
    20. Yabing Jiang & Hong Guo, 2012. "Design of Consumer Review Systems and Product Pricing," Working Papers 12-10, NET Institute.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormsom:v:23:y:2021:i:6:p:1354-1372. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.