IDEAS home Printed from https://ideas.repec.org/a/inm/ormksc/v31y2012i3p493-520.html
   My bibliography  Save this article

Designing Ranking Systems for Hotels on Travel Search Engines by Mining User-Generated and Crowdsourced Content

Author

Listed:
  • Anindya Ghose

    (Stern School of Business, New York University, New York, New York 10012)

  • Panagiotis G. Ipeirotis

    (Stern School of Business, New York University, New York, New York 10012)

  • Beibei Li

    (Stern School of Business, New York University, New York, New York 10012)

Abstract

User-generated content on social media platforms and product search engines is changing the way consumers shop for goods online. However, current product search engines fail to effectively leverage information created across diverse social media platforms. Moreover, current ranking algorithms in these product search engines tend to induce consumers to focus on one single product characteristic dimension (e.g., price, star rating). This approach largely ignores consumers' multidimensional preferences for products. In this paper, we propose to generate a ranking system that recommends products that provide, on average, the best value for the consumer's money. The key idea is that products that provide a higher surplus should be ranked higher on the screen in response to consumer queries. We use a unique data set of U.S. hotel reservations made over a three-month period through Travelocity, which we supplement with data from various social media sources using techniques from text mining, image classification, social geotagging, human annotations, and geomapping. We propose a random coefficient hybrid structural model, taking into consideration the two sources of consumer heterogeneity the different travel occasions and different hotel characteristics introduce. Based on the estimates from the model, we infer the economic impact of various location and service characteristics of hotels. We then propose a new hotel ranking system based on the average utility gain a consumer receives from staying in a particular hotel. By doing so, we can provide customers with the "best-value" hotels early on. Our user studies, using ranking comparisons from several thousand users, validate the superiority of our ranking system relative to existing systems on several travel search engines. On a broader note, this paper illustrates how social media can be mined and incorporated into a demand estimation model in order to generate a new ranking system in product search engines. We thus highlight the tight linkages between user behavior on social media and search engines. Our interdisciplinary approach provides several insights for using machine learning techniques in economics and marketing research.

Suggested Citation

  • Anindya Ghose & Panagiotis G. Ipeirotis & Beibei Li, 2012. "Designing Ranking Systems for Hotels on Travel Search Engines by Mining User-Generated and Crowdsourced Content," Marketing Science, INFORMS, vol. 31(3), pages 493-520, May.
  • Handle: RePEc:inm:ormksc:v:31:y:2012:i:3:p:493-520
    DOI: 10.1287/mksc.1110.0700
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mksc.1110.0700
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mksc.1110.0700?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Dhar, Vasant & Chang, Elaine A., 2009. "Does Chatter Matter? The Impact of User-Generated Content on Music Sales," Journal of Interactive Marketing, Elsevier, vol. 23(4), pages 300-307.
    2. Sanjiv R. Das & Mike Y. Chen, 2007. "Yahoo! for Amazon: Sentiment Extraction from Small Talk on the Web," Management Science, INFORMS, vol. 53(9), pages 1375-1388, September.
    3. Steve Berry & Oliver B. Linton & Ariel Pakes, 2004. "Limit Theorems for Estimating the Parameters of Differentiated Product Demand Systems," Review of Economic Studies, Oxford University Press, vol. 71(3), pages 613-654.
    4. Michael Luca, 2011. "Reviews, Reputation, and Revenue: The Case of Yelp.com," Harvard Business School Working Papers 12-016, Harvard Business School, revised Mar 2016.
    5. Susan Athey & Guido W. Imbens, 2007. "Discrete Choice Models With Multiple Unobserved Choice Characteristics," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 48(4), pages 1159-1192, November.
    6. Tuck Siong Chung & Roland T. Rust & Michel Wedel, 2009. "My Mobile Music: An Adaptive Personalization System for Digital Audio Players," Marketing Science, INFORMS, vol. 28(1), pages 52-68, 01-02.
    7. Hernán A. Bruno & Naufel J. Vilcassim, 2008. "—Structural Demand Estimation with Varying Product Availability," Marketing Science, INFORMS, vol. 27(6), pages 1126-1131, 11-12.
    8. Nevo, Aviv, 2001. "Measuring Market Power in the Ready-to-Eat Cereal Industry," Econometrica, Econometric Society, vol. 69(2), pages 307-342, March.
    9. Jerry A. Hausman, 1996. "Valuation of New Goods under Perfect and Imperfect Competition," NBER Chapters, in: The Economics of New Goods, pages 207-248, National Bureau of Economic Research, Inc.
    10. Nikolay Archak & Anindya Ghose & Panagiotis G. Ipeirotis, 2007. "Deriving the Pricing Power of Product Features by Mining Consumer Reviews," Working Papers 07-36, NET Institute.
    11. Harikesh Nair & Jean-Pierre Dubé & Pradeep Chintagunta, 2005. "Accounting for Primary and Secondary Demand Effects with Aggregate Data," Marketing Science, INFORMS, vol. 24(3), pages 444-460, November.
    12. Timothy F. Bresnahan & Robert J. Gordon, 1996. "The Economics of New Goods," NBER Books, National Bureau of Economic Research, Inc, number bres96-1, January.
    13. Nikolay Archak & Anindya Ghose & Panagiotis G. Ipeirotis, 2011. "Deriving the Pricing Power of Product Features by Mining Consumer Reviews," Management Science, INFORMS, vol. 57(8), pages 1485-1509, August.
    14. Jehoshua Eliashberg & Sam K. Hui & Z. John Zhang, 2007. "From Story Line to Box Office: A New Approach for Green-Lighting Movie Scripts," Management Science, INFORMS, vol. 53(6), pages 881-893, June.
    15. Chris Forman & Anindya Ghose & Batia Wiesenfeld, 2008. "Examining the Relationship Between Reviews and Sales: The Role of Reviewer Identity Disclosure in Electronic Markets," Information Systems Research, INFORMS, vol. 19(3), pages 291-313, September.
    16. Decker, Reinhold & Trusov, Michael, 2010. "Estimating aggregate consumer preferences from online product reviews," International Journal of Research in Marketing, Elsevier, vol. 27(4), pages 293-307.
    17. Xinxin Li & Lorin M. Hitt, 2008. "Self-Selection and Information Role of Online Product Reviews," Information Systems Research, INFORMS, vol. 19(4), pages 456-474, December.
    18. Joel H. Steckel & Wilfried R. Vanhonacker, 1993. "Cross-Validating Regression Models in Marketing Research," Marketing Science, INFORMS, vol. 12(4), pages 415-427.
    19. McCrary, Justin, 2008. "Manipulation of the running variable in the regression discontinuity design: A density test," Journal of Econometrics, Elsevier, vol. 142(2), pages 698-714, February.
    20. Oded Netzer & Ronen Feldman & Jacob Goldenberg & Moshe Fresko, 2012. "Mine Your Own Business: Market-Structure Surveillance Through Text Mining," Marketing Science, INFORMS, vol. 31(3), pages 521-543, May.
    21. Berry, Steven & Levinsohn, James & Pakes, Ariel, 1995. "Automobile Prices in Market Equilibrium," Econometrica, Econometric Society, vol. 63(4), pages 841-890, July.
    22. Wesley Hartmann & Harikesh S. Nair & Sridhar Narayanan, 2011. "Identifying Causal Marketing Mix Effects Using a Regression Discontinuity Design," Marketing Science, INFORMS, vol. 30(6), pages 1079-1097, November.
    23. Roland T. Rust & Tuck Siong Chung, 2006. "Marketing Models of Service and Relationships," Marketing Science, INFORMS, vol. 25(6), pages 560-580, 11-12.
    24. David Godes & Dina Mayzlin, 2004. "Using Online Conversations to Study Word-of-Mouth Communication," Marketing Science, INFORMS, vol. 23(4), pages 545-560, June.
    25. Steven Berry & Ariel Pakes, 2007. "The Pure Characteristics Demand Model," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 48(4), pages 1193-1225, November.
    26. Pradeep Chintagunta & Jean-Pierre Dubé & Khim Yong Goh, 2005. "Beyond the Endogeneity Bias: The Effect of Unmeasured Brand Characteristics on Household-Level Brand Choice Models," Management Science, INFORMS, vol. 51(5), pages 832-849, May.
    27. Minjae Song, 2008. "A Hybrid Discrete Choice Model of Differentiated Product Demand with an Application to Personal Computers," 2008 Meeting Papers 905, Society for Economic Dynamics.
    28. J. Miguel Villas-Boas & Russell S. Winer, 1999. "Endogeneity in Brand Choice Models," Management Science, INFORMS, vol. 45(10), pages 1324-1338, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nikolay Archak & Anindya Ghose & Panagiotis G. Ipeirotis, 2011. "Deriving the Pricing Power of Product Features by Mining Consumer Reviews," Management Science, INFORMS, vol. 57(8), pages 1485-1509, August.
    2. Xiao Liu & Param Vir Singh & Kannan Srinivasan, 2016. "A Structured Analysis of Unstructured Big Data by Leveraging Cloud Computing," Marketing Science, INFORMS, vol. 35(3), pages 363-388, May.
    3. Yuqian Xu & Mor Armony & Anindya Ghose, 2021. "The Interplay Between Online Reviews and Physician Demand: An Empirical Investigation," Management Science, INFORMS, vol. 67(12), pages 7344-7361, December.
    4. Steven T. Berry & Philip A. Haile, 2009. "Nonparametric Identification of Multinomial Choice Demand Models with Heterogeneous Consumers," NBER Working Papers 15276, National Bureau of Economic Research, Inc.
    5. Ishita Chakraborty & Minkyung Kim & K. Sudhir, 2019. "Attribute Sentiment Scoring With Online Text Reviews : Accounting for Language Structure and Attribute Self-Selection," Cowles Foundation Discussion Papers 2176R, Cowles Foundation for Research in Economics, Yale University, revised Sep 2020.
    6. Oded Netzer & Ronen Feldman & Jacob Goldenberg & Moshe Fresko, 2012. "Mine Your Own Business: Market-Structure Surveillance Through Text Mining," Marketing Science, INFORMS, vol. 31(3), pages 521-543, May.
    7. Akshay Kangale & S. Krishna Kumar & Mohd Arshad Naeem & Mark Williams & M. K. Tiwari, 2016. "Mining consumer reviews to generate ratings of different product attributes while producing feature-based review-summary," International Journal of Systems Science, Taylor & Francis Journals, vol. 47(13), pages 3272-3286, October.
    8. Genakos, Christos D., 2004. "Differential merger effects: the case of the personal computer industry," LSE Research Online Documents on Economics 6726, London School of Economics and Political Science, LSE Library.
    9. Yang Li & Asim Ansari, 2014. "A Bayesian Semiparametric Approach for Endogeneity and Heterogeneity in Choice Models," Management Science, INFORMS, vol. 60(5), pages 1161-1179, May.
    10. Kick, Markus, 2015. "Social Media Research: A Narrative Review," EconStor Preprints 182506, ZBW - Leibniz Information Centre for Economics.
    11. Ishita Chakraborty & Minkyung Kim & K. Sudhir, 2019. "Attribute Sentiment Scoring With Online Text Reviews : Accounting for Language Structure and Attribute Self-Selection," Cowles Foundation Discussion Papers 2176R2, Cowles Foundation for Research in Economics, Yale University, revised Jun 2021.
    12. Pei-Yu Chen & Yili Hong & Ying Liu, 2018. "The Value of Multidimensional Rating Systems: Evidence from a Natural Experiment and Randomized Experiments," Management Science, INFORMS, vol. 64(10), pages 4629-4647, October.
    13. Dominik Gutt & Jürgen Neumann & Steffen Zimmermann & Dennis Kundisch & Jianqing Chen, 2018. "Design of Review Systems - A Strategic Instrument to shape Online Review Behavior and Economic Outcomes," Working Papers Dissertations 42, Paderborn University, Faculty of Business Administration and Economics.
    14. Thomas E. Guerrero & C. Angelo Guevara & Elisabetta Cherchi & Juan de Dios Ortúzar, 2021. "Addressing endogeneity in strategic urban mode choice models," Transportation, Springer, vol. 48(4), pages 2081-2102, August.
    15. Hyunwoo Hwangbo & Jonghyuk Kim, 2019. "A Text Mining Approach for Sustainable Performance in the Film Industry," Sustainability, MDPI, vol. 11(11), pages 1-16, June.
    16. Christos Genakos & Kai‐Uwe Kühn & John Van Reenen, 2018. "Leveraging Monopoly Power by Degrading Interoperability: Theory and Evidence from Computer Markets," Economica, London School of Economics and Political Science, vol. 85(340), pages 873-902, October.
    17. Marchand, André & Hennig-Thurau, Thorsten & Wiertz, Caroline, 2017. "Not all digital word of mouth is created equal: Understanding the respective impact of consumer reviews and microblogs on new product success," International Journal of Research in Marketing, Elsevier, vol. 34(2), pages 336-354.
    18. Joao Macieira & Pedro Pereira & Joao Vareda, 2013. "Bundling Incentives in Markets with Product Complementarities: The Case of Triple-Play," Working Papers 13-15, NET Institute.
    19. Steven T. Berry & Philip A. Haile, 2014. "Identification in Differentiated Products Markets Using Market Level Data," Econometrica, Econometric Society, vol. 82, pages 1749-1797, September.
    20. Supriyo Mandal & Abyayananda Maiti, 2022. "Network promoter score (NePS): An indicator of product sales in E-commerce retailing sector," Electronic Markets, Springer;IIM University of St. Gallen, vol. 32(3), pages 1327-1349, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormksc:v:31:y:2012:i:3:p:493-520. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.