IDEAS home Printed from https://ideas.repec.org/a/inm/ormksc/v31y2012i3p493-520.html
   My bibliography  Save this article

Designing Ranking Systems for Hotels on Travel Search Engines by Mining User-Generated and Crowdsourced Content

Author

Listed:
  • Anindya Ghose

    () (Stern School of Business, New York University, New York, New York 10012)

  • Panagiotis G. Ipeirotis

    () (Stern School of Business, New York University, New York, New York 10012)

  • Beibei Li

    () (Stern School of Business, New York University, New York, New York 10012)

Abstract

User-generated content on social media platforms and product search engines is changing the way consumers shop for goods online. However, current product search engines fail to effectively leverage information created across diverse social media platforms. Moreover, current ranking algorithms in these product search engines tend to induce consumers to focus on one single product characteristic dimension (e.g., price, star rating). This approach largely ignores consumers' multidimensional preferences for products. In this paper, we propose to generate a ranking system that recommends products that provide, on average, the best value for the consumer's money. The key idea is that products that provide a higher surplus should be ranked higher on the screen in response to consumer queries. We use a unique data set of U.S. hotel reservations made over a three-month period through Travelocity, which we supplement with data from various social media sources using techniques from text mining, image classification, social geotagging, human annotations, and geomapping. We propose a random coefficient hybrid structural model, taking into consideration the two sources of consumer heterogeneity the different travel occasions and different hotel characteristics introduce. Based on the estimates from the model, we infer the economic impact of various location and service characteristics of hotels. We then propose a new hotel ranking system based on the average utility gain a consumer receives from staying in a particular hotel. By doing so, we can provide customers with the "best-value" hotels early on. Our user studies, using ranking comparisons from several thousand users, validate the superiority of our ranking system relative to existing systems on several travel search engines. On a broader note, this paper illustrates how social media can be mined and incorporated into a demand estimation model in order to generate a new ranking system in product search engines. We thus highlight the tight linkages between user behavior on social media and search engines. Our interdisciplinary approach provides several insights for using machine learning techniques in economics and marketing research.

Suggested Citation

  • Anindya Ghose & Panagiotis G. Ipeirotis & Beibei Li, 2012. "Designing Ranking Systems for Hotels on Travel Search Engines by Mining User-Generated and Crowdsourced Content," Marketing Science, INFORMS, vol. 31(3), pages 493-520, May.
  • Handle: RePEc:inm:ormksc:v:31:y:2012:i:3:p:493-520
    DOI: 10.1287/mksc.1110.0700
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mksc.1110.0700
    Download Restriction: no

    References listed on IDEAS

    as
    1. Dhar, Vasant & Chang, Elaine A., 2009. "Does Chatter Matter? The Impact of User-Generated Content on Music Sales," Journal of Interactive Marketing, Elsevier, vol. 23(4), pages 300-307.
    2. Sanjiv R. Das & Mike Y. Chen, 2007. "Yahoo! for Amazon: Sentiment Extraction from Small Talk on the Web," Management Science, INFORMS, vol. 53(9), pages 1375-1388, September.
    3. Steve Berry & Oliver B. Linton & Ariel Pakes, 2004. "Limit Theorems for Estimating the Parameters of Differentiated Product Demand Systems," Review of Economic Studies, Oxford University Press, vol. 71(3), pages 613-654.
    4. Michael Luca, 2011. "Reviews, Reputation, and Revenue: The Case of Yelp.com," Harvard Business School Working Papers 12-016, Harvard Business School, revised Mar 2016.
    5. Tuck Siong Chung & Roland T. Rust & Michel Wedel, 2009. "My Mobile Music: An Adaptive Personalization System for Digital Audio Players," Marketing Science, INFORMS, vol. 28(1), pages 52-68, 01-02.
    6. Hernán A. Bruno & Naufel J. Vilcassim, 2008. "—Structural Demand Estimation with Varying Product Availability," Marketing Science, INFORMS, vol. 27(6), pages 1126-1131, 11-12.
    7. Nevo, Aviv, 2001. "Measuring Market Power in the Ready-to-Eat Cereal Industry," Econometrica, Econometric Society, vol. 69(2), pages 307-342, March.
    8. Nikolay Archak & Anindya Ghose & Panagiotis G. Ipeirotis, 2007. "Deriving the Pricing Power of Product Features by Mining Consumer Reviews," Working Papers 07-36, NET Institute.
    9. Harikesh Nair & Jean-Pierre Dubé & Pradeep Chintagunta, 2005. "Accounting for Primary and Secondary Demand Effects with Aggregate Data," Marketing Science, INFORMS, vol. 24(3), pages 444-460, November.
    10. Nikolay Archak & Anindya Ghose & Panagiotis G. Ipeirotis, 2011. "Deriving the Pricing Power of Product Features by Mining Consumer Reviews," Management Science, INFORMS, vol. 57(8), pages 1485-1509, August.
    11. Jehoshua Eliashberg & Sam K. Hui & Z. John Zhang, 2007. "From Story Line to Box Office: A New Approach for Green-Lighting Movie Scripts," Management Science, INFORMS, vol. 53(6), pages 881-893, June.
    12. Decker, Reinhold & Trusov, Michael, 2010. "Estimating aggregate consumer preferences from online product reviews," International Journal of Research in Marketing, Elsevier, vol. 27(4), pages 293-307.
    13. Joel H. Steckel & Wilfried R. Vanhonacker, 1993. "Cross-Validating Regression Models in Marketing Research," Marketing Science, INFORMS, vol. 12(4), pages 415-427.
    14. McCrary, Justin, 2008. "Manipulation of the running variable in the regression discontinuity design: A density test," Journal of Econometrics, Elsevier, vol. 142(2), pages 698-714, February.
    15. Oded Netzer & Ronen Feldman & Jacob Goldenberg & Moshe Fresko, 2012. "Mine Your Own Business: Market-Structure Surveillance Through Text Mining," Marketing Science, INFORMS, vol. 31(3), pages 521-543, May.
    16. Wesley Hartmann & Harikesh S. Nair & Sridhar Narayanan, 2011. "Identifying Causal Marketing Mix Effects Using a Regression Discontinuity Design," Marketing Science, INFORMS, vol. 30(6), pages 1079-1097, November.
    17. Roland T. Rust & Tuck Siong Chung, 2006. "Marketing Models of Service and Relationships," Marketing Science, INFORMS, vol. 25(6), pages 560-580, 11-12.
    18. David Godes & Dina Mayzlin, 2004. "Using Online Conversations to Study Word-of-Mouth Communication," Marketing Science, INFORMS, vol. 23(4), pages 545-560, June.
    19. Berry, Steven & Levinsohn, James & Pakes, Ariel, 1995. "Automobile Prices in Market Equilibrium," Econometrica, Econometric Society, vol. 63(4), pages 841-890, July.
    20. Susan Athey & Guido W. Imbens, 2007. "Discrete Choice Models With Multiple Unobserved Choice Characteristics," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 48(4), pages 1159-1192, November.
    21. Steven Berry & Ariel Pakes, 2007. "The Pure Characteristics Demand Model," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 48(4), pages 1193-1225, November.
    22. Pradeep Chintagunta & Jean-Pierre Dubé & Khim Yong Goh, 2005. "Beyond the Endogeneity Bias: The Effect of Unmeasured Brand Characteristics on Household-Level Brand Choice Models," Management Science, INFORMS, vol. 51(5), pages 832-849, May.
    23. J. Miguel Villas-Boas & Russell S. Winer, 1999. "Endogeneity in Brand Choice Models," Management Science, INFORMS, vol. 45(10), pages 1324-1338, October.
    Full references (including those not matched with items on IDEAS)

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormksc:v:31:y:2012:i:3:p:493-520. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Matthew Walls). General contact details of provider: http://edirc.repec.org/data/inforea.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.