IDEAS home Printed from https://ideas.repec.org/a/eee/joinma/v25y2011i2p110-122.html
   My bibliography  Save this article

Decision Quality Measures in Recommendation Agents Research

Author

Listed:
  • Aksoy, Lerzan
  • Cooil, Bruce
  • Lurie, Nicholas H.

Abstract

Electronic recommendation agents provide a way for online marketers to gather information about consumer preferences and assess the quality of consumer decisions. Much of the literature on recommendation agents, however, employs divergent measures to assess consumer decision quality. Moreover, decision quality measures are dictated by the type of agent employed. This article provides a review of the decision quality measures used in the recommendation agent research to date and proposes novel measures. We classify and examine the assumptions of–and relationships among–preference-dependent, preference-independent, and subjective measures of decision quality. The analysis of data from an experiment that simulates a broad spectrum of recommendation agents shows that the relative utility and the sum of attribute values of the chosen alternative capture the majority of variance in objective decision quality. Although subjective decision quality measures turn out to be poor proxies for objective measures, they provide important incremental information. Managerial implications for deploying electronic recommendation agents to gather information and measure consumer decision quality under different conditions are discussed.

Suggested Citation

  • Aksoy, Lerzan & Cooil, Bruce & Lurie, Nicholas H., 2011. "Decision Quality Measures in Recommendation Agents Research," Journal of Interactive Marketing, Elsevier, vol. 25(2), pages 110-122.
    • Handle: RePEc:eee:joinma:v:25:y:2011:i:2:p:110-122
    DOI: 10.1016/j.intmar.2011.01.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1094996811000028
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.intmar.2011.01.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Shiv, Baba & Huber, Joel, 2000. "The Impact of Anticipating Satisfaction on Consumer Choice," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 27(2), pages 202-216, September.
    2. Panagiotis Mantalos & Ghazi Shukur, 2007. "The Robustness of the RESET Test to Non-Normal Error Terms," Computational Economics, Springer;Society for Computational Economics, vol. 30(4), pages 393-408, November.
    3. Gary L. Lilien & Arvind Rangaswamy & Gerrit H. Van Bruggen & Katrin Starke, 2004. "DSS Effectiveness in Marketing Resource Allocation Decisions: Reality vs. Perception," Information Systems Research, INFORMS, vol. 15(3), pages 216-235, September.
    4. Keller, Kevin Lane & Staelin, Richard, 1987. "Effects of Quality and Quantity of Information on Decision Effectiveness," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 14(2), pages 200-213, September.
    5. Hamparsum Bozdogan, 1987. "Model selection and Akaike's Information Criterion (AIC): The general theory and its analytical extensions," Psychometrika, Springer;The Psychometric Society, vol. 52(3), pages 345-370, September.
    6. Bearden, William O & Hardesty, David M & Rose, Randall L, 2001. "Consumer Self-Confidence: Refinements in Conceptualization and Measurement," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 28(1), pages 121-134, June.
    7. Arnaud De Bruyn & John C. Liechty & Eelko K. R. E. Huizingh & Gary L. Lilien, 2008. "Offering Online Recommendations with Minimum Customer Input Through Conjoint-Based Decision Aids," Marketing Science, INFORMS, vol. 27(3), pages 443-460, 05-06.
    8. Lurie, Nicholas H, 2004. "Decision Making in Information-Rich Environments: The Role of Information Structure," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 30(4), pages 473-486, March.
    9. F. Hutton Barron & Bruce E. Barrett, 1996. "Decision Quality Using Ranked Attribute Weights," Management Science, INFORMS, vol. 42(11), pages 1515-1523, November.
    10. Unknown, 2005. "Forward," 2005 Conference: Slovenia in the EU - Challenges for Agriculture, Food Science and Rural Affairs, November 10-11, 2005, Moravske Toplice, Slovenia 183804, Slovenian Association of Agricultural Economists (DAES).
    11. Daniel McFadden, 1986. "The Choice Theory Approach to Market Research," Marketing Science, INFORMS, vol. 5(4), pages 275-297.
    12. Ariely, Dan, 2000. "Controlling the Information Flow: Effects on Consumers' Decision Making and Preferences," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 27(2), pages 233-248, September.
    13. Diehl, Kristin & Kornish, Laura J & Lynch, John G, Jr, 2003. "Smart Agents: When Lower Search Costs for Quality Information Increase Price Sensitivity," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 30(1), pages 56-71, June.
    14. Flynn, Leisa Reinecke & Goldsmith, Ronald E., 1999. "A Short, Reliable Measure of Subjective Knowledge," Journal of Business Research, Elsevier, vol. 46(1), pages 57-66, September.
    15. Gerald Häubl & Valerie Trifts, 2000. "Consumer Decision Making in Online Shopping Environments: The Effects of Interactive Decision Aids," Marketing Science, INFORMS, vol. 19(1), pages 4-21, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jella Pfeiffer & Michael Scholz, 2013. "A Low-Effort Recommendation System with High Accuracy," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 5(6), pages 397-408, December.
    2. Kim, Jungkeun & Kim, Jeong Hyun & Kim, Changju & Park, Jooyoung, 2023. "Decisions with ChatGPT: Reexamining choice overload in ChatGPT recommendations," Journal of Retailing and Consumer Services, Elsevier, vol. 75(C).
    3. Ben Mimoun, Mohamed Slim & Lancelot Miltgen, Caroline & Slama, Boulbeba, 2022. "Is the shopper always the king/queen? Study of omnichannel retail technology use and shopping orientations," Journal of Retailing and Consumer Services, Elsevier, vol. 65(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lurie, Nicholas H. & Wen, Na, 2014. "Simple Decision Aids and Consumer Decision Making," Journal of Retailing, Elsevier, vol. 90(4), pages 511-523.
    2. Koehler, C.F. & Breugelmans, E. & Dellaert, B.G.C., 2010. "Consumer Acceptance of Recommendations by Interactive Decision Aids: The Joint Role of Temporal Distance and Concrete vs. Abstract Communications," ERIM Report Series Research in Management ERS-2010-041-MKT, Erasmus Research Institute of Management (ERIM), ERIM is the joint research institute of the Rotterdam School of Management, Erasmus University and the Erasmus School of Economics (ESE) at Erasmus University Rotterdam.
    3. Peter Gordon Roetzel, 2019. "Information overload in the information age: a review of the literature from business administration, business psychology, and related disciplines with a bibliometric approach and framework developmen," Business Research, Springer;German Academic Association for Business Research, vol. 12(2), pages 479-522, December.
    4. Murray, Kyle B. & Häubl, Gerald, 2009. "Personalization without Interrogation: Towards more Effective Interactions between Consumers and Feature-Based Recommendation Agents," Journal of Interactive Marketing, Elsevier, vol. 23(2), pages 138-146.
    5. Bonsall, Peter & Shires, Jeremy & Maule, John & Matthews, Bryan & Beale, Jo, 2007. "Responses to complex pricing signals: Theory, evidence and implications for road pricing," Transportation Research Part A: Policy and Practice, Elsevier, vol. 41(7), pages 672-683, August.
    6. Chuan-Hoo Tan & Hock-Hai Teo & Izak Benbasat, 2010. "Assessing Screening and Evaluation Decision Support Systems: A Resource-Matching Approach," Information Systems Research, INFORMS, vol. 21(2), pages 305-326, June.
    7. Suri, Rajneesh & Cai, Jane Zhen & Monroe, Kent B. & Thakor, Mrugank V., 2012. "Retailers’ Merchandise Organization and Price Perceptions," Journal of Retailing, Elsevier, vol. 88(1), pages 168-179.
    8. Choudhary, Vidyanand & Currim, Imran & Dewan, Sanjeev & Jeliazkov, Ivan & Mintz, Ofer & Turner, John, 2017. "Evaluation Set Size and Purchase: Evidence from a Product Search Engine," Journal of Interactive Marketing, Elsevier, vol. 37(C), pages 16-31.
    9. Punj, Girish & Moore, Robert, 2009. "Information search and consideration set formation in a web-based store environment," Journal of Business Research, Elsevier, vol. 62(6), pages 644-650, June.
    10. Shang, Wenjing & Hooker, Neal H., 2006. "Scales or Stars? Consumer Preferences for Food Quality Signals," 2006 Annual meeting, July 23-26, Long Beach, CA 21237, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    11. Anish Nagpal & Adwait Khare & Tilottama Chowdhury & Lauren Labrecque & Ameet Pandit, 2011. "The impact of the amount of available information on decision delay: The role of common features," Marketing Letters, Springer, vol. 22(4), pages 405-421, November.
    12. Gavan J. Fitzsimons & Donald R. Lehmann, 2004. "Reactance to Recommendations: When Unsolicited Advice Yields Contrary Responses," Marketing Science, INFORMS, vol. 23(1), pages 82-94, September.
    13. Johannes D. Hattula & Walter Herzog & Ravi Dhar, 2023. "The impact of touchscreen devices on consumers’ choice confidence and purchase likelihood," Marketing Letters, Springer, vol. 34(1), pages 35-53, March.
    14. Tuck Siong Chung & Roland T. Rust & Michel Wedel, 2009. "My Mobile Music: An Adaptive Personalization System for Digital Audio Players," Marketing Science, INFORMS, vol. 28(1), pages 52-68, 01-02.
    15. Stefan Hoffmann & Tom Joerß & Robert Mai & Payam Akbar, 2022. "Augmented reality-delivered product information at the point of sale: when information controllability backfires," Journal of the Academy of Marketing Science, Springer, vol. 50(4), pages 743-776, July.
    16. Ana Alina Tudoran, 2022. "A machine learning approach to identifying decision-making styles for managing customer relationships," Electronic Markets, Springer;IIM University of St. Gallen, vol. 32(1), pages 351-374, March.
    17. Benedict G. C. Dellaert & Suzanne B. Shu & Theo A. Arentze & Tom Baker & Kristin Diehl & Bas Donkers & Nathanael J. Fast & Gerald Häubl & Heidi Johnson & Uma R. Karmarkar & Harmen Oppewal & Bernd H. S, 2020. "Consumer decisions with artificially intelligent voice assistants," Marketing Letters, Springer, vol. 31(4), pages 335-347, December.
    18. J. Miguel Villas-Boas, 2009. "Product Variety and Endogenous Pricing with Evaluation Costs," Management Science, INFORMS, vol. 55(8), pages 1338-1346, August.
    19. Brühl, Johanna & Smith, Grant & Visser, Martine, 2019. "Simple is good: Redesigning utility bills to reduce complexity and increase understanding," Utilities Policy, Elsevier, vol. 60(C), pages 1-1.
    20. Eric Johnson & Suzanne Shu & Benedict Dellaert & Craig Fox & Daniel Goldstein & Gerald Häubl & Richard Larrick & John Payne & Ellen Peters & David Schkade & Brian Wansink & Elke Weber, 2012. "Beyond nudges: Tools of a choice architecture," Marketing Letters, Springer, vol. 23(2), pages 487-504, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:joinma:v:25:y:2011:i:2:p:110-122. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/journal-of-interactive-marketing/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.