IDEAS home Printed from https://ideas.repec.org/a/eee/jbrese/v114y2020icp93-101.html

The (im)precision of scholarly consumer behavior research

Author

Listed:
  • Trafimow, David
  • Hyman, Michael R.
  • Kostyk, Alena

Abstract

Knowing related empirical facts as precisely as possible is crucial to knowledge development. Does the sampling precision of published consumer research ensure it contributes meaningfully to marketing science? To answer this question, the sampling precision of four consumer-centric journals selected for their relative impact factors—Journal of Consumer Research (JCR), Journal of Consumer Psychology (JCP), Journal of Consumer Marketing (JCM), and International Journal of Consumer Studies (IJCS)—is compared. Based on a recently developed a priori procedure, analyses of articles published between 2000 and 2016 determined the precision of the reported sample means that estimate corresponding population means. Results show studies in all journals lack sufficient precision, with JCR and JCP studies half as precise as JCM and IJCS studies. Sampling precision’s value to scientific advancement partly reflects its connection to replication probabilities. Given low replication rates, the most cited consumer-related studies, which strongly influence subsequent research, may be the most misdirecting.

Suggested Citation

  • Trafimow, David & Hyman, Michael R. & Kostyk, Alena, 2020. "The (im)precision of scholarly consumer behavior research," Journal of Business Research, Elsevier, vol. 114(C), pages 93-101.
    • Handle: RePEc:eee:jbrese:v:114:y:2020:i:c:p:93-101
    DOI: 10.1016/j.jbusres.2020.04.008
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0148296320302186
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jbusres.2020.04.008?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. David Trafimow, 2019. "Five Nonobvious Changes in Editorial Practice for Editors and Reviewers to Consider When Evaluating Submissions in a Post p," The American Statistician, Taylor & Francis Journals, vol. 73(S1), pages 340-345, March.
    2. Lynch, John G, Jr, 1982. "On the External Validity of Experiments in Consumer Research," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 9(3), pages 225-239, December.
    3. David Trafimow, 2019. "A Frequentist Alternative to Significance Testing, p -Values, and Confidence Intervals," Econometrics, MDPI, vol. 7(2), pages 1-14, June.
    4. McQuitty, Shaun, 2004. "Statistical power and structural equation models in business research," Journal of Business Research, Elsevier, vol. 57(2), pages 175-183, February.
    5. Lynch, John G, Jr, 1983. "The Role of External Validity in Theoretical Research," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 10(1), pages 109-111, June.
    6. Rohail Ashraf & Dwight Merunka, 2017. "The use and misuse of student samples: An empirical investigation of European marketing research," Post-Print hal-01794416, HAL.
    7. Rohail Ashraf & Dwight Merunka, 2017. "The use and misuse of student samples: An empirical investigation of European marketing research," Post-Print hal-01822501, HAL.
    8. Calder, Bobby J & Phillips, Lynn W & Tybout, Alice M, 1981. "Designing Research for Application," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 8(2), pages 197-207, September.
    9. Hyman, Michael R., 2004. "Revising the structural framework for marketing management," Journal of Business Research, Elsevier, vol. 57(9), pages 923-932, September.
    10. Evanschitzky, Heiner & Baumgarth, Carsten & Hubbard, Raymond & Armstrong, J. Scott, 2007. "Replication research's disturbing trend," Journal of Business Research, Elsevier, vol. 60(4), pages 411-415, April.
    11. Espinosa, Jennifer A. & Ortinau, David J., 2016. "Debunking legendary beliefs about student samples in marketing research," Journal of Business Research, Elsevier, vol. 69(8), pages 3149-3158.
    12. Easley, Richard W. & Madden, Charles S. & Dunn, Mark G., 2000. "Conducting Marketing Science: The Role of Replication in the Research Process," Journal of Business Research, Elsevier, vol. 48(1), pages 83-92, April.
    13. Peterson, Robert A, 2001. "On the Use of College Students in Social Science Research: Insights from a Second-Order Meta-analysis," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 28(3), pages 450-461, December.
    14. Evanschitzky, Heiner & Armstrong, J. Scott, 2013. "Research with In-built replications: Comment and further suggestions for replication research," Journal of Business Research, Elsevier, vol. 66(9), pages 1406-1408.
    15. Shimp, Terence A & Bearden, William O, 1982. "Warranty and Other Extrinsic Cue Effects on Consumers' Risk Perceptions," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 9(1), pages 38-46, June.
    16. Hunter, John E, 2001. "The Desperate Need for Replications," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 28(1), pages 149-158, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Balafoutas, Loukas & Celse, Jeremy & Karakostas, Alexandros & Umashev, Nicholas, 2025. "Incentives and the replication crisis in social sciences: A critical review of open science practices," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 114(C).
    2. Riccardo Vecchio, 2022. "Fostering the debate among scholars to support the advancement of knowledge in the food-related consumer research: A commentary," Economia agro-alimentare, FrancoAngeli Editore, vol. 24(2), pages 1-15.
    3. Nathalie Peña-García & Mauricio Losada-Otálora & Jorge Juliao-Rossi & Augusto Rodríguez-Orejuela, 2021. "Co-Creation of Value and Customer Experience: An Application in Online Banking," Sustainability, MDPI, vol. 13(18), pages 1-14, September.
    4. Lee, Michael T. & Kachen, Sheen & Krishen, Anjala S. & Raschke, Robyn L., 2025. "Creativity ambidexterity and sustainable business: Taking advantage of creative thinking techniques," Technological Forecasting and Social Change, Elsevier, vol. 213(C).
    5. Vecchio, Riccardo, . "Fostering the debate among scholars to support the advancement of knowledge in the food-related consumer research: A commentary," Economia agro-alimentare / Food Economy, Italian Society of Agri-food Economics/Società Italiana di Economia Agro-Alimentare (SIEA), vol. 24(2).
    6. David Trafimow & Tonghui Wang & Cong Wang, 2021. "A Viable Approach to Mitigating Irreproducibility," Stats, MDPI, vol. 4(1), pages 1-11, March.
    7. Trafimow, David & Hyman, Michael R. & Kostyk, Alena & Wang, Cong & Wang, Tonghui, 2021. "The harmful effect of null hypothesis significance testing on marketing research: An example," Journal of Business Research, Elsevier, vol. 125(C), pages 39-44.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Peterson, Robert A. & Merunka, Dwight R., 2014. "Convenience samples of college students and research reproducibility," Journal of Business Research, Elsevier, vol. 67(5), pages 1035-1041.
    2. Lorenz Graf-Vlachy, 2019. "Like student like manager? Using student subjects in managerial debiasing research," Review of Managerial Science, Springer, vol. 13(2), pages 347-376, April.
    3. Brian ‘t Hart & Ian Phau, 2022. "Conceptualising attitudes towards brand genuinuity: scale development and validation," Journal of Brand Management, Palgrave Macmillan, vol. 29(4), pages 327-340, July.
    4. Marcel Lichters & Marko Sarstedt & Bodo Vogt, 2015. "On the practical relevance of the attraction effect: A cautionary note and guidelines for context effect experiments," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 5(1), pages 1-19, June.
    5. Sebastian Lehmann, 2014. "Toward an Understanding of the BDM: Predictive Validity, Gambling Effects, and Risk Attitude," FEMM Working Papers 150001, Otto-von-Guericke University Magdeburg, Faculty of Economics and Management.
    6. Marcel Lichters & Marko Sarstedt & Bodo Vogt, 2015. "On the practical relevance of the attraction effect: A cautionary note and guidelines for context effect experiments," AMS Review, Springer;Academy of Marketing Science, vol. 5(1), pages 1-19, June.
    7. Klenosky, David B. & Benet, Suzeanne B. & Chadraba, Petr, 1996. "Assessing Czech consumers' reactions to western marketing practices: A conjoint approach," Journal of Business Research, Elsevier, vol. 36(2), pages 189-198, June.
    8. Francisco J. Conejo & Lawrence F. Cunningham & Clifford E. Young, 2020. "Revisiting the Brand Luxury Index: new empirical evidence and future directions," Journal of Brand Management, Palgrave Macmillan, vol. 27(1), pages 108-122, January.
    9. Mitchell, Vincent Wayne & Balabanis, George, 2021. "The role of brand strength, type, image and product-category fit in retail brand collaborations," Journal of Retailing and Consumer Services, Elsevier, vol. 60(C).
    10. Georg Wübker, 1999. "Sonderangebotspolitik und Preisbündelung," Schmalenbach Journal of Business Research, Springer, vol. 51(7), pages 693-713, July.
    11. Hubbard, Raymond & Lindsay, R. Murray, 2013. "From significant difference to significant sameness: Proposing a paradigm shift in business research," Journal of Business Research, Elsevier, vol. 66(9), pages 1377-1388.
    12. Easley, Richard W. & Madden, Charles S. & Dunn, Mark G., 2000. "Conducting Marketing Science: The Role of Replication in the Research Process," Journal of Business Research, Elsevier, vol. 48(1), pages 83-92, April.
    13. Paswan, Audhesh K. & Dant, Rajiv P. & Lumpkin, James R., 1998. "An Empirical Investigation of the Linkages among Relationalism, Environmental Uncertainty, and Bureaucratization," Journal of Business Research, Elsevier, vol. 43(3), pages 125-140, November.
    14. McQuarrie, Edward F., 2004. "Integration of construct and external validity by means of proximal similarity:: Implications for laboratory experiments in marketing," Journal of Business Research, Elsevier, vol. 57(2), pages 142-153, February.
    15. Raquel Redondo & Carmen Valor & Isabel Carrero, 2022. "Unraveling the Relationship between Well-Being, Sustainable Consumption and Nature Relatedness: a Study of University Students," Applied Research in Quality of Life, Springer;International Society for Quality-of-Life Studies, vol. 17(2), pages 913-930, April.
    16. Moritz Loock & Diane M. Phillips, 2020. "A Firm’s Financial Reputation vs. Sustainability Reputation: Do Consumers Really Care?," Sustainability, MDPI, vol. 12(24), pages 1-17, December.
    17. Ulla A. Saari & Saku J. Mäkinen, 2017. "Measuring brand experiences cross-nationally," Journal of Brand Management, Palgrave Macmillan, vol. 24(1), pages 86-104, January.
    18. Michael A. Clemens, 2017. "The Meaning Of Failed Replications: A Review And Proposal," Journal of Economic Surveys, Wiley Blackwell, vol. 31(1), pages 326-342, February.
    19. Ramakrishna Salagrama & Sanjeev Prashar & T. Sai Vijay, 2021. "Do customers exhibit gratitude after service recovery? Understanding the moderating role of relationship type," Service Business, Springer;Pan-Pacific Business Association, vol. 15(4), pages 757-779, December.
    20. Milad Haghani & Michiel C. J. Bliemer & John M. Rose & Harmen Oppewal & Emily Lancsar, 2021. "Hypothetical bias in stated choice experiments: Part I. Integrative synthesis of empirical evidence and conceptualisation of external validity," Papers 2102.02940, arXiv.org.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jbrese:v:114:y:2020:i:c:p:93-101. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jbusres .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.