IDEAS home Printed from https://ideas.repec.org/a/spr/joamsc/v46y2018i1d10.1007_s11747-017-0528-7.html
   My bibliography  Save this article

On the significance of statistically insignificant results in consumer behavior experiments

Author

Listed:
  • Robert A. Peterson

    (The University of Texas at Austin)

  • U. N. Umesh

    (Washington State University)

Abstract

Experimentation is the sine qua non of consumer behavior research, and much of what is thought to be known about the behavior of consumers is based on findings from experiments. However, many articles that report consumer behavior experiments contain one or more results that are significantly insignificant. That is, one or more experimental results are so unusually weak or minuscule that they are unlikely to have come about by chance. As such, significantly insignificant results can be due to the “failure” of the theory underlying an experiment and/or the flawed design or implementation of an experiment. Consequently, significantly insignificant results have implications for the theories and methodologies employed in consumer behavior experiments, the quality of conclusions drawn from the experiments, and the credibility of the consumer behavior research discipline as a whole.

Suggested Citation

  • Robert A. Peterson & U. N. Umesh, 2018. "On the significance of statistically insignificant results in consumer behavior experiments," Journal of the Academy of Marketing Science, Springer, vol. 46(1), pages 81-91, January.
    • Handle: RePEc:spr:joamsc:v:46:y:2018:i:1:d:10.1007_s11747-017-0528-7
    DOI: 10.1007/s11747-017-0528-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11747-017-0528-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11747-017-0528-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Rod Duclos & Echo Wen Wan & Yuwei Jiang, 2013. "Show Me the Honey! Effects of Social Exclusion on Financial Risk-Taking," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 40(1), pages 122-135.
    2. Robert Peterson & Dwight Merunka, 2014. "Convenience samples of college students and research reproducibility," Post-Print hal-01822317, HAL.
    3. Jingjing Ma & Neal J. Roese, 2013. "The Countability Effect: Comparative versus Experiential Reactions to Reward Distributions," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 39(6), pages 1219-1233.
    4. Katherine White & Jennifer J. Argo & Jaideep Sengupta, 2012. "Dissociative versus Associative Responses to Social Identity Threat: The Role of Consumer Self-Construal," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 39(4), pages 704-719.
    5. Peterson, Robert A., 2005. "Response construction in consumer behavior research," Journal of Business Research, Elsevier, vol. 58(3), pages 348-353, March.
    6. Fabrizio Di Muro & Kyle B. Murray, 2012. "An Arousal Regulation Explanation of Mood Effects on Consumer Choice," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 39(3), pages 574-584.
    7. Calder, Bobby J & Burnkrant, Robert E, 1977. "Interpersonal Influence on Consumer Behavior: An Attribution Theory Approach," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 4(1), pages 29-38, June.
    8. Liyin Jin & Szu-Chi Huang & Ying Zhang, 2013. "The Unexpected Positive Impact of Fixed Structures on Goal Completion," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 40(4), pages 711-725.
    9. Adriana Samper & Janet A. Schwartz, 2013. "Price Inferences for Sacred versus Secular Goods: Changing the Price of Medicine Influences Perceived Health Risk," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 39(6), pages 1343-1358.
    10. Christensen R., 2003. "Significantly Insignificant F Tests," The American Statistician, American Statistical Association, vol. 57, pages 27-32, February.
    11. Monroe, Kent B, 1976. "The Influence of Price Differences and Brand Familiarity on Brand Preferences," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 3(1), pages 42-49, June.
    12. David A. Norton & Cait Poynor Lamberton & Rebecca Walker Naylor, 2013. "The Devil You (Don't) Know: Interpersonal Ambiguity and Inference Making in Competitive Contexts," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 40(2), pages 239-254.
    13. Lynch, John G. & Bradlow, Eric T. & Huber, Joel C. & Lehmann, Donald R., 2015. "Reflections on the replication corner: In praise of conceptual replications," International Journal of Research in Marketing, Elsevier, vol. 32(4), pages 333-342.
    14. Camerer, Colin & Dreber, Anna & Forsell, Eskil & Ho, Teck-Hua & Huber, Jurgen & Johannesson, Magnus & Kirchler, Michael & Almenberg, Johan & Altmejd, Adam & Chan, Taizan & Heikensten, Emma & Holzmeist, 2016. "Evaluating replicability of laboratory experiments in Economics," MPRA Paper 75461, University Library of Munich, Germany.
    15. Raman, Kalyan, 1994. "Inductive Inference and Replications: A Bayesian Perspective," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 20(4), pages 633-643, March.
    16. Peterson, Robert A. & Merunka, Dwight R., 2014. "Convenience samples of college students and research reproducibility," Journal of Business Research, Elsevier, vol. 67(5), pages 1035-1041.
    17. Jesse Chandler & et. al, 2016. "Response to Comment on "Estimating the Reproducibility of Psychological Science"," Mathematica Policy Research Reports cff9c2f16bb544c4bcca530c0, Mathematica Policy Research.
    18. Schlosser, Ann E, 2003. "Experiencing Products in the Virtual World: The Role of Goal and Imagery in Influencing Attitudes versus Purchase Intentions," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 30(2), pages 184-198, September.
    19. Wim Linden & Fanmin Guo, 2008. "Bayesian Procedures for Identifying Aberrant Response-Time Patterns in Adaptive Testing," Psychometrika, Springer;The Psychometric Society, vol. 73(3), pages 365-384, September.
    20. Peterson, Robert A, 2001. "On the Use of College Students in Social Science Research: Insights from a Second-Order Meta-analysis," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 28(3), pages 450-461, December.
    21. Louviere, Jordan J, 2001. "What If Consumer Experiments Impact Variances as Well as Means? Response Variability as a Behavioral Phenomenon," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 28(3), pages 506-511, December.
    22. Hunter, John E, 2001. "The Desperate Need for Replications," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 28(1), pages 149-158, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Agustín J. Sánchez-Medina & Juan Manuel Benítez-del-Rosario & Félix Blázquez-Santana, 2017. "Anomia and Displacement of Responsibility as Determinants of Tourist Company Managers’ Non-Involvement in Alleviating Poverty," Sustainability, MDPI, vol. 9(5), pages 1-15, May.
    2. Heleen Venema & Ruan Spies & Leon T. De Beer, 2021. "Psychometric Properties of the Personality Inventory for DSM-5 Brief Form in an Undergraduate Sample of South African University Students," SAGE Open, , vol. 11(1), pages 21582440209, January.
    3. Qin, Hong & Peak, Daniel Alan & Prybutok, Victor, 2021. "A virtual market in your pocket: How does mobile augmented reality (MAR) influence consumer decision making?," Journal of Retailing and Consumer Services, Elsevier, vol. 58(C).
    4. Höllig, Christoph E. & Tumasjan, Andranik & Welpe, Isabell M., 2020. "Individualizing gamified systems: The role of trait competitiveness and leaderboard design," Journal of Business Research, Elsevier, vol. 106(C), pages 288-303.
    5. Peterson, Robert A. & Merunka, Dwight R., 2014. "Convenience samples of college students and research reproducibility," Journal of Business Research, Elsevier, vol. 67(5), pages 1035-1041.
    6. Šerić, Maja & Ozretić-Došen, Đurđana & Škare, Vatroslav, 2020. "How can perceived consistency in marketing communications influence customer–brand relationship outcomes?," European Management Journal, Elsevier, vol. 38(2), pages 335-343.
    7. Wang, Wangshuai & Yi, Yanxi & Li, Jie & Sun, Gong & Zhang, Mo, 2022. "Lighting up the dark: How the scarcity of childhood resources leads to preferences for bright stimuli," Journal of Business Research, Elsevier, vol. 139(C), pages 1155-1164.
    8. Espinosa, Jennifer A. & Ortinau, David J., 2016. "Debunking legendary beliefs about student samples in marketing research," Journal of Business Research, Elsevier, vol. 69(8), pages 3149-3158.
    9. Melikşah Demir & Andrew Haynes & Marlyn Sanchez & Jennifer C. Parada, 2019. "Personal Sense of Uniqueness Mediates the Relationship Between Compassion for Others and Subjective Well-Being," Journal of Happiness Studies, Springer, vol. 20(6), pages 1751-1773, August.
    10. Cristina Robledo-Ardila & Juan Pablo Román-Calderón, 2022. "Potential: in search for meaning, theory and avenues for future research a systematic review," Management Review Quarterly, Springer, vol. 72(1), pages 149-186, February.
    11. Omar Al-Ubaydli & John List & Claire Mackevicius & Min Sok Lee & Dana Suskind, 2019. "How Can Experiments Play a Greater Role in Public Policy? 12 Proposals from an Economic Model of Scaling," Artefactual Field Experiments 00679, The Field Experiments Website.
    12. Mohammad Nurul Alam & Osarodion Ogiemwonyi & Ibrahim. E. Hago & Noor Azlinna Azizan & Fariza Hashim & Md Sazzad Hossain, 2023. "Understanding Consumer Environmental Ethics and the Willingness to Use Green Products," SAGE Open, , vol. 13(1), pages 21582440221, January.
    13. Mireia Ercilla-Montserrat & David Sanjuan-Delmás & Esther Sanyé-Mengual & Laura Calvet-Mir & Karla Banderas & Joan Rieradevall & Xavier Gabarrell, 2019. "Analysis of the consumer’s perception of urban food products from a soilless system in rooftop greenhouses: a case study from the Mediterranean area of Barcelona (Spain)," Agriculture and Human Values, Springer;The Agriculture, Food, & Human Values Society (AFHVS), vol. 36(3), pages 375-393, September.
    14. Roy Chen & Yan Chen & Yohanes E. Riyanto, 2021. "Best practices in replication: a case study of common information in coordination games," Experimental Economics, Springer;Economic Science Association, vol. 24(1), pages 2-30, March.
    15. Colin F. Camerer & Anna Dreber & Felix Holzmeister & Teck-Hua Ho & Jürgen Huber & Magnus Johannesson & Michael Kirchler & Gideon Nave & Brian A. Nosek & Thomas Pfeiffer & Adam Altmejd & Nick Buttrick , 2018. "Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015," Nature Human Behaviour, Nature, vol. 2(9), pages 637-644, September.
    16. José M. Ramírez-Hurtado & Alfredo G. Hernández-Díaz & Ana D. López-Sánchez & Víctor E. Pérez-León, 2021. "Measuring Online Teaching Service Quality in Higher Education in the COVID-19 Environment," IJERPH, MDPI, vol. 18(5), pages 1-14, March.
    17. Dwayne D. Gremler & Yves Vaerenbergh & Elisabeth C. Brüggen & Kevin P. Gwinner, 2020. "Understanding and managing customer relational benefits in services: a meta-analysis," Journal of the Academy of Marketing Science, Springer, vol. 48(3), pages 565-583, May.
    18. Aysun Ata Aktürk & Hasibe Özlen Demircan, 2018. "Development of Preschool Children Sibling Rivalry Scale (PSRS)," Child Indicators Research, Springer;The International Society of Child Indicators (ISCI), vol. 11(1), pages 117-136, February.
    19. Trafimow, David & Hyman, Michael R. & Kostyk, Alena, 2020. "The (im)precision of scholarly consumer behavior research," Journal of Business Research, Elsevier, vol. 114(C), pages 93-101.
    20. Joana César Machado & Beatriz Fonseca & Carla Martins, 2021. "Brand logo and brand gender: examining the effects of natural logo designs and color on brand gender perceptions and affect," Journal of Brand Management, Palgrave Macmillan, vol. 28(2), pages 152-170, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:joamsc:v:46:y:2018:i:1:d:10.1007_s11747-017-0528-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.