IDEAS home Printed from https://ideas.repec.org/a/eee/ijrema/v31y2014i3p317-326.html

Meta-analysis selection bias in marketing research

Author

Listed:
  • Eisend, Martin
  • Tarrahi, Farid

Abstract

The tendency of meta-analytic authors to select particular studies is called selection bias. Selection bias can affect the strength of the meta-analytic estimate and the attention that scholars devote to the results. This research is, in effect, a meta-analysis of the effect sizes reported or calculated from 94 meta-analysis studies of various topics in marketing research. The analysis reveals that estimates depend on the publication status of the included studies. The greater the percentage of studies that were published in academic journals vs. non-published studies, the greater is the size of the meta-effects, and the more published studies from leading journals the meta-analysis includes, the stronger the effect size. The meta-analytic effect size is a mediator for the influence of both the ratio of unpublished studies and the ratio of studies from leading journals on the probability of a meta-analysis to be published in a leading journal, which increases the number of citations to a meta-analysis. The findings of this study have several implications for meta-analysts, editors, reviewers and the marketing community on how to conduct and read current and future meta-analysis in marketing research.

Suggested Citation

  • Eisend, Martin & Tarrahi, Farid, 2014. "Meta-analysis selection bias in marketing research," International Journal of Research in Marketing, Elsevier, vol. 31(3), pages 317-326.
    • Handle: RePEc:eee:ijrema:v:31:y:2014:i:3:p:317-326
    DOI: 10.1016/j.ijresmar.2014.03.006
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167811614000317
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ijresmar.2014.03.006?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Paul D Ellis, 2010. "Effect sizes and the interpretation of research results in international business," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 41(9), pages 1581-1588, December.
    2. Frank Renkewitz & Heather M. Fuchs & Susann Fiedler, 2011. "Is there evidence of publication biases in JDM research?," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 6(8), pages 870-881, December.
    3. Jonathan Knight, 2003. "Null and void," Nature, Nature, vol. 422(6932), pages 554-555, April.
    4. Banks, George C. & McDaniel, Michael A., 2011. "The Kryptonite of Evidence-Based I–O Psychology," Industrial and Organizational Psychology, Cambridge University Press, vol. 4(1), pages 40-44, March.
    5. Xinshu Zhao & John G. Lynch & Qimei Chen, 2010. "Reconsidering Baron and Kenny: Myths and Truths about Mediation Analysis," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 37(2), pages 197-206, August.
    6. David Moher & Alessandro Liberati & Jennifer Tetzlaff & Douglas G Altman & The PRISMA Group, 2009. "Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-6, July.
    7. Kremer, Sara T.M. & Bijmolt, Tammo H.A. & Leeflang, Peter S.H. & Wieringa, Jaap E., 2008. "Generalizations on the effectiveness of pharmaceutical promotional expenditures," International Journal of Research in Marketing, Elsevier, vol. 25(4), pages 234-246.
    8. Peterson, Robert A, 2001. "On the Use of College Students in Social Science Research: Insights from a Second-Order Meta-analysis," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 28(3), pages 450-461, December.
    9. Marnik G. Dekimpe & Dominique M. Hanssens, 1995. "Empirical Generalizations About Market Evolution and Stationarity," Marketing Science, INFORMS, vol. 14(3_supplem), pages 109-121.
    10. Sue Duval & Richard Tweedie, 2000. "Trim and Fill: A Simple Funnel-Plot–Based Method of Testing and Adjusting for Publication Bias in Meta-Analysis," Biometrics, The International Biometric Society, vol. 56(2), pages 455-463, June.
    11. Leonard M. Lodish & Magid M. Abraham & Jeanne Livelsberger & Beth Lubetkin & Bruce Richardson & Mary Ellen Stevens, 1995. "A Summary of Fifty-Five In-Market Experimental Estimates of the Long-Term Effect of TV Advertising," Marketing Science, INFORMS, vol. 14(3_supplem), pages 133-140.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mangirdas Morkunas & Elzė Rudienė & Lukas Giriūnas & Laura Daučiūnienė, 2020. "Assessment of Factors Causing Bias in Marketing- Related Publications," Publications, MDPI, vol. 8(4), pages 1-16, October.
    2. Zongyuan Liu & Harcharanjit Singh Mahinder Singh & Fatema Al Shibli, 2025. "What is a recognized mechanism for transforming big data analytics into firm performance? A meta-analysis from cultural view," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 12(1), pages 1-20, December.
    3. Peng, Chenming & Eisend, Martin & Xiang, Diandian & Chen, Zengxiang & Zhao, Hong, 2025. "A meta-analysis of corporate social responsibility effects: The role of stakeholder type and country factors," International Journal of Research in Marketing, Elsevier, vol. 42(3), pages 809-826.
    4. Eisend, Martin & Hermann, Erik, 2020. "Sexual orientation and consumption: Why and when do homosexuals and heterosexuals consume differently?," International Journal of Research in Marketing, Elsevier, vol. 37(4), pages 678-696.
    5. Okazaki, Shintaro & Eisend, Martin & Plangger, Kirk & de Ruyter, Ko & Grewal, Dhruv, 2020. "Understanding the Strategic Consequences of Customer Privacy Concerns: A Meta-Analytic Review," Journal of Retailing, Elsevier, vol. 96(4), pages 458-473.
    6. Chang, Woojung & Ellinger, Alexander E. & Kim, Kyoungmi (Kate) & Franke, George R., 2016. "Supply chain integration and firm financial performance: A meta-analysis of positional advantage mediation and moderating factors," European Management Journal, Elsevier, vol. 34(3), pages 282-295.
    7. Wendling, Alexandre & Galiez, Clovis, 2026. "Gamma approximation of stratified truncated exact test (GASTE-test) & application," Computational Statistics & Data Analysis, Elsevier, vol. 214(C).
    8. Nikolaus Seitz & Martina Buratti & Erik E. Lehmann & Julie Kurrle, 2026. "A meta-analysis towards the effectiveness of startup accelerators," The Journal of Technology Transfer, Springer, vol. 51(1), pages 373-413, February.
    9. Mou, Jian & Benyoucef, Morad, 2021. "Consumer behavior in social commerce: Results from a meta-analysis," Technological Forecasting and Social Change, Elsevier, vol. 167(C).
    10. Wesley James Johnston & Angelina Nhat Hanh Le & Julian Ming-Sung Cheng, 2018. "A meta-analytic review of influence strategies in marketing channel relationships," Journal of the Academy of Marketing Science, Springer, vol. 46(4), pages 674-702, July.
    11. Arte, Pratik & Larimo, Jorma, 2022. "Moderating influence of product diversification on the international diversification-performance relationship: A meta-analysis," Journal of Business Research, Elsevier, vol. 139(C), pages 1408-1423.
    12. François A. Carrillat & Renaud Legoux & Allègre L. Hadida, 2018. "Debates and assumptions about motion picture performance: a meta-analysis," Journal of the Academy of Marketing Science, Springer, vol. 46(2), pages 273-299, March.
    13. Rik Pieters, 2017. "Meaningful Mediation Analysis: Plausible Causal Inference and Informative Communication," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 44(3), pages 692-716.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alba Carrillo & María Rubio-Aparicio & Guadalupe Molinari & Ángel Enrique & Julio Sánchez-Meca & Rosa M Baños, 2019. "Effects of the Best Possible Self intervention: A systematic review and meta-analysis," PLOS ONE, Public Library of Science, vol. 14(9), pages 1-23, September.
    2. Daniele Zago & Maria Eugênia Andrighetto Canozzi & Júlio Otávio Jardim Barcellos, 2020. "Pregnant beef cow’s nutrition and its effects on postnatal weight and carcass quality of their progeny," PLOS ONE, Public Library of Science, vol. 15(8), pages 1-20, August.
    3. Viktoria Maria Baumeister & Leonie Petra Kuen & Maike Bruckes & Gerhard Schewe, 2021. "The Relationship of Work-Related ICT Use With Well-being, Incorporating the Role of Resources and Demands: A Meta-Analysis," SAGE Open, , vol. 11(4), pages 21582440211, November.
    4. Ritchwood, Tiarney D. & Ford, Haley & DeCoster, Jamie & Sutton, Marnie & Lochman, John E., 2015. "Risky sexual behavior and substance use among adolescents: A meta-analysis," Children and Youth Services Review, Elsevier, vol. 52(C), pages 74-88.
    5. Christopher Winchester & Kelsey E. Medeiros, 2023. "In Bounds but Out of the Box: A Meta-Analysis Clarifying the Effect of Ethicality on Creativity," Journal of Business Ethics, Springer, vol. 183(3), pages 713-743, March.
    6. Lianjie Liu & Zhuo Shao & Hang Yu & Wei Zhang & Hao Wang & Zubing Mei, 2020. "Is the platelet to lymphocyte ratio a promising biomarker to distinguish acute appendicitis? Evidence from a systematic review with meta-analysis," PLOS ONE, Public Library of Science, vol. 15(5), pages 1-15, May.
    7. Sara Farag & Catherine Tsang & Philip N Murphy, 2023. "Polyphenol supplementation and executive functioning in overweight and obese adults at risk of cognitive impairment: A systematic review and meta-analysis," PLOS ONE, Public Library of Science, vol. 18(5), pages 1-22, May.
    8. Kim, Yeolib & Kim, Seung Hyun & Peterson, Robert A. & Choi, Jeonghye, 2023. "Privacy concern and its consequences: A meta-analysis," Technological Forecasting and Social Change, Elsevier, vol. 196(C).
    9. Mohammad Najm Dadam & Le Thanh Hien & Engy M Makram & Lam Vinh Sieu & Ahmad Morad & Nada Khalil & Linh Tran & Abdelrahman M Makram & Nguyen Tien Huy, 2024. "Role of cell-free DNA levels in the diagnosis and prognosis of sepsis and bacteremia: A systematic review and meta-analysis," PLOS ONE, Public Library of Science, vol. 19(8), pages 1-16, August.
    10. Fabrizio Sgolastra & Ambra Petrucci & Marco Severino & Roberto Gatto & Annalisa Monaco, 2013. "Relationship between Periodontitis and Pre-Eclampsia: A Meta-Analysis," PLOS ONE, Public Library of Science, vol. 8(8), pages 1-11, August.
    11. Ioana A Cristea & Robin N Kok & Pim Cuijpers, 2016. "The Effectiveness of Cognitive Bias Modification Interventions for Substance Addictions: A Meta-Analysis," PLOS ONE, Public Library of Science, vol. 11(9), pages 1-19, September.
    12. Je-Young Lee & Minkyung Baek, 2023. "Effects of Gamification on Students’ English Language Proficiency: A Meta-Analysis on Research in South Korea," Sustainability, MDPI, vol. 15(14), pages 1-19, July.
    13. S Bally & J Cottin & M C Gagnieu & J C Lega & C Verstuyft & S Rheims & G Lesca & M Cucherat & Guillaume Grenet, 2022. "Publication bias in pharmacogenetics of adverse reaction to antiseizure drugs: An umbrella review and a meta-epidemiological study," PLOS ONE, Public Library of Science, vol. 17(12), pages 1-14, December.
    14. Martin Polak & Norbert Tanzer & Per Carlbring, 2022. "PROTOCOL: Effects of virtual reality exposure therapy versus in vivo exposure in treating social anxiety disorder in adults: A systematic review and meta‐analysis," Campbell Systematic Reviews, John Wiley & Sons, vol. 18(3), September.
    15. Muthanna Samara & Bruna Da Silva Nascimento & Aiman El-Asam & Sara Hammuda & Nabil Khattab, 2021. "How Can Bullying Victimisation Lead to Lower Academic Achievement? A Systematic Review and Meta-Analysis of the Mediating Role of Cognitive-Motivational Factors," IJERPH, MDPI, vol. 18(5), pages 1-21, February.
    16. Wan Shakira Rodzlan Hasani & Nor Asiah Muhamad & Nur Hasnah Maamor & Tengku Muhammad Hanis & Chen Xin Wee & Muhammad Radzi Abu Hassan & Zulkarnain Abdul Karim & Kamarul Imran Musa, 2023. "Premature mortality and years of potential life lost from cardiovascular diseases: Protocol of a systematic review and meta-analysis," PLOS ONE, Public Library of Science, vol. 18(5), pages 1-11, May.
    17. Xian-Tao Zeng & Wei Luo & Wei Huang & Quan Wang & Yi Guo & Wei-Dong Leng, 2013. "Tooth Loss and Head and Neck Cancer: A Meta-Analysis of Observational Studies," PLOS ONE, Public Library of Science, vol. 8(11), pages 1-8, November.
    18. Zhao-Feng Chen & Lufei Young & Chong Ho Yu & S. Pamela K. Shiao, 2018. "A Meta-Prediction of Methylenetetrahydrofolate-Reductase Polymorphisms and Air Pollution Increased the Risk of Ischemic Heart Diseases Worldwide," IJERPH, MDPI, vol. 15(7), pages 1-16, July.
    19. Chun-Yu Chang & Po-Chen Lin & Yung-Jiun Chien & Chien-Sheng Chen & Meng-Yu Wu, 2020. "Analysis of Chest-Compression Depth and Full Recoil in Two Infant Chest-Compression Techniques Performed by a Single Rescuer: Systematic Review and Meta-Analysis," IJERPH, MDPI, vol. 17(11), pages 1-17, June.
    20. Ikonen, Iina & Aydinli, Aylin & Verlegh, Peeter, 2025. "Adding good or removing bad: Consumer response to nutrition claims," Journal of Retailing, Elsevier, vol. 101(4), pages 659-678.

    More about this item

    Keywords

    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ijrema:v:31:y:2014:i:3:p:317-326. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/international-journal-of-research-in-marketing/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.