IDEAS home Printed from https://ideas.repec.org/p/osf/osfxxx/cs4vy.html

Bulletproof Bias? Considering the Type of Data in Common Proportion of Variance Effect Sizes

Author

Listed:
  • Buchanan, Erin Michelle

    (Harrisburg University of Science and Technology)

  • Scofield, John E.

Abstract

As effect sizes gain ground as important indicators of practical significance and as a meta-analytic tool, we must critically understand their limitations and biases. This project expands on research by @Okada2013, which highlighted the positive bias of eta squared and suggested the use of omega squared or epsilon for their lack of bias. These variance overlap measures were examined for potential bias in different data scenarios (i.e. truncated and Likert type data) to elucidate differences in bias from previous research. We found that data precision and truncation affected effect size bias, often lowering the bias in eta squared. This work expands our understanding of bias on variance overlap measures and allows researchers to make an informed choice about the type of effect to report given their research study. Implications for sample size planning and power are also discussed.

Suggested Citation

  • Buchanan, Erin Michelle & Scofield, John E., 2017. "Bulletproof Bias? Considering the Type of Data in Common Proportion of Variance Effect Sizes," OSF Preprints cs4vy, Center for Open Science.
    • Handle: RePEc:osf:osfxxx:cs4vy
    DOI: 10.31219/osf.io/cs4vy
    as

    Download full text from publisher

    File URL: https://osf.io/download/599f3a566c613b0251368d6a/
    Download Restriction: no
    File URL: https://libkey.io/10.31219/osf.io/cs4vy?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Fern, Edward F & Monroe, Kent B, 1996. "Effect-Size Estimates: Issues and Problems in Interpretation," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 23(2), pages 89-105, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hans H. Bauer & Marc Fischer & Yvonne McInturff, 1999. "Der Bildkommunikationseffekt — eine Metaanalyse," Schmalenbach Journal of Business Research, Springer, vol. 51(9), pages 805-831, September.
    2. Mohamed M. Mostafa, 2008. "Through the Eye of a Child," Global Business Review, International Management Institute, vol. 9(2), pages 243-255, August.
    3. Yenee Kim & Richard G. McFarland, 2024. "Are you looking for something specific or just looking around? Adaptive selling on the basis of customer shopping goals in retail sales," Journal of the Academy of Marketing Science, Springer, vol. 52(6), pages 1780-1804, November.
    4. Mourali, Mehdi & Yang, Zhiyong & Pons, Frank & Hassay, Derek, 2018. "Consumer power and choice deferral: The role of anticipated regret," International Journal of Research in Marketing, Elsevier, vol. 35(1), pages 81-99.
    5. Saha, Sajeeb & Ranjan, Kumar Rakesh & Pappu, Ravi & Akhlaghpour, Saeed, 2023. "Corporate giving and its impact on consumer evaluations: A meta-analysis," Journal of Business Research, Elsevier, vol. 158(C).
    6. Rachel N Carey & Daragh T McDermott & Kiran M Sarma, 2013. "The Impact of Threat Appeals on Fear Arousal and Driver Behavior: A Meta-Analysis of Experimental Research 1990–2011," PLOS ONE, Public Library of Science, vol. 8(5), pages 1-8, May.
    7. Zongyuan Liu & Harcharanjit Singh Mahinder Singh & Fatema Al Shibli, 2025. "What is a recognized mechanism for transforming big data analytics into firm performance? A meta-analysis from cultural view," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 12(1), pages 1-20, December.
    8. Dutta, Sujay & Pullig, Chris, 2015. "A commentary on reporting effect size and confidence intervals: Response to Palmer and Strelan (2014)," Journal of Business Research, Elsevier, vol. 68(5), pages 1082-1085.
    9. Lehmann, Donald R., 2003. "Finding important findings," Journal of Business Research, Elsevier, vol. 56(1), pages 89-90, January.
    10. Fernando Oliveira Santini & Wagner Junior Ladeira & Claudio Hoffmann Sampaio & Diego Costa Pinto, 2018. "The brand experience extended model: a meta-analysis," Journal of Brand Management, Palgrave Macmillan, vol. 25(6), pages 519-535, November.
    11. So Young Sohn, 2000. "Multivariate meta analysis with potentially correlated marketing study results," Naval Research Logistics (NRL), John Wiley & Sons, vol. 47(6), pages 500-510, September.
    12. Alexander P. Schudey & Ove Jensen & Nils D. Kraiczy, 2016. "„Made in?“ – Eine Metaanalyse multidimensionaler Country-of-Origin Effekte [„Made in?“ – A multidimensional meta analysis of country-of-origin effects]," Schmalenbach Journal of Business Research, Springer, vol. 68(1), pages 47-74, April.
    13. Verlegh, Peeter W. J. & Steenkamp, Jan-Benedict E. M., 1999. "A review and meta-analysis of country-of-origin research," Journal of Economic Psychology, Elsevier, vol. 20(5), pages 521-546, October.
    14. Xia, Lan & Kukar-Kinney, Monika & Monroe, Kent B., 2010. "Effects of Consumers’ Efforts on Price and Promotion Fairness Perceptions," Journal of Retailing, Elsevier, vol. 86(1), pages 1-10.
    15. Gianluca Vagnani & Corrado Gatti & Luca Proietti, 2019. "A conceptual framework of the adoption of innovations in organizations: a meta-analytical review of the literature," Journal of Management & Governance, Springer;Accademia Italiana di Economia Aziendale (AIDEA), vol. 23(4), pages 1023-1062, December.
    16. Freling, Traci H. & Yang, Zhiyong & Saini, Ritesh & Itani, Omar S. & Rashad Abualsamh, Ryan, 2020. "When poignant stories outweigh cold hard facts: A meta-analysis of the anecdotal bias," Organizational Behavior and Human Decision Processes, Elsevier, vol. 160(C), pages 51-67.
    17. García-Meca, Emma & Sánchez-Ballesta, Juan Pedro, 2006. "Influences on financial analyst forecast errors: A meta-analysis," International Business Review, Elsevier, vol. 15(1), pages 29-52, February.
    18. Hofmann, Julian & Clement, Michel & Völckner, Franziska & Hennig-Thurau, Thorsten, 2017. "Empirical generalizations on the impact of stars on the economic success of movies," International Journal of Research in Marketing, Elsevier, vol. 34(2), pages 442-461.
    19. Leonard Grebe & Dirk Schiereck, 2024. "Day-of-the-week effect: a meta-analysis," Eurasian Economic Review, Springer;Eurasia Business and Economics Society, vol. 14(4), pages 1057-1094, December.
    20. Santini, Fernando de Oliveira & Sampaio, Claudio Hoffmann & Rasul, Tareq & Ladeira, Wagner Junior & Kar, Arpan Kumar & Perin, Marcelo Gattermann & Azhar, Mohd, 2025. "Understanding students’ technology acceptance behaviour: A meta-analytic study," Technology in Society, Elsevier, vol. 81(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:osfxxx:cs4vy. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://osf.io/preprints/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.