Effect sizes and the interpretation of research results in international business
AbstractJournal editors and academy presidents are increasingly calling on researchers to evaluate the substantive, as opposed to the statistical, significance of their results. To measure the extent to which these calls have been heeded, I aggregated the meta-analytically derived effect size estimates obtained from 965 individual samples. I then surveyed 204 studies published in the Journal of International Business Studies. I found that the average effect size in international business research is small, and that most published studies lack the statistical power to detect such effects reliably. I also found that many authors confuse statistical with substantive significance when interpreting their research results. These practices have likely led to unacceptably high Type II error rates and invalid inferences regarding real-world effects. By emphasizing p values over their effect size estimates, researchers are under-selling their results and settling for contributions that are less than what they really have to offer. In view of this, I offer four recommendations for improving research and reporting practices.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoArticle provided by Palgrave Macmillan in its journal Journal of International Business Studies.
Volume (Year): 41 (2010)
Issue (Month): 9 (December)
Contact details of provider:
Web page: http://www.palgrave-journals.com/
Postal: Palgrave Macmillan Journals, Subscription Department, Houndmills, Basingstoke, Hampshire RG21 6XS, UK
You can help add them by filling out this form.
CitEc Project, subscribe to its RSS feed for this item.
- Wang, Danny T. & Gu, Flora F. & Tse, David K. & Yim, Chi Kin (Bennett), 2013. "When does FDI matter? The roles of local institutions and ethnic origins of FDI," International Business Review, Elsevier, vol. 22(2), pages 450-465.
- Zhan, Ge, 2013. "Statistical power in international business research: Study levels and data types," International Business Review, Elsevier, vol. 22(4), pages 678-686.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Elizabeth Gale).
If references are entirely missing, you can add them using this form.