IDEAS home Printed from https://ideas.repec.org/a/spr/qualqt/v58y2024i2d10.1007_s11135-023-01692-x.html
   My bibliography  Save this article

Second-order synthesis of meta-analytic studies in applied linguistics (1998–2021)

Author

Listed:
  • Mohammad Reza Anani Sarab

    (Shahid Beheshti University)

  • Mohammad Amini Farsani

    (Iran University of Science and Technology)

Abstract

The present article reports on a study which examined research synthetic studies over a period of 24 years from 1998 to 2021 collected from 30 representative applied linguistic journals. The study aimed to investigate the adequacy of reporting and adherence to standards of rigor and transparency in all steps of the meta-analyses. Following a synthetic approach, we synthesized 90 meta-analyses in applied linguistics (AL) journals. The results revealed strengths in all steps and a number of weaknesses in some steps of the process. AL meta-analysts did fairly well in locating the candidate studies by using different databases and supplementary search strategies. In their data analysis phase, they used random effects models more than a combination of random and fixed effects models. To interpret the effect sizes, almost half of the studies used Cohen’s benchmark and almost one third of them used Plonsky and Oswald’s field-specific benchmark. The areas which need to be addressed in future synthetic studies were identified as: more precise identification of moderator variables; more reliable data collection by paying adequate attention to coding sheet piloting and coder qualifications and training; and more reliance on measures other than Q-statistics. The implications of these results are discussed.

Suggested Citation

  • Mohammad Reza Anani Sarab & Mohammad Amini Farsani, 2024. "Second-order synthesis of meta-analytic studies in applied linguistics (1998–2021)," Quality & Quantity: International Journal of Methodology, Springer, vol. 58(2), pages 1517-1543, April.
    • Handle: RePEc:spr:qualqt:v:58:y:2024:i:2:d:10.1007_s11135-023-01692-x
    DOI: 10.1007/s11135-023-01692-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11135-023-01692-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11135-023-01692-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jörn H. Block & Christian Fisch, 2020. "Eight tips and questions for your bibliographic study in business and management research," Management Review Quarterly, Springer, vol. 70(3), pages 307-312, August.
    2. Mohammad Amini Farsani & Esmat Babaii, 2020. "Applied linguistics research in three decades: a methodological synthesis of graduate theses in an EFL context," Quality & Quantity: International Journal of Methodology, Springer, vol. 54(4), pages 1257-1283, August.
    3. Anonymous, 2013. "Notes from the Editors," American Political Science Review, Cambridge University Press, vol. 107(3), pages 1-1, August.
    4. Anonymous, 2013. "Notes from the Editors," American Political Science Review, Cambridge University Press, vol. 107(2), pages 1-1, May.
    5. Anonymous, 2013. "Notes from the Editors," American Political Science Review, Cambridge University Press, vol. 107(1), pages 1-1, February.
    6. Anonymous, 2013. "Notes from the Editors," American Political Science Review, Cambridge University Press, vol. 107(4), pages 1-1, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mohammad Amini Farsani & Reihaneh Barzegar, 2025. "Tracing sampling in applied linguistics: the case of quantitative research approach," Quality & Quantity: International Journal of Methodology, Springer, vol. 59(1), pages 111-123, February.
    2. Mohammad Amini Farsani & Esmat Babaii & Maryam Beikmohammadi & Meysam Babaii Farsani, 2022. "Mixed-methods research proficiency for applied linguists: a PLS-path modelling approach," Quality & Quantity: International Journal of Methodology, Springer, vol. 56(5), pages 3337-3362, October.
    3. Naomi Prachi Hazarika, 2020. "Spaces of Intermediation and Political Participation: a Study of KuSumpur pahadI redevelopment project," CSH-IFP Working Papers 0016, Centre de Sciences Humaines, New Delhi, revised Jul 2020.
    4. Mohammad Amini Farsani & Esmat Babaii, 2020. "Applied linguistics research in three decades: a methodological synthesis of graduate theses in an EFL context," Quality & Quantity: International Journal of Methodology, Springer, vol. 54(4), pages 1257-1283, August.
    5. Fabio Gobbi, 2021. "Evaluating Forecasts from State-Dependent Autoregressive Models for US GDP Growth Rate. Comparison with Alternative Approaches," Advances in Management and Applied Economics, SCIENPRESS Ltd, vol. 11(6), pages 1-7.
    6. S M Ferdous & M Sohel Rahman, 2015. "An Integer Programming Formulation of the Minimum Common String Partition Problem," PLOS ONE, Public Library of Science, vol. 10(7), pages 1-16, July.
    7. Jin Qi & Zhiyong Yang, 2014. "Learning Dictionaries of Sparse Codes of 3D Movements of Body Joints for Real-Time Human Activity Understanding," PLOS ONE, Public Library of Science, vol. 9(12), pages 1-24, December.
    8. Kwangsu Lee & Dong Hoon Lee, 2015. "Security Analysis of the Unrestricted Identity-Based Aggregate Signature Scheme," PLOS ONE, Public Library of Science, vol. 10(5), pages 1-8, May.
    9. A F M Saifuddin Saif & Anton Satria Prabuwono & Zainal Rasyid Mahayuddin, 2015. "Moment Feature Based Fast Feature Extraction Algorithm for Moving Object Detection Using Aerial Images," PLOS ONE, Public Library of Science, vol. 10(6), pages 1-11, June.
    10. Daniel Gamermann & Arnau Montagud & J Alberto Conejero & Pedro Fernández de Córdoba & Javier F Urchueguía, 2019. "Large scale evaluation of differences between network-based and pairwise sequence-alignment-based methods of dendrogram reconstruction," PLOS ONE, Public Library of Science, vol. 14(9), pages 1-13, September.
    11. Anna Görlitz & Michael Dobler, 2023. "Financial accounting for deferred taxes: a systematic review of empirical evidence," Management Review Quarterly, Springer, vol. 73(1), pages 113-165, February.
    12. Manuel Kaiser & Andreas Kuckertz, 2024. "Bibliometrically mapping the research field of entrepreneurial communication: where we stand and where we need to go," Management Review Quarterly, Springer, vol. 74(4), pages 2087-2120, December.
    13. Dyckhoff, Harald & Souren, Rainer, 2022. "Integrating multiple criteria decision analysis and production theory for performance evaluation: Framework and review," European Journal of Operational Research, Elsevier, vol. 297(3), pages 795-816.
    14. Neelam Kaushal & Rahul Pratap Singh Kaurav & Brijesh Sivathanu & Neeraj Kaushik, 2023. "Artificial intelligence and HRM: identifying future research Agenda using systematic literature review and bibliometric analysis," Management Review Quarterly, Springer, vol. 73(2), pages 455-493, June.
    15. Sánchez-Pérez, Manuel & Marín-Carrillo, María Belén & Segovia-López, Cristina & Terán-Yépez, Eduardo, 2025. "Bibliometric articles in business and management: Factors affecting production and scholarly impact," Journal of Business Research, Elsevier, vol. 186(C).
    16. Lanh Thi Nguyen & Anh Nguyen-Quoc & Bui Thi Kim Dung, 2023. "Mapping the research on the legacy of socialism, individual attitudes, and entrepreneurship: a bibliometric analysis and future research agenda," Management Review Quarterly, Springer, vol. 73(4), pages 1419-1456, December.
    17. Kameleddine B. Benameur & Mohamed M. Mostafa & Ahmed Hassanein & Mohammed Z. Shariff & Wasim Al-Shattarat, 2024. "Sustainability reporting scholarly research: a bibliometric review and a future research agenda," Management Review Quarterly, Springer, vol. 74(2), pages 823-866, June.
    18. Julian Andrés Diaz Tautiva & Felipe Ignacio Rifo Rivera & Sebastian Andrés Barros Celume & Sergio Andrés Rifo Rivera, 2024. "Mapping the research about organisations in the latin american context: a bibliometric analysis," Management Review Quarterly, Springer, vol. 74(1), pages 121-169, February.
    19. Julián Andres Díaz Tautiva & Joana Huaman & Roberto D. Ponce Oliva, 2024. "Trends in research on climate change and organizations: a bibliometric analysis (1999–2021)," Management Review Quarterly, Springer, vol. 74(1), pages 227-261, February.
    20. Tejaswi Patil & Zillur Rahman, 2023. "A bibliometric analysis of scientific literature on guilt in marketing," Management Review Quarterly, Springer, vol. 73(3), pages 1385-1415, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:qualqt:v:58:y:2024:i:2:d:10.1007_s11135-023-01692-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.