IDEAS home Printed from https://ideas.repec.org/p/osf/ecoevo/su4zv.html
   My bibliography  Save this paper

Phylogenetic multilevel meta-analysis: A simulation study on the importance of modeling the phylogeny

Author

Listed:
  • Cinar, Ozan
  • Nakagawa, Shinichi

    (University of New South Wales)

  • Viechtbauer, Wolfgang

    (Maastricht University)

Abstract

Meta-analyses in ecology and evolution typically include multiple estimates from the same study and based on multiple species. The resulting dependencies in the data can be addressed by using a phylogenetic multilevel meta-analysis model. However, the complexity of the model poses challenges for accurately estimating model parameter. We therefore carried out a simulation study to investigate the performance of models with different degrees of complexities. While the overall mean was estimated with little to no bias irrespective of the model, only the model that accounted for the multilevel structure and that incorporates both a non-phylogenetic and a phylogenetic variance component provided confidence intervals with approximately nominal coverage rates. We therefore suggest that meta-analysts in ecology and evolution use the phylogenetic multilevel meta-analysis model as the de facto standard when analyzing multi-species datasets.

Suggested Citation

  • Cinar, Ozan & Nakagawa, Shinichi & Viechtbauer, Wolfgang, 2020. "Phylogenetic multilevel meta-analysis: A simulation study on the importance of modeling the phylogeny," EcoEvoRxiv su4zv, Center for Open Science.
    • Handle: RePEc:osf:ecoevo:su4zv
    DOI: 10.31219/osf.io/su4zv
    as

    Download full text from publisher

    File URL: https://osf.io/download/5fbb800577aa6504d09496b3/
    Download Restriction: no
    File URL: https://libkey.io/10.31219/osf.io/su4zv?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Mark Pagel, 1999. "Inferring the historical patterns of biological evolution," Nature, Nature, vol. 401(6756), pages 877-884, October.
    2. Julian P. T. Higgins & Simon G. Thompson & David J. Spiegelhalter, 2009. "A re‐evaluation of random‐effects meta‐analysis," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 172(1), pages 137-159, January.
    3. Viechtbauer, Wolfgang, 2010. "Conducting Meta-Analyses in R with the metafor Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 36(i03).
    4. Konstantopoulos, Spyros, 2011. "Fixed Effects and Variance Components Estimation in Three-Level Meta-Analysis," IZA Discussion Papers 5678, Institute of Labor Economics (IZA).
    5. Jessica Gurevitch & Julia Koricheva & Shinichi Nakagawa & Gavin Stewart, 2018. "Meta-analysis and the science of research synthesis," Nature, Nature, vol. 555(7695), pages 175-182, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Christopher Hansen & Holger Steinmetz & Jörn Block, 2022. "How to conduct a meta-analysis in eight steps: a practical guide," Management Review Quarterly, Springer, vol. 72(1), pages 1-19, February.
    2. Sangsuk Yoon & Nathan M. Fong & Angelika Dimoka, 2019. "The robustness of anchoring effects on preferential judgments," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 14(4), pages 470-487, July.
    3. L. M. Diele-Viegas & R. T. Figueroa & B. Vilela & C. F. D. Rocha, 2020. "Are reptiles toast? A worldwide evaluation of Lepidosauria vulnerability to climate change," Climatic Change, Springer, vol. 159(4), pages 581-599, April.
    4. Christopher Hansen & Joern Block & Matthias Neuenkirch, 2020. "Family Firm Performance Over The Business Cycle: A Meta‐Analysis," Journal of Economic Surveys, Wiley Blackwell, vol. 34(3), pages 476-511, July.
    5. Jaskiewicz, Peter & Block, Joern & Wagner, Dominik & Carney, Michael & Hansen, Christopher, 2021. "How do cross-country differences in institutional trust and trust in family explain the mixed performance effects of family management? A meta-analysis," Journal of World Business, Elsevier, vol. 56(5).
    6. repec:cup:judgdm:v:14:y:2019:i:4:p:470-487 is not listed on IDEAS
    7. John Protzko & Jon Krosnick & Leif Nelson & Brian A. Nosek & Jordan Axt & Matt Berent & Nicholas Buttrick & Matthew DeBell & Charles R. Ebersole & Sebastian Lundmark & Bo MacInnis & Michael O’Donnell , 2024. "High replicability of newly discovered social-behavioural findings is achievable," Nature Human Behaviour, Nature, vol. 8(2), pages 311-319, February.
    8. Johannes Knoll & Jörg Matthes, 2017. "The effectiveness of celebrity endorsements: a meta-analysis," Journal of the Academy of Marketing Science, Springer, vol. 45(1), pages 55-75, January.
    9. Schubert, Anna-Lena, 2019. "A meta-analysis of the worst performance rule," Intelligence, Elsevier, vol. 73(C), pages 88-100.
    10. Boris Forthmann & Karin Kaczykowski & Mathias Benedek & Heinz Holling, 2023. "The Manic Idea Creator? A Review and Meta-Analysis of the Relationship between Bipolar Disorder and Creative Cognitive Potential," IJERPH, MDPI, vol. 20(13), pages 1-39, June.
    11. Shannon G. Klein & Cassandra Roch & Carlos M. Duarte, 2024. "Systematic review of the uncertainty of coral reef futures under climate change," Nature Communications, Nature, vol. 15(1), pages 1-17, December.
    12. Neda Nasrollahi & Tim Jowett & Liana Machado, 2022. "Emotional information processing in young and older adults: meta-analysis reveals faces elicit distinct biases," European Journal of Ageing, Springer, vol. 19(3), pages 369-379, September.
    13. Colagrossi, Marco & Rossignoli, Domenico & Maggioni, Mario A., 2020. "Does democracy cause growth? A meta-analysis (of 2000 regressions)," European Journal of Political Economy, Elsevier, vol. 61(C).
    14. Peter Hartley & Patricia Costello & Rachel Fenner & Nathalie Gibbins & Édáin Quinn & Isla Kuhn & Victoria L Keevil & Roman Romero-Ortuno, 2019. "Change in skeletal muscle associated with unplanned hospital admissions in adult patients: A systematic review and meta-analysis," PLOS ONE, Public Library of Science, vol. 14(1), pages 1-21, January.
    15. David Weisberger & Virginia Nichols & Matt Liebman, 2019. "Does diversifying crop rotations suppress weeds? A meta-analysis," PLOS ONE, Public Library of Science, vol. 14(7), pages 1-12, July.
    16. Thomas Rockstuhl & Robert Eisenberger & Lynn M. Shore & James N. Kurtessis & Michael T. Ford & Louis C. Buffardi & Salar Mesdaghinia, 2020. "Perceived organizational support (POS) across 54 nations: A cross-cultural meta-analysis of POS effects," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 51(6), pages 933-962, August.
    17. Babin, Barry J. & Herrmann, Jean-Luc & Kacha, Mathieu & Babin, Laurie A., 2021. "The effectiveness of brand placements: A meta-analytic synthesis," International Journal of Research in Marketing, Elsevier, vol. 38(4), pages 1017-1033.
    18. Jing Gao & Wei Hu & Jiawei Wang & Yichong Cui & Liuxin Li, 2023. "Response of Growth-Related Traits of Submerged Macrophytes to Light Reduction: A Meta-Analysis," Sustainability, MDPI, vol. 15(7), pages 1-19, March.
    19. Fahad M. Al Amer & Christopher G. Thompson & Lifeng Lin, 2021. "Bayesian Methods for Meta-Analyses of Binary Outcomes: Implementations, Examples, and Impact of Priors," IJERPH, MDPI, vol. 18(7), pages 1-14, March.
    20. François A. Carrillat & Renaud Legoux & Allègre L. Hadida, 2018. "Debates and assumptions about motion picture performance: a meta-analysis," Journal of the Academy of Marketing Science, Springer, vol. 46(2), pages 273-299, March.
    21. Laura A. B. Wilson & Susanne R. K. Zajitschek & Malgorzata Lagisz & Jeremy Mason & Hamed Haselimashhadi & Shinichi Nakagawa, 2022. "Sex differences in allometry for phenotypic traits in mice indicate that females are not scaled males," Nature Communications, Nature, vol. 13(1), pages 1-12, December.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:ecoevo:su4zv. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://ecoevorxiv.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.