IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0208177.html
   My bibliography  Save this article

Assessing robustness against potential publication bias in Activation Likelihood Estimation (ALE) meta-analyses for fMRI

Author

Listed:
  • Freya Acar
  • Ruth Seurinck
  • Simon B Eickhoff
  • Beatrijs Moerkerke

Abstract

The importance of integrating research findings is incontrovertible and procedures for coordinate-based meta-analysis (CBMA) such as Activation Likelihood Estimation (ALE) have become a popular approach to combine results of fMRI studies when only peaks of activation are reported. As meta-analytical findings help building cumulative knowledge and guide future research, not only the quality of such analyses but also the way conclusions are drawn is extremely important. Like classical meta-analyses, coordinate-based meta-analyses can be subject to different forms of publication bias which may impact results and invalidate findings. The file drawer problem refers to the problem where studies fail to get published because they do not obtain anticipated results (e.g. due to lack of statistical significance). To enable assessing the stability of meta-analytical results and determine their robustness against the potential presence of the file drawer problem, we present an algorithm to determine the number of noise studies that can be added to an existing ALE fMRI meta-analysis before spatial convergence of reported activation peaks over studies in specific regions is no longer statistically significant. While methods to gain insight into the validity and limitations of results exist for other coordinate-based meta-analysis toolboxes, such as Galbraith plots for Multilevel Kernel Density Analysis (MKDA) and funnel plots and egger tests for seed-based d mapping, this procedure is the first to assess robustness against potential publication bias for the ALE algorithm. The method assists in interpreting meta-analytical results with the appropriate caution by looking how stable results remain in the presence of unreported information that may differ systematically from the information that is included. At the same time, the procedure provides further insight into the number of studies that drive the meta-analytical results. We illustrate the procedure through an example and test the effect of several parameters through extensive simulations. Code to generate noise studies is made freely available which enables users to easily use the algorithm when interpreting their results.

Suggested Citation

  • Freya Acar & Ruth Seurinck & Simon B Eickhoff & Beatrijs Moerkerke, 2018. "Assessing robustness against potential publication bias in Activation Likelihood Estimation (ALE) meta-analyses for fMRI," PLOS ONE, Public Library of Science, vol. 13(11), pages 1-23, November.
    • Handle: RePEc:plo:pone00:0208177
    DOI: 10.1371/journal.pone.0208177
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0208177
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0208177&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0208177?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Nikos K. Logothetis, 2008. "What we can do and what we cannot do with fMRI," Nature, Nature, vol. 453(7197), pages 869-878, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. John C Moring & Fatima T Husain & Jodie Gray & Crystal Franklin & Alan L Peterson & Patricia A Resick & Amy Garrett & Carlos Esquivel & Peter T Fox, 2022. "Invariant structural and functional brain regions associated with tinnitus: A meta-analysis," PLOS ONE, Public Library of Science, vol. 17(10), pages 1-17, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:hum:wpaper:sfb649dp2014-036 is not listed on IDEAS
    2. Adam S. Tuzolele Mbuku, 2024. "Evolution of the concept of Homo Economicus in light of advances in Neuroeconomics: towards a more realistic model of economic decision-making [Evolution du concept de l'Homo Economicus à la lumièr," Post-Print hal-04564775, HAL.
    3. Olsen, Carmen & Gold, Anna, 2018. "Future research directions at the intersection between cognitive neuroscience research and auditors’ professional skepticism," Journal of Accounting Literature, Elsevier, vol. 41(C), pages 127-141.
    4. Federico Rocchi & Carola Canella & Shahryar Noei & Daniel Gutierrez-Barragan & Ludovico Coletta & Alberto Galbusera & Alexia Stuefer & Stefano Vassanelli & Massimo Pasqualetti & Giuliano Iurilli & Ste, 2022. "Increased fMRI connectivity upon chemogenetic inhibition of the mouse prefrontal cortex," Nature Communications, Nature, vol. 13(1), pages 1-15, December.
    5. Hadi Vafaii & Francesca Mandino & Gabriel Desrosiers-Grégoire & David O’Connor & Marija Markicevic & Xilin Shen & Xinxin Ge & Peter Herman & Fahmeed Hyder & Xenophon Papademetris & Mallar Chakravarty , 2024. "Multimodal measures of spontaneous brain activity reveal both common and divergent patterns of cortical functional organization," Nature Communications, Nature, vol. 15(1), pages 1-19, December.
    6. repec:plo:pone00:0018537 is not listed on IDEAS
    7. Nicos Nicolaou & Phillip H. Phan & Ute Stephan, 2021. "The Biological Perspective in Entrepreneurship Research," Entrepreneurship Theory and Practice, , vol. 45(1), pages 3-17, January.
    8. Luis Manssuer & Qiong Ding & Yashu Feng & Ruoqi Yang & Wei Liu & Bomin Sun & Shikun Zhan & Valerie Voon, 2024. "Reward recalibrates rule representations in human amygdala and hippocampus intracranial recordings," Nature Communications, Nature, vol. 15(1), pages 1-16, December.
    9. Ahmed H. Alsharif & Salmi Mohd Isa, 2024. "Revolutionizing consumer insights: the impact of fMRI in neuromarketing research," Future Business Journal, Springer, vol. 10(1), pages 1-26, December.
    10. Angelika Dimoka & Paul A. Pavlou & Fred D. Davis, 2011. "Research Commentary ---NeuroIS: The Potential of Cognitive Neuroscience for Information Systems Research," Information Systems Research, INFORMS, vol. 22(4), pages 687-702, December.
    11. Wei Li & Miao Wang & Wen Wen & Yue Huang & Xi Chen & Wenliang Fan & The Alzheimer's Disease Neuroimaging Initiative, 2018. "Neural Dynamics during Resting State: A Functional Magnetic Resonance Imaging Exploration with Reduction and Visualization," Complexity, Hindawi, vol. 2018, pages 1-10, June.
    12. Xu Cui & Chess Stetson & P Read Montague & David M Eagleman, 2009. "Ready…Go: Amplitude of the fMRI Signal Encodes Expectation of Cue Arrival Time," PLOS Biology, Public Library of Science, vol. 7(8), pages 1-11, August.
    13. H. Lina Schaare & Maria Blöchl & Deniz Kumral & Marie Uhlig & Lorenz Lemcke & Sofie L. Valk & Arno Villringer, 2023. "Associations between mental health, blood pressure and the development of hypertension," Nature Communications, Nature, vol. 14(1), pages 1-17, December.
    14. Sacha Bourgeois-Gironde & Itzhak Gingi Aharon, 2011. "From Neuroeconomics to Genetics: The Intertemporal Choices Case as an Example," Post-Print ijn_00713466, HAL.
    15. Alejandro Morán & Miguel C Soriano, 2018. "Improving the quality of a collective signal in a consumer EEG headset," PLOS ONE, Public Library of Science, vol. 13(5), pages 1-21, May.
    16. Pérez-Centeno, Victor, 2018. "Brain-driven entrepreneurship research: Expanded review and research agenda towards entrepreneurial enhancement," Working Papers 02/18, Institut für Mittelstandsforschung (IfM) Bonn.
    17. Eleonora Maggioni & Jorge Arrubla & Tracy Warbrick & Jürgen Dammers & Anna M Bianchi & Gianluigi Reni & Michela Tosetti & Irene Neuner & N Jon Shah, 2014. "Removal of Pulse Artefact from EEG Data Recorded in MR Environment at 3T. Setting of ICA Parameters for Marking Artefactual Components: Application to Resting-State Data," PLOS ONE, Public Library of Science, vol. 9(11), pages 1-15, November.
    18. Daniella Laureiro-Martínez & Stefano Brusoni & Nicola Canessa & Maurizio Zollo, 2015. "Understanding the exploration–exploitation dilemma: An fMRI study of attention control and decision-making performance," Strategic Management Journal, Wiley Blackwell, vol. 36(3), pages 319-338, March.
    19. John A Clithero & Dharol Tankersley & Scott A Huettel, 2008. "Foundations of Neuroeconomics: From Philosophy to Practice," PLOS Biology, Public Library of Science, vol. 6(11), pages 1-6, November.
    20. Munro, Eileen & Musholt, Kristina, 2014. "Neuroscience and the risks of maltreatment," Children and Youth Services Review, Elsevier, vol. 47(P1), pages 18-26.
    21. Macauley Smith Breault & Pierre Sacré & Zachary B. Fitzgerald & John T. Gale & Kathleen E. Cullen & Jorge A. González-Martínez & Sridevi V. Sarma, 2023. "Internal states as a source of subject-dependent movement variability are represented by large-scale brain networks," Nature Communications, Nature, vol. 14(1), pages 1-20, December.
    22. Fabian A Soto & Sanjay Narasiwodeyar, 2023. "Improving the validity of neuroimaging decoding tests of invariant and configural neural representation," PLOS Computational Biology, Public Library of Science, vol. 19(1), pages 1-44, January.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0208177. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.