IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0133465.html
   My bibliography  Save this article

Family-Based Benchmarking of Copy Number Variation Detection Software

Author

Listed:
  • Marcel Elie Nutsua
  • Annegret Fischer
  • Almut Nebel
  • Sylvia Hofmann
  • Stefan Schreiber
  • Michael Krawczak
  • Michael Nothnagel

Abstract

The analysis of structural variants, in particular of copy-number variations (CNVs), has proven valuable in unraveling the genetic basis of human diseases. Hence, a large number of algorithms have been developed for the detection of CNVs in SNP array signal intensity data. Using the European and African HapMap trio data, we undertook a comparative evaluation of six commonly used CNV detection software tools, namely Affymetrix Power Tools (APT), QuantiSNP, PennCNV, GLAD, R-gada and VEGA, and assessed their level of pair-wise prediction concordance. The tool-specific CNV prediction accuracy was assessed in silico by way of intra-familial validation. Software tools differed greatly in terms of the number and length of the CNVs predicted as well as the number of markers included in a CNV. All software tools predicted substantially more deletions than duplications. Intra-familial validation revealed consistently low levels of prediction accuracy as measured by the proportion of validated CNVs (34-60%). Moreover, up to 20% of apparent family-based validations were found to be due to chance alone. Software using Hidden Markov models (HMM) showed a trend to predict fewer CNVs than segmentation-based algorithms albeit with greater validity. PennCNV yielded the highest prediction accuracy (60.9%). Finally, the pairwise concordance of CNV prediction was found to vary widely with the software tools involved. We recommend HMM-based software, in particular PennCNV, rather than segmentation-based algorithms when validity is the primary concern of CNV detection. QuantiSNP may be used as an additional tool to detect sets of CNVs not detectable by the other tools. Our study also reemphasizes the need for laboratory-based validation, such as qPCR, of CNVs predicted in silico.

Suggested Citation

  • Marcel Elie Nutsua & Annegret Fischer & Almut Nebel & Sylvia Hofmann & Stefan Schreiber & Michael Krawczak & Michael Nothnagel, 2015. "Family-Based Benchmarking of Copy Number Variation Detection Software," PLOS ONE, Public Library of Science, vol. 10(7), pages 1-17, July.
  • Handle: RePEc:plo:pone00:0133465
    DOI: 10.1371/journal.pone.0133465
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0133465
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0133465&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0133465?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Brendan Maher, 2008. "Personal genomes: The case of the missing heritability," Nature, Nature, vol. 456(7218), pages 18-21, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:plo:pone00:0083057 is not listed on IDEAS
    2. Yumei Yang & Qishan Wang & Qiang Chen & Rongrong Liao & Xiangzhe Zhang & Hongjie Yang & Youmin Zheng & Zhiwu Zhang & Yuchun Pan, 2014. "A New Genotype Imputation Method with Tolerance to High Missing Rate and Rare Variants," PLOS ONE, Public Library of Science, vol. 9(6), pages 1-7, June.
    3. Chung-Feng Kao & Jia-Rou Liu & Hung Hung & Po-Hsiu Kuo, 2015. "A Robust GWSS Method to Simultaneously Detect Rare and Common Variants for Complex Disease," PLOS ONE, Public Library of Science, vol. 10(4), pages 1-14, April.
    4. Dominic Russ & John A Williams & Victor Roth Cardoso & Laura Bravo-Merodio & Samantha C Pendleton & Furqan Aziz & Animesh Acharjee & Georgios V Gkoutos, 2022. "Evaluating the detection ability of a range of epistasis detection methods on simulated data for pure and impure epistatic models," PLOS ONE, Public Library of Science, vol. 17(2), pages 1-19, February.
    5. von Stumm, Sophie & Kandaswamy, Radhika & Maxwell, Jessye, 2023. "Gene-environment interplay in early life cognitive development," Intelligence, Elsevier, vol. 98(C).
    6. Janet Currie, 2011. "Ungleichheiten bei der Geburt: Einige Ursachen und Folgen," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 12(s1), pages 42-65, May.
    7. repec:plo:pone00:0078038 is not listed on IDEAS
    8. Kettlewell, Nathan & Tymula, Agnieszka & Yoo, Hong Il, 2023. "The Heritability of Economic Preferences," IZA Discussion Papers 16633, Institute of Labor Economics (IZA).
    9. repec:plo:pone00:0138223 is not listed on IDEAS
    10. repec:plo:pcbi00:1002600 is not listed on IDEAS
    11. Shashaank Vattikuti & Juen Guo & Carson C Chow, 2012. "Heritability and Genetic Correlations Explained by Common SNPs for Metabolic Syndrome Traits," PLOS Genetics, Public Library of Science, vol. 8(3), pages 1-8, March.
    12. Bingley, Paul & Cappellari, Lorenzo & Tatsiramos, Konstantinos, 2023. "On the Origins of Socio-Economic Inequalities: Evidence from Twin Families," IZA Discussion Papers 16520, Institute of Labor Economics (IZA).
    13. Gabriel E Hoffman & Benjamin A Logsdon & Jason G Mezey, 2013. "PUMA: A Unified Framework for Penalized Multiple Regression Analysis of GWAS Data," PLOS Computational Biology, Public Library of Science, vol. 9(6), pages 1-19, June.
    14. Patrick Murigu Kamau Njage & Clementine Henri & Pimlapas Leekitcharoenphon & Michel‐Yves Mistou & Rene S. Hendriksen & Tine Hald, 2019. "Machine Learning Methods as a Tool for Predicting Risk of Illness Applying Next‐Generation Sequencing Data," Risk Analysis, John Wiley & Sons, vol. 39(6), pages 1397-1413, June.
    15. Yunpeng Wang & Arne B Gjuvsland & Jon Olav Vik & Nicolas P Smith & Peter J Hunter & Stig W Omholt, 2012. "Parameters in Dynamic Models of Complex Traits are Containers of Missing Heritability," PLOS Computational Biology, Public Library of Science, vol. 8(4), pages 1-9, April.
    16. Christian Magnus Page & Sergio E Baranzini & Bjørn-Helge Mevik & Steffan Daniel Bos & Hanne F Harbo & Bettina Kulle Andreassen, 2015. "Assessing the Power of Exome Chips," PLOS ONE, Public Library of Science, vol. 10(10), pages 1-13, October.
    17. Diana Chang & Feng Gao & Andrea Slavney & Li Ma & Yedael Y Waldman & Aaron J Sams & Paul Billing-Ross & Aviv Madar & Richard Spritz & Alon Keinan, 2014. "Accounting for eXentricities: Analysis of the X Chromosome in GWAS Reveals X-Linked Genes Implicated in Autoimmune Diseases," PLOS ONE, Public Library of Science, vol. 9(12), pages 1-31, December.
    18. Hou-Feng Zheng & Jing-Jing Rong & Ming Liu & Fang Han & Xing-Wei Zhang & J Brent Richards & Li Wang, 2015. "Performance of Genotype Imputation for Low Frequency and Rare Variants from the 1000 Genomes," PLOS ONE, Public Library of Science, vol. 10(1), pages 1-10, January.
    19. Lucas Alvizi & Diogo Nani & Luciano Abreu Brito & Gerson Shigeru Kobayashi & Maria Rita Passos-Bueno & Roberto Mayor, 2023. "Neural crest E-cadherin loss drives cleft lip/palate by epigenetic modulation via pro-inflammatory gene–environment interaction," Nature Communications, Nature, vol. 14(1), pages 1-14, December.
    20. Yuanjia Wang & Yin-Hsiu Chen & Qiong Yang, 2012. "Joint Rare Variant Association Test of the Average and Individual Effects for Sequencing Studies," PLOS ONE, Public Library of Science, vol. 7(3), pages 1-13, March.
    21. McEvoy, Brian P. & Visscher, Peter M., 2009. "Genetics of human height," Economics & Human Biology, Elsevier, vol. 7(3), pages 294-306, December.
    22. Zhiqiu Hu & Rong-Cai Yang, 2014. "Marker-Based Estimation of Genetic Parameters in Genomics," PLOS ONE, Public Library of Science, vol. 9(7), pages 1-12, July.
    23. repec:plo:pgen00:1004787 is not listed on IDEAS
    24. repec:osf:thesis:a4nz2_v1 is not listed on IDEAS
    25. Chuong B Do & David A Hinds & Uta Francke & Nicholas Eriksson, 2012. "Comparison of Family History and SNPs for Predicting Risk of Complex Disease," PLOS Genetics, Public Library of Science, vol. 8(10), pages 1-16, October.
    26. Iuliana Ionita-Laza & Joseph D Buxbaum & Nan M Laird & Christoph Lange, 2011. "A New Testing Strategy to Identify Rare Variants with Either Risk or Protective Effect on Disease," PLOS Genetics, Public Library of Science, vol. 7(2), pages 1-6, February.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0133465. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.