IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0013283.html
   My bibliography  Save this article

When the Optimal Is Not the Best: Parameter Estimation in Complex Biological Models

Author

Listed:
  • Diego Fernández Slezak
  • Cecilia Suárez
  • Guillermo A Cecchi
  • Guillermo Marshall
  • Gustavo Stolovitzky

Abstract

Background: The vast computational resources that became available during the past decade enabled the development and simulation of increasingly complex mathematical models of cancer growth. These models typically involve many free parameters whose determination is a substantial obstacle to model development. Direct measurement of biochemical parameters in vivo is often difficult and sometimes impracticable, while fitting them under data-poor conditions may result in biologically implausible values. Results: We discuss different methodological approaches to estimate parameters in complex biological models. We make use of the high computational power of the Blue Gene technology to perform an extensive study of the parameter space in a model of avascular tumor growth. We explicitly show that the landscape of the cost function used to optimize the model to the data has a very rugged surface in parameter space. This cost function has many local minima with unrealistic solutions, including the global minimum corresponding to the best fit. Conclusions: The case studied in this paper shows one example in which model parameters that optimally fit the data are not necessarily the best ones from a biological point of view. To avoid force-fitting a model to a dataset, we propose that the best model parameters should be found by choosing, among suboptimal parameters, those that match criteria other than the ones used to fit the model. We also conclude that the model, data and optimization approach form a new complex system and point to the need of a theory that addresses this problem more generally.

Suggested Citation

  • Diego Fernández Slezak & Cecilia Suárez & Guillermo A Cecchi & Guillermo Marshall & Gustavo Stolovitzky, 2010. "When the Optimal Is Not the Best: Parameter Estimation in Complex Biological Models," PLOS ONE, Public Library of Science, vol. 5(10), pages 1-10, October.
  • Handle: RePEc:plo:pone00:0013283
    DOI: 10.1371/journal.pone.0013283
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0013283
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0013283&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0013283?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Hiroaki Kitano, 2002. "Computational systems biology," Nature, Nature, vol. 420(6912), pages 206-210, November.
    2. Ryan N Gutenkunst & Joshua J Waterfall & Fergal P Casey & Kevin S Brown & Christopher R Myers & James P Sethna, 2007. "Universally Sloppy Parameter Sensitivities in Systems Biology Models," PLOS Computational Biology, Public Library of Science, vol. 3(10), pages 1-8, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Afnizanfaizal Abdullah & Safaai Deris & Mohd Saberi Mohamad & Sohail Anwar, 2013. "An Improved Swarm Optimization for Parameter Estimation and Biological Model Selection," PLOS ONE, Public Library of Science, vol. 8(4), pages 1-16, April.
    2. Tianhai Tian & Jiangning Song, 2012. "Mathematical Modelling of the MAP Kinase Pathway Using Proteomic Datasets," PLOS ONE, Public Library of Science, vol. 7(8), pages 1-12, August.
    3. Afnizanfaizal Abdullah & Safaai Deris & Sohail Anwar & Satya N V Arjunan, 2013. "An Evolutionary Firefly Algorithm for the Estimation of Nonlinear Biological Model Parameters," PLOS ONE, Public Library of Science, vol. 8(3), pages 1-16, March.
    4. Andreas Wagner, 2015. "Causal Drift, Robust Signaling, and Complex Disease," PLOS ONE, Public Library of Science, vol. 10(3), pages 1-29, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Samuel Bandara & Johannes P Schlöder & Roland Eils & Hans Georg Bock & Tobias Meyer, 2009. "Optimal Experimental Design for Parameter Estimation of a Cell Signaling Model," PLOS Computational Biology, Public Library of Science, vol. 5(11), pages 1-12, November.
    2. Joshua Russell-Buckland & Christopher P Barnes & Ilias Tachtsidis, 2019. "A Bayesian framework for the analysis of systems biology models of the brain," PLOS Computational Biology, Public Library of Science, vol. 15(4), pages 1-29, April.
    3. Adel Dayarian & Madalena Chaves & Eduardo D Sontag & Anirvan M Sengupta, 2009. "Shape, Size, and Robustness: Feasible Regions in the Parameter Space of Biochemical Networks," PLOS Computational Biology, Public Library of Science, vol. 5(1), pages 1-12, January.
    4. Mark Read & Paul S. Andrews & Jon Timmis & Vipin Kumar, 2011. "Techniques for grounding agent-based simulations in the real domain: a case study in experimental autoimmune encephalomyelitis," Mathematical and Computer Modelling of Dynamical Systems, Taylor & Francis Journals, vol. 18(1), pages 67-86, May.
    5. Amrita X Sarkar & Eric A Sobie, 2010. "Regression Analysis for Constraining Free Parameters in Electrophysiological Models of Cardiac Cells," PLOS Computational Biology, Public Library of Science, vol. 6(9), pages 1-11, September.
    6. Hongwei Shao & Tao Peng & Zhiwei Ji & Jing Su & Xiaobo Zhou, 2013. "Systematically Studying Kinase Inhibitor Induced Signaling Network Signatures by Integrating Both Therapeutic and Side Effects," PLOS ONE, Public Library of Science, vol. 8(12), pages 1-16, December.
    7. Chandra, Yanto & Wilkinson, Ian F., 2017. "Firm internationalization from a network-centric complex-systems perspective," Journal of World Business, Elsevier, vol. 52(5), pages 691-701.
    8. Jacobo Ayensa-Jiménez & Marina Pérez-Aliacar & Teodora Randelovic & José Antonio Sanz-Herrera & Mohamed H. Doweidar & Manuel Doblaré, 2020. "Analysis of the Parametric Correlation in Mathematical Modeling of In Vitro Glioblastoma Evolution Using Copulas," Mathematics, MDPI, vol. 9(1), pages 1-22, December.
    9. Qing-Ju Jiao & Yan-Kai Zhang & Lu-Ning Li & Hong-Bin Shen, 2011. "BinTree Seeking: A Novel Approach to Mine Both Bi-Sparse and Cohesive Modules in Protein Interaction Networks," PLOS ONE, Public Library of Science, vol. 6(11), pages 1-12, November.
    10. Tom C Freeman & Leon Goldovsky & Markus Brosch & Stijn van Dongen & Pierre Mazière & Russell J Grocock & Shiri Freilich & Janet Thornton & Anton J Enright, 2007. "Construction, Visualisation, and Clustering of Transcription Networks from Microarray Expression Data," PLOS Computational Biology, Public Library of Science, vol. 3(10), pages 1-11, October.
    11. Yuksel Bayraktar & Esme Isik & Ibrahim Isik & Ayfer Ozyilmaz & Metin Toprak & Fatma Kahraman Guloglu & Serdar Aydin, 2022. "Analyzing of Alzheimer’s Disease Based on Biomedical and Socio-Economic Approach Using Molecular Communication, Artificial Neural Network, and Random Forest Models," Sustainability, MDPI, vol. 14(13), pages 1-15, June.
    12. Alireza Yazdani & Lu Lu & Maziar Raissi & George Em Karniadakis, 2020. "Systems biology informed deep learning for inferring parameters and hidden dynamics," PLOS Computational Biology, Public Library of Science, vol. 16(11), pages 1-19, November.
    13. Fridtjof Brauns & Leila Iñigo de la Cruz & Werner K.-G. Daalman & Ilse Bruin & Jacob Halatek & Liedewij Laan & Erwin Frey, 2023. "Redundancy and the role of protein copy numbers in the cell polarization machinery of budding yeast," Nature Communications, Nature, vol. 14(1), pages 1-14, December.
    14. Eberhard O Voit & Harald A Martens & Stig W Omholt, 2015. "150 Years of the Mass Action Law," PLOS Computational Biology, Public Library of Science, vol. 11(1), pages 1-7, January.
    15. Céline Christiansen-Jucht & Kamil Erguler & Chee Yan Shek & María-Gloria Basáñez & Paul E. Parham, 2015. "Modelling Anopheles gambiae s.s. Population Dynamics with Temperature- and Age-Dependent Survival," IJERPH, MDPI, vol. 12(6), pages 1-31, May.
    16. Mika Gustafsson & Michael Hörnquist, 2010. "Gene Expression Prediction by Soft Integration and the Elastic Net—Best Performance of the DREAM3 Gene Expression Challenge," PLOS ONE, Public Library of Science, vol. 5(2), pages 1-8, February.
    17. Gabriele Lillacci & Mustafa Khammash, 2010. "Parameter Estimation and Model Selection in Computational Biology," PLOS Computational Biology, Public Library of Science, vol. 6(3), pages 1-17, March.
    18. Andrew White & Malachi Tolman & Howard D Thames & Hubert Rodney Withers & Kathy A Mason & Mark K Transtrum, 2016. "The Limitations of Model-Based Experimental Design and Parameter Estimation in Sloppy Systems," PLOS Computational Biology, Public Library of Science, vol. 12(12), pages 1-26, December.
    19. Matthew A Hibbs & Chad L Myers & Curtis Huttenhower & David C Hess & Kai Li & Amy A Caudy & Olga G Troyanskaya, 2009. "Directing Experimental Biology: A Case Study in Mitochondrial Biogenesis," PLOS Computational Biology, Public Library of Science, vol. 5(3), pages 1-12, March.
    20. Elba Raimúndez & Simone Keller & Gwen Zwingenberger & Karolin Ebert & Sabine Hug & Fabian J Theis & Dieter Maier & Birgit Luber & Jan Hasenauer, 2020. "Model-based analysis of response and resistance factors of cetuximab treatment in gastric cancer cell lines," PLOS Computational Biology, Public Library of Science, vol. 16(3), pages 1-21, March.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0013283. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.