IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0013283.html
   My bibliography  Save this article

When the Optimal Is Not the Best: Parameter Estimation in Complex Biological Models

Author

Listed:
  • Diego Fernández Slezak
  • Cecilia Suárez
  • Guillermo A Cecchi
  • Guillermo Marshall
  • Gustavo Stolovitzky

Abstract

Background: The vast computational resources that became available during the past decade enabled the development and simulation of increasingly complex mathematical models of cancer growth. These models typically involve many free parameters whose determination is a substantial obstacle to model development. Direct measurement of biochemical parameters in vivo is often difficult and sometimes impracticable, while fitting them under data-poor conditions may result in biologically implausible values. Results: We discuss different methodological approaches to estimate parameters in complex biological models. We make use of the high computational power of the Blue Gene technology to perform an extensive study of the parameter space in a model of avascular tumor growth. We explicitly show that the landscape of the cost function used to optimize the model to the data has a very rugged surface in parameter space. This cost function has many local minima with unrealistic solutions, including the global minimum corresponding to the best fit. Conclusions: The case studied in this paper shows one example in which model parameters that optimally fit the data are not necessarily the best ones from a biological point of view. To avoid force-fitting a model to a dataset, we propose that the best model parameters should be found by choosing, among suboptimal parameters, those that match criteria other than the ones used to fit the model. We also conclude that the model, data and optimization approach form a new complex system and point to the need of a theory that addresses this problem more generally.

Suggested Citation

  • Diego Fernández Slezak & Cecilia Suárez & Guillermo A Cecchi & Guillermo Marshall & Gustavo Stolovitzky, 2010. "When the Optimal Is Not the Best: Parameter Estimation in Complex Biological Models," PLOS ONE, Public Library of Science, vol. 5(10), pages 1-10, October.
  • Handle: RePEc:plo:pone00:0013283
    DOI: 10.1371/journal.pone.0013283
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0013283
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0013283&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0013283?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Ryan N Gutenkunst & Joshua J Waterfall & Fergal P Casey & Kevin S Brown & Christopher R Myers & James P Sethna, 2007. "Universally Sloppy Parameter Sensitivities in Systems Biology Models," PLOS Computational Biology, Public Library of Science, vol. 3(10), pages 1-8, October.
    2. Hiroaki Kitano, 2002. "Computational systems biology," Nature, Nature, vol. 420(6912), pages 206-210, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Afnizanfaizal Abdullah & Safaai Deris & Mohd Saberi Mohamad & Sohail Anwar, 2013. "An Improved Swarm Optimization for Parameter Estimation and Biological Model Selection," PLOS ONE, Public Library of Science, vol. 8(4), pages 1-16, April.
    2. Afnizanfaizal Abdullah & Safaai Deris & Sohail Anwar & Satya N V Arjunan, 2013. "An Evolutionary Firefly Algorithm for the Estimation of Nonlinear Biological Model Parameters," PLOS ONE, Public Library of Science, vol. 8(3), pages 1-16, March.
    3. Tianhai Tian & Jiangning Song, 2012. "Mathematical Modelling of the MAP Kinase Pathway Using Proteomic Datasets," PLOS ONE, Public Library of Science, vol. 7(8), pages 1-12, August.
    4. Andreas Wagner, 2015. "Causal Drift, Robust Signaling, and Complex Disease," PLOS ONE, Public Library of Science, vol. 10(3), pages 1-29, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Joshua Russell-Buckland & Christopher P Barnes & Ilias Tachtsidis, 2019. "A Bayesian framework for the analysis of systems biology models of the brain," PLOS Computational Biology, Public Library of Science, vol. 15(4), pages 1-29, April.
    2. Samuel Bandara & Johannes P Schlöder & Roland Eils & Hans Georg Bock & Tobias Meyer, 2009. "Optimal Experimental Design for Parameter Estimation of a Cell Signaling Model," PLOS Computational Biology, Public Library of Science, vol. 5(11), pages 1-12, November.
    3. Dominic M Dunstan & Mark P Richardson & Eugenio Abela & Ozgur E Akman & Marc Goodfellow, 2023. "Global nonlinear approach for mapping parameters of neural mass models," PLOS Computational Biology, Public Library of Science, vol. 19(3), pages 1-28, March.
    4. repec:plo:pgen00:1006132 is not listed on IDEAS
    5. repec:plo:pone00:0024246 is not listed on IDEAS
    6. Hongwei Shao & Tao Peng & Zhiwei Ji & Jing Su & Xiaobo Zhou, 2013. "Systematically Studying Kinase Inhibitor Induced Signaling Network Signatures by Integrating Both Therapeutic and Side Effects," PLOS ONE, Public Library of Science, vol. 8(12), pages 1-16, December.
    7. Chandra, Yanto & Wilkinson, Ian F., 2017. "Firm internationalization from a network-centric complex-systems perspective," Journal of World Business, Elsevier, vol. 52(5), pages 691-701.
    8. repec:plo:pcbi00:0030142 is not listed on IDEAS
    9. Mika Gustafsson & Michael Hörnquist, 2010. "Gene Expression Prediction by Soft Integration and the Elastic Net—Best Performance of the DREAM3 Gene Expression Challenge," PLOS ONE, Public Library of Science, vol. 5(2), pages 1-8, February.
    10. Gabriele Lillacci & Mustafa Khammash, 2010. "Parameter Estimation and Model Selection in Computational Biology," PLOS Computational Biology, Public Library of Science, vol. 6(3), pages 1-17, March.
    11. Andrew White & Malachi Tolman & Howard D Thames & Hubert Rodney Withers & Kathy A Mason & Mark K Transtrum, 2016. "The Limitations of Model-Based Experimental Design and Parameter Estimation in Sloppy Systems," PLOS Computational Biology, Public Library of Science, vol. 12(12), pages 1-26, December.
    12. Elba Raimúndez & Simone Keller & Gwen Zwingenberger & Karolin Ebert & Sabine Hug & Fabian J Theis & Dieter Maier & Birgit Luber & Jan Hasenauer, 2020. "Model-based analysis of response and resistance factors of cetuximab treatment in gastric cancer cell lines," PLOS Computational Biology, Public Library of Science, vol. 16(3), pages 1-21, March.
    13. Joseph D Taylor & Samuel Winnall & Alain Nogaret, 2020. "Estimation of neuron parameters from imperfect observations," PLOS Computational Biology, Public Library of Science, vol. 16(7), pages 1-22, July.
    14. Niki Vermeulen, 2018. "The choreography of a new research field: Aggregation, circulation and oscillation," Environment and Planning A, , vol. 50(8), pages 1764-1784, November.
    15. Xinxian Shao & Andrew Mugler & Justin Kim & Ha Jun Jeong & Bruce R Levin & Ilya Nemenman, 2017. "Growth of bacteria in 3-d colonies," PLOS Computational Biology, Public Library of Science, vol. 13(7), pages 1-19, July.
    16. repec:plo:pcbi00:1003705 is not listed on IDEAS
    17. Armaghan W Naik & Joshua D Kangas & Christopher J Langmead & Robert F Murphy, 2013. "Efficient Modeling and Active Learning Discovery of Biological Responses," PLOS ONE, Public Library of Science, vol. 8(12), pages 1-1, December.
    18. Joep P J Schmitz & Jeroen A L Jeneson & Joep W M van Oorschot & Jeanine J Prompers & Klaas Nicolay & Peter A J Hilbers & Natal A W van Riel, 2012. "Prediction of Muscle Energy States at Low Metabolic Rates Requires Feedback Control of Mitochondrial Respiratory Chain Activity by Inorganic Phosphate," PLOS ONE, Public Library of Science, vol. 7(3), pages 1-14, March.
    19. Marco S Nobile & Paolo Cazzaniga & Daniela Besozzi & Dario Pescini & Giancarlo Mauri, 2014. "cuTauLeaping: A GPU-Powered Tau-Leaping Stochastic Simulator for Massive Parallel Analyses of Biological Systems," PLOS ONE, Public Library of Science, vol. 9(3), pages 1-20, March.
    20. Fabian Fröhlich & Barbara Kaltenbacher & Fabian J Theis & Jan Hasenauer, 2017. "Scalable Parameter Estimation for Genome-Scale Biochemical Reaction Networks," PLOS Computational Biology, Public Library of Science, vol. 13(1), pages 1-18, January.
    21. Markus J. Buehler & Theodor Ackbarow, 2008. "Nanomechanical strength mechanisms of hierarchical biological materials and tissues," Computer Methods in Biomechanics and Biomedical Engineering, Taylor & Francis Journals, vol. 11(6), pages 595-607.
    22. Agus Hartoyo & Peter J Cadusch & David T J Liley & Damien G Hicks, 2019. "Parameter estimation and identifiability in a neural population model for electro-cortical activity," PLOS Computational Biology, Public Library of Science, vol. 15(5), pages 1-27, May.
    23. Luca Cardelli & Rosa D Hernansaiz-Ballesteros & Neil Dalchau & Attila Csikász-Nagy, 2017. "Efficient Switches in Biology and Computer Science," PLOS Computational Biology, Public Library of Science, vol. 13(1), pages 1-16, January.
    24. Christian A Tiemann & Joep Vanlier & Maaike H Oosterveer & Albert K Groen & Peter A J Hilbers & Natal A W van Riel, 2013. "Parameter Trajectory Analysis to Identify Treatment Effects of Pharmacological Interventions," PLOS Computational Biology, Public Library of Science, vol. 9(8), pages 1-15, August.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0013283. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.