IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0269438.html
   My bibliography  Save this article

Assessing model adequacy for Bayesian Skyline plots using posterior predictive simulation

Author

Listed:
  • Emanuel M Fonseca
  • Drew J Duckett
  • Filipe G Almeida
  • Megan L Smith
  • Maria Tereza C Thomé
  • Bryan C Carstens

Abstract

Bayesian skyline plots (BSPs) are a useful tool for making inferences about demographic history. For example, researchers typically apply BSPs to test hypotheses regarding how climate changes have influenced intraspecific genetic diversity over time. Like any method, BSP has assumptions that may be violated in some empirical systems (e.g., the absence of population genetic structure), and the naïve analysis of data collected from these systems may lead to spurious results. To address these issues, we introduce P2C2M.Skyline, an R package designed to assess model adequacy for BSPs using posterior predictive simulation. P2C2M.Skyline uses a phylogenetic tree and the log file output from Bayesian Skyline analyses to simulate posterior predictive datasets and then compares this null distribution to statistics calculated from the empirical data to check for model violations. P2C2M.Skyline was able to correctly identify model violations when simulated datasets were generated assuming genetic structure, which is a clear violation of BSP model assumptions. Conversely, P2C2M.Skyline showed low rates of false positives when models were simulated under the BSP model. We also evaluate the P2C2M.Skyline performance in empirical systems, where we detected model violations when DNA sequences from multiple populations were lumped together. P2C2M.Skyline represents a user-friendly and computationally efficient resource for researchers aiming to make inferences from BSP.

Suggested Citation

  • Emanuel M Fonseca & Drew J Duckett & Filipe G Almeida & Megan L Smith & Maria Tereza C Thomé & Bryan C Carstens, 2022. "Assessing model adequacy for Bayesian Skyline plots using posterior predictive simulation," PLOS ONE, Public Library of Science, vol. 17(7), pages 1-13, July.
  • Handle: RePEc:plo:pone00:0269438
    DOI: 10.1371/journal.pone.0269438
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0269438
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0269438&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0269438?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Andrew Gelman, 2003. "A Bayesian Formulation of Exploratory Data Analysis and Goodness‐of‐fit Testing," International Statistical Review, International Statistical Institute, vol. 71(2), pages 369-382, August.
    2. repec:plo:pcbi00:1003537 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Haoying Wang & Guohui Wu, 2022. "Modeling discrete choices with large fine-scale spatial data: opportunities and challenges," Journal of Geographical Systems, Springer, vol. 24(3), pages 325-351, July.
    2. Gonzalez, Jhonny & Moriarty, John & Palczewski, Jan, 2017. "Bayesian calibration and number of jump components in electricity spot price models," Energy Economics, Elsevier, vol. 65(C), pages 375-388.
    3. Deg-Hyo Bae & Kyung-Hwan Son & Jae-Min So, 2017. "Utilization of the Bayesian Method to Improve Hydrological Drought Prediction Accuracy," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 31(11), pages 3527-3541, September.
    4. Clough, Brian J. & Russell, Matthew B. & Domke, Grant M. & Woodall, Christopher W. & Radtke, Philip J., 2016. "Comparing tree foliage biomass models fitted to a multispecies, felled-tree biomass dataset for the United States," Ecological Modelling, Elsevier, vol. 333(C), pages 79-91.
    5. Andrew Gelman & Christian Hennig, 2017. "Beyond subjective and objective in statistics," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 180(4), pages 967-1033, October.
    6. Bhattacharya, Arnab & Wilson, Simon P., 2018. "Sequential Bayesian inference for static parameters in dynamic state space models," Computational Statistics & Data Analysis, Elsevier, vol. 127(C), pages 187-203.
    7. Golnaz Shahtahmassebi & Rana Moyeed, 2016. "An application of the generalized Poisson difference distribution to the Bayesian modelling of football scores," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 70(3), pages 260-273, August.
    8. Constandina Koki & Stefanos Leonardos & Georgios Piliouras, 2020. "Exploring the Predictability of Cryptocurrencies via Bayesian Hidden Markov Models," Papers 2011.03741, arXiv.org, revised Dec 2020.
    9. C. Jessica E. Metcalf & David A. Stephens & Mark Rees & Svata M. Louda & Kathleen H. Keeler, 2009. "Using Bayesian inference to understand the allocation of resources between sexual and asexual reproduction," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 58(2), pages 143-170, May.
    10. Koki, Constandina & Leonardos, Stefanos & Piliouras, Georgios, 2022. "Exploring the predictability of cryptocurrencies via Bayesian hidden Markov models," Research in International Business and Finance, Elsevier, vol. 59(C).
    11. Panagiotis Papastamoulis & Fotios S. Milienos, 2025. "Bayesian inference and cure rate modeling for event history data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 34(1), pages 1-27, March.
    12. David Lunn & Jessica Barrett & Michael Sweeting & Simon Thompson, 2013. "Fully Bayesian hierarchical modelling in two stages, with application to meta-analysis," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 62(4), pages 551-572, August.
    13. Brun, Mélanie & Abraham, Christophe & Jarry, Marc & Dumas, Jacques & Lange, Frédéric & Prévost, Etienne, 2011. "Estimating an homogeneous series of a population abundance indicator despite changes in data collection procedure: A hierarchical Bayesian modelling approach," Ecological Modelling, Elsevier, vol. 222(5), pages 1069-1079.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0269438. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.