IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0281259.html
   My bibliography  Save this article

Directed acyclic graphs in perioperative observational research–A systematic review and critique against best practice recommendations

Author

Listed:
  • Matthew Lamont Watson
  • Sebastian H M Hickman
  • Kaya Marlen Dreesbeimdiek
  • Katharina Kohler
  • Daniel J Stubbs

Abstract

The Directed Acyclic Graph (DAG) is a graph representing causal pathways for informing the conduct of an observational study. The use of DAGs allows transparent communication of a causal model between researchers and can prevent over-adjustment biases when conducting causal inference, permitting greater confidence and transparency in reported causal estimates. In the era of ‘big data’ and increasing number of observational studies, the role of the DAG is becoming more important. Recent best-practice guidance for constructing a DAG with reference to the literature has been published in the ‘Evidence synthesis for constructing DAGs’ (ESC-DAG) protocol. We aimed to assess adherence to these principles for DAGs constructed within perioperative literature. Following registration on the International Prospective Register of Systematic Reviews (PROSPERO) and with adherence to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) reporting framework for systematic reviews, we searched the Excerpta Medica dataBASE (Embase), the Medical Literature Analysis and Retrieval System Online (MEDLINE) and Cochrane databases for perioperative observational research incorporating a DAG. Nineteen studies were included in the final synthesis. No studies demonstrated any evidence of following the mapping stage of the protocol. Fifteen (79%) fulfilled over half of the translation and integration one stages of the protocol. Adherence with one stage did not guarantee fulfilment of the other. Two studies (11%) undertook the integration two stage. Unmeasured variables were handled inconsistently between studies. Only three (16%) studies included unmeasured variables within their DAG and acknowledged their implication within the main text. Overall, DAGs that were constructed for use in perioperative observational literature did not consistently adhere to best practice, potentially limiting the benefits of subsequent causal inference. Further work should focus on exploring reasons for this deviation and increasing methodological transparency around DAG construction.

Suggested Citation

  • Matthew Lamont Watson & Sebastian H M Hickman & Kaya Marlen Dreesbeimdiek & Katharina Kohler & Daniel J Stubbs, 2023. "Directed acyclic graphs in perioperative observational research–A systematic review and critique against best practice recommendations," PLOS ONE, Public Library of Science, vol. 18(2), pages 1-16, February.
    • Handle: RePEc:plo:pone00:0281259
    DOI: 10.1371/journal.pone.0281259
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0281259
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0281259&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0281259?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Deaton, Angus & Cartwright, Nancy, 2018. "Understanding and misunderstanding randomized controlled trials," Social Science & Medicine, Elsevier, vol. 210(C), pages 2-21.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Christopher J. Ruhm, 2019. "Shackling the Identification Police?," Southern Economic Journal, John Wiley & Sons, vol. 85(4), pages 1016-1026, April.
    2. Martin, Will, 2021. "Tools for measuring the full impacts of agricultural interventions," IFPRI-MCC technical papers 2, International Food Policy Research Institute (IFPRI).
    3. Cristina Bellés-Obrero & María Lombardi, 2022. "Teacher Performance Pay and Student Learning: Evidence from a Nationwide Program in Peru," Economic Development and Cultural Change, University of Chicago Press, vol. 70(4), pages 1631-1669.
    4. Jesus Fernandez-Villaverde, 2020. "Simple Rules for a Complex World with Arti?cial Intelligence," PIER Working Paper Archive 20-010, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    5. Vellore Arthi & James Fenske, 2018. "Polygamy and child mortality: Historical and modern evidence from Nigeria’s Igbo," Review of Economics of the Household, Springer, vol. 16(1), pages 97-141, March.
    6. Irina Gemmo & Pierre-Carl Michaud & Olivia S. Mitchell, 2023. "Selection into Financial Education and Effects on Portfolio Choice," NBER Working Papers 31682, National Bureau of Economic Research, Inc.
    7. Castaing, Pauline & Gazeaud, Jules, 2025. "Do index insurance programs live up to their promises? Aggregating evidence from multiple experiments," Journal of Development Economics, Elsevier, vol. 175(C).
    8. Andreas C Drichoutis & Rodolfo M Nayga, 2020. "Economic Rationality under Cognitive Load," The Economic Journal, Royal Economic Society, vol. 130(632), pages 2382-2409.
    9. Wallin, Annika & Wahlberg, Lena & Persson, Johannes & Dewitt, Barry, 2020. "“Science and proven experience”: How should the epistemology of medicine inform the regulation of healthcare?," Health Policy, Elsevier, vol. 124(8), pages 842-848.
    10. Wang Ning, 2018. "Law and the Economy: An Introduction to Coasian Law and Economics," Man and the Economy, De Gruyter, vol. 5(2), pages 1-13, December.
    11. Jörg Peters & Jörg Langbein & Gareth Roberts, 2018. "Generalization in the Tropics – Development Policy, Randomized Controlled Trials, and External Validity," The World Bank Research Observer, World Bank, vol. 33(1), pages 34-64.
    12. John A. List & Fatemeh Momeni & Yves Zenou, 2020. "The Social Side of Early Human Capital Formation: Using a Field Experiment to Estimate the Causal Impact of Neighborhoods," Working Papers 2020-187, Becker Friedman Institute for Research In Economics.
    13. Denis Fougère & Nicolas Jacquemet, 2020. "Policy Evaluation Using Causal Inference Methods," SciencePo Working papers Main hal-03455978, HAL.
    14. Elias Bouacida & Renaud Foucart, 2022. "Rituals of Reason," Working Papers 344119591, Lancaster University Management School, Economics Department.
    15. Maurizio Canavari & Andreas C. Drichoutis & Jayson L. Lusk & Rodolfo M. Nayga, Jr., 2018. "How to run an experimental auction: A review of recent advances," Working Papers 2018-5, Agricultural University of Athens, Department Of Agricultural Economics.
    16. James R. Stevenson & Karen Macours & Douglas Gollin, 2023. "The Rigor Revolution: New Standards of Evidence for Impact Assessment of International Agricultural Research," Annual Review of Resource Economics, Annual Reviews, vol. 15(1), pages 495-515, October.
    17. James Derbyshire & Mandeep Dhami & Ian Belton & Dilek Önkal, 2023. "The value of experiments in futures and foresight science as illustrated by the case of scenario planning," Futures & Foresight Science, John Wiley & Sons, vol. 5(2), June.
    18. Mujcic, Redzo & Powdthavee, Nattavudh, 2022. "How Do Humans Respond to Huge Financial Losses?," IZA Discussion Papers 15536, Institute of Labor Economics (IZA).
    19. Vikram Dayal & Anand Murugesan, 2020. "Demystifying causal inference: ingredients of a recipe," IEG Working Papers 393, Institute of Economic Growth.
    20. Guido W. Imbens, 2020. "Potential Outcome and Directed Acyclic Graph Approaches to Causality: Relevance for Empirical Practice in Economics," Journal of Economic Literature, American Economic Association, vol. 58(4), pages 1129-1179, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0281259. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.