IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0231670.html
   My bibliography  Save this article

Confounding adjustment performance of ordinal analysis methods in stroke studies

Author

Listed:
  • Thomas P Zonneveld
  • Annette Aigner
  • Rolf H H Groenwold
  • Ale Algra
  • Paul J Nederkoorn
  • Ulrike Grittner
  • Nyika D Kruyt
  • Bob Siegerink

Abstract

Background: In stroke studies, ordinal logistic regression (OLR) is often used to analyze outcome on the modified Rankin Scale (mRS), whereas the non-parametric Mann-Whitney measure of superiority (MWS) has also been suggested. It is unclear how these perform comparatively when confounding adjustment is warranted. Aims: Our aim is to quantify the performance of OLR and MWS in different confounding variable settings. Methods: We set up a simulation study with three different scenarios; (1) dichotomous confounding variables, (2) continuous confounding variables, and (3) confounding variable settings mimicking a study on functional outcome after stroke. We compared adjusted ordinal logistic regression (aOLR) and stratified Mann-Whitney measure of superiority (sMWS), and also used propensity scores to stratify the MWS (psMWS). For comparability, OLR estimates were transformed to a MWS. We report bias, the percentage of runs that produced a point estimate deviating by more than 0.05 points (point estimate variation), and the coverage probability. Results: In scenario 1, there was no bias in both sMWS and aOLR, with similar point estimate variation and coverage probabilities. In scenario 2, sMWS resulted in more bias (0.04 versus 0.00), and higher point estimate variation (41.6% versus 3.3%), whereas coverage probabilities were similar. In scenario 3, there was no bias in both methods, point estimate variation was higher in the sMWS (6.7%) versus aOLR (1.1%), and coverage probabilities were 0.98 (sMWS) versus 0.95 (aOLR). With psMWS, bias remained 0.00, with less point estimate variation (1.5%) and a coverage probability of 0.95. Conclusions: The bias of both adjustment methods was similar in our stroke simulation scenario, and the higher point estimate variation in the MWS improved with propensity score based stratification. The stratified MWS is a valid alternative for adjusted OLR only when the ratio of number of strata versus number of observations is relatively low, but propensity score based stratification extends the application range of the MWS.

Suggested Citation

  • Thomas P Zonneveld & Annette Aigner & Rolf H H Groenwold & Ale Algra & Paul J Nederkoorn & Ulrike Grittner & Nyika D Kruyt & Bob Siegerink, 2020. "Confounding adjustment performance of ordinal analysis methods in stroke studies," PLOS ONE, Public Library of Science, vol. 15(4), pages 1-10, April.
    • Handle: RePEc:plo:pone00:0231670
    DOI: 10.1371/journal.pone.0231670
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0231670
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0231670&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0231670?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Richard Williams, 2006. "Generalized ordered logit/partial proportional odds models for ordinal dependent variables," Stata Journal, StataCorp LLC, vol. 6(1), pages 58-82, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mengyuan Zhou, 2022. "Does the Source of Inheritance Matter in Bequest Attitudes? Evidence from Japan," Journal of Family and Economic Issues, Springer, vol. 43(4), pages 867-887, December.
    2. Yuri Reina-Aranza, 2015. "Violencia de pareja y estado de salud de la mujer en Colombia," Documentos de Trabajo Sobre Economía Regional y Urbana 13964, Banco de la República, Economía Regional.
    3. Cristina Chaminade & Monica Plechero, 2015. "Do Regions Make a Difference? Regional Innovation Systems and Global Innovation Networks in the ICT Industry," European Planning Studies, Taylor & Francis Journals, vol. 23(2), pages 215-237, February.
    4. Bruno Amable, 2009. "The Differentiation of Social Demands in Europe. The Social Basis of the European Models of Capitalism," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 91(3), pages 391-426, May.
    5. Giuseppina Guagnano & Elisabetta Santarelli & Isabella Santini, 2016. "Can Social Capital Affect Subjective Poverty in Europe? An Empirical Analysis Based on a Generalized Ordered Logit Model," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 128(2), pages 881-907, September.
    6. Hanna Dudek & Joanna Landmesser, 2012. "Income satisfaction and relative deprivation," Statistics in Transition new series, Główny Urząd Statystyczny (Polska), vol. 13(2), pages 321-334, June.
    7. Yahui Wang, 2019. "What Affects Participation in the Farmland Rental Market in Rural China? Evidence from CHARLS," Sustainability, MDPI, vol. 11(24), pages 1-15, December.
    8. Joachim Wagner, 2009. "Exporte und Firmenerfolg: Welche Firmen profitieren wie vom internationalen Handel?," AStA Wirtschafts- und Sozialstatistisches Archiv, Springer;Deutsche Statistische Gesellschaft - German Statistical Society, vol. 3(2), pages 109-122, October.
    9. Charlie Tchinda & Marcus Dejardin, 2021. "Are Business Policy Measures in Response to the COVID-19 Pandemic to Be Equally Valued? An Exploration According to SMEs Owners’ Business Expectations," Sustainability, MDPI, vol. 13(21), pages 1-42, October.
    10. Woo, C.K. & Zarnikau, J. & Moore, J. & Horowitz, I., 2011. "Wind generation and zonal-market price divergence: Evidence from Texas," Energy Policy, Elsevier, vol. 39(7), pages 3928-3938, July.
    11. Wixe, Sofia & Nilsson, Pia & Naldi, Lucia & Westlund, Hans, 2017. "Disentangling Innovation in Small Food Firms: The role of External Knowledge, Support, and Collaboration," Working Paper Series in Economics and Institutions of Innovation 446, Royal Institute of Technology, CESIS - Centre of Excellence for Science and Innovation Studies.
    12. Sofia Wixe & Pia Nilsson & Lucia Naldi & Hans Westlund, 2023. "The role of collaboration and external knowledge for innovation in small food firms," The Annals of Regional Science, Springer;Western Regional Science Association, vol. 70(1), pages 135-155, February.
    13. Hong Leng & Bingbing Han, 2022. "Effect of Environmental Planning on Elderly Individual Quality of Life in Severe Cold Regions: A Case Study in Northeastern China," Sustainability, MDPI, vol. 14(6), pages 1-17, March.
    14. Nilsson, Helena & Backman, Mikaela & Öner, Özge, 2020. "Towards a life after retail? The relationship between human capital and career outcomes in retail," HFI Working Papers 15, Institute of Retail Economics (Handelns Forskningsinstitut).
    15. Devillanova, Carlo & Raitano, Michele & Struffolino, Emanuela, 2019. "Longitudinal employment trajectories and health in middle life: Insights from linked administrative and survey data," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 40, pages 1375-1412.
    16. Dusanee Kesavayuth & Robert Rosenman & Vasileios Zikos, 2013. "Does Personality Affect how People Perceive their Health?," Working Papers 2013-13, School of Economic Sciences, Washington State University.
    17. Maciej Kostrzewski & Jadwiga Kostrzewska, 2021. "The Impact of Forecasting Jumps on Forecasting Electricity Prices," Energies, MDPI, vol. 14(2), pages 1-17, January.
    18. Brancati, Emanuele, 2013. "Innovation, financial constraints and relationship lending: evidence from Italy during the recent crises," MPRA Paper 50329, University Library of Munich, Germany.
    19. Catalina Martínez & Laura Cruz-Castro & Luis Sanz-Menéndez, 2016. "Innovation capabilities in the private sector: evaluating subsidies for hiring S&T workers in Spain," Research Evaluation, Oxford University Press, vol. 25(2), pages 196-208.
    20. Sarah Brown & Jennifer Roberts & Karl Taylor, 2010. "Reservation wages, labour market participation and health," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 173(3), pages 501-529, July.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0231670. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.