IDEAS home Printed from https://ideas.repec.org/p/ifs/ifsewp/16-23.html

‘Randomisation bias’ in the medical literature: a review

Author

Listed:
  • Barbara Sianesi

    (Institute for Fiscal Studies and Institute for Fiscal Studies)

Abstract

Randomised controlled or clinical trials (RCTs) are generally viewed as the most reliable method to draw causal inference as to the effects of a treatment, as they should guarantee that the individuals being compared differ only in terms of their exposure to the treatment of interest. This ‘gold standard’ result however hinges on the requirement that the randomisation device determines the random allocation of individuals to the treatment without affecting any other element of the causal model. This ‘no randomisation bias’ assumption is generally untestable but if violated would undermine the causal inference emerging from an RCT, both in terms of its internal validity and in terms of its relevance for policy purposes. This paper offers a concise review of how the medical literature identifies and deals with such issues.

Suggested Citation

  • Barbara Sianesi, 2016. "‘Randomisation bias’ in the medical literature: a review," IFS Working Papers W16/23, Institute for Fiscal Studies.
    • Handle: RePEc:ifs:ifsewp:16/23
    as

    Download full text from publisher

    File URL: https://www.ifs.org.uk/uploads/publications/wps/WP201623.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Glasgow, R.E. & Vogt, T.M. & Boles, S.M., 1999. "Evaluating the public health impact of health promotion interventions: The RE-AIM framework," American Journal of Public Health, American Public Health Association, vol. 89(9), pages 1322-1327.
    2. Hunt Allcott, 2012. "Site Selection Bias in Program Evaluation," NBER Working Papers 18373, National Bureau of Economic Research, Inc.
    3. Barbara Sianesi, 2014. "Dealing with randomisation bias in a social experiment: the case of ERA," IFS Working Papers W14/10, Institute for Fiscal Studies.
    4. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    5. Bower, Peter & King, Michael & Nazareth, Irwin & Lampe, Fiona & Sibbald, Bonnie, 2005. "Patient preferences in randomised controlled trials: Conceptual framework and implications for research," Social Science & Medicine, Elsevier, vol. 61(3), pages 685-695, August.
    6. James J. Heckman & Jeffrey A. Smith, 1998. "Evaluating the Welfare State," NBER Working Papers 6542, National Bureau of Economic Research, Inc.
    7. Joseph Hotz, V. & Imbens, Guido W. & Mortimer, Julie H., 2005. "Predicting the efficacy of future training programs using past experiences at other locations," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 241-270.
    8. James Heckman, 2013. "Sample selection bias as a specification error," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 31(3), pages 129-137.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sianesi, Barbara, 2017. "Evidence of randomisation bias in a large-scale social experiment: The case of ERA," Journal of Econometrics, Elsevier, vol. 198(1), pages 41-64.
    2. Jeffrey Smith & Arthur Sweetman, 2016. "Viewpoint: Estimating the causal effects of policies and programs," Canadian Journal of Economics, Canadian Economics Association, vol. 49(3), pages 871-905, August.
    3. James J. Heckman, 2008. "Econometric Causality," International Statistical Review, International Statistical Institute, vol. 76(1), pages 1-27, April.
    4. James J. Heckman, 2005. "Micro Data, Heterogeneity and the Evaluation of Public Policy Part 2," The American Economist, Sage Publications, vol. 49(1), pages 16-44, March.
    5. Jean-Pierre Florens & James Heckman & Costas Meghir & Edward Vytlacil, 2002. "Instrumental variables, local instrumental variables and control functions," CeMMAP working papers CWP15/02, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    6. Paul Hunermund & Elias Bareinboim, 2019. "Causal Inference and Data Fusion in Econometrics," Papers 1912.09104, arXiv.org, revised Mar 2023.
    7. Mogstad, Magne & Torgovitsky, Alexander & Walters, Christopher R., 2024. "Policy evaluation with multiple instrumental variables," Journal of Econometrics, Elsevier, vol. 243(1).
    8. Timothy B. Armstrong & Michal Kolesár, 2021. "Sensitivity analysis using approximate moment condition models," Quantitative Economics, Econometric Society, vol. 12(1), pages 77-108, January.
    9. Manuel Arellano & Stéphane Bonhomme, 2017. "Quantile Selection Models With an Application to Understanding Changes in Wage Inequality," Econometrica, Econometric Society, vol. 85, pages 1-28, January.
    10. Sokbae Lee & Bernard Salanié, 2018. "Identifying Effects of Multivalued Treatments," Econometrica, Econometric Society, vol. 86(6), pages 1939-1963, November.
    11. Salanié, Bernard & Lee, Sokbae, 2020. "Filtered and Unfiltered Treatment Effects with Targeting Instruments," CEPR Discussion Papers 15092, C.E.P.R. Discussion Papers.
    12. Eva Deuchert & Martin Huber, 2017. "A Cautionary Tale About Control Variables in IV Estimation," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 79(3), pages 411-425, June.
    13. Albert Saiz & Elena Zoido, 2002. "The returns to speaking a second language," Working Papers 02-16, Federal Reserve Bank of Philadelphia.
    14. Peter Hull & Michal Kolesár & Christopher Walters, 2022. "Labor by design: contributions of David Card, Joshua Angrist, and Guido Imbens," Scandinavian Journal of Economics, Wiley Blackwell, vol. 124(3), pages 603-645, July.
    15. Tamini, Lota D., 2011. "A nonparametric analysis of the impact of agri-environmental advisory activities on best management practice adoption: A case study of Québec," Ecological Economics, Elsevier, vol. 70(7), pages 1363-1374, May.
    16. Huber, Martin & Meier, Jonas & Wallimann, Hannes, 2022. "Business analytics meets artificial intelligence: Assessing the demand effects of discounts on Swiss train tickets," Transportation Research Part B: Methodological, Elsevier, vol. 163(C), pages 22-39.
    17. Sun, Hao & Wang, Hai & Wan, Zhixi, 2019. "Model and analysis of labor supply for ride-sharing platforms in the presence of sample self-selection and endogeneity," Transportation Research Part B: Methodological, Elsevier, vol. 125(C), pages 76-93.
    18. Imbens, Guido W., 2014. "Instrumental Variables: An Econometrician's Perspective," IZA Discussion Papers 8048, IZA Network @ LISER.
    19. Richard Blundell & Lorraine Dearden & Barbara Sianesi, 2003. "Evaluating the impact of education on earnings in the UK: Models, methods and results from the NCDS," IFS Working Papers W03/20, Institute for Fiscal Studies.
    20. Rupert, Peter & Zanella, Giulio, 2018. "Grandchildren and their grandparents' labor supply," Journal of Public Economics, Elsevier, vol. 159(C), pages 89-103.

    More about this item

    Keywords

    ;
    ;

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ifs:ifsewp:16/23. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Emma Hyman (email available below). General contact details of provider: https://edirc.repec.org/data/ifsssuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.