IDEAS home Printed from https://ideas.repec.org/a/sae/evarev/v39y2015i6p527-554.html
   My bibliography  Save this article

Testing for Response Shift Bias in Evaluations of School Antibullying Programs

Author

Listed:
  • Thérèse Shaw
  • Donna Cross
  • Stephen R. Zubrick

Abstract

Background: Involvement in bullying at school is detrimental to students’ mental and physical health; however, school antibullying programs have not been found to be uniformly successful. Self-reported frequency of involvement in bullying victimization and perpetration, often used as outcome measures in intervention impact evaluation studies, may be subject to response shift, particularly in intervention conditions. Such differential shifts could lead to biased estimates of intervention effects. Objectives: This study investigated the presence of reconceptualization, reprioritization, and recalibration response shift, resulting from intervention implementation. Method: The study subjects were Grade 8 students ( n = 3,382, 53% female) in the 35 schools participating in the Cyber Friendly Schools Project, a longitudinal group-randomized intervention trial. Response shift was assessed by comparing traditional and retrospective pretest measures of bullying involvement, as well as testing for measurement invariance over time in the Forms of Bullying Scale (FBS) using confirmatory factor analyses. Results: No evidence of response shift was found, indicating students’ understandings of bullying behavior remained stable over time. These findings also demonstrate the applicability of the FBS in longitudinal studies involving adolescents. Conclusion: While response shift was not present in our study, researchers conducting program evaluations in other contexts are advised to consider testing for this potential source of bias in their studies.

Suggested Citation

  • Thérèse Shaw & Donna Cross & Stephen R. Zubrick, 2015. "Testing for Response Shift Bias in Evaluations of School Antibullying Programs," Evaluation Review, , vol. 39(6), pages 527-554, December.
    • Handle: RePEc:sae:evarev:v:39:y:2015:i:6:p:527-554
    DOI: 10.1177/0193841X16629863
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0193841X16629863
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0193841X16629863?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Schwartz, Carolyn E. & Sprangers, Mirjam A. G., 1999. "Methodological approaches for assessing response shift in longitudinal health-related quality-of-life research," Social Science & Medicine, Elsevier, vol. 48(11), pages 1531-1548, June.
    2. B. King-Kallimanis & F. Oort & G. Garst, 2010. "Using structural equation modelling to detect measurement bias and response shift in longitudinal data," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 94(2), pages 139-156, June.
    3. Sprangers, Mirjam A. G. & Schwartz, Carolyn E., 1999. "Integrating response shift into health-related quality of life research: a theoretical model," Social Science & Medicine, Elsevier, vol. 48(11), pages 1507-1515, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Damschroder, Laura J. & Zikmund-Fisher, Brian J. & Ubel, Peter A., 2005. "The impact of considering adaptation in health state valuation," Social Science & Medicine, Elsevier, vol. 61(2), pages 267-277, July.
    2. Mohamed Boucekine & Laurent Boyer & Karine Baumstarck & Aurelie Millier & Badih Ghattas & Pascal Auquier & Mondher Toumi, 2015. "Exploring the Response Shift Effect on the Quality of Life of Patients with Schizophrenia," Medical Decision Making, , vol. 35(3), pages 388-397, April.
    3. Astrid Wahl & Tone Rustøen & Berit Hanestad & Eva Gjengedal & Torbjørn Moum, 2005. "Self-Efficacy, Pulmonary Function, Perceived Health and Global Quality of Life of Cystic Fibrosis Patients," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 72(2), pages 239-261, June.
    4. Carolyn Schwartz & Penelope Keyl & John Marcum & Rita Bode, 2009. "Helping Others Shows Differential Benefits on Health and Well-being for Male and Female Teens," Journal of Happiness Studies, Springer, vol. 10(4), pages 431-448, August.
    5. Valentina Piwowar & Felicitas Thiel, 2014. "Evaluating Response Shift in Training Evaluation," Evaluation Review, , vol. 38(5), pages 420-448, October.
    6. Wim Groot, 2003. "Scale of reference bias and the evolution of health," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 4(3), pages 176-183, September.
    7. Rissanen, Ritva & Warnqvist, Anna & Hasselberg, Marie, 2023. "“I knew who I was this morning, but I've changed a few times since then”: A study combining register and self-reported QoL data in assessing how response shift may occur in an injury population," Social Science & Medicine, Elsevier, vol. 326(C).
    8. Richard Milne & Kathy Heaton-Brown & Paul Hansen & David Thomas & Vernon Harvey & Alison Cubitt, 2006. "Quality-of-Life Valuations of Advanced Breast Cancer by New Zealand Women," PharmacoEconomics, Springer, vol. 24(3), pages 281-292, March.
    9. Nick Bansback & Huiying Sun & Daphne P. Guh & Xin Li & Bohdan Nosyk & Susan Griffin & Paul G. Barnett & Aslam H. Anis, 2008. "Impact of the recall period on measuring health utilities for acute events," Health Economics, John Wiley & Sons, Ltd., vol. 17(12), pages 1413-1419.
    10. Svenja M. Spuling & Oliver Huxhold & Susanne Wurm, 2017. "Predictors of Self-Rated Health: Does Education Play a Role Above and Beyond Age?," The Journals of Gerontology: Series B, The Gerontological Society of America, vol. 72(3), pages 415-424.
    11. Patricia Cubí‐Mollá & Mireia Jofre‐Bonet & Victoria Serra‐Sastre, 2017. "Adaptation to health states: Sick yet better off?," Health Economics, John Wiley & Sons, Ltd., vol. 26(12), pages 1826-1843, December.
    12. Julie Yun Chen & Eric Yuk Fai Wan & Edmond Pui Hang Choi & Anca Ka Chun Chan & Karina Hiu Yen Chan & Joyce Pui Yan Tsang & Cindy Lo Kuen Lam, 2017. "The Health-Related Quality of Life of Chinese Patients on Hemodialysis and Peritoneal Dialysis," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 10(6), pages 799-808, December.
    13. Markus Wettstein & Hans-Werner Wahl & Anna Schlomann, 2022. "The Impact of the COVID-19 Pandemic on Trajectories of Well-Being of Middle-Aged and older Adults: A Multidimensional and Multidirectional Perspective," Journal of Happiness Studies, Springer, vol. 23(7), pages 3577-3604, October.
    14. Joseph T. King Jr. & Joel Tsevat & Judith R. Lave & Mark S. Roberts, 2005. "Willingness to Pay for a Quality-Adjusted Life Year: Implications for Societal Health Care Resource Allocation," Medical Decision Making, , vol. 25(6), pages 667-677, November.
    15. de Hond, Anne & Bakx, Pieter & Versteegh, Matthijs, 2019. "Can time heal all wounds? An empirical assessment of adaptation to functional limitations in an older population," Social Science & Medicine, Elsevier, vol. 222(C), pages 180-187.
    16. Chia-Huei Wu, 2009. "Enhancing quality of life by shifting importance perception among life domains," Journal of Happiness Studies, Springer, vol. 10(1), pages 37-47, March.
    17. Fereshteh Ghahramani & Jingguo Wang, 2020. "Impact of Smartphones on Quality of Life: A Health Information Behavior Perspective," Information Systems Frontiers, Springer, vol. 22(6), pages 1275-1290, December.
    18. Giorgio Eduardo Montanari & Marco Doretti & Maria Francesca Marino, 2022. "Model-based two-way clustering of second-level units in ordinal multilevel latent Markov models," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 16(2), pages 457-485, June.
    19. Rasolofoson, Ranaivo A. & Nielsen, Martin R. & Jones, Julia P.G., 2018. "The potential of the Global Person Generated Index for evaluating the perceived impacts of conservation interventions on subjective well-being," World Development, Elsevier, vol. 105(C), pages 107-118.
    20. Nele Van Hecke & Claudia Claes & Wouter Vanderplasschen & Jessica De Maeyer & Nico De Witte & Stijn Vandevelde, 2018. "Conceptualisation and Measurement of Quality of Life Based on Schalock and Verdugo’s Model: A Cross-Disciplinary Review of the Literature," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 137(1), pages 335-351, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:evarev:v:39:y:2015:i:6:p:527-554. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.