IDEAS home Printed from https://ideas.repec.org/a/sae/sagope/v6y2016i3p2158244016659905.html
   My bibliography  Save this article

Three Tales of Change

Author

Listed:
  • Nikolaus Bezruczko
  • Serah S. Fatani
  • Noriko Magari

Abstract

When could it be safe to report ordinal scores instead of linear measures? In this study, preschool gains measured with ordinal scores were compared with residualized gain scores, as well as Rasch model measures of linear change (logits) to clarify respective implications for objectivity, precision, validity, and meaningfulness. Results showed that ordinal scores and linear gains were highly correlated (~.90), and specific conditions were identified such as pre-test score distributions, pre-test variability, and overall test targeting that determine complementarity of ordinal scores and linear scale values for reporting achievement gains. Several properties of ordinal score gains were discussed, including negative correlation between gain and pre-test, unreliability of gains, and usefulness of residualized gains. This report concludes by supporting interchangeability of ordinal scores and objective, linear measures when appraisal of complementarity is supervised by principles of mathematical logic.

Suggested Citation

  • Nikolaus Bezruczko & Serah S. Fatani & Noriko Magari, 2016. "Three Tales of Change," SAGE Open, , vol. 6(3), pages 21582440166, July.
    • Handle: RePEc:sae:sagope:v:6:y:2016:i:3:p:2158244016659905
    DOI: 10.1177/2158244016659905
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/2158244016659905
    Download Restriction: no
    File URL: https://libkey.io/10.1177/2158244016659905?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. David Rogosa & John Willett, 1985. "Understanding correlates of change by modeling individual differences in growth," Psychometrika, Springer;The Psychometric Society, vol. 50(2), pages 203-228, June.
    2. Susan Embretson (Whitely), 1984. "A general latent trait model for response processes," Psychometrika, Springer;The Psychometric Society, vol. 49(2), pages 175-186, June.
    3. Binder, Arnold, 1984. "Restrictions on statistics imposed by method of measurement: Some reality, much mythology," Journal of Criminal Justice, Elsevier, vol. 12(5), pages 467-481.
    4. Donald Zimmerman & Richard Williams, 1982. "The relative error magnitude in three measures of change," Psychometrika, Springer;The Psychometric Society, vol. 47(2), pages 141-147, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jason Barabas, 1998. "Wage Erosion, Economic Assessments, and Social Welfare Opinions," JCPR Working Papers 56, Northwestern University/University of Chicago Joint Center for Poverty Research.
    2. Nana Kim & Daniel M. Bolt & James Wollack, 2022. "Noncompensatory MIRT For Passage-Based Tests," Psychometrika, Springer;The Psychometric Society, vol. 87(3), pages 992-1009, September.
    3. Acedo, Francisco J. & Coviello, Nicole & Agustí, María, 2021. "Caution ahead! The long-term effects of initial export intensity and geographic dispersion on INV development," Journal of World Business, Elsevier, vol. 56(6).
    4. Federico Aime & Aaron D. Hill & Jason W. Ridge, 2020. "Looking for respect? How prior TMT social comparisons affect executives' new TMT engagements," Strategic Management Journal, Wiley Blackwell, vol. 41(12), pages 2185-2199, December.
    5. Janota, Jessica J. & Broussard, Shorna R., 2008. "Examining private forest policy preferences," Forest Policy and Economics, Elsevier, vol. 10(3), pages 89-97, January.
    6. Peter Congdon & John Shepherd, 1988. "Components of Social Change in Urban Areas," Urban Studies, Urban Studies Journal Limited, vol. 25(3), pages 173-189, June.
    7. Sora Lee & Daniel M. Bolt, 2018. "Asymmetric Item Characteristic Curves and Item Complexity: Insights from Simulation and Real Data Analyses," Psychometrika, Springer;The Psychometric Society, vol. 83(2), pages 453-475, June.
    8. Katherine E. Castellano & Andrew D. Ho, 2015. "Practical Differences Among Aggregate-Level Conditional Status Metrics," Journal of Educational and Behavioral Statistics, , vol. 40(1), pages 35-68, February.
    9. Kaestner, Robert & Grossman, Michael, 2009. "Effects of weight on children's educational achievement," Economics of Education Review, Elsevier, vol. 28(6), pages 651-661, December.
    10. Tenko Raykov, 2001. "On the Use and Utility of the Reliability Coefficient in Social and Behavioral Research," Quality & Quantity: International Journal of Methodology, Springer, vol. 35(3), pages 253-263, August.
    11. Li, Xiaoming & Harrison, Sayward E. & Fairchild, Amanda J. & Chi, Peilian & Zhao, Junfeng & Zhao, Guoxiang, 2017. "A randomized controlled trial of a resilience-based intervention on psychosocial well-being of children affected by HIV/AIDS: Effects at 6- and 12-month follow-up," Social Science & Medicine, Elsevier, vol. 190(C), pages 256-264.
    12. Hess, Brian, 2000. "Assessing program impact using latent growth modeling: a primer for the evaluator," Evaluation and Program Planning, Elsevier, vol. 23(4), pages 419-428, November.
    13. Ping Chen, 2017. "A Comparative Study of Online Item Calibration Methods in Multidimensional Computerized Adaptive Testing," Journal of Educational and Behavioral Statistics, , vol. 42(5), pages 559-590, October.
    14. Elizabeth Ayers & Sophia Rabe-Hesketh & Rebecca Nugent, 2013. "Incorporating Student Covariates in Cognitive Diagnosis Models," Journal of Classification, Springer;The Classification Society, vol. 30(2), pages 195-224, July.
    15. Michael J. Shanahan & Adam Davey & Jennifer Brooks, 1998. "Dynamic Models of Poverty and Psychosocial Adjustment through Childhood," JCPR Working Papers 49, Northwestern University/University of Chicago Joint Center for Poverty Research.
    16. Cheng-Hsuan Li & Yi-Jin Ju & Pei-Jyun Hsieh, 2022. "A Nonparametric Weighted Cognitive Diagnosis Model and Its Application on Remedial Instruction in a Small-Class Situation," Sustainability, MDPI, vol. 14(10), pages 1-17, May.
    17. Tenko Raykov, 1995. "On statistical approaches to the study of the “Law of Initial Values”," Quality & Quantity: International Journal of Methodology, Springer, vol. 29(3), pages 251-271, August.
    18. Robert Kaestner & Hope Corman, 1995. "The Impact of Child Health and Family Inputs on Child Cognitive Develop-ment," NBER Working Papers 5257, National Bureau of Economic Research, Inc.
    19. Nkafu Anumendem & Bieke De Fraine & Patrick Onghena & Jan Van Damme, 2013. "The impact of coding time on the estimation of school effects," Quality & Quantity: International Journal of Methodology, Springer, vol. 47(2), pages 1021-1040, February.
    20. William Meredith & John Tisak, 1990. "Latent curve analysis," Psychometrika, Springer;The Psychometric Society, vol. 55(1), pages 107-122, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:sagope:v:6:y:2016:i:3:p:2158244016659905. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.