IDEAS home Printed from https://ideas.repec.org/a/spr/psycho/v81y2016i4d10.1007_s11336-015-9476-7.html
   My bibliography  Save this article

Detection of Test Speededness Using Change-Point Analysis

Author

Listed:
  • Can Shao

    (University of Notre Dame)

  • Jun Li

    (University of Notre Dame)

  • Ying Cheng

    (University of Notre Dame)

Abstract

Change-point analysis (CPA) is a well-established statistical method to detect abrupt changes, if any, in a sequence of data. In this paper, we propose a procedure based on CPA to detect test speededness. This procedure is not only able to classify examinees into speeded and non-speeded groups, but also identify the point at which an examinee starts to speed. Identification of the change point can be very useful. First, it informs decision makers of the appropriate length of a test. Second, by removing the speeded responses, instead of the entire response sequence of an examinee suspected of speededness, ability estimation can be improved. Simulation studies show that this procedure is efficient in detecting both speeded examinees and the speeding point. Ability estimation is dramatically improved by removing speeded responses identified by our procedure. The procedure is then applied to a real dataset for illustration purpose.

Suggested Citation

  • Can Shao & Jun Li & Ying Cheng, 2016. "Detection of Test Speededness Using Change-Point Analysis," Psychometrika, Springer;The Psychometric Society, vol. 81(4), pages 1118-1141, December.
    • Handle: RePEc:spr:psycho:v:81:y:2016:i:4:d:10.1007_s11336-015-9476-7
    DOI: 10.1007/s11336-015-9476-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11336-015-9476-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11336-015-9476-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Armin Schwartzman & Xihong Lin, 2011. "The effect of correlation in false discovery rate estimation," Biometrika, Biometrika Trust, vol. 98(1), pages 199-214.
    2. John D. Storey & Jonathan E. Taylor & David Siegmund, 2004. "Strong control, conservative point estimation and simultaneous conservative consistency of false discovery rates: a unified approach," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(1), pages 187-205, February.
    3. Andrews, Donald W K, 1993. "Tests for Parameter Instability and Structural Change with Unknown Change Point," Econometrica, Econometric Society, vol. 61(4), pages 821-856, July.
    4. Yuri Goegebeur & Paul Boeck & James Wollack & Allan Cohen, 2008. "A Speeded Item Response Model with Gradual Process Change," Psychometrika, Springer;The Psychometric Society, vol. 73(1), pages 65-87, March.
    5. Ivo Molenaar & Herbert Hoijtink, 1990. "The many null distributions of person fit indices," Psychometrika, Springer;The Psychometric Society, vol. 55(1), pages 75-106, March.
    6. Jeff Douglas & Hae Rim Kim & Brian Habing & Furong Gao, 1998. "Investigating Local Dependence With Conditional Covariance Functions," Journal of Educational and Behavioral Statistics, , vol. 23(2), pages 129-151, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hongyue Zhu & Hong Jiao & Wei Gao & Xiangbin Meng, 2023. "Bayesian Change-Point Analysis Approach to Detecting Aberrant Test-Taking Behavior Using Response Times," Journal of Educational and Behavioral Statistics, , vol. 48(4), pages 490-520, August.
    2. Maxwell Hong & Lizhen Lin & Ying Cheng, 2021. "Asymptotically Corrected Person Fit Statistics for Multidimensional Constructs with Simple Structure and Mixed Item Types," Psychometrika, Springer;The Psychometric Society, vol. 86(2), pages 464-488, June.
    3. Jeffrey M. Patton & Ying Cheng & Maxwell Hong & Qi Diao, 2019. "Detection and Treatment of Careless Responses to Improve Item Parameter Estimation," Journal of Educational and Behavioral Statistics, , vol. 44(3), pages 309-341, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jianqing Fan & Xu Han, 2017. "Estimation of the false discovery proportion with unknown dependence," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(4), pages 1143-1164, September.
    2. Ghosh Debashis, 2012. "Incorporating the Empirical Null Hypothesis into the Benjamini-Hochberg Procedure," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 11(4), pages 1-21, July.
    3. Sairam Rayaprolu & Zhiyi Chi, 2021. "False Discovery Variance Reduction in Large Scale Simultaneous Hypothesis Tests," Methodology and Computing in Applied Probability, Springer, vol. 23(3), pages 711-733, September.
    4. Chen, Xiongzhi & Doerge, R.W., 2020. "A strong law of large numbers related to multiple testing normal means," Statistics & Probability Letters, Elsevier, vol. 159(C).
    5. Chen, Xiongzhi, 2020. "A strong law of large numbers for simultaneously testing parameters of Lancaster bivariate distributions," Statistics & Probability Letters, Elsevier, vol. 167(C).
    6. Joshy Easaw & Roberto Golinelli, 2022. "Professionals Inflation Forecasts: The Two Dimensions Of Forecaster Inattentiveness [“Sectoral and aggregate inflation dynamics in the euro area”]," Oxford Economic Papers, Oxford University Press, vol. 74(3), pages 701-720.
    7. Bernard, Jean-Thomas & Idoudi, Nadhem & Khalaf, Lynda & Yelou, Clement, 2007. "Finite sample multivariate structural change tests with application to energy demand models," Journal of Econometrics, Elsevier, vol. 141(2), pages 1219-1244, December.
    8. Zheng, Li & Abbasi, Kashif Raza & Salem, Sultan & Irfan, Muhammad & Alvarado, Rafael & Lv, Kangjuan, 2022. "How technological innovation and institutional quality affect sectoral energy consumption in Pakistan? Fresh policy insights from novel econometric approach," Technological Forecasting and Social Change, Elsevier, vol. 183(C).
    9. Jan Gottschalk & Ulrich Fritsche, 2005. "The New Keynesian Model and the Long-Run Vertical Phillips Curve: Does It Hold for Germany?," Discussion Papers of DIW Berlin 521, DIW Berlin, German Institute for Economic Research.
    10. Rasmus Fatum & Jesper Pedersen & Peter Norman Sørensen, 2010. "Are the Intraday Effects of Central Bank Intervention on Exchange Rate Spreads Asymmetric and State Dependent?," Discussion Papers 10-20, University of Copenhagen. Department of Economics.
    11. Candelon, Bertrand & Lieb, Lenard, 2013. "Fiscal policy in good and bad times," Journal of Economic Dynamics and Control, Elsevier, vol. 37(12), pages 2679-2694.
    12. González-Rivera, Gloria & Sun, Yingying, 2017. "Density forecast evaluation in unstable environments," International Journal of Forecasting, Elsevier, vol. 33(2), pages 416-432.
    13. Neely, Christopher J. & Weller, Paul, 2000. "Predictability in International Asset Returns: A Reexamination," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 35(4), pages 601-620, December.
    14. Baum, Christopher F & Karasulu, Meral, 1998. "Modelling Federal Reserve Discount Policy," Computational Economics, Springer;Society for Computational Economics, vol. 11(1-2), pages 53-70, April.
    15. Guntram B. Wolff & Alexander Schulz, 2008. "Sovereign bond market integration: the euro, trading platforms and globalisation," European Economy - Economic Papers 2008 - 2015 332, Directorate General Economic and Financial Affairs (DG ECFIN), European Commission.
    16. Garcia, Rene, 1998. "Asymptotic Null Distribution of the Likelihood Ratio Test in Markov Switching Models," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(3), pages 763-788, August.
    17. Franses, P.H. & McAleer, M., 1995. "Testing Nested and Non-Nested Periodically Integrated Autoregressive Models," Papers 9510, Tilburg - Center for Economic Research.
    18. Shinhye Chang & Rangan Gupta & Stephen M. Miller, 2018. "Causality Between Per Capita Real GDP and Income Inequality in the U.S.: Evidence from a Wavelet Analysis," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 135(1), pages 269-289, January.
    19. Aslanidis, Nektarios, 2007. "Business Cycle Regimes in CEECs Production: A Threshold SURE Approach," Working Papers 2072/5318, Universitat Rovira i Virgili, Department of Economics.
    20. Pierre Perron & Yohei Yamamoto, 2022. "Structural change tests under heteroskedasticity: Joint estimation versus two‐steps methods," Journal of Time Series Analysis, Wiley Blackwell, vol. 43(3), pages 389-411, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:psycho:v:81:y:2016:i:4:d:10.1007_s11336-015-9476-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.