IDEAS home Printed from https://ideas.repec.org/p/hub/wpecon/200940.html
   My bibliography  Save this paper

Going beyond the detection of differential item functioning in tests for personnel selection

Author

Listed:
  • Meulders, Michel

    (Hogeschool-Universiteit Brussel (HUB), Belgium)

  • De Boeck, Paul

    (Katholieke Universiteit Leuven)

  • Vandenberk, Miek

    (Katholieke Universiteit Leuven)

Abstract

Differential item functioning (DIF) occurs when persons with equal ability who belong to different groups have a different probability to correctly solve an item of a certain test. As the occurrence of DIF is considered a serious problem when using tests for personnel selection, many procedures have been developed for detecting DIF. However, models for explaining DIF in a systematic manner have received only little attention. This paper discusses a further extension of item response theory based models that provides a strong substantive basis for explaining DIF. The general idea is to model item difficulties in each group as a function of item features such as the cognitive processes that are needed for correctly solving items. A different weight for a particular feature across groups also called differential feature functioning then provides a strong substantive basis for explaining why DIF may occur in items that share this particular feature. Differential feature functioning can be used for estimating the average difference between feature weights across groups. Another useful model extension is to consider feature weights that are random over persons. Models with random feature weights allow to assess the extent to which feature weights tend to differ between groups as well as within groups. As an illustration of the approach, the proposed models will be used for modeling DIF in a test for transitive reasoning using data from personnel selection.

Suggested Citation

  • Meulders, Michel & De Boeck, Paul & Vandenberk, Miek, 2009. "Going beyond the detection of differential item functioning in tests for personnel selection," Working Papers 2009/40, Hogeschool-Universiteit Brussel, Faculteit Economie en Management.
    • Handle: RePEc:hub:wpecon:200940
    as

    Download full text from publisher

    File URL: https://lirias.hubrussel.be/bitstream/123456789/2872/1/09HRP40.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. David J. Spiegelhalter & Nicola G. Best & Bradley P. Carlin & Angelika Van Der Linde, 2002. "Bayesian measures of model complexity and fit," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(4), pages 583-639, October.
    2. Nambury Raju, 1988. "The area between two item characteristic curves," Psychometrika, Springer;The Psychometric Society, vol. 53(4), pages 495-502, December.
    3. Henk Kelderman, 1989. "Item bias detection using loglinear irt," Psychometrika, Springer;The Psychometric Society, vol. 54(4), pages 681-697, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Clemens Draxler, 2018. "Bayesian conditional inference for Rasch models," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 102(2), pages 245-262, April.
    2. Buddhavarapu, Prasad & Bansal, Prateek & Prozzi, Jorge A., 2021. "A new spatial count data model with time-varying parameters," Transportation Research Part B: Methodological, Elsevier, vol. 150(C), pages 566-586.
    3. Mumtaz, Haroon & Theodoridis, Konstantinos, 2017. "Common and country specific economic uncertainty," Journal of International Economics, Elsevier, vol. 105(C), pages 205-216.
    4. Jesse Elliott & Zemin Bai & Shu-Ching Hsieh & Shannon E Kelly & Li Chen & Becky Skidmore & Said Yousef & Carine Zheng & David J Stewart & George A Wells, 2020. "ALK inhibitors for non-small cell lung cancer: A systematic review and network meta-analysis," PLOS ONE, Public Library of Science, vol. 15(2), pages 1-18, February.
    5. Christina Leuker & Thorsten Pachur & Ralph Hertwig & Timothy J. Pleskac, 2019. "Do people exploit risk–reward structures to simplify information processing in risky choice?," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 5(1), pages 76-94, August.
    6. Francois Olivier & Laval Guillaume, 2011. "Deviance Information Criteria for Model Selection in Approximate Bayesian Computation," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 10(1), pages 1-25, July.
    7. Raggi, Davide & Bordignon, Silvano, 2012. "Long memory and nonlinearities in realized volatility: A Markov switching approach," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3730-3742.
    8. Angelica Gianfreda & Francesco Ravazzolo & Luca Rossini, 2023. "Large Time‐Varying Volatility Models for Hourly Electricity Prices," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 85(3), pages 545-573, June.
    9. Rubio, F.J. & Steel, M.F.J., 2011. "Inference for grouped data with a truncated skew-Laplace distribution," Computational Statistics & Data Analysis, Elsevier, vol. 55(12), pages 3218-3231, December.
    10. Alessandri, Piergiorgio & Mumtaz, Haroon, 2019. "Financial regimes and uncertainty shocks," Journal of Monetary Economics, Elsevier, vol. 101(C), pages 31-46.
    11. Padilla, Juan L. & Azevedo, Caio L.N. & Lachos, Victor H., 2018. "Multidimensional multiple group IRT models with skew normal latent trait distributions," Journal of Multivariate Analysis, Elsevier, vol. 167(C), pages 250-268.
    12. Svetlana V. Tishkovskaya & Paul G. Blackwell, 2021. "Bayesian estimation of heterogeneous environments from animal movement data," Environmetrics, John Wiley & Sons, Ltd., vol. 32(6), September.
    13. David Macro & Jeroen Weesie, 2016. "Inequalities between Others Do Matter: Evidence from Multiplayer Dictator Games," Games, MDPI, vol. 7(2), pages 1-23, April.
    14. Tautenhahn, Susanne & Heilmeier, Hermann & Jung, Martin & Kahl, Anja & Kattge, Jens & Moffat, Antje & Wirth, Christian, 2012. "Beyond distance-invariant survival in inverse recruitment modeling: A case study in Siberian Pinus sylvestris forests," Ecological Modelling, Elsevier, vol. 233(C), pages 90-103.
    15. Julian P. T. Higgins & Simon G. Thompson & David J. Spiegelhalter, 2009. "A re‐evaluation of random‐effects meta‐analysis," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 172(1), pages 137-159, January.
    16. Simon Mak & Derek Bingham & Yi Lu, 2016. "A regional compound Poisson process for hurricane and tropical storm damage," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 65(5), pages 677-703, November.
    17. Xi, Yanhui & Peng, Hui & Qin, Yemei & Xie, Wenbiao & Chen, Xiaohong, 2015. "Bayesian analysis of heavy-tailed market microstructure model and its application in stock markets," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 117(C), pages 141-153.
    18. Huang, Zhaodong & Chien, Steven & Zhu, Wei & Zheng, Pengjun, 2022. "Scheduling wheel inspection for sustainable urban rail transit operation: A Bayesian approach," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 586(C).
    19. Jorge I. Figueroa-Zúñiga & Cristian L. Bayes & Víctor Leiva & Shuangzhe Liu, 2022. "Robust beta regression modeling with errors-in-variables: a Bayesian approach and numerical applications," Statistical Papers, Springer, vol. 63(3), pages 919-942, June.
    20. Leonardo Oliveira Martins & Hirohisa Kishino, 2010. "Distribution of distances between topologies and its effect on detection of phylogenetic recombination," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 62(1), pages 145-159, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hub:wpecon:200940. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sabine Janssens (email available below). General contact details of provider: https://edirc.repec.org/data/emhubbe.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.