IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v205y2010i3p709-718.html
   My bibliography  Save this article

Determining targets for multi-stage adaptive tests using integer programming

Author

Listed:
  • Armstrong, Ronald D.
  • Kung, Mabel T.
  • Roussos, Louis A.

Abstract

This paper considers a multi-stage adaptive test (MST) where the testlets at each stage are determined prior to the administration. The assembly of a MST requires target information and target response functions for the MST design. The targets are chosen to create tests with accurate scoring and high utilization of items in an operational pool. Forcing all MSTs to have information and response function plots to be within an interval about the targets will yield parallel MSTs, in the sense that standardized paper-and-pencil tests are considered parallel. The objective of this paper is to present a method to determine targets for the MST design based on an item pool and an assumed distribution of examinee ability. The approach is applied to a Skills Readiness Inventory test designed to identify logical reasoning deficiencies of examinees. This method can be applied to obtain item response theory targets for a linear test as this is a special case of a MST.

Suggested Citation

  • Armstrong, Ronald D. & Kung, Mabel T. & Roussos, Louis A., 2010. "Determining targets for multi-stage adaptive tests using integer programming," European Journal of Operational Research, Elsevier, vol. 205(3), pages 709-718, September.
  • Handle: RePEc:eee:ejores:v:205:y:2010:i:3:p:709-718
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377-2217(09)00917-5
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lu, Chin-Shan & Lai, Kee-hung & Cheng, T.C.E., 2007. "Application of structural equation modeling to evaluate the intention of shippers to use Internet services in liner shipping," European Journal of Operational Research, Elsevier, vol. 180(2), pages 845-867, July.
    2. Adema, Jos J. & Boekkooi-Timminga, Ellen & van der Linden, Wim J., 1991. "Achievement test construction using 0-1 linear programming," European Journal of Operational Research, Elsevier, vol. 55(1), pages 103-111, November.
    3. Ronald Armstrong & Dmitry Belov & Alexander Weissman, 2005. "Developing and Assembling the Law School Admission Test," Interfaces, INFORMS, vol. 35(2), pages 140-151, April.
    4. Csondes, Tibor & Kotnyek, Balazs & Zoltan Szabo, Janos, 2002. "Application of heuristic methods for conformance test selection," European Journal of Operational Research, Elsevier, vol. 142(1), pages 203-218, October.
    5. Mavrommatis, George, 2008. "Learning objects and objectives towards automatic learning construction," European Journal of Operational Research, Elsevier, vol. 187(3), pages 1449-1458, June.
    6. Gupta, Sumeet & Kim, Hee W., 2008. "Linking structural equation modeling to Bayesian networks: Decision support for customer retention in virtual communities," European Journal of Operational Research, Elsevier, vol. 190(3), pages 818-833, November.
    7. Anderson, Ronald D. & Vastag, Gyula, 2004. "Causal modeling alternatives in operations research: Overview and application," European Journal of Operational Research, Elsevier, vol. 156(1), pages 92-109, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bernard Veldkamp, 2013. "Application of robust optimization to automated test assembly," Annals of Operations Research, Springer, vol. 206(1), pages 595-610, July.
    2. Deutsch, Eliza S. & Alameddine, Ibrahim & Qian, Song S., 2020. "Using structural equation modeling to better understand microcystis biovolume dynamics in a mediterranean hypereutrophic reservoir," Ecological Modelling, Elsevier, vol. 435(C).
    3. Kamble, Sachin S. & Gunasekaran, Angappa & Kumar, Vikas & Belhadi, Amine & Foropon, Cyril, 2021. "A machine learning based approach for predicting blockchain adoption in supply Chain," Technological Forecasting and Social Change, Elsevier, vol. 163(C).
    4. Tamayo-Torres, Javier & Gutierrez-Gutierrez, Leopoldo & Ruiz-Moreno, Antonia, 2014. "The relationship between exploration and exploitation strategies, manufacturing flexibility and organizational learning: An empirical comparison between Non-ISO and ISO certified firms," European Journal of Operational Research, Elsevier, vol. 232(1), pages 72-86.
    5. Ülengin, Füsun & Kabak, Özgür & Önsel, Sule & Ülengin, Burç & Aktas, Emel, 2010. "A problem-structuring model for analyzing transportation-environment relationships," European Journal of Operational Research, Elsevier, vol. 200(3), pages 844-859, February.
    6. Vedant Singh & Anita Verma, 2019. "Influence of respondent type on relationships between safety climate and safety performance in manufacturing firm," Journal of Risk and Reliability, , vol. 233(2), pages 268-284, April.
    7. Önsel Ekici, Şule & Kabak, Özgür & Ülengin, Füsun, 2019. "Improving logistics performance by reforming the pillars of Global Competitiveness Index," Transport Policy, Elsevier, vol. 81(C), pages 197-207.
    8. Simone CASCHILI & Francesca MEDDA, 2015. "The Port Attractiveness Index:Application On African Ports," Region et Developpement, Region et Developpement, LEAD, Universite du Sud - Toulon Var, vol. 41, pages 47-82.
    9. Michail Tsagris, 2021. "A New Scalable Bayesian Network Learning Algorithm with Applications to Economics," Computational Economics, Springer;Society for Computational Economics, vol. 57(1), pages 341-367, January.
    10. Abdulaziz Alghadeer & Sherif Mohamed, 2016. "Diffusion of Organisational Innovation in Saudi Arabia: The Case of the Project Management Office (PMO)," International Journal of Innovation and Technology Management (IJITM), World Scientific Publishing Co. Pte. Ltd., vol. 13(04), pages 1-22, August.
    11. Thomas Dufhues & Gertrud Buchenrieder & Zhanli Sun, 2021. "Exploring Policy Options in Regulating Rural–Urban Migration with a Bayesian Network: A Case Study in Kazakhstan," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 33(3), pages 553-577, June.
    12. Ekici, Ahmet & Önsel Ekici, Şule, 2021. "Understanding and managing complexity through Bayesian network approach: The case of bribery in business transactions," Journal of Business Research, Elsevier, vol. 129(C), pages 757-773.
    13. Ülengin, Füsun & Önsel, Şule & Aktas, Emel & Kabak, Özgür & Özaydın, Özay, 2014. "A decision support methodology to enhance the competitiveness of the Turkish automotive industry," European Journal of Operational Research, Elsevier, vol. 234(3), pages 789-801.
    14. Chao, Shih-Liang & Lin, Pei-Shan, 2009. "Critical factors affecting the adoption of container security service: The shippers' perspective," International Journal of Production Economics, Elsevier, vol. 122(1), pages 67-77, November.
    15. Veasna, Sou & Wu, Wann-Yih & Huang, Chu-Hsin, 2013. "The impact of destination source credibility on destination satisfaction: The mediating effects of destination attachment and destination image," Tourism Management, Elsevier, vol. 36(C), pages 511-526.
    16. Vytautas Dikcius & Eleonora Seimiene & Ramunas Casas, 2018. "Brand Personality Scale: Is It Applicable For A Small Emerging Country?," Organizations and Markets in Emerging Economies, Faculty of Economics, Vilnius University, vol. 9(2).
    17. Bastič Majda & Mulej Matjaž & Zore Mira, 2020. "CSR and Financial Performance – Linked by Innovative Activities," Naše gospodarstvo/Our economy, Sciendo, vol. 66(2), pages 1-14, June.
    18. Pani, Agnivesh & Sahu, Prasanta K., 2022. "Modelling non-response in establishment-based freight surveys: A sampling tool for statewide freight data collection in middle-income countries," Transport Policy, Elsevier, vol. 124(C), pages 128-138.
    19. Long Chen & Xiaokun Liu & Peng Jing, 2023. "Do Unprecedented Gasoline Prices Affect the Consumer Switching to New Energy Vehicles? An Integrated Social Cognitive Theory Model," Sustainability, MDPI, vol. 15(10), pages 1-25, May.
    20. Lu, Chin-Shan & Weng, Hsiang-Kai & Huang, Fei & Leung, Lai-Han & Wang, Wen-Di, 2018. "Assessing the seafaring intention of maritime students in Hong Kong," Transportation Research Part A: Policy and Practice, Elsevier, vol. 110(C), pages 258-273.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:205:y:2010:i:3:p:709-718. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.