01986nas a2200133 4500008003900000245006600039210006400105300001200169490000700181520157400188100002501762700002001787856004501807 2018 d00aWhat Information Works Best?: A Comparison of Routing Methods0 aWhat Information Works Best A Comparison of Routing Methods a499-5150 v423 aThere are many item selection methods proposed for computerized adaptive testing (CAT) applications. However, not all of them have been used in computerized multistage testing (ca-MST). This study uses some item selection methods as a routing method in ca-MST framework. These are maximum Fisher information (MFI), maximum likelihood weighted information (MLWI), maximum posterior weighted information (MPWI), Kullback–Leibler (KL), and posterior Kullback–Leibler (KLP). The main purpose of this study is to examine the performance of these methods when they are used as a routing method in ca-MST applications. These five information methods under four ca-MST panel designs and two test lengths (30 items and 60 items) were tested using the parameters of a real item bank. Results were evaluated with overall findings (mean bias, root mean square error, correlation between true and estimated thetas, and module exposure rates) and conditional findings (conditional absolute bias, standard error of measurement, and root mean square error). It was found that test length affected the outcomes much more than other study conditions. Under 30-item conditions, 1-3 designs outperformed other panel designs. Under 60-item conditions, 1-3-3 designs were better than other panel designs. Each routing method performed well under particular conditions; there was no clear best method in the studied conditions. The recommendations for routing methods in any particular condition were provided for researchers and practitioners as well as the limitations of these results.1 aSari, Halil, Ibrahim1 aRaborn, Anthony uhttps://doi.org/10.1177/014662161775299001392nas a2200145 4500008004100000245007100041210006900112260001200181520089200193653000801085653001801093653001701111100002601128856009201154 2011 eng d00aWalking the Tightrope: Using Better Content Control to Improve CAT0 aWalking the Tightrope Using Better Content Control to Improve CA c10/20113 a
All testing involves a balance between measurement precision and content considerations. CAT item-selection algorithms have evolved to accommodate content considerations. Reviews CAT evolution including: Original/”Pure” adaptive exams, Constrained CAT, Weighted-deviations method, Shadow-Test Approach, Testlets instead of fully adapted tests, Administration of one item may preclude the administration of other item(s), and item relationships.
Research Questions
10aCAT10aCAT evolution10atest content1 aGialluca, Kathleen, A uhttp://www.iacat.org/content/walking-tightrope-using-better-content-control-improve-cat00426nas a2200109 4500008004100000245007300041210006900114300001200183490000700195100001300202856010100215 2009 eng d00aWhen cognitive diagnosis meets computerized adaptive testing: CD-CAT0 aWhen cognitive diagnosis meets computerized adaptive testing CDC a619-6320 v741 aCheng, Y uhttp://www.iacat.org/content/when-cognitive-diagnosis-meets-computerized-adaptive-testing-cd-cat00433nas a2200109 4500008004100000245007500041210007100116300001200187490000700199100001700206856010000223 2008 eng d00aThe Wald–Wolfowitz Theorem Is Violated in Sequential Mastery Testing0 aWald–Wolfowitz Theorem Is Violated in Sequential Mastery Testing a293-3030 v271 aFinkelman, M uhttp://www.iacat.org/content/wald%E2%80%93wolfowitz-theorem-violated-sequential-mastery-testing01149nas a2200205 4500008004100000245008200041210006900123260005600192520043100248653002100679653003000700653001600730653001600746653001800762100001500780700001700795700001700812700001400829856010000843 2002 eng d00aThe work ahead: A psychometric infrastructure for computerized adaptive tests0 awork ahead A psychometric infrastructure for computerized adapti aMahwah, N.J. USAbLawrence Erlbaum Associates, Inc.3 a(From the chapter) Considers the past and future of computerized adaptive tests and computer-based tests and looks at issues and challenges confronting a testing program as it implements and operates a computer-based test. Recommendations for testing programs from The National Council of Measurement in Education Ad Hoc Committee on Computerized Adaptive Test Disclosure are appended. (PsycINFO Database Record (c) 2005 APA )10aAdaptive Testing10aComputer Assisted Testing10aEducational10aMeasurement10aPsychometrics1 aDrasgow, F1 aPotenza, M P1 aFreemer, J J1 aWard, W C uhttp://www.iacat.org/content/work-ahead-psychometric-infrastructure-computerized-adaptive-tests00507nas a2200097 4500008004100000245013100041210006900172260003400241100001000275856012400285 1999 eng d00aWISCAT: Een computergestuurd toetspakket voor rekenen en wiskunde [A computerized test package for arithmetic and mathematics]0 aWISCAT Een computergestuurd toetspakket voor rekenen en wiskunde aCito: Arnhem, The Netherlands1 aCito. uhttp://www.iacat.org/content/wiscat-een-computergestuurd-toetspakket-voor-rekenen-en-wiskunde-computerized-test-package00505nas a2200097 4500008004100000245008400041210006900125260008800194100001700282856010800299 1991 eng d00aWhat lies ahead? Computer technology and its implications for personnel testing0 aWhat lies ahead Computer technology and its implications for per aNATO Workshop on Computer-based Assessment of Military Personnel, Brussels, Belgium1 aMcBride, J R uhttp://www.iacat.org/content/what-lies-ahead-computer-technology-and-its-implications-personnel-testing00389nas a2200085 4500008004100000245007800041210006900119100001500188856010000203 1990 eng d00aWhat can we do with computerized adaptive testing and what we cannot do? 0 aWhat can we do with computerized adaptive testing and what we ca1 aLaurier, M uhttp://www.iacat.org/content/what-can-we-do-computerized-adaptive-testing-and-what-we-cannot-do00431nas a2200109 4500008004100000245007500041210006900116300000900185490000900194100001800203856010000221 1987 eng d00aWilcox' closed sequential testing procedure in stratified item domains0 aWilcox closed sequential testing procedure in stratified item do a3-120 v1(1)1 aGruijter, D N uhttp://www.iacat.org/content/wilcox-closed-sequential-testing-procedure-stratified-item-domains00533nas a2200109 4500008004100000245008700041210006900128260008700197100001700284700001400301856010800315 1974 eng d00aA word knowledge item pool for adaptive ability measurement (Research Report 74-2)0 aword knowledge item pool for adaptive ability measurement Resear aMinneapolis MN: Department of Psychology, Computerized Adaptive Testing Laboratory1 aMcBride, J R1 aWeiss, DJ uhttp://www.iacat.org/content/word-knowledge-item-pool-adaptive-ability-measurement-research-report-74-2