%0 Journal Article %J Applied Psychological Measurement %D 2014 %T Using Multidimensional CAT to Administer a Short, Yet Precise, Screening Test %A Yao, Lihua %A Pommerich, Mary %A Segall, Daniel O. %X

Multidimensional computerized adaptive testing (MCAT) provides a mechanism by which the simultaneous goals of accurate prediction and minimal testing time for a screening test could both be met. This article demonstrates the use of MCAT to administer a screening test for the Computerized Adaptive Testing–Armed Services Vocational Aptitude Battery (CAT-ASVAB) under a variety of manipulated conditions. CAT-ASVAB is a test battery administered via unidimensional CAT (UCAT) that is used to qualify applicants for entry into the U.S. military and assign them to jobs. The primary research question being evaluated is whether the use of MCAT to administer a screening test can lead to significant reductions in testing time from the full-length selection test, without significant losses in score precision. Different stopping rules, item selection methods, content constraints, time constraints, and population distributions for the MCAT administration are evaluated through simulation, and compared with results from a regular full-length UCAT administration.

%B Applied Psychological Measurement %V 38 %P 614-631 %U http://apm.sagepub.com/content/38/8/614.abstract %R 10.1177/0146621614541514 %0 Journal Article %J Journal of Educational Measurement %D 2008 %T Local Dependence in an Operational CAT: Diagnosis and Implications %A Pommerich, Mary %A Segall, Daniel O. %X

The accuracy of CAT scores can be negatively affected by local dependence if the CAT utilizes parameters that are misspecified due to the presence of local dependence and/or fails to control for local dependence in responses during the administration stage. This article evaluates the existence and effect of local dependence in a test of Mathematics Knowledge. Diagnostic tools were first used to evaluate the existence of local dependence in items that were calibrated under a 3PL model. A simulation study was then used to evaluate the effect of local dependence on the precision of examinee CAT scores when the 3PL model was used for selection and scoring. The diagnostic evaluation showed strong evidence for local dependence. The simulation suggested that local dependence in parameters had a minimal effect on CAT score precision, while local dependence in responses had a substantial effect on score precision, depending on the degree of local dependence present.

%B Journal of Educational Measurement %V 45 %P 201–223 %U http://dx.doi.org/10.1111/j.1745-3984.2008.00061.x %R 10.1111/j.1745-3984.2008.00061.x