TY - JOUR T1 - Optimizing cognitive ability measurement with multidimensional computer adaptive testing JF - International Journal of Testing Y1 - In Press A1 - Makransky, G. A1 - Glas, C. A. W. ER - TY - JOUR T1 - An Extended Taxonomy of Variants of Computerized Adaptive Testing JF - Journal of Computerized Adaptive Testing Y1 - 2023 A1 - Roy Levy A1 - John T. Behrens A1 - Robert J. Mislevy KW - Adaptive Testing KW - evidence-centered design KW - Item Response Theory KW - knowledge-based model construction KW - missingness VL - 10 IS - 1 ER - TY - JOUR T1 - Application of Dimension Reduction to CAT Item Selection Under the Bifactor Model JF - Applied Psychological Measurement Y1 - 2019 A1 - Xiuzhen Mao A1 - Jiahui Zhang A1 - Tao Xin AB - Multidimensional computerized adaptive testing (MCAT) based on the bifactor model is suitable for tests with multidimensional bifactor measurement structures. Several item selection methods that proved to be more advantageous than the maximum Fisher information method are not practical for bifactor MCAT due to time-consuming computations resulting from high dimensionality. To make them applicable in bifactor MCAT, dimension reduction is applied to four item selection methods, which are the posterior-weighted Fisher D-optimality (PDO) and three non-Fisher information-based methods—posterior expected Kullback–Leibler information (PKL), continuous entropy (CE), and mutual information (MI). They were compared with the Bayesian D-optimality (BDO) method in terms of estimation precision. When both the general and group factors are the measurement objectives, BDO, PDO, CE, and MI perform equally well and better than PKL. When the group factors represent nuisance dimensions, MI and CE perform the best in estimating the general factor, followed by the BDO, PDO, and PKL. How the bifactor pattern and test length affect estimation accuracy was also discussed. VL - 43 UR - https://doi.org/10.1177/0146621618813086 ER - TY - JOUR T1 - Computerized Adaptive Testing in Early Education: Exploring the Impact of Item Position Effects on Ability Estimation JF - Journal of Educational Measurement Y1 - 2019 A1 - Albano, Anthony D. A1 - Cai, Liuhan A1 - Lease, Erin M. A1 - McConnell, Scott R. AB - Abstract Studies have shown that item difficulty can vary significantly based on the context of an item within a test form. In particular, item position may be associated with practice and fatigue effects that influence item parameter estimation. The purpose of this research was to examine the relevance of item position specifically for assessments used in early education, an area of testing that has received relatively limited psychometric attention. In an initial study, multilevel item response models fit to data from an early literacy measure revealed statistically significant increases in difficulty for items appearing later in a 20-item form. The estimated linear change in logits for an increase of 1 in position was .024, resulting in a predicted change of .46 logits for a shift from the beginning to the end of the form. A subsequent simulation study examined impacts of item position effects on person ability estimation within computerized adaptive testing. Implications and recommendations for practice are discussed. VL - 56 UR - https://onlinelibrary.wiley.com/doi/abs/10.1111/jedm.12215 ER - TY - JOUR T1 - Efficiency of Targeted Multistage Calibration Designs Under Practical Constraints: A Simulation Study JF - Journal of Educational Measurement Y1 - 2019 A1 - Berger, Stéphanie A1 - Verschoor, Angela J. A1 - Eggen, Theo J. H. M. A1 - Moser, Urs AB - Abstract Calibration of an item bank for computer adaptive testing requires substantial resources. In this study, we investigated whether the efficiency of calibration under the Rasch model could be enhanced by improving the match between item difficulty and student ability. We introduced targeted multistage calibration designs, a design type that considers ability-related background variables and performance for assigning students to suitable items. Furthermore, we investigated whether uncertainty about item difficulty could impair the assembling of efficient designs. The results indicated that targeted multistage calibration designs were more efficient than ordinary targeted designs under optimal conditions. Limited knowledge about item difficulty reduced the efficiency of one of the two investigated targeted multistage calibration designs, whereas targeted designs were more robust. VL - 56 UR - https://onlinelibrary.wiley.com/doi/abs/10.1111/jedm.12203 ER - TY - CONF T1 - Adapting Linear Models for Optimal Test Design to More Complex Test Specifications T2 - IACAT 2017 Conference Y1 - 2017 A1 - Maxim Morin KW - Complex Test Specifications KW - Linear Models KW - Optimal Test Design AB -

Combinatorial optimization (CO) has proven to be a very helpful approach for addressing test assembly issues and for providing solutions. Furthermore, CO has been applied for several test designs, including: (1) for the development of linear test forms; (2) for computerized adaptive testing and; (3) for multistage testing. In his seminal work, van der Linden (2006) laid out the basis for using linear models for simultaneously assembling exams and item pools in a variety of conditions: (1) for single tests and multiple tests; (2) with item sets, etc. However, for some testing programs, the number and complexity of test specifications can grow rapidly. Consequently, the mathematical representation of the test assembly problem goes beyond most approaches reported either in van der Linden’s book or in the majority of other publications related to test assembly. In this presentation, we extend van der Linden’s framework by including the concept of blocks for test specifications. We modify the usual mathematical notation of a test assembly problem by including this concept and we show how it can be applied to various test designs. Finally, we will demonstrate an implementation of this approach in a stand-alone software, called the ATASolver.

Session Video

JF - IACAT 2017 Conference PB - Niigata Seiryo University CY - Niigata, Japan ER - TY - CONF T1 - Analysis of CAT Precision Depending on Parameters of the Item Pool T2 - IACAT 2017 Conference Y1 - 2017 A1 - Anatoly Maslak A1 - Stanislav Pozdniakov KW - CAT KW - Item parameters KW - Precision AB -

The purpose of this research project is to analyze the measurement precision of a latent variable depending on parameters of the item pool. The influence of the following factors is analyzed:

Factor A – range of variation of items in the pool. This factor varies on three levels with the following ranges in logits: a1 – [-3.0; +3.0], a2 - [-4.0; +4.0], a3 - [-5.0; +5.0].

Factor B – number of items in the pool. The factor varies on six levels with the following number of items for every factor: b1 - 128, b2 - 256, b3 – 512, b4 - 1024, b5 – 2048, b6 – 4096. The items are evenly distributed in each of the variation ranges.

Factor C – examinees’ proficiency varies at 30 levels (c1, c2, …, c30), which are evenly distributed in the range [-3.0; +3.0] logit.

The investigation was based on a simulation experiment within the framework of the theory of latent variables.

Response Y is the precision of measurement of examinees’ proficiency, which is calculated as the difference between the true levels of examinees’ proficiency and estimates obtained by means of adaptive testing. Three factor ANOVA was used for data processing.

The following results were obtained:

1. Factor A is significant. Ceteris paribus, the greater the range of variation of items in the pool, the higher the estimation precision is.

2. Factor B is significant. Ceteris paribus, the greater the number of items in the pool, the higher the estimation precision is.

3. Factor C is statistically insignificant at level α = .05. It means that the precision of estimation of examinees’ proficiency is the same within the range of their variation.

4. The only significant interaction among all interactions is AB. The significance of this interaction is explained by the fact that increasing the number of items in the pool decreases the effect of the range of variation of items in the pool. 

Session Video

JF - IACAT 2017 Conference PB - Niigata Seiryo University CY - Niigata, Japan UR - https://drive.google.com/file/d/1Bwe58kOQRgCSbB8x6OdZTDK4OIm3LQI3/view?usp=drive_web ER - TY - CONF T1 - Comparison of Pretest Item Calibration Methods in a Computerized Adaptive Test (CAT) T2 - IACAT 2017 Conference Y1 - 2017 A1 - Huijuan Meng A1 - Chris Han KW - CAT KW - Pretest Item Calibration AB -

Calibration methods for pretest items in a computerized adaptive test (CAT) are not a new area of research inquiry. After decades of research on CAT, the fixed item parameter calibration (FIPC) method has been widely accepted and used by practitioners to address two CAT calibration issues: (a) a restricted ability range each item is exposed to, and (b) a sparse response data matrix. In FIPC, the parameters of the operational items are fixed at their original values, and multiple expectation maximization (EM) cycles are used to estimate parameters of the pretest items with prior ability distribution being updated multiple times (Ban, Hanson, Wang, Yi, & Harris, 2001; Kang & Peterson, 2009; Pommerich & Segall, 2003).

Another calibration method is the fixed person parameter calibration (FPPC) method proposed by Stocking (1988) as “Method A.” Under this approach, candidates’ ability estimates are fixed in the calibration of pretest items and they define the scale on which the parameter estimates are reported. The logic of FPPC is suitable for CAT applications because the person parameters are estimated based on operational items and available for pretest item calibration. In Stocking (1988), the FPPC was evaluated using the LOGIST computer program developed by Wood, Wingersky, and Lord (1976). He reported that “Method A” produced larger root mean square errors (RMSEs) in the middle ability range than “Method B,” which required the use of anchor items (administered non-adaptively) and linking steps to attempt to correct for the potential scale drift due to the use of imperfect ability estimates.

Since then, new commercial software tools such as BILOG-MG and flexMIRT (Cai, 2013) have been developed to handle the FPPC method with different implementations (e.g., the MH-RM algorithm with flexMIRT). The performance of the FPPC method with those new software tools, however, has rarely been researched in the literature.

In our study, we evaluated the performance of two pretest item calibration methods using flexMIRT, the new software tool. The FIPC and FPPC are compared under various CAT settings. Each simulated exam contains 75% operational items and 25% pretest items, and real item parameters are used to generate the CAT data. This study also addresses the lack of guidelines in existing CAT item calibration literature regarding population ability shift and exam length (more accurate theta estimates are expected in longer exams). Thus, this study also investigates the following four factors and their impact on parameter estimation accuracy, including: (1) candidate population changes (3 ability distributions); (2) exam length (20: 15 OP + 5 PT, 40: 30 OP + 10 PT, and 60: 45 OP + 15 PT); (3) data model fit (3PL and 3PL with fixed C), and (4) pretest item calibration sample sizes (300, 500, and 1000). This study’s findings will fill the gap in this area of research and thus provide new information on which practitioners can base their decisions when selecting a pretest calibration method for their exams.

References

Ban, J. C., Hanson, B. A., Wang, T., Yi, Q., & Harris, D. J. (2001). A comparative study of online pretest item—Calibration/scaling methods in computerized adaptive testing. Journal of Educational Measurement, 38(3), 191–212.

Cai, L. (2013). flexMIRT® Flexible Multilevel Multidimensional Item Analysis and Test Scoring (Version 2) [Computer software]. Chapel Hill, NC: Vector Psychometric Group.

Kang, T., & Petersen, N. S. (2009). Linking item parameters to a base scale (Research Report No. 2009– 2). Iowa City, IA: ACT.

Pommerich, M., & Segall, D.O. (2003, April). Calibrating CAT pools and online pretest items using marginal maximum likelihood methods. Paper presented at the annual meeting of the National Council on Measurement in Education, Chicago, IL.

Stocking, M. L. (1988). Scale drift in online calibration (Research Report No. 88–28). Princeton, NJ: Educational Testing Service.

Wood, R. L., Wingersky, M. S., & Lord, F. M. (1976). LOGIST: A computer program for estimating examinee ability and item characteristic curve parameters (RM76-6) [Computer program]. Princeton, NJ: Educational Testing Service.

Session Video

JF - IACAT 2017 Conference PB - Niigata Seiryo University CY - Niigata, Japan ER - TY - CONF T1 - Efficiency of Targeted Multistage Calibration Designs under Practical Constraints: A Simulation Study T2 - IACAT 2017 Conference Y1 - 2017 A1 - Stephanie Berger A1 - Angela J. Verschoor A1 - Theo Eggen A1 - Urs Moser KW - CAT KW - Efficiency KW - Multistage Calibration AB -

Calibration of an item bank for computer adaptive testing requires substantial resources. In this study, we focused on two related research questions. First, we investigated whether the efficiency of item calibration under the Rasch model could be enhanced by calibration designs that optimize the match between item difficulty and student ability (Berger, 1991). Therefore, we introduced targeted multistage calibration designs, a design type that refers to a combination of traditional targeted calibration designs and multistage designs. As such, targeted multistage calibration designs consider ability-related background variables (e.g., grade in school), as well as performance (i.e., outcome of a preceding test stage) for assigning students to suitable items.

Second, we explored how limited a priori knowledge about item difficulty affects the efficiency of both targeted calibration designs and targeted multistage calibration designs. When arranging items within a given calibration design, test developers need to know the item difficulties to locate items optimally within the design. However, usually, no empirical information about item difficulty is available before item calibration. Owing to missing empirical data, test developers might fail to assign all items to the most suitable location within a calibration design.

Both research questions were addressed in a simulation study in which we varied the calibration design, as well as the accuracy of item distribution across the different booklets or modules within each design (i.e., number of misplaced items). The results indicated that targeted multistage calibration designs were more efficient than ordinary targeted designs under optimal conditions. Especially, targeted multistage calibration designs provided more accurate estimates for very easy and 52 IACAT 2017 ABSTRACTS BOOKLET very difficult items. Limited knowledge about item difficulty during test construction impaired the efficiency of all designs. The loss of efficiency was considerably large for one of the two investigated targeted multistage calibration designs, whereas targeted designs were more robust.

References

Berger, M. P. F. (1991). On the efficiency of IRT models when applied to different sampling designs. Applied Psychological Measurement, 15(3), 293–306. doi:10.1177/014662169101500310

Session Video

JF - IACAT 2017 Conference PB - Niigata Seiryo University CY - Niigata, Japan UR - https://drive.google.com/file/d/1ko2LuiARKqsjL_6aupO4Pj9zgk6p_xhd/view?usp=sharing ER - TY - JOUR T1 - The validation of a computer-adaptive test (CAT) for assessing health-related quality of life in children and adolescents in a clinical sample: study design, methods and first results of the Kids-CAT study JF - Quality of Life Research Y1 - 2017 A1 - Barthel, D. A1 - Otto, C. A1 - Nolte, S. A1 - Meyrose, A.-K. A1 - Fischer, F. A1 - Devine, J. A1 - Walter, O. A1 - Mierke, A. A1 - Fischer, K. I. A1 - Thyen, U. A1 - Klein, M. A1 - Ankermann, T. A1 - Rose, M. A1 - Ravens-Sieberer, U. AB - Recently, we developed a computer-adaptive test (CAT) for assessing health-related quality of life (HRQoL) in children and adolescents: the Kids-CAT. It measures five generic HRQoL dimensions. The aims of this article were (1) to present the study design and (2) to investigate its psychometric properties in a clinical setting. VL - 26 UR - https://doi.org/10.1007/s11136-016-1437-9 ER - TY - JOUR T1 - Optimal Reassembly of Shadow Tests in CAT JF - Applied Psychological Measurement Y1 - 2016 A1 - Choi, Seung W. A1 - Moellering, Karin T. A1 - Li, Jie A1 - van der Linden, Wim J. AB - Even in the age of abundant and fast computing resources, concurrency requirements for large-scale online testing programs still put an uninterrupted delivery of computer-adaptive tests at risk. In this study, to increase the concurrency for operational programs that use the shadow-test approach to adaptive testing, we explored various strategies aiming for reducing the number of reassembled shadow tests without compromising the measurement quality. Strategies requiring fixed intervals between reassemblies, a certain minimal change in the interim ability estimate since the last assembly before triggering a reassembly, and a hybrid of the two strategies yielded substantial reductions in the number of reassemblies without degradation in the measurement accuracy. The strategies effectively prevented unnecessary reassemblies due to adapting to the noise in the early test stages. They also highlighted the practicality of the shadow-test approach by minimizing the computational load involved in its use of mixed-integer programming. VL - 40 UR - http://apm.sagepub.com/content/40/7/469.abstract ER - TY - JOUR T1 - A Comparison of IRT Proficiency Estimation Methods Under Adaptive Multistage Testing JF - Journal of Educational Measurement Y1 - 2015 A1 - Kim, Sooyeon A1 - Moses, Tim A1 - Yoo, Hanwook (Henry) AB - This inquiry is an investigation of item response theory (IRT) proficiency estimators’ accuracy under multistage testing (MST). We chose a two-stage MST design that includes four modules (one at Stage 1, three at Stage 2) and three difficulty paths (low, middle, high). We assembled various two-stage MST panels (i.e., forms) by manipulating two assembly conditions in each module, such as difficulty level and module length. For each panel, we investigated the accuracy of examinees’ proficiency levels derived from seven IRT proficiency estimators. The choice of Bayesian (prior) versus non-Bayesian (no prior) estimators was of more practical significance than the choice of number-correct versus item-pattern scoring estimators. The Bayesian estimators were slightly more efficient than the non-Bayesian estimators, resulting in smaller overall error. Possible score changes caused by the use of different proficiency estimators would be nonnegligible, particularly for low- and high-performing examinees. VL - 52 UR - http://dx.doi.org/10.1111/jedm.12063 ER - TY - JOUR T1 - The Applicability of Multidimensional Computerized Adaptive Testing for Cognitive Ability Measurement in Organizational Assessment JF - International Journal of Testing Y1 - 2013 A1 - Makransky, Guido A1 - Glas, Cees A. W. VL - 13 UR - http://www.tandfonline.com/doi/abs/10.1080/15305058.2012.672352 ER - TY - JOUR T1 - The applicability of multidimensional computerized adaptive testing to cognitive ability measurement in organizational assessment JF - International Journal of Testing Y1 - 2013 A1 - Makransky, G. A1 - Glas, C. A. W. VL - 13 IS - 2 ER - TY - JOUR T1 - The Application of the Monte Carlo Approach to Cognitive Diagnostic Computerized Adaptive Testing With Content Constraints JF - Applied Psychological Measurement Y1 - 2013 A1 - Mao, Xiuzhen A1 - Xin, Tao AB -

The Monte Carlo approach which has previously been implemented in traditional computerized adaptive testing (CAT) is applied here to cognitive diagnostic CAT to test the ability of this approach to address multiple content constraints. The performance of the Monte Carlo approach is compared with the performance of the modified maximum global discrimination index (MMGDI) method on simulations in which the only content constraint is on the number of items that measure each attribute. The results of the two simulation experiments show that (a) the Monte Carlo method fulfills all the test requirements and produces satisfactory measurement precision and item exposure results and (b) the Monte Carlo method outperforms the MMGDI method when the Monte Carlo method applies either the posterior-weighted Kullback–Leibler algorithm or the hybrid Kullback–Leibler information as the item selection index. Overall, the recovery rate of the knowledge states, the distribution of the item exposure, and the utilization rate of the item bank are improved when the Monte Carlo method is used.

VL - 37 UR - http://apm.sagepub.com/content/37/6/482.abstract ER - TY - JOUR T1 - Uncertainties in the Item Parameter Estimates and Robust Automated Test Assembly JF - Applied Psychological Measurement Y1 - 2013 A1 - Veldkamp, Bernard P. A1 - Matteucci, Mariagiulia A1 - de Jong, Martijn G. AB -

Item response theory parameters have to be estimated, and because of the estimation process, they do have uncertainty in them. In most large-scale testing programs, the parameters are stored in item banks, and automated test assembly algorithms are applied to assemble operational test forms. These algorithms treat item parameters as fixed values, and uncertainty is not taken into account. As a consequence, resulting tests might be off target or less informative than expected. In this article, the process of parameter estimation is described to provide insight into the causes of uncertainty in the item parameters. The consequences of uncertainty are studied. Besides, an alternative automated test assembly algorithm is presented that is robust against uncertainties in the data. Several numerical examples demonstrate the performance of the robust test assembly algorithm, and illustrate the consequences of not taking this uncertainty into account. Finally, some recommendations about the use of robust test assembly and some directions for further research are given.

VL - 37 UR - http://apm.sagepub.com/content/37/2/123.abstract ER - TY - JOUR T1 - Balancing Flexible Constraints and Measurement Precision in Computerized Adaptive Testing JF - Educational and Psychological Measurement Y1 - 2012 A1 - Moyer, Eric L. A1 - Galindo, Jennifer L. A1 - Dodd, Barbara G. AB -

Managing test specifications—both multiple nonstatistical constraints and flexibly defined constraints—has become an important part of designing item selection procedures for computerized adaptive tests (CATs) in achievement testing. This study compared the effectiveness of three procedures: constrained CAT, flexible modified constrained CAT, and the weighted penalty model in balancing multiple flexible constraints and maximizing measurement precision in a fixed-length CAT. The study also addressed the effect of two different test lengths—25 items and 50 items—and of including or excluding the randomesque item exposure control procedure with the three methods, all of which were found effective in selecting items that met flexible test constraints when used in the item selection process for longer tests. When the randomesque method was included to control for item exposure, the weighted penalty model and the flexible modified constrained CAT models performed better than did the constrained CAT procedure in maintaining measurement precision. When no item exposure control method was used in the item selection process, no practical difference was found in the measurement precision of each balancing method.

VL - 72 UR - http://epm.sagepub.com/content/72/4/629.abstract ER - TY - THES T1 - Computerized adaptive testing in industrial and organizational psychology Y1 - 2012 A1 - Makransky, G. PB - University of Twente CY - Twente, The Netherlands VL - Ph.D. ER - TY - JOUR T1 - Detecting Local Item Dependence in Polytomous Adaptive Data JF - Journal of Educational Measurement Y1 - 2012 A1 - Mislevy, Jessica L. A1 - Rupp, André A. A1 - Harring, Jeffrey R. AB -

A rapidly expanding arena for item response theory (IRT) is in attitudinal and health-outcomes survey applications, often with polytomous items. In particular, there is interest in computer adaptive testing (CAT). Meeting model assumptions is necessary to realize the benefits of IRT in this setting, however. Although initial investigations of local item dependence have been studied both for polytomous items in fixed-form settings and for dichotomous items in CAT settings, there have been no publications applying local item dependence detection methodology to polytomous items in CAT despite its central importance to these applications. The current research uses a simulation study to investigate the extension of widely used pairwise statistics, Yen's Q3 Statistic and Pearson's Statistic X2, in this context. The simulation design and results are contextualized throughout with a real item bank of this type from the Patient-Reported Outcomes Measurement Information System (PROMIS).

VL - 49 UR - http://dx.doi.org/10.1111/j.1745-3984.2012.00165.x ER - TY - JOUR T1 - Development of a computerized adaptive test for depression JF - Archives of General Psychiatry Y1 - 2012 A1 - Robert D. Gibbons A1 - David .J. Weiss A1 - Paul A. Pilkonis A1 - Ellen Frank A1 - Tara Moore A1 - Jong Bae Kim A1 - David J. Kupfer VL - 69 UR - WWW.ARCHGENPSYCHIATRY.COM IS - 11 ER - TY - JOUR T1 - Improving personality facet scores with multidimensional computerized adaptive testing: An illustration with the NEO PI-R JF - Assessment Y1 - 2012 A1 - Makransky, G. A1 - Mortensen, E. L. A1 - Glas, C. A. W. ER - TY - JOUR T1 - A Mixture Rasch Model–Based Computerized Adaptive Test for Latent Class Identification JF - Applied Psychological Measurement Y1 - 2012 A1 - Hong Jiao, A1 - Macready, George A1 - Liu, Junhui A1 - Cho, Youngmi AB -

This study explored a computerized adaptive test delivery algorithm for latent class identification based on the mixture Rasch model. Four item selection methods based on the Kullback–Leibler (KL) information were proposed and compared with the reversed and the adaptive KL information under simulated testing conditions. When item separation was large, all item selection methods did not differ evidently in terms of accuracy in classifying examinees into different latent classes and estimating latent ability. However, when item separation was small, two methods with class-specific ability estimates performed better than the other two methods based on a single latent ability estimate across all latent classes. The three types of KL information distributions were compared. The KL and the reversed KL information could be the same or different depending on the ability level and the item difficulty difference between latent classes. Although the KL information and the reversed KL information were different at some ability levels and item difficulty difference levels, the use of the KL, the reversed KL, or the adaptive KL information did not affect the results substantially due to the symmetric distribution of item difficulty differences between latent classes in the simulated item pools. Item pool usage and classification convergence points were examined as well.

VL - 36 UR - http://apm.sagepub.com/content/36/6/469.abstract ER - TY - JOUR T1 - catR: An R Package for Computerized Adaptive Testing JF - Applied Psychological Measurement Y1 - 2011 A1 - Magis, D. A1 - Raîche, G. KW - computer program KW - computerized adaptive testing KW - Estimation KW - Item Response Theory AB -

Computerized adaptive testing (CAT) is an active current research field in psychometrics and educational measurement. However, there is very little software available to handle such adaptive tasks. The R package catR was developed to perform adaptive testing with as much flexibility as possible, in an attempt to provide a developmental and testing platform to the interested user. Several item-selection rules and ability estimators are implemented. The item bank can be provided by the user or randomly generated from parent distributions of item parameters. Three stopping rules are available. The output can be graphically displayed.

ER - TY - JOUR T1 - Content range and precision of a computer adaptive test of upper extremity function for children with cerebral palsy JF - Physical & Occupational Therapy in Pediatrics Y1 - 2011 A1 - Montpetit, K. A1 - Haley, S. A1 - Bilodeau, N. A1 - Ni, P. A1 - Tian, F. A1 - Gorton, G., 3rd A1 - Mulcahey, M. J. AB - This article reports on the content range and measurement precision of an upper extremity (UE) computer adaptive testing (CAT) platform of physical function in children with cerebral palsy. Upper extremity items representing skills of all abilities were administered to 305 parents. These responses were compared with two traditional standardized measures: Pediatric Outcomes Data Collection Instrument and Functional Independence Measure for Children. The UE CAT correlated strongly with the upper extremity component of these measures and had greater precision when describing individual functional ability. The UE item bank has wider range with items populating the lower end of the ability spectrum. This new UE item bank and CAT have the capability to quickly assess children of all ages and abilities with good precision and, most importantly, with items that are meaningful and appropriate for their age and level of physical function. VL - 31 SN - 1541-3144 (Electronic)0194-2638 (Linking) N1 - Montpetit, KathleenHaley, StephenBilodeau, NathalieNi, PengshengTian, FengGorton, George 3rdMulcahey, M JEnglandPhys Occup Ther Pediatr. 2011 Feb;31(1):90-102. Epub 2010 Oct 13. JO - Phys Occup Ther Pediatr ER - TY - CONF T1 - Practitioner’s Approach to Identify Item Drift in CAT T2 - Annual Conference of the International Association for Computerized Adaptive Testing Y1 - 2011 A1 - Huijuan Meng A1 - Susan Steinkamp A1 - Paul Jones A1 - Joy Matthews-Lopez KW - CUSUM method KW - G2 statistic KW - IPA KW - item drift KW - item parameter drift KW - Lord's chi-square statistic KW - Raju's NCDIF JF - Annual Conference of the International Association for Computerized Adaptive Testing ER - TY - JOUR T1 - Unproctored Internet test verification: Using adaptive confirmation testing JF - Organizational Research Methods Y1 - 2011 A1 - Makransky, G. A1 - Glas, C. A. W. VL - 14 ER - TY - JOUR T1 - An automatic online calibration design in adaptive testing JF - Journal of Applied Testing Technology Y1 - 2010 A1 - Makransky, G. A1 - Glas, C. A. W. VL - 11 ER - TY - JOUR T1 - A Comparison of Item Selection Techniques for Testlets JF - Applied Psychological Measurement Y1 - 2010 A1 - Murphy, Daniel L. A1 - Dodd, Barbara G. A1 - Vaughn, Brandon K. AB -

This study examined the performance of the maximum Fisher’s information, the maximum posterior weighted information, and the minimum expected posterior variance methods for selecting items in a computerized adaptive testing system when the items were grouped in testlets. A simulation study compared the efficiency of ability estimation among the item selection techniques under varying conditions of local-item dependency when the response model was either the three-parameter-logistic item response theory or the three-parameter-logistic testlet response theory. The item selection techniques performed similarly within any particular condition, the practical implications of which are discussed within the article.

VL - 34 UR - http://apm.sagepub.com/content/34/6/424.abstract ER - TY - CHAP T1 - Designing and Implementing a Multistage Adaptive Test: The Uniform CPA Exam T2 - Elements of Adaptive Testing Y1 - 2010 A1 - Melican, G.J. A1 - Breithaupt, K A1 - Zhang, Y. JF - Elements of Adaptive Testing ER - TY - CHAP T1 - Detecting Person Misfit in Adaptive Testing T2 - Elements of Adaptive Testing Y1 - 2010 A1 - Meijer, R. R. A1 - van Krimpen-Stoop, E. M. L. A. JF - Elements of Adaptive Testing ER - TY - JOUR T1 - Detection of aberrant item score patterns in computerized adaptive testing: An empirical example using the CUSUM JF - Personality and Individual Differences Y1 - 2010 A1 - Egberink, I. J. L. A1 - Meijer, R. R. A1 - Veldkamp, B. P. A1 - Schakel, L. A1 - Smid, N. G. KW - CAT KW - computerized adaptive testing KW - CUSUM approach KW - person Fit AB - The scalability of individual trait scores on a computerized adaptive test (CAT) was assessed through investigating the consistency of individual item score patterns. A sample of N = 428 persons completed a personality CAT as part of a career development procedure. To detect inconsistent item score patterns, we used a cumulative sum (CUSUM) procedure. Combined information from the CUSUM, other personality measures, and interviews showed that similar estimated trait values may have a different interpretation.Implications for computer-based assessment are discussed. VL - 48 SN - 01918869 ER - TY - JOUR T1 - Development and validation of patient-reported outcome measures for sleep disturbance and sleep-related impairments JF - Sleep Y1 - 2010 A1 - Buysse, D. J. A1 - Yu, L. A1 - Moul, D. E. A1 - Germain, A. A1 - Stover, A. A1 - Dodds, N. E. A1 - Johnston, K. L. A1 - Shablesky-Cade, M. A. A1 - Pilkonis, P. A. KW - *Outcome Assessment (Health Care) KW - *Self Disclosure KW - Adult KW - Aged KW - Aged, 80 and over KW - Cross-Sectional Studies KW - Factor Analysis, Statistical KW - Female KW - Humans KW - Male KW - Middle Aged KW - Psychometrics KW - Questionnaires KW - Reproducibility of Results KW - Sleep Disorders/*diagnosis KW - Young Adult AB - STUDY OBJECTIVES: To develop an archive of self-report questions assessing sleep disturbance and sleep-related impairments (SRI), to develop item banks from this archive, and to validate and calibrate the item banks using classic validation techniques and item response theory analyses in a sample of clinical and community participants. DESIGN: Cross-sectional self-report study. SETTING: Academic medical center and participant homes. PARTICIPANTS: One thousand nine hundred ninety-three adults recruited from an Internet polling sample and 259 adults recruited from medical, psychiatric, and sleep clinics. INTERVENTIONS: None. MEASUREMENTS AND RESULTS: This study was part of PROMIS (Patient-Reported Outcomes Information System), a National Institutes of Health Roadmap initiative. Self-report item banks were developed through an iterative process of literature searches, collecting and sorting items, expert content review, qualitative patient research, and pilot testing. Internal consistency, convergent validity, and exploratory and confirmatory factor analysis were examined in the resulting item banks. Factor analyses identified 2 preliminary item banks, sleep disturbance and SRI. Item response theory analyses and expert content review narrowed the item banks to 27 and 16 items, respectively. Validity of the item banks was supported by moderate to high correlations with existing scales and by significant differences in sleep disturbance and SRI scores between participants with and without sleep disorders. CONCLUSIONS: The PROMIS sleep disturbance and SRI item banks have excellent measurement properties and may prove to be useful for assessing general aspects of sleep and SRI with various groups of patients and interventions. VL - 33 SN - 0161-8105 (Print)0161-8105 (Linking) N1 - Buysse, Daniel JYu, LanMoul, Douglas EGermain, AnneStover, AngelaDodds, Nathan EJohnston, Kelly LShablesky-Cade, Melissa APilkonis, Paul AAR052155/AR/NIAMS NIH HHS/United StatesU01AR52155/AR/NIAMS NIH HHS/United StatesU01AR52158/AR/NIAMS NIH HHS/United StatesU01AR52170/AR/NIAMS NIH HHS/United StatesU01AR52171/AR/NIAMS NIH HHS/United StatesU01AR52177/AR/NIAMS NIH HHS/United StatesU01AR52181/AR/NIAMS NIH HHS/United StatesU01AR52186/AR/NIAMS NIH HHS/United StatesResearch Support, N.I.H., ExtramuralValidation StudiesUnited StatesSleepSleep. 2010 Jun 1;33(6):781-92. U2 - 2880437 ER - TY - CHAP T1 - Multidimensional Adaptive Testing with Kullback–Leibler Information Item Selection T2 - Elements of Adaptive Testing Y1 - 2010 A1 - Mulder, J. A1 - van der Linden, W. J. JF - Elements of Adaptive Testing ER - TY - ABST T1 - Validation of a computer-adaptive test to evaluate generic health-related quality of life Y1 - 2010 A1 - Rebollo, P. A1 - Castejon, I. A1 - Cuervo, J. A1 - Villa, G. A1 - Garcia-Cueto, E. A1 - Diaz-Cuervo, H. A1 - Zardain, P. C. A1 - Muniz, J. A1 - Alonso, J. AB - BACKGROUND: Health Related Quality of Life (HRQoL) is a relevant variable in the evaluation of health outcomes. Questionnaires based on Classical Test Theory typically require a large number of items to evaluate HRQoL. Computer Adaptive Testing (CAT) can be used to reduce tests length while maintaining and, in some cases, improving accuracy. This study aimed at validating a CAT based on Item Response Theory (IRT) for evaluation of generic HRQoL: the CAT-Health instrument. METHODS: Cross-sectional study of subjects aged over 18 attending Primary Care Centres for any reason. CAT-Health was administered along with the SF-12 Health Survey. Age, gender and a checklist of chronic conditions were also collected. CAT-Health was evaluated considering: 1) feasibility: completion time and test length; 2) content range coverage, Item Exposure Rate (IER) and test precision; and 3) construct validity: differences in the CAT-Health scores according to clinical variables and correlations between both questionnaires. RESULTS: 396 subjects answered CAT-Health and SF-12, 67.2% females, mean age (SD) 48.6 (17.7) years. 36.9% did not report any chronic condition. Median completion time for CAT-Health was 81 seconds (IQ range = 59-118) and it increased with age (p < 0.001). The median number of items administered was 8 (IQ range = 6-10). Neither ceiling nor floor effects were found for the score. None of the items in the pool had an IER of 100% and it was over 5% for 27.1% of the items. Test Information Function (TIF) peaked between levels -1 and 0 of HRQoL. Statistically significant differences were observed in the CAT-Health scores according to the number and type of conditions. CONCLUSIONS: Although domain-specific CATs exist for various areas of HRQoL, CAT-Health is one of the first IRT-based CATs designed to evaluate generic HRQoL and it has proven feasible, valid and efficient, when administered to a broad sample of individuals attending primary care settings. JF - Health and Quality of Life Outcomes VL - 8 SN - 1477-7525 (Electronic)1477-7525 (Linking) N1 - Rebollo, PabloCastejon, IgnacioCuervo, JesusVilla, GuillermoGarcia-Cueto, EduardoDiaz-Cuervo, HelenaZardain, Pilar CMuniz, JoseAlonso, JordiSpanish CAT-Health Research GroupEnglandHealth Qual Life Outcomes. 2010 Dec 3;8:147. U2 - 3022567 ER - TY - CHAP T1 - Applications of CAT in admissions to higher education in Israel: Twenty-two years of experience Y1 - 2009 A1 - Gafni, N. A1 - Cohen, Y. A1 - Roded, K A1 - Baumer, M A1 - Moshinsky, A. CY - D. J. Weiss (Ed.), Proceedings of the 2009 GMAC Conference on Computerized Adaptive Testing. N1 - {PDF file, 326 KB} ER - TY - CHAP T1 - An automatic online calibration design in adaptive testing Y1 - 2009 A1 - Makransky, G. CY - D. J. Weiss (Ed.), Proceedings of the 2009 GMAC Conference on Computerized Adaptive Testing. N1 - {PDF file, 365 KB} ER - TY - CONF T1 - Comparing methods to recalibrate drifting items in computerized adaptive testing T2 - American Educational Research Association Y1 - 2009 A1 - Masters, J. S. A1 - Muckle, T. J. A1 - Bontempo, B JF - American Educational Research Association CY - San Diego, CA ER - TY - CHAP T1 - A comparison of three methods of item selection for computerized adaptive testing Y1 - 2009 A1 - Costa, D. R. A1 - Karino, C. A. A1 - Moura, F. A. S. A1 - Andrade, D. F. CY - D. J. Weiss (Ed.), Proceedings of the 2009 GMAC Conference on Computerized Adaptive Testing. N1 - PDF file, 531 K ER - TY - CHAP T1 - Criterion-related validity of an innovative CAT-based personality measure Y1 - 2009 A1 - Schneider, R. J. A1 - McLellan, R. A. A1 - Kantrowitz, T. M. A1 - Houston, J. S. A1 - Borman, W. C. AB - This paper describes development and initial criterion-related validation of the PreVisor Computer Adaptive Personality Scales (PCAPS), a computerized adaptive testing-based personality measure that uses an ideal point IRT model based on forced-choice, paired-comparison responses. Based on results from a large consortium study, a composite of six PCAPS scales identified as relevant to the population of interest (first-line supervisors) had an estimated operational validity against an overall job performance criterion of ρ = .25. Uncorrected and corrected criterion-related validity results for each of the six PCAPS scales making up the composite are also reported. Because the PCAPS algorithm computes intermediate scale scores until a stopping rule is triggered, we were able to graph number of statement-pairs presented against criterion-related validities. Results showed generally monotonically increasing functions. However, asymptotic validity levels, or at least a reduction in the rate of increase in slope, were often reached after 5-7 statement-pairs were presented. In the case of the composite measure, there was some evidence that validities decreased after about six statement-pairs. A possible explanation for this is provided. CY - D. J. Weiss (Ed.), Proceedings of the 2009 GMAC Conference on Computerized Adaptive Testing. N1 - {PDF File, 163 KB} ER - TY - JOUR T1 - Development of an item bank for the assessment of depression in persons with mental illnesses and physical diseases using Rasch analysis JF - Rehabilitation Psychology Y1 - 2009 A1 - Forkmann, T. A1 - Boecker, M. A1 - Norra, C. A1 - Eberle, N. A1 - Kircher, T. A1 - Schauerte, P. A1 - Mischke, K. A1 - Westhofen, M. A1 - Gauggel, S. A1 - Wirtz, M. KW - Adaptation, Psychological KW - Adult KW - Aged KW - Depressive Disorder/*diagnosis/psychology KW - Diagnosis, Computer-Assisted KW - Female KW - Heart Diseases/*psychology KW - Humans KW - Male KW - Mental Disorders/*psychology KW - Middle Aged KW - Models, Statistical KW - Otorhinolaryngologic Diseases/*psychology KW - Personality Assessment/statistics & numerical data KW - Personality Inventory/*statistics & numerical data KW - Psychometrics/statistics & numerical data KW - Questionnaires KW - Reproducibility of Results KW - Sick Role AB - OBJECTIVE: The calibration of item banks provides the basis for computerized adaptive testing that ensures high diagnostic precision and minimizes participants' test burden. The present study aimed at developing a new item bank that allows for assessing depression in persons with mental and persons with somatic diseases. METHOD: The sample consisted of 161 participants treated for a depressive syndrome, and 206 participants with somatic illnesses (103 cardiologic, 103 otorhinolaryngologic; overall mean age = 44.1 years, SD =14.0; 44.7% women) to allow for validation of the item bank in both groups. Persons answered a pool of 182 depression items on a 5-point Likert scale. RESULTS: Evaluation of Rasch model fit (infit < 1.3), differential item functioning, dimensionality, local independence, item spread, item and person separation (>2.0), and reliability (>.80) resulted in a bank of 79 items with good psychometric properties. CONCLUSIONS: The bank provides items with a wide range of content coverage and may serve as a sound basis for computerized adaptive testing applications. It might also be useful for researchers who wish to develop new fixed-length scales for the assessment of depression in specific rehabilitation settings. VL - 54 SN - 0090-5550 (Print)0090-5550 (Linking) N1 - Forkmann, ThomasBoecker, MarenNorra, ChristineEberle, NicoleKircher, TiloSchauerte, PatrickMischke, KarlWesthofen, MartinGauggel, SiegfriedWirtz, MarkusResearch Support, Non-U.S. Gov'tUnited StatesRehabilitation psychologyRehabil Psychol. 2009 May;54(2):186-97. ER - TY - JOUR T1 - Effekte des adaptiven Testens auf die Moti¬vation zur Testbearbeitung [Effects of adaptive testing on test taking motivation]. JF - Diagnostica Y1 - 2009 A1 - Frey, A. A1 - Hartig, J. A1 - Moosbrugger, H. VL - 55 ER - TY - JOUR T1 - Measuring global physical health in children with cerebral palsy: Illustration of a multidimensional bi-factor model and computerized adaptive testing JF - Quality of Life Research Y1 - 2009 A1 - Haley, S. M. A1 - Ni, P. A1 - Dumas, H. M. A1 - Fragala-Pinkham, M. A. A1 - Hambleton, R. K. A1 - Montpetit, K. A1 - Bilodeau, N. A1 - Gorton, G. E. A1 - Watson, K. A1 - Tucker, C. A. KW - *Computer Simulation KW - *Health Status KW - *Models, Statistical KW - Adaptation, Psychological KW - Adolescent KW - Cerebral Palsy/*physiopathology KW - Child KW - Child, Preschool KW - Factor Analysis, Statistical KW - Female KW - Humans KW - Male KW - Massachusetts KW - Pennsylvania KW - Questionnaires KW - Young Adult AB - PURPOSE: The purposes of this study were to apply a bi-factor model for the determination of test dimensionality and a multidimensional CAT using computer simulations of real data for the assessment of a new global physical health measure for children with cerebral palsy (CP). METHODS: Parent respondents of 306 children with cerebral palsy were recruited from four pediatric rehabilitation hospitals and outpatient clinics. We compared confirmatory factor analysis results across four models: (1) one-factor unidimensional; (2) two-factor multidimensional (MIRT); (3) bi-factor MIRT with fixed slopes; and (4) bi-factor MIRT with varied slopes. We tested whether the general and content (fatigue and pain) person score estimates could discriminate across severity and types of CP, and whether score estimates from a simulated CAT were similar to estimates based on the total item bank, and whether they correlated as expected with external measures. RESULTS: Confirmatory factor analysis suggested separate pain and fatigue sub-factors; all 37 items were retained in the analyses. From the bi-factor MIRT model with fixed slopes, the full item bank scores discriminated across levels of severity and types of CP, and compared favorably to external instruments. CAT scores based on 10- and 15-item versions accurately captured the global physical health scores. CONCLUSIONS: The bi-factor MIRT CAT application, especially the 10- and 15-item versions, yielded accurate global physical health scores that discriminated across known severity groups and types of CP, and correlated as expected with concurrent measures. The CATs have potential for collecting complex data on the physical health of children with CP in an efficient manner. VL - 18 SN - 0962-9343 (Print)0962-9343 (Linking) N1 - Haley, Stephen MNi, PengshengDumas, Helene MFragala-Pinkham, Maria AHambleton, Ronald KMontpetit, KathleenBilodeau, NathalieGorton, George EWatson, KyleTucker, Carole AK02 HD045354-01A1/HD/NICHD NIH HHS/United StatesK02 HD45354-01A1/HD/NICHD NIH HHS/United StatesResearch Support, N.I.H., ExtramuralResearch Support, Non-U.S. Gov'tNetherlandsQuality of life research : an international journal of quality of life aspects of treatment, care and rehabilitationQual Life Res. 2009 Apr;18(3):359-70. Epub 2009 Feb 17. U2 - 2692519 ER - TY - JOUR T1 - Multidimensional Adaptive Testing with Optimal Design Criteria for Item Selection JF - Psychometrika Y1 - 2009 A1 - Mulder, J. A1 - van der Linden, W. J. AB - Several criteria from the optimal design literature are examined for use with item selection in multidimensional adaptive testing. In particular, it is examined what criteria are appropriate for adaptive testing in which all abilities are intentional, some should be considered as a nuisance, or the interest is in the testing of a composite of the abilities. Both the theoretical analyses and the studies of simulated data in this paper suggest that the criteria of A-optimality and D-optimality lead to the most accurate estimates when all abilities are intentional, with the former slightly outperforming the latter. The criterion of E-optimality showed occasional erratic behavior for this case of adaptive testing, and its use is not recommended. If some of the abilities are nuisances, application of the criterion of A(s)-optimality (or D(s)-optimality), which focuses on the subset of intentional abilities is recommended. For the measurement of a linear combination of abilities, the criterion of c-optimality yielded the best results. The preferences of each of these criteria for items with specific patterns of parameter values was also assessed. It was found that the criteria differed mainly in their preferences of items with different patterns of values for their discrimination parameters. VL - 74 SN - 0033-3123 (Print)0033-3123 (Linking) N1 - Journal articlePsychometrikaPsychometrika. 2009 Jun;74(2):273-296. Epub 2008 Dec 23. U2 - 2813188 ER - TY - CHAP T1 - The nine lives of CAT-ASVAB: Innovations and revelations Y1 - 2009 A1 - Pommerich, M A1 - Segall, D. O. A1 - Moreno, K. E. AB - The Armed Services Vocational Aptitude Battery (ASVAB) is administered annually to more than one million military applicants and high school students. ASVAB scores are used to determine enlistment eligibility, assign applicants to military occupational specialties, and aid students in career exploration. The ASVAB is administered as both a paper-and-pencil (P&P) test and a computerized adaptive test (CAT). CAT-ASVAB holds the distinction of being the first large-scale adaptive test battery to be administered in a high-stakes setting. Approximately two-thirds of military applicants currently take CAT-ASVAB; long-term plans are to replace P&P-ASVAB with CAT-ASVAB at all test sites. Given CAT-ASVAB’s pedigree—approximately 20 years in development and 20 years in operational administration—much can be learned from revisiting some of the major highlights of CATASVAB history. This paper traces the progression of CAT-ASVAB through nine major phases of development including: research and evelopment of the CAT-ASVAB prototype, the initial development of psychometric procedures and item pools, initial and full-scale operational implementation, the introduction of new item pools, the introduction of Windows administration, the introduction of Internet administration, and research and development of the next generation CATASVAB. A background and history is provided for each phase, including discussions of major research and operational issues, innovative approaches and practices, and lessons learned. CY - In D. J. Weiss (Ed.), Proceedings of the 2009 GMAC Conference on Computerized Adaptive Testing. N1 - {PDF File, 169 KB} ER - TY - ABST T1 - Proposta para a construo de um Teste Adaptativo Informatizado baseado na Teoria da Resposta ao Item (Proposal for the construction of a Computerized Adaptive Testing based on the Item Response Theory) Y1 - 2009 A1 - Moreira Junior, F. J. A1 - Andrade, D. F. CY - Poster session presented at the Congresso Brasileiro de Teoria da Resposta ao Item, Florianpolis SC Brazil N1 - (In Portguese) ER - TY - JOUR T1 - Replenishing a computerized adaptive test of patient-reported daily activity functioning JF - Quality of Life Research Y1 - 2009 A1 - Haley, S. M. A1 - Ni, P. A1 - Jette, A. M. A1 - Tao, W. A1 - Moed, R. A1 - Meyers, D. A1 - Ludlow, L. H. KW - *Activities of Daily Living KW - *Disability Evaluation KW - *Questionnaires KW - *User-Computer Interface KW - Adult KW - Aged KW - Cohort Studies KW - Computer-Assisted Instruction KW - Female KW - Humans KW - Male KW - Middle Aged KW - Outcome Assessment (Health Care)/*methods AB - PURPOSE: Computerized adaptive testing (CAT) item banks may need to be updated, but before new items can be added, they must be linked to the previous CAT. The purpose of this study was to evaluate 41 pretest items prior to including them into an operational CAT. METHODS: We recruited 6,882 patients with spine, lower extremity, upper extremity, and nonorthopedic impairments who received outpatient rehabilitation in one of 147 clinics across 13 states of the USA. Forty-one new Daily Activity (DA) items were administered along with the Activity Measure for Post-Acute Care Daily Activity CAT (DA-CAT-1) in five separate waves. We compared the scoring consistency with the full item bank, test information function (TIF), person standard errors (SEs), and content range of the DA-CAT-1 to the new CAT (DA-CAT-2) with the pretest items by real data simulations. RESULTS: We retained 29 of the 41 pretest items. Scores from the DA-CAT-2 were more consistent (ICC = 0.90 versus 0.96) than DA-CAT-1 when compared with the full item bank. TIF and person SEs were improved for persons with higher levels of DA functioning, and ceiling effects were reduced from 16.1% to 6.1%. CONCLUSIONS: Item response theory and online calibration methods were valuable in improving the DA-CAT. VL - 18 SN - 0962-9343 (Print)0962-9343 (Linking) N1 - Haley, Stephen MNi, PengshengJette, Alan MTao, WeiMoed, RichardMeyers, DougLudlow, Larry HK02 HD45354-01/HD/NICHD NIH HHS/United StatesResearch Support, N.I.H., ExtramuralNetherlandsQuality of life research : an international journal of quality of life aspects of treatment, care and rehabilitationQual Life Res. 2009 May;18(4):461-71. Epub 2009 Mar 14. ER - TY - JOUR T1 - Studying the Equivalence of Computer-Delivered and Paper-Based Administrations of the Raven Standard Progressive Matrices Test JF - Educational and Psychological Measurement Y1 - 2009 A1 - Arce-Ferrer, Alvaro J. A1 - Martínez Guzmán, Elvira AB -

This study investigates the effect of mode of administration of the Raven Standard Progressive Matrices test on distribution, accuracy, and meaning of raw scores. A random sample of high school students take counterbalanced paper-and-pencil and computer-based administrations of the test and answer a questionnaire surveying preferences for computer-delivered test administrations. Administration mode effect is studied with repeated measures multivariate analysis of variance, internal consistency reliability estimates, and confirmatory factor analysis approaches. Results show a lack of test mode effect on distribution, accuracy, and meaning of raw scores. Participants indicate their preferences for the computer-delivered administration of the test. The article discusses findings in light of previous studies of the Raven Standard Progressive Matrices test.

VL - 69 UR - http://epm.sagepub.com/content/69/5/855.abstract ER - TY - JOUR T1 - Adaptive short forms for outpatient rehabilitation outcome assessment JF - American Journal of Physical Medicine and Rehabilitation Y1 - 2008 A1 - Jette, A. M. A1 - Haley, S. M. A1 - Ni, P. A1 - Moed, R. KW - *Activities of Daily Living KW - *Ambulatory Care Facilities KW - *Mobility Limitation KW - *Treatment Outcome KW - Disabled Persons/psychology/*rehabilitation KW - Female KW - Humans KW - Male KW - Middle Aged KW - Questionnaires KW - Rehabilitation Centers AB - OBJECTIVE: To develop outpatient Adaptive Short Forms for the Activity Measure for Post-Acute Care item bank for use in outpatient therapy settings. DESIGN: A convenience sample of 11,809 adults with spine, lower limb, upper limb, and miscellaneous orthopedic impairments who received outpatient rehabilitation in 1 of 127 outpatient rehabilitation clinics in the United States. We identified optimal items for use in developing outpatient Adaptive Short Forms based on the Basic Mobility and Daily Activities domains of the Activity Measure for Post-Acute Care item bank. Patient scores were derived from the Activity Measure for Post-Acute Care computerized adaptive testing program. Items were selected for inclusion on the Adaptive Short Forms based on functional content, range of item coverage, measurement precision, item exposure rate, and data collection burden. RESULTS: Two outpatient Adaptive Short Forms were developed: (1) an 18-item Basic Mobility Adaptive Short Form and (2) a 15-item Daily Activities Adaptive Short Form, derived from the same item bank used to develop the Activity Measure for Post-Acute Care computerized adaptive testing program. Both Adaptive Short Forms achieved acceptable psychometric properties. CONCLUSIONS: In outpatient postacute care settings where computerized adaptive testing outcome applications are currently not feasible, item response theory-derived Adaptive Short Forms provide the efficient capability to monitor patients' functional outcomes. The development of Adaptive Short Form functional outcome instruments linked by a common, calibrated item bank has the potential to create a bridge to outcome monitoring across postacute care settings and can facilitate the eventual transformation from Adaptive Short Forms to computerized adaptive testing applications easier and more acceptable to the rehabilitation community. VL - 87 SN - 1537-7385 (Electronic) N1 - Jette, Alan MHaley, Stephen MNi, PengshengMoed, RichardK02 HD45354-01/HD/NICHD NIH HHS/United StatesR01 HD43568/HD/NICHD NIH HHS/United StatesResearch Support, N.I.H., ExtramuralResearch Support, U.S. Gov't, Non-P.H.S.Research Support, U.S. Gov't, P.H.S.United StatesAmerican journal of physical medicine & rehabilitation / Association of Academic PhysiatristsAm J Phys Med Rehabil. 2008 Oct;87(10):842-52. ER - TY - JOUR T1 - Combining computer adaptive testing technology with cognitively diagnostic assessment JF - Behavioral Research Methods Y1 - 2008 A1 - McGlohen, M. A1 - Chang, Hua-Hua KW - *Cognition KW - *Computers KW - *Models, Statistical KW - *User-Computer Interface KW - Diagnosis, Computer-Assisted/*instrumentation KW - Humans AB - A major advantage of computerized adaptive testing (CAT) is that it allows the test to home in on an examinee's ability level in an interactive manner. The aim of the new area of cognitive diagnosis is to provide information about specific content areas in which an examinee needs help. The goal of this study was to combine the benefit of specific feedback from cognitively diagnostic assessment with the advantages of CAT. In this study, three approaches to combining these were investigated: (1) item selection based on the traditional ability level estimate (theta), (2) item selection based on the attribute mastery feedback provided by cognitively diagnostic assessment (alpha), and (3) item selection based on both the traditional ability level estimate (theta) and the attribute mastery feedback provided by cognitively diagnostic assessment (alpha). The results from these three approaches were compared for theta estimation accuracy, attribute mastery estimation accuracy, and item exposure control. The theta- and alpha-based condition outperformed the alpha-based condition regarding theta estimation, attribute mastery pattern estimation, and item exposure control. Both the theta-based condition and the theta- and alpha-based condition performed similarly with regard to theta estimation, attribute mastery estimation, and item exposure control, but the theta- and alpha-based condition has an additional advantage in that it uses the shadow test method, which allows the administrator to incorporate additional constraints in the item selection process, such as content balancing, item type constraints, and so forth, and also to select items on the basis of both the current theta and alpha estimates, which can be built on top of existing 3PL testing programs. VL - 40 SN - 1554-351X (Print) N1 - McGlohen, MeghanChang, Hua-HuaUnited StatesBehavior research methodsBehav Res Methods. 2008 Aug;40(3):808-21. ER - TY - JOUR T1 - Computerized adaptive testing for patients with knee inpairments produced valid and responsive measures of function JF - Journal of Clinical Epidemiology Y1 - 2008 A1 - Hart, D. L. A1 - Wang, Y-C. A1 - Stratford, P. W. A1 - Mioduski, J. E. VL - 61 ER - TY - JOUR T1 - Computerized adaptive testing in back pain: Validation of the CAT-5D-QOL JF - Spine Y1 - 2008 A1 - Kopec, J. A. A1 - Badii, M. A1 - McKenna, M. A1 - Lima, V. D. A1 - Sayre, E. C. A1 - Dvorak, M. KW - *Disability Evaluation KW - *Health Status Indicators KW - *Quality of Life KW - Adult KW - Aged KW - Algorithms KW - Back Pain/*diagnosis/psychology KW - British Columbia KW - Diagnosis, Computer-Assisted/*standards KW - Feasibility Studies KW - Female KW - Humans KW - Internet KW - Male KW - Middle Aged KW - Predictive Value of Tests KW - Questionnaires/*standards KW - Reproducibility of Results AB - STUDY DESIGN: We have conducted an outcome instrument validation study. OBJECTIVE: Our objective was to develop a computerized adaptive test (CAT) to measure 5 domains of health-related quality of life (HRQL) and assess its feasibility, reliability, validity, and efficiency. SUMMARY OF BACKGROUND DATA: Kopec and colleagues have recently developed item response theory based item banks for 5 domains of HRQL relevant to back pain and suitable for CAT applications. The domains are Daily Activities (DAILY), Walking (WALK), Handling Objects (HAND), Pain or Discomfort (PAIN), and Feelings (FEEL). METHODS: An adaptive algorithm was implemented in a web-based questionnaire administration system. The questionnaire included CAT-5D-QOL (5 scales), Modified Oswestry Disability Index (MODI), Roland-Morris Disability Questionnaire (RMDQ), SF-36 Health Survey, and standard clinical and demographic information. Participants were outpatients treated for mechanical back pain at a referral center in Vancouver, Canada. RESULTS: A total of 215 patients completed the questionnaire and 84 completed a retest. On average, patients answered 5.2 items per CAT-5D-QOL scale. Reliability ranged from 0.83 (FEEL) to 0.92 (PAIN) and was 0.92 for the MODI, RMDQ, and Physical Component Summary (PCS-36). The ceiling effect was 0.5% for PAIN compared with 2% for MODI and 5% for RMQ. The CAT-5D-QOL scales correlated as anticipated with other measures of HRQL and discriminated well according to the level of satisfaction with current symptoms, duration of the last episode, sciatica, and disability compensation. The average relative discrimination index was 0.87 for PAIN, 0.67 for DAILY and 0.62 for WALK, compared with 0.89 for MODI, 0.80 for RMDQ, and 0.59 for PCS-36. CONCLUSION: The CAT-5D-QOL is feasible, reliable, valid, and efficient in patients with back pain. This methodology can be recommended for use in back pain research and should improve outcome assessment, facilitate comparisons across studies, and reduce patient burden. VL - 33 SN - 1528-1159 (Electronic)0362-2436 (Linking) N1 - Kopec, Jacek ABadii, MaziarMcKenna, MarioLima, Viviane DSayre, Eric CDvorak, MarcelResearch Support, Non-U.S. Gov'tValidation StudiesUnited StatesSpineSpine (Phila Pa 1976). 2008 May 20;33(12):1384-90. ER - TY - JOUR T1 - Computerized Adaptive Testing of Personality Traits JF - Zeitschrift für Psychologie / Journal of Psychology Y1 - 2008 A1 - Hol, A. M. A1 - Vorst, H. C. M. A1 - Mellenbergh, G. J. KW - Adaptive Testing KW - cmoputer-assisted testing KW - Item Response Theory KW - Likert scales KW - Personality Measures AB -

A computerized adaptive testing (CAT) procedure was simulated with ordinal polytomous personality data collected using a
conventional paper-and-pencil testing format. An adapted Dutch version of the dominance scale of Gough and Heilbrun’s Adjective
Check List (ACL) was used. This version contained Likert response scales with five categories. Item parameters were estimated using Samejima’s graded response model from the responses of 1,925 subjects. The CAT procedure was simulated using the responses of 1,517 other subjects. The value of the required standard error in the stopping rule of the CAT was manipulated. The relationship between CAT latent trait estimates and estimates based on all dominance items was studied. Additionally, the pattern of relationships between the CAT latent trait estimates and the other ACL scales was compared to that between latent trait estimates based on the entire item pool and the other ACL scales. The CAT procedure resulted in latent trait estimates qualitatively equivalent to latent trait estimates based on all items, while a substantial reduction of the number of used items could be realized (at the stopping rule of 0.4 about 33% of the 36 items was used).

VL - 216 IS - 1 ER - TY - JOUR T1 - Impact of altering randomization intervals on precision of measurement and item exposure JF - Journal of Applied Measurement Y1 - 2008 A1 - Muckle, T. J. A1 - Bergstrom, B. A. A1 - Becker, K. A1 - Stahl, J. A. AB -

This paper reports on the use of simulation when a randomization procedure is used to control item exposure in a computerized adaptive test for certification. We present a method to determine the optimum width of the interval from which items are selected and we report on the impact of relaxing the interval width on measurement precision and item exposure. Results indicate that, if the item bank is well targeted, it may be possible to widen the randomization interval and thus reduce item exposure, without seriously impacting the error of measure for test takers whose ability estimate is near the pass point.

VL - 9 IS - 2 ER - TY - JOUR T1 - Measuring physical functioning in children with spinal impairments with computerized adaptive testing JF - Journal of Pediatric Orthopedics Y1 - 2008 A1 - Mulcahey, M. J. A1 - Haley, S. M. A1 - Duffy, T. A1 - Pengsheng, N. A1 - Betz, R. R. KW - *Disability Evaluation KW - Adolescent KW - Child KW - Child, Preschool KW - Computer Simulation KW - Cross-Sectional Studies KW - Disabled Children/*rehabilitation KW - Female KW - Humans KW - Infant KW - Kyphosis/*diagnosis/rehabilitation KW - Male KW - Prospective Studies KW - Reproducibility of Results KW - Scoliosis/*diagnosis/rehabilitation AB - BACKGROUND: The purpose of this study was to assess the utility of measuring current physical functioning status of children with scoliosis and kyphosis by applying computerized adaptive testing (CAT) methods. Computerized adaptive testing uses a computer interface to administer the most optimal items based on previous responses, reducing the number of items needed to obtain a scoring estimate. METHODS: This was a prospective study of 77 subjects (0.6-19.8 years) who were seen by a spine surgeon during a routine clinic visit for progress spine deformity. Using a multidimensional version of the Pediatric Evaluation of Disability Inventory CAT program (PEDI-MCAT), we evaluated content range, accuracy and efficiency, known-group validity, concurrent validity with the Pediatric Outcomes Data Collection Instrument, and test-retest reliability in a subsample (n = 16) within a 2-week interval. RESULTS: We found the PEDI-MCAT to have sufficient item coverage in both self-care and mobility content for this sample, although most patients tended to score at the higher ends of both scales. Both the accuracy of PEDI-MCAT scores as compared with a fixed format of the PEDI (r = 0.98 for both mobility and self-care) and test-retest reliability were very high [self-care: intraclass correlation (3,1) = 0.98, mobility: intraclass correlation (3,1) = 0.99]. The PEDI-MCAT took an average of 2.9 minutes for the parents to complete. The PEDI-MCAT detected expected differences between patient groups, and scores on the PEDI-MCAT correlated in expected directions with scores from the Pediatric Outcomes Data Collection Instrument domains. CONCLUSIONS: Use of the PEDI-MCAT to assess the physical functioning status, as perceived by parents of children with complex spinal impairments, seems to be feasible and achieves accurate and efficient estimates of self-care and mobility function. Additional item development will be needed at the higher functioning end of the scale to avoid ceiling effects for older children. LEVEL OF EVIDENCE: This is a level II prospective study designed to establish the utility of computer adaptive testing as an evaluation method in a busy pediatric spine practice. VL - 28 SN - 0271-6798 (Print)0271-6798 (Linking) N1 - Mulcahey, M JHaley, Stephen MDuffy, TheresaPengsheng, NiBetz, Randal RK02 HD045354-01A1/HD/NICHD NIH HHS/United StatesUnited StatesJournal of pediatric orthopedicsJ Pediatr Orthop. 2008 Apr-May;28(3):330-5. U2 - 2696932 ER - TY - CHAP T1 - Adaptive estimators of trait level in adaptive testing: Some proposals Y1 - 2007 A1 - Raîche, G. A1 - Blais, J. G. A1 - Magis, D. CY - D. J. Weiss (Ed.), Proceedings of the 2007 GMAC Conference on Computerized Adaptive Testing. N1 - {PDF file, 125 KB} ER - TY - JOUR T1 - Computerized adaptive testing for polytomous motivation items: Administration mode effects and a comparison with short forms JF - Applied Psychological Measurement Y1 - 2007 A1 - Hol, A. M. A1 - Vorst, H. C. M. A1 - Mellenbergh, G. J. KW - 2220 Tests & Testing KW - Adaptive Testing KW - Attitude Measurement KW - computer adaptive testing KW - Computer Assisted Testing KW - items KW - Motivation KW - polytomous motivation KW - Statistical Validity KW - Test Administration KW - Test Forms KW - Test Items AB - In a randomized experiment (n=515), a computerized and a computerized adaptive test (CAT) are compared. The item pool consists of 24 polytomous motivation items. Although items are carefully selected, calibration data show that Samejima's graded response model did not fit the data optimally. A simulation study is done to assess possible consequences of model misfit. CAT efficiency was studied by a systematic comparison of the CAT with two types of conventional fixed length short forms, which are created to be good CAT competitors. Results showed no essential administration mode effects. Efficiency analyses show that CAT outperformed the short forms in almost all aspects when results are aggregated along the latent trait scale. The real and the simulated data results are very similar, which indicate that the real data results are not affected by model misfit. (PsycINFO Database Record (c) 2007 APA ) (journal abstract) VL - 31 SN - 0146-6216 N1 - 10.1177/0146621606297314Journal; Peer Reviewed Journal; Journal Article ER - TY - JOUR T1 - Computerized Adaptive Testing for Polytomous Motivation Items: Administration Mode Effects and a Comparison With Short Forms JF - Applied Psychological Measurement Y1 - 2007 A1 - Hol, A. Michiel A1 - Vorst, Harrie C. M. A1 - Mellenbergh, Gideon J. AB -

In a randomized experiment (n = 515), a computerized and a computerized adaptive test (CAT) are compared. The item pool consists of 24 polytomous motivation items. Although items are carefully selected, calibration data show that Samejima's graded response model did not fit the data optimally. A simulation study is done to assess possible consequences of model misfit. CAT efficiency was studied by a systematic comparison of the CAT with two types of conventional fixed length short forms, which are created to be good CAT competitors. Results showed no essential administration mode effects. Efficiency analyses show that CAT outperformed the short forms in almost all aspects when results are aggregated along the latent trait scale. The real and the simulated data results are very similar, which indicate that the real data results are not affected by model misfit.

VL - 31 UR - http://apm.sagepub.com/content/31/5/412.abstract ER - TY - JOUR T1 - Computerizing Organizational Attitude Surveys JF - Educational and Psychological Measurement Y1 - 2007 A1 - Mueller, Karsten A1 - Liebig, Christian A1 - Hattrup, Keith AB -

Two quasi-experimental field studies were conducted to evaluate the psychometric equivalence of computerized and paper-and-pencil job satisfaction measures. The present research extends previous work in the area by providing better control of common threats to validity in quasi-experimental research on test mode effects and by evaluating a more comprehensive measurement model for job attitudes. Results of both studies demonstrated substantial equivalence of the computerized measure with the paper-and-pencil version. Implications for the practical use of computerized organizational attitude surveys are discussed.

VL - 67 UR - http://epm.sagepub.com/content/67/4/658.abstract ER - TY - JOUR T1 - IRT health outcomes data analysis project: an overview and summary JF - Quality of Life Research Y1 - 2007 A1 - Cook, K. F. A1 - Teal, C. R. A1 - Bjorner, J. B. A1 - Cella, D. A1 - Chang, C-H. A1 - Crane, P. K. A1 - Gibbons, L. E. A1 - Hays, R. D. A1 - McHorney, C. A. A1 - Ocepek-Welikson, K. A1 - Raczek, A. E. A1 - Teresi, J. A. A1 - Reeve, B. B. KW - *Data Interpretation, Statistical KW - *Health Status KW - *Quality of Life KW - *Questionnaires KW - *Software KW - Female KW - HIV Infections/psychology KW - Humans KW - Male KW - Neoplasms/psychology KW - Outcome Assessment (Health Care)/*methods KW - Psychometrics KW - Stress, Psychological AB - BACKGROUND: In June 2004, the National Cancer Institute and the Drug Information Association co-sponsored the conference, "Improving the Measurement of Health Outcomes through the Applications of Item Response Theory (IRT) Modeling: Exploration of Item Banks and Computer-Adaptive Assessment." A component of the conference was presentation of a psychometric and content analysis of a secondary dataset. OBJECTIVES: A thorough psychometric and content analysis was conducted of two primary domains within a cancer health-related quality of life (HRQOL) dataset. RESEARCH DESIGN: HRQOL scales were evaluated using factor analysis for categorical data, IRT modeling, and differential item functioning analyses. In addition, computerized adaptive administration of HRQOL item banks was simulated, and various IRT models were applied and compared. SUBJECTS: The original data were collected as part of the NCI-funded Quality of Life Evaluation in Oncology (Q-Score) Project. A total of 1,714 patients with cancer or HIV/AIDS were recruited from 5 clinical sites. MEASURES: Items from 4 HRQOL instruments were evaluated: Cancer Rehabilitation Evaluation System-Short Form, European Organization for Research and Treatment of Cancer Quality of Life Questionnaire, Functional Assessment of Cancer Therapy and Medical Outcomes Study Short-Form Health Survey. RESULTS AND CONCLUSIONS: Four lessons learned from the project are discussed: the importance of good developmental item banks, the ambiguity of model fit results, the limits of our knowledge regarding the practical implications of model misfit, and the importance in the measurement of HRQOL of construct definition. With respect to these lessons, areas for future research are suggested. The feasibility of developing item banks for broad definitions of health is discussed. VL - 16 SN - 0962-9343 (Print) N1 - Cook, Karon FTeal, Cayla RBjorner, Jakob BCella, DavidChang, Chih-HungCrane, Paul KGibbons, Laura EHays, Ron DMcHorney, Colleen AOcepek-Welikson, KatjaRaczek, Anastasia ETeresi, Jeanne AReeve, Bryce B1U01AR52171-01/AR/United States NIAMSR01 (CA60068)/CA/United States NCIY1-PC-3028-01/PC/United States NCIResearch Support, N.I.H., ExtramuralNetherlandsQuality of life research : an international journal of quality of life aspects of treatment, care and rehabilitationQual Life Res. 2007;16 Suppl 1:121-32. Epub 2007 Mar 10. ER - TY - JOUR T1 - Prospective evaluation of the am-pac-cat in outpatient rehabilitation settings JF - Physical Therapy Y1 - 2007 A1 - Jette, A., A1 - Haley, S. A1 - Tao, W. A1 - Ni, P. A1 - Moed, R. A1 - Meyers, D. A1 - Zurek, M. VL - 87 ER - TY - CONF T1 - A comparison of online calibration methods for a CAT T2 - Presented at the National Council on Measurement on Education Y1 - 2006 A1 - Morgan, D. L. A1 - Way, W. D. A1 - Augemberg, K.E. JF - Presented at the National Council on Measurement on Education CY - San Francisco, CA ER - TY - JOUR T1 - An Introduction to Multistage Testing JF - Applied Measurement in Education Y1 - 2006 A1 - Alan D Mead VL - 19 UR - http://www.tandfonline.com/doi/abs/10.1207/s15324818ame1903_1 ER - TY - JOUR T1 - Maximum information stratification method for controlling item exposure in computerized adaptive testing JF - Psicothema Y1 - 2006 A1 - Barrada, J A1 - Mazuela, P. A1 - Olea, J. KW - *Artificial Intelligence KW - *Microcomputers KW - *Psychological Tests KW - *Software Design KW - Algorithms KW - Chi-Square Distribution KW - Humans KW - Likelihood Functions AB - The proposal for increasing the security in Computerized Adaptive Tests that has received most attention in recent years is the a-stratified method (AS - Chang and Ying, 1999): at the beginning of the test only items with low discrimination parameters (a) can be administered, with the values of the a parameters increasing as the test goes on. With this method, distribution of the exposure rates of the items is less skewed, while efficiency is maintained in trait-level estimation. The pseudo-guessing parameter (c), present in the three-parameter logistic model, is considered irrelevant, and is not used in the AS method. The Maximum Information Stratified (MIS) model incorporates the c parameter in the stratification of the bank and in the item-selection rule, improving accuracy by comparison with the AS, for item banks with a and b parameters correlated and uncorrelated. For both kinds of banks, the blocking b methods (Chang, Qian and Ying, 2001) improve the security of the item bank.Método de estratificación por máxima información para el control de la exposición en tests adaptativos informatizados. La propuesta para aumentar la seguridad en los tests adaptativos informatizados que ha recibido más atención en los últimos años ha sido el método a-estratificado (AE - Chang y Ying, 1999): en los momentos iniciales del test sólo pueden administrarse ítems con bajos parámetros de discriminación (a), incrementándose los valores del parámetro a admisibles según avanza el test. Con este método la distribución de las tasas de exposición de los ítems es más equilibrada, manteniendo una adecuada precisión en la medida. El parámetro de pseudoadivinación (c), presente en el modelo logístico de tres parámetros, se supone irrelevante y no se incorpora en el AE. El método de Estratificación por Máxima Información (EMI) incorpora el parámetro c a la estratificación del banco y a la regla de selección de ítems, mejorando la precisión en comparación con AE, tanto para bancos donde los parámetros a y b correlacionan como para bancos donde no. Para ambos tipos de bancos, los métodos de bloqueo de b (Chang, Qian y Ying, 2001) mejoran la seguridad del banco. VL - 18 SN - 0214-9915 (Print) N1 - Barrada, Juan RamonMazuela, PalomaOlea, JulioResearch Support, Non-U.S. Gov'tSpainPsicothemaPsicothema. 2006 Feb;18(1):156-9. ER - TY - JOUR T1 - Simulated computerized adaptive test for patients with lumbar spine impairments was efficient and produced valid measures of function JF - Journal of Clinical Epidemiology Y1 - 2006 A1 - Hart, D. L. A1 - Mioduski, J. E. A1 - Werneke, M. W. A1 - Stratford, P. W. KW - Back Pain Functional Scale KW - computerized adaptive testing KW - Item Response Theory KW - Lumbar spine KW - Rehabilitation KW - True-score equating AB - Objective: To equate physical functioning (PF) items with Back Pain Functional Scale (BPFS) items, develop a computerized adaptive test (CAT) designed to assess lumbar spine functional status (LFS) in people with lumbar spine impairments, and compare discriminant validity of LFS measures (qIRT) generated using all items analyzed with a rating scale Item Response Theory model (RSM) and measures generated using the simulated CAT (qCAT). Methods: We performed a secondary analysis of retrospective intake rehabilitation data. Results: Unidimensionality and local independence of 25 BPFS and PF items were supported. Differential item functioning was negligible for levels of symptom acuity, gender, age, and surgical history. The RSM fit the data well. A lumbar spine specific CAT was developed that was 72% more efficient than using all 25 items to estimate LFS measures. qIRT and qCAT measures did not discriminate patients by symptom acuity, age, or gender, but discriminated patients by surgical history in similar clinically logical ways. qCAT measures were as precise as qIRT measures. Conclusion: A body part specific simulated CAT developed from an LFS item bank was efficient and produced precise measures of LFS without eroding discriminant validity. VL - 59 ER - TY - JOUR T1 - Simulated computerized adaptive test for patients with lumbar spine impairments was efficient and produced valid measures of function JF - Journal of Clinical Epidemiology Y1 - 2006 A1 - Hart, D. A1 - Mioduski, J. A1 - Werenke, M. A1 - Stratford, P. VL - 59 ER - TY - JOUR T1 - Simulated computerized adaptive test for patients with shoulder impairments was efficient and produced valid measures of function JF - Journal of Clinical Epidemiology Y1 - 2006 A1 - Hart, D. L. A1 - Cook, K. F. A1 - Mioduski, J. E. A1 - Teal, C. R. A1 - Crane, P. K. KW - computerized adaptive testing KW - Flexilevel Scale of Shoulder Function KW - Item Response Theory KW - Rehabilitation AB -

Background and Objective: To test unidimensionality and local independence of a set of shoulder functional status (SFS) items,
develop a computerized adaptive test (CAT) of the items using a rating scale item response theory model (RSM), and compare discriminant validity of measures generated using all items (qIRT) and measures generated using the simulated CAT (qCAT).
Study Design and Setting: We performed a secondary analysis of data collected prospectively during rehabilitation of 400 patients
with shoulder impairments who completed 60 SFS items.
Results: Factor analytic techniques supported that the 42 SFS items formed a unidimensional scale and were locally independent. Except for five items, which were deleted, the RSM fit the data well. The remaining 37 SFS items were used to generate the CAT. On average, 6 items on were needed to estimate precise measures of function using the SFS CAT, compared with all 37 SFS items. The qIRT and qCAT measures were highly correlated (r 5 .96) and resulted in similar classifications of patients.
Conclusion: The simulated SFS CAT was efficient and produced precise, clinically relevant measures of functional status with good
discriminating ability. 

VL - 59 IS - 3 ER - TY - JOUR T1 - Simulated computerized adaptive test for patients with shoulder impairments was efficient and produced valid measures of function JF - Journal of Clinical Epidemiology Y1 - 2006 A1 - Hart, D. L. A1 - Cook, K. F. A1 - Mioduski, J. E. A1 - Teal, C. R. A1 - Crane, P. K. KW - *Computer Simulation KW - *Range of Motion, Articular KW - Activities of Daily Living KW - Adult KW - Aged KW - Aged, 80 and over KW - Factor Analysis, Statistical KW - Female KW - Humans KW - Male KW - Middle Aged KW - Prospective Studies KW - Reproducibility of Results KW - Research Support, N.I.H., Extramural KW - Research Support, U.S. Gov't, Non-P.H.S. KW - Shoulder Dislocation/*physiopathology/psychology/rehabilitation KW - Shoulder Pain/*physiopathology/psychology/rehabilitation KW - Shoulder/*physiopathology KW - Sickness Impact Profile KW - Treatment Outcome AB - BACKGROUND AND OBJECTIVE: To test unidimensionality and local independence of a set of shoulder functional status (SFS) items, develop a computerized adaptive test (CAT) of the items using a rating scale item response theory model (RSM), and compare discriminant validity of measures generated using all items (theta(IRT)) and measures generated using the simulated CAT (theta(CAT)). STUDY DESIGN AND SETTING: We performed a secondary analysis of data collected prospectively during rehabilitation of 400 patients with shoulder impairments who completed 60 SFS items. RESULTS: Factor analytic techniques supported that the 42 SFS items formed a unidimensional scale and were locally independent. Except for five items, which were deleted, the RSM fit the data well. The remaining 37 SFS items were used to generate the CAT. On average, 6 items were needed to estimate precise measures of function using the SFS CAT, compared with all 37 SFS items. The theta(IRT) and theta(CAT) measures were highly correlated (r = .96) and resulted in similar classifications of patients. CONCLUSION: The simulated SFS CAT was efficient and produced precise, clinically relevant measures of functional status with good discriminating ability. VL - 59 N1 - 0895-4356 (Print)Journal ArticleValidation Studies ER - TY - CONF T1 - A variant of the progressive restricted item exposure control procedure in computerized adaptive testing systems based on the 3PL and the partial credit model T2 - Paper presented at the annual meetings of the American Educational Research Association Y1 - 2006 A1 - McClarty, L. K. A1 - Sperling, R. A1 - Dodd, B. G. JF - Paper presented at the annual meetings of the American Educational Research Association CY - San Francisco ER - TY - JOUR T1 - Constructing a Computerized Adaptive Test for University Applicants With Disabilities JF - Applied Measurement in Education Y1 - 2005 A1 - Moshinsky, Avital A1 - Kazin, Cathrael VL - 18 UR - http://www.tandfonline.com/doi/abs/10.1207/s15324818ame1804_3 ER - TY - JOUR T1 - Data pooling and analysis to build a preliminary item bank: an example using bowel function in prostate cancer JF - Evaluation and the Health Professions Y1 - 2005 A1 - Eton, D. T. A1 - Lai, J. S. A1 - Cella, D. A1 - Reeve, B. B. A1 - Talcott, J. A. A1 - Clark, J. A. A1 - McPherson, C. P. A1 - Litwin, M. S. A1 - Moinpour, C. M. KW - *Quality of Life KW - *Questionnaires KW - Adult KW - Aged KW - Data Collection/methods KW - Humans KW - Intestine, Large/*physiopathology KW - Male KW - Middle Aged KW - Prostatic Neoplasms/*physiopathology KW - Psychometrics KW - Research Support, Non-U.S. Gov't KW - Statistics, Nonparametric AB - Assessing bowel function (BF) in prostate cancer can help determine therapeutic trade-offs. We determined the components of BF commonly assessed in prostate cancer studies as an initial step in creating an item bank for clinical and research application. We analyzed six archived data sets representing 4,246 men with prostate cancer. Thirty-one items from validated instruments were available for analysis. Items were classified into domains (diarrhea, rectal urgency, pain, bleeding, bother/distress, and other) then subjected to conventional psychometric and item response theory (IRT) analyses. Items fit the IRT model if the ratio between observed and expected item variance was between 0.60 and 1.40. Four of 31 items had inadequate fit in at least one analysis. Poorly fitting items included bleeding (2), rectal urgency (1), and bother/distress (1). A fifth item assessing hemorrhoids was poorly correlated with other items. Our analyses supported four related components of BF: diarrhea, rectal urgency, pain, and bother/distress. VL - 28 N1 - 0163-2787 (Print)Journal Article ER - TY - JOUR T1 - An item response theory-based pain item bank can enhance measurement precision JF - Journal of Pain and Symptom Management Y1 - 2005 A1 - Lai, J-S. A1 - Dineen, K. A1 - Reeve, B. B. A1 - Von Roenn, J. A1 - Shervin, D. A1 - McGuire, M. A1 - Bode, R. K. A1 - Paice, J. A1 - Cella, D. KW - computerized adaptive testing AB - Cancer-related pain is often under-recognized and undertreated. This is partly due to the lack of appropriate assessments, which need to be comprehensive and precise yet easily integrated into clinics. Computerized adaptive testing (CAT) can enable precise-yet-brief assessments by only selecting the most informative items from a calibrated item bank. The purpose of this study was to create such a bank. The sample included 400 cancer patients who were asked to complete 61 pain-related items. Data were analyzed using factor analysis and the Rasch model. The final bank consisted of 43 items which satisfied the measurement requirement of factor analysis and the Rasch model, demonstrated high internal consistency and reasonable item-total correlations, and discriminated patients with differing degrees of pain. We conclude that this bank demonstrates good psychometric properties, is sensitive to pain reported by patients, and can be used as the foundation for a CAT pain-testing platform for use in clinical practice. VL - 30 N1 - 0885-3924Journal Article ER - TY - JOUR T1 - La Validez desde una óptica psicométrica [Validity from a psychometric perspective] JF - Acta Comportamentalia Y1 - 2005 A1 - Muñiz, J. KW - Factor Analysis KW - Measurement KW - Psychometrics KW - Scaling (Testing) KW - Statistical KW - Technology KW - Test Validity AB - El estudio de la validez constituye el eje central de los análisis psicométricos de los instrumentos de medida. En esta comunicación se traza una breve nota histórica de los distintos modos de concebir la validez a lo largo de los tiempos, se comentan las líneas actuales, y se tratan de vislumbrar posibles vías futuras, teniendo en cuenta el impacto que las nuevas tecnologías informáticas están ejerciendo sobre los propios instrumentos de medida en Psicología y Educación. Cuestiones como los nuevos formatos multimedia de los ítems, la evaluación a distancia, el uso intercultural de las pruebas, las consecuencias de su uso, o los tests adaptativos informatizados, reclaman nuevas formas de evaluar y conceptualizar la validez. También se analizan críticamente algunos planteamientos recientes sobre el concepto de validez. The study of validity constitutes a central axis of psychometric analyses of measurement instruments. This paper presents a historical sketch of different modes of conceiving validity, with commentary on current views, and it attempts to predict future lines of research by considering the impact of new computerized technologies on measurement instruments in psychology and education. Factors such as the new multimedia format of items, distance assessment, the intercultural use of tests, the consequences of the latter, or the development of computerized adaptive tests demand new ways of conceiving and evaluating validity. Some recent thoughts about the concept of validity are also critically analyzed. (PsycINFO Database Record (c) 2005 APA ) (journal abstract) VL - 13 ER - TY - JOUR T1 - A randomized experiment to compare conventional, computerized, and computerized adaptive administration of ordinal polytomous attitude items JF - Applied Psychological Measurement Y1 - 2005 A1 - Hol, A. M. A1 - Vorst, H. C. M. A1 - Mellenbergh, G. J. KW - Computer Assisted Testing KW - Test Administration KW - Test Items AB - A total of 520 high school students were randomly assigned to a paper-and-pencil test (PPT), a computerized standard test (CST), or a computerized adaptive test (CAT) version of the Dutch School Attitude Questionnaire (SAQ), consisting of ordinal polytomous items. The CST administered items in the same order as the PPT. The CAT administered all items of three SAQ subscales in adaptive order using Samejima's graded response model, so that six different stopping rule settings could be applied afterwards. School marks were used as external criteria. Results showed significant but small multivariate administration mode effects on conventional raw scores and small to medium effects on maximum likelihood latent trait estimates. When the precision of CAT latent trait estimates decreased, correlations with grade point average in general decreased. However, the magnitude of the decrease was not very large as compared to the PPT, the CST, and the CAT without the stopping rule. (PsycINFO Database Record (c) 2005 APA ) (journal abstract) VL - 29 ER - TY - JOUR T1 - A Randomized Experiment to Compare Conventional, Computerized, and Computerized Adaptive Administration of Ordinal Polytomous Attitude Items JF - Applied Psychological Measurement Y1 - 2005 A1 - Hol, A. Michiel A1 - Vorst, Harrie C. M. A1 - Mellenbergh, Gideon J. AB -

A total of 520 high school students were randomly assigned to a paper-and-pencil test (PPT), a computerized standard test (CST), or a computerized adaptive test (CAT) version of the Dutch School Attitude Questionnaire (SAQ), consisting of ordinal polytomous items. The CST administered items in the same order as the PPT. The CAT administered all items of three SAQ subscales in adaptive order using Samejima’s graded response model, so that six different stopping rule settings could be applied afterwards. School marks were used as external criteria. Results showed significant but small multivariate administration mode effects on conventional raw scores and small to medium effects on maximum likelihood latent trait estimates. When the precision of CAT latent trait estimates decreased, correlations with grade point average in general decreased. However, the magnitude of the decrease was not very large as compared to the PPT, the CST, and the CAT without the stopping rule.

VL - 29 UR - http://apm.sagepub.com/content/29/3/159.abstract ER - TY - JOUR T1 - Simulated computerized adaptive tests for measuring functional status were efficient with good discriminant validity in patients with hip, knee, or foot/ankle impairments JF - Journal of Clinical Epidemiology Y1 - 2005 A1 - Hart, D. L. A1 - Mioduski, J. E. A1 - Stratford, P. W. KW - *Health Status Indicators KW - Activities of Daily Living KW - Adolescent KW - Adult KW - Aged KW - Aged, 80 and over KW - Ankle Joint/physiopathology KW - Diagnosis, Computer-Assisted/*methods KW - Female KW - Hip Joint/physiopathology KW - Humans KW - Joint Diseases/physiopathology/*rehabilitation KW - Knee Joint/physiopathology KW - Lower Extremity/*physiopathology KW - Male KW - Middle Aged KW - Research Support, N.I.H., Extramural KW - Research Support, U.S. Gov't, P.H.S. KW - Retrospective Studies AB - BACKGROUND AND OBJECTIVE: To develop computerized adaptive tests (CATs) designed to assess lower extremity functional status (FS) in people with lower extremity impairments using items from the Lower Extremity Functional Scale and compare discriminant validity of FS measures generated using all items analyzed with a rating scale Item Response Theory model (theta(IRT)) and measures generated using the simulated CATs (theta(CAT)). METHODS: Secondary analysis of retrospective intake rehabilitation data. RESULTS: Unidimensionality of items was strong, and local independence of items was adequate. Differential item functioning (DIF) affected item calibration related to body part, that is, hip, knee, or foot/ankle, but DIF did not affect item calibration for symptom acuity, gender, age, or surgical history. Therefore, patients were separated into three body part specific groups. The rating scale model fit all three data sets well. Three body part specific CATs were developed: each was 70% more efficient than using all LEFS items to estimate FS measures. theta(IRT) and theta(CAT) measures discriminated patients by symptom acuity, age, and surgical history in similar ways. theta(CAT) measures were as precise as theta(IRT) measures. CONCLUSION: Body part-specific simulated CATs were efficient and produced precise measures of FS with good discriminant validity. VL - 58 N1 - 0895-4356 (Print)Journal ArticleMulticenter StudyValidation Studies ER - TY - JOUR T1 - Somministrazione di test computerizzati di tipo adattivo: Un' applicazione del modello di misurazione di Rasch [Administration of computerized and adaptive tests: An application of the Rasch Model] JF - Testing Psicometria Metodologia Y1 - 2005 A1 - Miceli, R. A1 - Molinengo, G. KW - Adaptive Testing KW - Computer Assisted Testing KW - Item Response Theory computerized adaptive testing KW - Models KW - Psychometrics AB - The aim of the present study is to describe the characteristics of a procedure for administering computerized and adaptive tests (Computer Adaptive Testing or CAT). Items to be asked to the individuals are interactively chosen and are selected from a "bank" in which they were previously calibrated and recorded on the basis of their difficulty level. The selection of items is performed by increasingly more accurate estimates of the examinees' ability. The building of an item-bank on Psychometrics and the implementation of this procedure allow a first validation through Monte Carlo simulations. (PsycINFO Database Record (c) 2006 APA ) (journal abstract) VL - 12 ER - TY - JOUR T1 - Toward efficient and comprehensive measurement of the alcohol problems continuum in college students: The Brief Young Adult Alcohol Consequences Questionnaire JF - Alcoholism: Clinical & Experimental Research Y1 - 2005 A1 - Kahler, C. W. A1 - Strong, D. R. A1 - Read, J. P. A1 - De Boeck, P. A1 - Wilson, M. A1 - Acton, G. S. A1 - Palfai, T. P. A1 - Wood, M. D. A1 - Mehta, P. D. A1 - Neale, M. C. A1 - Flay, B. R. A1 - Conklin, C. A. A1 - Clayton, R. R. A1 - Tiffany, S. T. A1 - Shiffman, S. A1 - Krueger, R. F. A1 - Nichol, P. E. A1 - Hicks, B. M. A1 - Markon, K. E. A1 - Patrick, C. J. A1 - Iacono, William G. A1 - McGue, Matt A1 - Langenbucher, J. W. A1 - Labouvie, E. A1 - Martin, C. S. A1 - Sanjuan, P. M. A1 - Bavly, L. A1 - Kirisci, L. A1 - Chung, T. A1 - Vanyukov, M. A1 - Dunn, M. A1 - Tarter, R. A1 - Handel, R. W. A1 - Ben-Porath, Y. S. A1 - Watt, M. KW - Psychometrics KW - Substance-Related Disorders AB - Background: Although a number of measures of alcohol problems in college students have been studied, the psychometric development and validation of these scales have been limited, for the most part, to methods based on classical test theory. In this study, we conducted analyses based on item response theory to select a set of items for measuring the alcohol problem severity continuum in college students that balances comprehensiveness and efficiency and is free from significant gender bias., Method: We conducted Rasch model analyses of responses to the 48-item Young Adult Alcohol Consequences Questionnaire by 164 male and 176 female college students who drank on at least a weekly basis. An iterative process using item fit statistics, item severities, item discrimination parameters, model residuals, and analysis of differential item functioning by gender was used to pare the items down to those that best fit a Rasch model and that were most efficient in discriminating among levels of alcohol problems in the sample., Results: The process of iterative Rasch model analyses resulted in a final 24-item scale with the data fitting the unidimensional Rasch model very well. The scale showed excellent distributional properties, had items adequately matched to the severity of alcohol problems in the sample, covered a full range of problem severity, and appeared highly efficient in retaining all of the meaningful variance captured by the original set of 48 items., Conclusions: The use of Rasch model analyses to inform item selection produced a final scale that, in both its comprehensiveness and its efficiency, should be a useful tool for researchers studying alcohol problems in college students. To aid interpretation of raw scores, examples of the types of alcohol problems that are likely to be experienced across a range of selected scores are provided., (C)2005Research Society on AlcoholismAn important, sometimes controversial feature of all psychological phenomena is whether they are categorical or dimensional. A conceptual and psychometric framework is described for distinguishing whether the latent structure behind manifest categories (e.g., psychiatric diagnoses, attitude groups, or stages of development) is category-like or dimension-like. Being dimension-like requires (a) within-category heterogeneity and (b) between-category quantitative differences. Being category-like requires (a) within-category homogeneity and (b) between-category qualitative differences. The relation between this classification and abrupt versus smooth differences is discussed. Hybrid structures are possible. Being category-like is itself a matter of degree; the authors offer a formalized framework to determine this degree. Empirical applications to personality disorders, attitudes toward capital punishment, and stages of cognitive development illustrate the approach., (C) 2005 by the American Psychological AssociationThe authors conducted Rasch model ( G. Rasch, 1960) analyses of items from the Young Adult Alcohol Problems Screening Test (YAAPST; S. C. Hurlbut & K. J. Sher, 1992) to examine the relative severity and ordering of alcohol problems in 806 college students. Items appeared to measure a single dimension of alcohol problem severity, covering a broad range of the latent continuum. Items fit the Rasch model well, with less severe symptoms reliably preceding more severe symptoms in a potential progression toward increasing levels of problem severity. However, certain items did not index problem severity consistently across demographic subgroups. A shortened, alternative version of the YAAPST is proposed, and a norm table is provided that allows for a linking of total YAAPST scores to expected symptom expression., (C) 2004 by the American Psychological AssociationA didactic on latent growth curve modeling for ordinal outcomes is presented. The conceptual aspects of modeling growth with ordinal variables and the notion of threshold invariance are illustrated graphically using a hypothetical example. The ordinal growth model is described in terms of 3 nested models: (a) multivariate normality of the underlying continuous latent variables (yt) and its relationship with the observed ordinal response pattern (Yt), (b) threshold invariance over time, and (c) growth model for the continuous latent variable on a common scale. Algebraic implications of the model restrictions are derived, and practical aspects of fitting ordinal growth models are discussed with the help of an empirical example and Mx script ( M. C. Neale, S. M. Boker, G. Xie, & H. H. Maes, 1999). The necessary conditions for the identification of growth models with ordinal data and the methodological implications of the model of threshold invariance are discussed., (C) 2004 by the American Psychological AssociationRecent research points toward the viability of conceptualizing alcohol problems as arrayed along a continuum. Nevertheless, modern statistical techniques designed to scale multiple problems along a continuum (latent trait modeling; LTM) have rarely been applied to alcohol problems. This study applies LTM methods to data on 110 problems reported during in-person interviews of 1,348 middle-aged men (mean age = 43) from the general population. The results revealed a continuum of severity linking the 110 problems, ranging from heavy and abusive drinking, through tolerance and withdrawal, to serious complications of alcoholism. These results indicate that alcohol problems can be arrayed along a dimension of severity and emphasize the relevance of LTM to informing the conceptualization and assessment of alcohol problems., (C) 2004 by the American Psychological AssociationItem response theory (IRT) is supplanting classical test theory as the basis for measures development. This study demonstrated the utility of IRT for evaluating DSM-IV diagnostic criteria. Data on alcohol, cannabis, and cocaine symptoms from 372 adult clinical participants interviewed with the Composite International Diagnostic Interview-Expanded Substance Abuse Module (CIDI-SAM) were analyzed with Mplus ( B. Muthen & L. Muthen, 1998) and MULTILOG ( D. Thissen, 1991) software. Tolerance and legal problems criteria were dropped because of poor fit with a unidimensional model. Item response curves, test information curves, and testing of variously constrained models suggested that DSM-IV criteria in the CIDI-SAM discriminate between only impaired and less impaired cases and may not be useful to scale case severity. IRT can be used to study the construct validity of DSM-IV diagnoses and to identify diagnostic criteria with poor performance., (C) 2004 by the American Psychological AssociationThis study examined the psychometric characteristics of an index of substance use involvement using item response theory. The sample consisted of 292 men and 140 women who qualified for a Diagnostic and Statistical Manual of Mental Disorders (3rd ed., rev.; American Psychiatric Association, 1987) substance use disorder (SUD) diagnosis and 293 men and 445 women who did not qualify for a SUD diagnosis. The results indicated that men had a higher probability of endorsing substance use compared with women. The index significantly predicted health, psychiatric, and psychosocial disturbances as well as level of substance use behavior and severity of SUD after a 2-year follow-up. Finally, this index is a reliable and useful prognostic indicator of the risk for SUD and the medical and psychosocial sequelae of drug consumption., (C) 2002 by the American Psychological AssociationComparability, validity, and impact of loss of information of a computerized adaptive administration of the Minnesota Multiphasic Personality Inventory-2 (MMPI-2) were assessed in a sample of 140 Veterans Affairs hospital patients. The countdown method ( Butcher, Keller, & Bacon, 1985) was used to adaptively administer Scales L (Lie) and F (Frequency), the 10 clinical scales, and the 15 content scales. Participants completed the MMPI-2 twice, in 1 of 2 conditions: computerized conventional test-retest, or computerized conventional-computerized adaptive. Mean profiles and test-retest correlations across modalities were comparable. Correlations between MMPI-2 scales and criterion measures supported the validity of the countdown method, although some attenuation of validity was suggested for certain health-related items. Loss of information incurred with this mode of adaptive testing has minimal impact on test validity. Item and time savings were substantial., (C) 1999 by the American Psychological Association VL - 29 N1 - MiscellaneousArticleMiscellaneous Article ER - TY - RPRT T1 - The use of person-fit statistics in computerized adaptive testing Y1 - 2005 A1 - Meijer, R. R. A1 - van Krimpen-Stoop, E. M. L. A. JF - LSAC Research Report Series PB - Law School Administration Council CY - Newton, PA. USA SN - Computerized Testing Report 97-14 ER - TY - CHAP T1 - Adaptive computerized educational systems: A case study T2 - Evidence-based educational methods Y1 - 2004 A1 - Ray, R. D. ED - R. W. Malott KW - Artificial KW - Computer Assisted Instruction KW - Computer Software KW - Higher Education KW - Individualized KW - Instruction KW - Intelligence KW - Internet KW - Undergraduate Education AB - (Created by APA) Adaptive instruction describes adjustments typical of one-on-one tutoring as discussed in the college tutorial scenario. So computerized adaptive instruction refers to the use of computer software--almost always incorporating artificially intelligent services--which has been designed to adjust both the presentation of information and the form of questioning to meet the current needs of an individual learner. This chapter describes a system for Internet-delivered adaptive instruction. The author attempts to demonstrate a sharp difference between the teaching that takes place outside of the classroom in universities and the kind that is at least afforded, if not taken advantage of by many, students in a more personalized educational setting such as those in the small liberal arts colleges. The author describes a computer-based technology that allows that gap to be bridged with the advantage of at least having more highly prepared learners sitting in college classrooms. A limited range of emerging research that supports that proposition is cited. (PsycINFO Database Record (c) 2005 APA ) JF - Evidence-based educational methods T3 - Educational Psychology Series PB - Elsevier Academic Press CY - San Diego, CA. USA N1 - Using Smart Source ParsingEvidence-based educational methods. A volume in the educational psychology series. (pp. 143-170). San Diego, CA : Elsevier Academic Press, [URL:http://www.academicpress.com]. xxiv, 382 pp ER - TY - BOOK T1 - The application of cognitive diagnosis and computerized adaptive testing to a large-scale assessment Y1 - 2004 A1 - McGlohen, MK CY - Unpublished doctoral dissertation, University of Texas at Austin ER - TY - CONF T1 - Combining computer adaptive testing technology with cognitively diagnostic assessment T2 - Paper presented at the annual meeting of the National Council on Measurement in Education Y1 - 2004 A1 - McGlohen, MK A1 - Chang, Hua-Hua A1 - Wills, J. T. JF - Paper presented at the annual meeting of the National Council on Measurement in Education CY - San Diego CA N1 - {PDF file, 782 KB} ER - TY - JOUR T1 - Computerized adaptive measurement of depression: A simulation study JF - BMC Psychiatry Y1 - 2004 A1 - Gardner, W. A1 - Shear, K. A1 - Kelleher, K. J. A1 - Pajer, K. A. A1 - Mammen, O. A1 - Buysse, D. A1 - Frank, E. KW - *Computer Simulation KW - Adult KW - Algorithms KW - Area Under Curve KW - Comparative Study KW - Depressive Disorder/*diagnosis/epidemiology/psychology KW - Diagnosis, Computer-Assisted/*methods/statistics & numerical data KW - Factor Analysis, Statistical KW - Female KW - Humans KW - Internet KW - Male KW - Mass Screening/methods KW - Patient Selection KW - Personality Inventory/*statistics & numerical data KW - Pilot Projects KW - Prevalence KW - Psychiatric Status Rating Scales/*statistics & numerical data KW - Psychometrics KW - Research Support, Non-U.S. Gov't KW - Research Support, U.S. Gov't, P.H.S. KW - Severity of Illness Index KW - Software AB - Background: Efficient, accurate instruments for measuring depression are increasingly importantin clinical practice. We developed a computerized adaptive version of the Beck DepressionInventory (BDI). We examined its efficiency and its usefulness in identifying Major DepressiveEpisodes (MDE) and in measuring depression severity.Methods: Subjects were 744 participants in research studies in which each subject completed boththe BDI and the SCID. In addition, 285 patients completed the Hamilton Depression Rating Scale.Results: The adaptive BDI had an AUC as an indicator of a SCID diagnosis of MDE of 88%,equivalent to the full BDI. The adaptive BDI asked fewer questions than the full BDI (5.6 versus 21items). The adaptive latent depression score correlated r = .92 with the BDI total score and thelatent depression score correlated more highly with the Hamilton (r = .74) than the BDI total scoredid (r = .70).Conclusions: Adaptive testing for depression may provide greatly increased efficiency withoutloss of accuracy in identifying MDE or in measuring depression severity. VL - 4 ER - TY - JOUR T1 - Kann die Konfundierung von Konzentrationsleistung und Aktivierung durch adaptives Testen mit dern FAKT vermieden werden? [Avoiding the confounding of concentration performance and activation by adaptive testing with the FACT] JF - Zeitschrift für Differentielle und Diagnostische Psychologie Y1 - 2004 A1 - Frey, A. A1 - Moosbrugger, H. KW - Adaptive Testing KW - Computer Assisted Testing KW - Concentration KW - Performance KW - Testing computerized adaptive testing AB - The study investigates the effect of computerized adaptive testing strategies on the confounding of concentration performance with activation. A sample of 54 participants was administered 1 out of 3 versions (2 adaptive, 1 non-adaptive) of the computerized Frankfurt Adaptive Concentration Test FACT (Moosbrugger & Heyden, 1997) at three subsequent points in time. During the test administration changes in activation (electrodermal activity) were recorded. The results pinpoint a confounding of concentration performance with activation for the non-adaptive test version, but not for the adaptive test versions (p = .01). Thus, adaptive FACT testing strategies can remove the confounding of concentration performance with activation, thereby increasing the discriminant validity. In conclusion, an attention-focusing-hypothesis is formulated to explain the observed effect. (PsycINFO Database Record (c) 2005 APA ) (journal abstract) VL - 25 ER - TY - CONF T1 - A learning environment for english for academic purposes based on adaptive tests and task-based systems T2 - Intelligent Tutoring Systems. Y1 - 2004 A1 - PITON-GONÇALVES, J. A1 - ALUISIO, S. M. A1 - MENDONCA, L. H. A1 - NOVAES, O. O. JF - Intelligent Tutoring Systems. PB - Springer Berlin Heidelberg ER - TY - CONF T1 - A sequential Bayesian procedure for item calibration in multistage testing T2 - Paper presented at the annual meeting of the National Council on Measurement in Education Y1 - 2004 A1 - van der Linden, W. J. A1 - Alan D Mead JF - Paper presented at the annual meeting of the National Council on Measurement in Education CY - San Diego CA ER - TY - JOUR T1 - Siette: a web-based tool for adaptive testing JF - International Journal of Artificial Intelligence in Education Y1 - 2004 A1 - Conejo, R A1 - Guzmán, E A1 - Millán, E A1 - Trella, M A1 - Pérez-De-La-Cruz, JL A1 - Ríos, A KW - computerized adaptive testing VL - 14 ER - TY - JOUR T1 - Using patterns of summed scores in paper-and-pencil tests and computer-adaptive tests to detect misfitting item score patterns JF - Journal of Educational Measurement Y1 - 2004 A1 - Meijer, R. R. KW - Computer Assisted Testing KW - Item Response Theory KW - person Fit KW - Test Scores AB - Two new methods have been proposed to determine unexpected sum scores on subtests (testlets) both for paper-and-pencil tests and computer adaptive tests. A method based on a conservative bound using the hypergeometric distribution, denoted ρ, was compared with a method where the probability for each score combination was calculated using a highest density region (HDR). Furthermore, these methods were compared with the standardized log-likelihood statistic with and without a correction for the estimated latent trait value (denoted as l-super(*)-sub(z) and l-sub(z), respectively). Data were simulated on the basis of the one-parameter logistic model, and both parametric and nonparametric logistic regression was used to obtain estimates of the latent trait. Results showed that it is important to take the trait level into account when comparing subtest scores. In a nonparametric item response theory (IRT) context, on adapted version of the HDR method was a powerful alterative to ρ. In a parametric IRT context, results showed that l-super(*)-sub(z) had the highest power when the data were simulated conditionally on the estimated latent trait level. (PsycINFO Database Record (c) 2005 APA ) (journal abstract) VL - 41 ER - TY - JOUR T1 - A Bayesian method for the detection of item preknowledge in computerized adaptive testing JF - Applied Psychological Measurement Y1 - 2003 A1 - McLeod L. D., Lewis, C., A1 - Thissen, D. VL - 27 ER - TY - JOUR T1 - A Bayesian method for the detection of item preknowledge in computerized adaptive testing JF - Applied Psychological Measurement Y1 - 2003 A1 - McLeod, L. A1 - Lewis, C. A1 - Thissen, D. KW - Adaptive Testing KW - Cheating KW - Computer Assisted Testing KW - Individual Differences computerized adaptive testing KW - Item KW - Item Analysis (Statistical) KW - Mathematical Modeling KW - Response Theory AB - With the increased use of continuous testing in computerized adaptive testing, new concerns about test security have evolved, such as how to ensure that items in an item pool are safeguarded from theft. In this article, procedures to detect test takers using item preknowledge are explored. When test takers use item preknowledge, their item responses deviate from the underlying item response theory (IRT) model, and estimated abilities may be inflated. This deviation may be detected through the use of person-fit indices. A Bayesian posterior log odds ratio index is proposed for detecting the use of item preknowledge. In this approach to person fit, the estimated probability that each test taker has preknowledge of items is updated after each item response. These probabilities are based on the IRT parameters, a model specifying the probability that each item has been memorized, and the test taker's item responses. Simulations based on an operational computerized adaptive test (CAT) pool are used to demonstrate the use of the odds ratio index. (PsycINFO Database Record (c) 2005 APA ) VL - 27 ER - TY - CONF T1 - Can We Assess Pre-K Kids With Computer-Based Tests: STAR Early Literacy Data T2 - Presentation to the 33rd Annual National Conference on Large-Scale Assessment. Y1 - 2003 A1 - J. R. McBride JF - Presentation to the 33rd Annual National Conference on Large-Scale Assessment. CY - San Antonio TX ER - TY - JOUR T1 - Computer-adaptive test for measuring personality factors using item response theory JF - Dissertation Abstracts International: Section B: The Sciences & Engineering Y1 - 2003 A1 - Macdonald, Paul Lawrence AB - The aim of the present research was to develop a computer adaptive test with the graded response model to measure the Five Factor Model of personality attributes. In the first of three studies, simulated items and simulated examinees were used to investigate systematically the impact of several variables on the accuracy and efficiency of a computer adaptive test. Item test banks containing more items, items with greater trait discrimination, and more response options resulted in increased accuracy and efficiency of the computer adaptive test. It was also found that large stopping rule values required fewer items before stopping but had less accuracy compared to smaller stopping rule values. This demonstrated a trade-off between accuracy and efficiency such that greater measurement accuracy can be obtained at a cost of decreased test efficiency. In the second study, the archival responses of 501 participants to five 30-item test banks measuring the Five Factor Model of personality were utilized in simulations of a computer adaptive personality test. The computer adaptive test estimates of participant trait scores were highly correlated with the item response theory trait estimates, and the magnitude of the correlation was related directly to the stopping rule value with higher correlations and less measurement error being associated with smaller stopping rule values. It was also noted that the performance of the computer adaptive test was dependent on the personality factor being measured whereby Conscientiousness required the most number of items to be administered and Neuroticism required the least. The results confirmed that a simulated computer adaptive test using archival personality data could accurately and efficiently attain trait estimates. In the third study, 276 student participants selected response options with a click of a mouse in a computer adaptive personality test (CAPT) measuring the Big Five factors of the Five Factor Model of personality structure. Participant responses to alternative measures of the Big Five were also collected using conventional paper-and-pencil personality questionnaires. It was found that the CAPT obtained trait estimates that were very accurate even with very few administered items. Similarly, the CAPT trait estimates demonstrated moderate to high concurrent validity with the alternative Big Five measures, and the strength of the estimates varied as a result of the similarity of the personality items and assessment methodology. It was also found that the computer adaptive test was accurately able to detect, with relatively few items, the relations between the measured personality traits and several socially interesting variables such as smoking behavior, alcohol consumption rating, and number of dates per month. Implications of the results of this research are discussed in terms of the utility of computer adaptive testing of personality characteristics. As well, methodological limitations of the studies are noted and directions for future research are considered. (PsycINFO Database Record (c) 2004 APA, all rights reserved). VL - 64 ER - TY - JOUR T1 - A feasibility study of on-the-fly item generation in adaptive testing JF - Journal of Technology, Learning, and Assessment Y1 - 2003 A1 - Bejar, I. I. A1 - Lawless, R. R., A1 - Morley, M. E., A1 - Wagner, M. E., A1 - Bennett R. E., A1 - Revuelta, J. VL - 2 IS - 3 N1 - {PDF file, 427 KB} ER - TY - CHAP T1 - Item selection in polytomous CAT T2 - New developments in psychometrics Y1 - 2003 A1 - Veldkamp, B. P. ED - A. Okada ED - K. Shigenasu ED - Y. Kano ED - J. Meulman KW - computerized adaptive testing JF - New developments in psychometrics PB - Psychometric Society, Springer CY - Tokyo, Japan ER - TY - ABST T1 - A sequential Bayes procedure for item calibration in multi-stage testing Y1 - 2003 A1 - van der Linden, W. J. A1 - Alan D Mead CY - Manuscript in preparation ER - TY - JOUR T1 - Ten recommendations for advancing patient-centered outcomes measurement for older persons JF - Annals of Internal Medicine Y1 - 2003 A1 - McHorney, C. A. KW - *Health Status Indicators KW - Aged KW - Geriatric Assessment/*methods KW - Humans KW - Patient-Centered Care/*methods KW - Research Support, U.S. Gov't, Non-P.H.S. AB - The past 50 years have seen great progress in the measurement of patient-based outcomes for older populations. Most of the measures now used were created under the umbrella of a set of assumptions and procedures known as classical test theory. A recent alternative for health status assessment is item response theory. Item response theory is superior to classical test theory because it can eliminate test dependency and achieve more precise measurement through computerized adaptive testing. Computerized adaptive testing reduces test administration times and allows varied and precise estimates of ability. Several key challenges must be met before computerized adaptive testing becomes a productive reality. I discuss these challenges for the health assessment of older persons in the form of 10 "Ds": things we need to deliberate, debate, decide, and do. VL - 139 N1 - 1539-3704Journal ArticleReview ER - TY - JOUR T1 - Detection of person misfit in computerized adaptive tests with polytomous items JF - Applied Psychological Measurement Y1 - 2002 A1 - van Krimpen-Stoop, E. M. L. A. A1 - Meijer, R. R. AB - Item scores that do not fit an assumed item response theory model may cause the latent trait value to be inaccurately estimated. For a computerized adaptive test (CAT) using dichotomous items, several person-fit statistics for detecting mis.tting item score patterns have been proposed. Both for paper-and-pencil (P&P) tests and CATs, detection ofperson mis.t with polytomous items is hardly explored. In this study, the nominal and empirical null distributions ofthe standardized log-likelihood statistic for polytomous items are compared both for P&P tests and CATs. Results showed that the empirical distribution of this statistic differed from the assumed standard normal distribution for both P&P tests and CATs. Second, a new person-fit statistic based on the cumulative sum (CUSUM) procedure from statistical process control was proposed. By means ofsimulated data, critical values were determined that can be used to classify a pattern as fitting or misfitting. The effectiveness of the CUSUM to detect simulees with item preknowledge was investigated. Detection rates using the CUSUM were high for realistic numbers ofdisclosed items. VL - 26 ER - TY - CONF T1 - The Development of STAR Early Literacy T2 - Presentation to the 32rd Annual National Conference on Large-Scale Assessment. Y1 - 2002 A1 - J. R. McBride JF - Presentation to the 32rd Annual National Conference on Large-Scale Assessment. CY - Desert Springs CA ER - TY - ABST T1 - A feasibility study of on-the-fly item generation in adaptive testing (GRE Board Report No 98-12) Y1 - 2002 A1 - Bejar, I. I. A1 - Lawless, R. R A1 - Morley, M. E A1 - Wagner, M. E. A1 - Bennett, R. E. A1 - Revuelta, J. CY - Educational Testing Service RR02-23. Princeton NJ: Educational Testing Service. Note = “{PDF file, 193 KB} ER - TY - CONF T1 - Mapping the Development of Pre-reading Skills with STAR Early Literacy T2 - Presentation to the Annual Meeting of the Society for the Scientific Study of Reading. Chicago. Y1 - 2002 A1 - J. R. McBride A1 - Tardrew, S.P. JF - Presentation to the Annual Meeting of the Society for the Scientific Study of Reading. Chicago. ER - TY - JOUR T1 - Outlier detection in high-stakes certification testing JF - Journal of Educational Measurement Y1 - 2002 A1 - Meijer, R. R. KW - Adaptive Testing KW - computerized adaptive testing KW - Educational Measurement KW - Goodness of Fit KW - Item Analysis (Statistical) KW - Item Response Theory KW - person Fit KW - Statistical Estimation KW - Statistical Power KW - Test Scores AB - Discusses recent developments of person-fit analysis in computerized adaptive testing (CAT). Methods from statistical process control are presented that have been proposed to classify an item score pattern as fitting or misfitting the underlying item response theory model in CAT Most person-fit research in CAT is restricted to simulated data. In this study, empirical data from a certification test were used. Alternatives are discussed to generate norms so that bounds can be determined to classify an item score pattern as fitting or misfitting. Using bounds determined from a sample of a high-stakes certification test, the empirical analysis showed that different types of misfit can be distinguished Further applications using statistical process control methods to detect misfitting item score patterns are discussed. (PsycINFO Database Record (c) 2005 APA ) VL - 39 ER - TY - CONF T1 - The robustness of the unidimensional 3PL IRT model when applied to two-dimensional data in computerized adaptive testing T2 - Paper presented at the annual meeting of the American Educational Research Association Y1 - 2002 A1 - Zhao, J. C. A1 - McMorris, R. F. A1 - Pruzek, R. M. A1 - Chen, R. JF - Paper presented at the annual meeting of the American Educational Research Association CY - New Orleans LA N1 - {PDF file, 1.356 MB} ER - TY - ABST T1 - Application of data mining to response data in a computerized adaptive test Y1 - 2001 A1 - Mendez, F. A. CY - Paper presented at the Annual Meeting of the National Council on Measurement in Education, Seattle WA ER - TY - JOUR T1 - Assessment in the twenty-first century: A role of computerised adaptive testing in national curriculum subjects JF - Teacher Development Y1 - 2001 A1 - Cowan, P. A1 - Morrison, H. KW - computerized adaptive testing AB - With the investment of large sums of money in new technologies forschools and education authorities and the subsequent training of teachers to integrate Information and Communications Technology (ICT) into their teaching strategies, it is remarkable that the old outdated models of assessment still remain. This article highlights the current problems associated with pen-and paper-testing and offers suggestions for an innovative and new approach to assessment for the twenty-first century. Based on the principle of the 'wise examiner' a computerised adaptive testing system which measures pupils' ability against the levels of the United Kingdom National Curriculum has been developed for use in mathematics. Using constructed response items, pupils are administered a test tailored to their ability with a reliability index of 0.99. Since the software administers maximally informative questions matched to each pupil's current ability estimate, no two pupils will receive the same set of items in the same order therefore removing opportunities for plagarism and teaching to the test. All marking is automated and a journal recording the outcome of the test and highlighting the areas of difficulty for each pupil is available for printing by the teacher. The current prototype of the system can be used on a school's network however the authors envisage a day when Examination Boards or the Qualifications and Assessment Authority (QCA) will administer Government tests from a central server to all United Kingdom schools or testing centres. Results will be issued at the time of testing and opportunities for resits will become more widespr VL - 5 ER - TY - JOUR T1 - Concerns with computerized adaptive oral proficiency assessment. A commentary on "Comparing examinee attitudes Toward computer-assisted and other oral proficient assessments": Response to the Norris Commentary JF - Language Learning and Technology Y1 - 2001 A1 - Norris, J. M. A1 - Kenyon, D. M. A1 - Malabonga, V. AB - Responds to an article on computerized adaptive second language (L2) testing, expressing concerns about the appropriateness of such tests for informing language educators about the language skills of L2 learners and users and fulfilling the intended purposes and achieving the desired consequences of language test use.The authors of the original article respond. (Author/VWL) VL - 5 ER - TY - JOUR T1 - CUSUM-based person-fit statistics for adaptive testing JF - Journal of Educational and Behavioral Statistics Y1 - 2001 A1 - van Krimpen-Stoop, E. M. L. A. A1 - Meijer, R. R. VL - 26 ER - TY - JOUR T1 - An examination of the comparative reliability, validity, and accuracy of performance ratings made using computerized adaptive rating scales JF - Journal of Applied Psychology Y1 - 2001 A1 - Borman, W. C. A1 - Buck, D. E. A1 - Hanson, M. A. A1 - Motowidlo, S. J. A1 - Stark, S. A1 - F Drasgow KW - *Computer Simulation KW - *Employee Performance Appraisal KW - *Personnel Selection KW - Adult KW - Automatic Data Processing KW - Female KW - Human KW - Male KW - Reproducibility of Results KW - Sensitivity and Specificity KW - Support, U.S. Gov't, Non-P.H.S. KW - Task Performance and Analysis KW - Video Recording AB - This laboratory research compared the reliability, validity, and accuracy of a computerized adaptive rating scale (CARS) format and 2 relatively common and representative rating formats. The CARS is a paired-comparison rating task that uses adaptive testing principles to present pairs of scaled behavioral statements to the rater to iteratively estimate a ratee's effectiveness on 3 dimensions of contextual performance. Videotaped vignettes of 6 office workers were prepared, depicting prescripted levels of contextual performance, and 112 subjects rated these vignettes using the CARS format and one or the other competing format. Results showed 23%-37% lower standard errors of measurement for the CARS format. In addition, validity was significantly higher for the CARS format (d = .18), and Cronbach's accuracy coefficients showed significantly higher accuracy, with a median effect size of .08. The discussion focuses on possible reasons for the results. VL - 86 N1 - 214803450021-9010Journal ArticleValidation Studies ER - TY - CONF T1 - Methods to test invariant ability across subgroups of items in CAT T2 - Paper presented at the Annual Meeting of the National Council on Measurement in Education Y1 - 2001 A1 - Meijer, R. R. JF - Paper presented at the Annual Meeting of the National Council on Measurement in Education CY - Seattle WA ER - TY - JOUR T1 - Nouveaux développements dans le domaine du testing informatisé [New developments in the area of computerized testing] JF - Psychologie Française Y1 - 2001 A1 - Meijer, R. R. A1 - Grégoire, J. KW - Adaptive Testing KW - Computer Applications KW - Computer Assisted KW - Diagnosis KW - Psychological Assessment computerized adaptive testing AB - L'usage de l'évaluation assistée par ordinateur s'est fortement développé depuis la première formulation de ses principes de base dans les années soixante et soixante-dix. Cet article offre une introduction aux derniers développements dans le domaine de l'évaluation assistée par ordinateur, en particulier celui du testing adaptative informatisée (TAI). L'estimation de l'aptitude, la sélection des items et le développement d'une base d'items dans le cas du TAI sont discutés. De plus, des exemples d'utilisations innovantes de l'ordinateur dans des systèmes intégrés de testing et de testing via Internet sont présentés. L'article se termine par quelques illustrations de nouvelles applications du testing informatisé et des suggestions pour des recherches futures.Discusses the latest developments in computerized psychological assessment, with emphasis on computerized adaptive testing (CAT). Ability estimation, item selection, and item pool development in CAT are described. Examples of some innovative approaches to CAT are presented. (PsycINFO Database Record (c) 2005 APA ) VL - 46 ER - TY - ABST T1 - Testing via the Internet: A literature review and analysis of issues for Department of Defense Internet testing of the Armed Services Vocational Aptitude Battery (ASVAB) in high schools (FR-01-12) Y1 - 2001 A1 - J. R. McBride A1 - Paddock, A. F. A1 - Wise, L. L. A1 - Strickland, W. J. A1 - B. K. Waters CY - Alexandria VA: Human Resources Research Organization N1 - {PDF file, 894 KB} ER - TY - JOUR T1 - Toepassing van een computergestuurde adaptieve testprocedure op persoonlijkheidsdata [Application of a computerised adaptive test procedure on personality data] JF - Nederlands Tijdschrift voor de Psychologie en haar Grensgebieden Y1 - 2001 A1 - Hol, A. M. A1 - Vorst, H. C. M. A1 - Mellenbergh, G. J. KW - Adaptive Testing KW - Computer Applications KW - Computer Assisted Testing KW - Personality Measures KW - Test Reliability computerized adaptive testing AB - Studied the applicability of a computerized adaptive testing procedure to an existing personality questionnaire within the framework of item response theory. The procedure was applied to the scores of 1,143 male and female university students (mean age 21.8 yrs) in the Netherlands on the Neuroticism scale of the Amsterdam Biographical Questionnaire (G. J. Wilde, 1963). The graded response model (F. Samejima, 1969) was used. The quality of the adaptive test scores was measured based on their correlation with test scores for the entire item bank and on their correlation with scores on other scales from the personality test. The results indicate that computerized adaptive testing can be applied to personality scales. (PsycINFO Database Record (c) 2005 APA ) VL - 56 ER - TY - BOOK T1 - Computerized adaptive testing: A primer (2nd edition) Y1 - 2000 A1 - Wainer, H., A1 - Dorans, N. A1 - Eignor, D. R. A1 - Flaugher, R. A1 - Green, B. F. A1 - Mislevy, R. A1 - Steinberg, L. A1 - Thissen, D. CY - Hillsdale, N. J. : Lawrence Erlbaum Associates ER - TY - CHAP T1 - Detecting person misfit in adaptive testing using statistical process control techniques Y1 - 2000 A1 - van Krimpen-Stoop, E. M. L. A. A1 - Meijer, R. R. CY - W. J. van der Linden, and C. A. W. Glas (Editors). Computerized Adaptive Testing: Theory and Practice. Norwell MA: Kluwer. ER - TY - CHAP T1 - Detecting person misfit in adaptive testing using statistical process control techniques T2 - Computer adaptive testing: Theory and practice Y1 - 2000 A1 - van Krimpen-Stoop, E. M. L. A. A1 - Meijer, R. R. KW - person Fit JF - Computer adaptive testing: Theory and practice PB - Kluwer Academic. CY - Dordrecht, The Netherlands ER - TY - CONF T1 - Detecting test-takers who have memorized items in computerized-adaptive testing and muti-stage testing: A comparison T2 - Paper presented at the annual meeting of the National Council on Measurement in Education Y1 - 2000 A1 - Patsula, L N. A1 - McLeod, L. D. JF - Paper presented at the annual meeting of the National Council on Measurement in Education CY - New Orleans LA ER - TY - ABST T1 - Detection of person misfit in computerized adaptive testing with polytomous items (Research Report 00-01) Y1 - 2000 A1 - van Krimpen-Stoop, E. M. L. A. A1 - Meijer, R. R. CY - Enschede, The Netherlands: University of Twente, Faculty of Educational Science and Technology, Department of Measurement and Data Analysis ER - TY - JOUR T1 - Does adaptive testing violate local independence? JF - Psychometrika Y1 - 2000 A1 - Mislevy, R. J. A1 - Chang, Hua-Hua VL - 65 ER - TY - CHAP T1 - The GRE computer adaptive test: Operational issues Y1 - 2000 A1 - Mills, C. N. A1 - Steffen, M. CY - W. J. van der Linden and C. A. W. Glas (Eds.), Computerized adaptive testing: Theory and practice (pp. 75-99). Dordrecht, Netherlands: Kluwer. ER - TY - JOUR T1 - Item response theory and health outcomes measurement in the 21st century JF - Medical Care Y1 - 2000 A1 - Hays, R. D. A1 - Morales, L. S. A1 - Reise, S. P. KW - *Models, Statistical KW - Activities of Daily Living KW - Data Interpretation, Statistical KW - Health Services Research/*methods KW - Health Surveys KW - Human KW - Mathematical Computing KW - Outcome Assessment (Health Care)/*methods KW - Research Design KW - Support, Non-U.S. Gov't KW - Support, U.S. Gov't, P.H.S. KW - United States AB - Item response theory (IRT) has a number of potential advantages over classical test theory in assessing self-reported health outcomes. IRT models yield invariant item and latent trait estimates (within a linear transformation), standard errors conditional on trait level, and trait estimates anchored to item content. IRT also facilitates evaluation of differential item functioning, inclusion of items with different response formats in the same scale, and assessment of person fit and is ideally suited for implementing computer adaptive testing. Finally, IRT methods can be helpful in developing better health outcome measures and in assessing change over time. These issues are reviewed, along with a discussion of some of the methodological and practical challenges in applying IRT methods. VL - 38 N1 - 204349670025-7079Journal Article ER - TY - JOUR T1 - The null distribution of person-fit statistics for conventional and adaptive tests JF - Applied Psychological Measurement Y1 - 2000 A1 - van Krimpen-Stoop, E. M. L. A. A1 - Meijer, R. R. VL - 23 ER - TY - CHAP T1 - Using Bayesian Networks in Computerized Adaptive Tests Y1 - 2000 A1 - Millan, E. A1 - Trella, M A1 - Perez-de-la-Cruz, J.-L. A1 - Conejo, R CY - M. Ortega and J. Bravo (Eds.),Computers and Education in the 21st Century. Kluwer, pp. 217228. ER - TY - CONF T1 - Adjusting computer adaptive test starting points to conserve item pool T2 - Paper presented at the annual meeting of the American Educational Research Association Y1 - 1999 A1 - Zhu, D. A1 - Fan. M. JF - Paper presented at the annual meeting of the American Educational Research Association CY - Montreal, Canada ER - TY - JOUR T1 - Alternative methods for the detection of item preknowledge in computerized adaptive testing JF - Dissertation Abstracts International: Section B: the Sciences & Engineering Y1 - 1999 A1 - McLeod, Lori Davis KW - computerized adaptive testing VL - 59 ER - TY - JOUR T1 - Computerized Adaptive Testing: Overview and Introduction JF - Applied Psychological Measurement Y1 - 1999 A1 - Meijer, R. R. A1 - Nering, M. L. KW - computerized adaptive testing AB - Use of computerized adaptive testing (CAT) has increased substantially since it was first formulated in the 1970s. This paper provides an overview of CAT and introduces the contributions to this Special Issue. The elements of CAT discussed here include item selection procedures, estimation of the latent trait, item exposure, measurement precision, and item bank development. Some topics for future research are also presented. VL - 23 ER - TY - JOUR T1 - Computerized adaptive testing: Overview and introduction JF - Applied Psychological Measurement Y1 - 1999 A1 - Meijer, R. R. A1 - Nering, M. L. VL - 23 ER - TY - JOUR T1 - CUSUM-based person-fit statistics for adaptive testing JF - Journal of Educational and Behavioral Statistics Y1 - 1999 A1 - van Krimpen-Stoop, E. M. L. A. A1 - Meijer, R. R. VL - 26 ER - TY - ABST T1 - CUSUM-based person-fit statistics for adaptive testing (Research Report 99-05) Y1 - 1999 A1 - van Krimpen-Stoop, E. M. L. A. A1 - Meijer, R. R. CY - Enschede, The Netherlands: University of Twente, Faculty of Educational Science and Technology, Department of Measurement and Data Analysis ER - TY - JOUR T1 - Detecting item memorization in the CAT environment JF - Applied Psychological Measurement Y1 - 1999 A1 - McLeod L. D., A1 - Lewis, C. VL - 23 ER - TY - CONF T1 - Detecting items that have been memorized in the CAT environment T2 - Paper presented at the annual meeting of the National Council on Measurement in Education Y1 - 1999 A1 - McLeod, L. D. A1 - Schinpke, D. L. JF - Paper presented at the annual meeting of the National Council on Measurement in Education CY - Montreal, Canada ER - TY - CHAP T1 - Development and introduction of a computer adaptive Graduate Record Examination General Test Y1 - 1999 A1 - Mills, C. N. CY - F. Drasgow and J .B. Olson-Buchanan (Eds.). Innovations in computerized assessment (pp. 117-135). Mahwah NJ: Erlbaum. ER - TY - CHAP T1 - Development of the computerized adaptive testing version of the Armed Services Vocational Aptitude Battery Y1 - 1999 A1 - Segall, D. O. A1 - Moreno, K. E. CY - F. Drasgow and J. Olson-Buchanan (Eds.). Innovations in computerized assessment. Mahwah NJ: Erlbaum. ER - TY - JOUR T1 - Graphical models and computerized adaptive testing JF - Applied Psychological Measurement Y1 - 1999 A1 - Almond, R. G. A1 - Mislevy, R. J. KW - computerized adaptive testing AB - Considers computerized adaptive testing from the perspective of graphical modeling (GM). GM provides methods for making inferences about multifaceted skills and knowledge and for extracting data from complex performances. Provides examples from language-proficiency assessment. (SLD) VL - 23 ER - TY - JOUR T1 - The null distribution of person-fit statistics for conventional and adaptive tests JF - Applied Psychological Measurement Y1 - 1999 A1 - van Krimpen-Stoop, E. M. L. A. A1 - Meijer, R. R. VL - 23 ER - TY - CONF T1 - Principles for administering adaptive tests T2 - Paper presented at the annual meeting of the National Council on Measurement in Education Y1 - 1999 A1 - Miller, T. A1 - Davey, T. JF - Paper presented at the annual meeting of the National Council on Measurement in Education CY - Montreal Canada ER - TY - CONF T1 - A Bayesian approach to detection of item preknowledge in a CAT T2 - Paper presented at the annual meeting of the National Council on Measurement in Education Y1 - 1998 A1 - McLeod, L. D. A1 - Lewis, C. JF - Paper presented at the annual meeting of the National Council on Measurement in Education CY - San Diego CA ER - TY - CONF T1 - Computerized adaptive rating scales that measure contextual performance T2 - Paper presented at the 3th annual conference of the Society for Industrial and Organizational Psychology Y1 - 1998 A1 - Borman, W. C. A1 - Hanson, M. A. A1 - Montowidlo, S. J A1 - F Drasgow A1 - Foster, L A1 - Kubisiak, U. C. JF - Paper presented at the 3th annual conference of the Society for Industrial and Organizational Psychology CY - Dallas TX ER - TY - ABST T1 - Does adaptive testing violate local independence? (Research Report 98-33) Y1 - 1998 A1 - Mislevy, R. J. A1 - Chang, Hua-Hua CY - Princeton NJ: Educational Testing Service ER - TY - CHAP T1 - Innovations in computer-based ability testing: Promise, problems and perils Y1 - 1998 A1 - J. R. McBride CY - In Hakel, M.D. (Ed.) Beyond multiple choice: Alternatives to traditional testing for selection. Hillsdale, NJ: Lawrence Erlbaum Associates. ER - TY - JOUR T1 - Measuring change conventionally and adaptively JF - Educational and Psychological Measurement Y1 - 1998 A1 - May, K. A1 - Nicewander, W. A. VL - 58 ER - TY - CONF T1 - A new approach for the detection of item preknowledge in computerized adaptive testing T2 - Paper presented at the annual meeting of the Psychometric Society Y1 - 1998 A1 - McLeod, L. D. A1 - Lewis, C. JF - Paper presented at the annual meeting of the Psychometric Society CY - Urbana, IL ER - TY - ABST T1 - Person fit based on statistical process control in an adaptive testing environment (Research Report 98-13) Y1 - 1998 A1 - van Krimpen-Stoop, E. M. L. A. A1 - Meijer, R. R. CY - Enschede, The Netherlands: University of Twente, Faculty of Educational Science and Technology, Department of Measurement and Data Analysis ER - TY - ABST T1 - Simulating the null distribution of person-fit statistics for conventional and adaptive tests (Research Report 98-02) Y1 - 1998 A1 - Meijer, R. R. A1 - van Krimpen-Stoop, E. M. L. A. CY - Enschede, The Netherlands: University of Twente, Faculty of Educational Science and Technology, Department of Measurement and Data Analysis ER - TY - ABST T1 - Statistical tests for person misfit in computerized adaptive testing (Research Report 98-01) Y1 - 1998 A1 - Glas, C. A. W. A1 - Meijer, R. R. A1 - van Krimpen-Stoop, E. M. L. A. CY - Enschede, The Netherlands : University of Twente, Faculty of Educational Science and Technology, Department of Measurement and Data Analysis ER - TY - RPRT T1 - Statistical tests for person misfit in computerized adaptive testing Y1 - 1998 A1 - Glas, C. A. W. A1 - Meijer, R. R. A1 - van Krimpen-Stoop, E. M. PB - Faculty of Educational Science and Technology, Univeersity of Twente CY - Enschede, The Netherlands SN - 98-01 ER - TY - JOUR T1 - Swedish Enlistment Battery: Construct validity and latent variable estimation of cognitive abilities by the CAT-SEB JF - International Journal of Selection and Assessment Y1 - 1998 A1 - Mardberg, B. A1 - Carlstedt, B. VL - 6 ER - TY - ABST T1 - Three response types for broadening the conception of mathematical problem solving in computerized-adaptive tests (Research Report 98-45) Y1 - 1998 A1 - Bennett, R. E. A1 - Morley, M. A1 - Quardt, D. CY - Princeton NJ : Educational Testing Service N1 - #BE98-45 (Also presented at National Council on Measurement in Education, 1998) ER - TY - ABST T1 - CAST 5 for Windows users' guide Y1 - 1997 A1 - J. R. McBride A1 - Cooper, R. R CY - Contract No. "MDA903-93-D-0032, DO 0054. Alexandria, VA: Human Resources Research Organization ER - TY - CHAP T1 - CAT-ASVAB cost and benefit analyses Y1 - 1997 A1 - Wise, L. L. A1 - Curran, L. T. A1 - J. R. McBride CY - W. A. Sands, B. K. Waters, and J. R. McBride (Eds.), Computer adaptive testing: From inquiry to operation (pp. 227-236). Washington, DC: American Psychological Association. ER - TY - CHAP T1 - CAT-ASVAB operational test and evaluation Y1 - 1997 A1 - Moreno, K. E. CY - W. A. Sands, B. K. Waters, and . R. McBride (Eds.), Computerized adaptive testing: From inquiry to operation (pp. 199-205). Washington DC: American Psychological Association. ER - TY - BOOK T1 - Computerized adaptive testing: From inquiry to operation Y1 - 1997 A1 - Sands, W. A. A1 - B. K. Waters A1 - J. R. McBride KW - computerized adaptive testing AB - (from the cover) This book traces the development of computerized adaptive testing (CAT) from its origins in the 1960s to its integration with the Armed Services Vocational Aptitude Battery (ASVAB) in the 1990s. A paper-and-pencil version of the battery (P&P-ASVAB) has been used by the Defense Department since the 1970s to measure the abilities of applicants for military service. The test scores are used both for initial qualification and for classification into entry-level training opportunities. /// This volume provides the developmental history of the CAT-ASVAB through its various stages in the Joint-Service arena. Although the majority of the book concerns the myriad technical issues that were identified and resolved, information is provided on various political and funding support challenges that were successfully overcome in developing, testing, and implementing the battery into one of the nation's largest testing programs. The book provides useful information to professionals in the testing community and everyone interested in personnel assessment and evaluation. (PsycINFO Database Record (c) 2004 APA, all rights reserved). PB - American Psychological Association CY - Washington, D.C., USA N1 - References .Using Smart Source Parsingxvii, pp ER - TY - JOUR T1 - A computerized adaptive testing system for speech discrimination measurement: The Speech Sound Pattern Discrimination Test JF - Journal of the Accoustical Society of America Y1 - 1997 A1 - Bochner, J. A1 - Garrison, W. A1 - Palmer, L. A1 - MacKenzie, D. A1 - Braveman, A. KW - *Diagnosis, Computer-Assisted KW - *Speech Discrimination Tests KW - *Speech Perception KW - Adolescent KW - Adult KW - Audiometry, Pure-Tone KW - Human KW - Middle Age KW - Psychometrics KW - Reproducibility of Results AB - A computerized, adaptive test-delivery system for the measurement of speech discrimination, the Speech Sound Pattern Discrimination Test, is described and evaluated. Using a modified discrimination task, the testing system draws on a pool of 130 items spanning a broad range of difficulty to estimate an examinee's location along an underlying continuum of speech processing ability, yet does not require the examinee to possess a high level of English language proficiency. The system is driven by a mathematical measurement model which selects only test items which are appropriate in difficulty level for a given examinee, thereby individualizing the testing experience. Test items were administered to a sample of young deaf adults, and the adaptive testing system evaluated in terms of respondents' sensory and perceptual capabilities, acoustic and phonetic dimensions of speech, and theories of speech perception. Data obtained in this study support the validity, reliability, and efficiency of this test as a measure of speech processing ability. VL - 101 N1 - 972575560001-4966Journal Article ER - TY - ABST T1 - Computerized adaptive testing through the World Wide Web Y1 - 1997 A1 - Shermis, M. D. A1 - Mzumara, H. A1 - Brown, M. A1 - Lillig, C. CY - (ERIC No. ED414536) ER - TY - CONF T1 - Controlling test and computer anxiety: Test performance under CAT and SAT conditions T2 - Paper presented at the annual meeting of the National Council on Measurement in Education Y1 - 1997 A1 - Shermis, M. D. A1 - Mzumara, H. A1 - Bublitz, S. JF - Paper presented at the annual meeting of the National Council on Measurement in Education CY - Chicago IL ER - TY - CHAP T1 - Current and future challenges Y1 - 1997 A1 - Segall, D. O. A1 - Moreno, K. E. CY - W. A. Sands, B. K. Waters, and J. R. McBride (Eds.). Computerized adaptive testing: From inquiry to operation (pp 257-269). Washington DC: American Psychological Association. ER - TY - JOUR T1 - Developing and scoring an innovative computerized writing assessment JF - Journal of Educational Measurement Y1 - 1997 A1 - Davey, T. A1 - Godwin, J., A1 - Mittelholz, D. VL - 34 ER - TY - JOUR T1 - Evaluating an automatically scorable, open-ended response type for measuring mathematical reasoning in computer-adaptive tests Y1 - 1997 A1 - Bennett, R. E. A1 - Steffen, M. A1 - Singley, M.K. A1 - Morley, M. A1 - Jacquemin, D. ER - TY - CHAP T1 - Item exposure control in CAT-ASVAB T2 - Computerized adaptive testing: From inquiry to operation Y1 - 1997 A1 - Hetter, R. D. A1 - Sympson, J. B. ED - J. R. McBride AB - Describes the method used to control item exposure in computerized adaptive testing-Armed Services Vocational Aptitude Battery (CAT-ASVAB). The method described was developed specifically to ensure that CAT-ASVAB items were expose no more often than the items in the printers ASVAB's alternate forms, ensuring that CAT ASVAB is nor more vulnerable than printed ASVAB forms to comprise from item exposure. (PsycINFO Database Record (c) 2010 APA, all rights reserved) JF - Computerized adaptive testing: From inquiry to operation PB - American Psychological Association CY - Washington D.C., USA ER - TY - CHAP T1 - Item pool development and evaluation Y1 - 1997 A1 - Segall, D. O. A1 - Moreno, K. E. A1 - Hetter, D. H. CY - W. A. Sands, B. K. Waters, and J. R. McBride (Eds.), Computerized adaptive testing: From inquiry to operation (pp. 117-130). Washington DC: American Psychological Association. ER - TY - ABST T1 - Modification of the Computerized Adaptive Screening Test (CAST) for use by recruiters in all military services Y1 - 1997 A1 - J. R. McBride A1 - Cooper, R. R CY - Final Technical Report FR-WATSD-97-24, Contract No. MDA903-93-D-0032, DO 0054. Alexandria VA: Human Resources Research Organization. ER - TY - CHAP T1 - Policy and program management perspective Y1 - 1997 A1 - Martin, C.J. A1 - Hoshaw, C.R. CY - W.A. Sands, B.K. Waters, and J.R. McBride (Eds.), Computerized adaptive testing: From inquiry to operation. Washington, DC: American Psychological Association. ER - TY - CHAP T1 - Preliminary psychometric research for CAT-ASVAB: Selecting an adaptive testing strategy Y1 - 1997 A1 - J. R. McBride A1 - Wetzel, C. D. A1 - Hetter, R. D. CY - W. A. Sands, B. K. Waters, and J. R. McBride (Eds.), Computerized adaptive testing: From inquiry to operation (pp. 83-95). Washington DC: American Psychological Association. ER - TY - CHAP T1 - Psychometric procedures for administering CAT-ASVAB Y1 - 1997 A1 - Segall, D. O. A1 - Moreno, K. E. A1 - Bloxom, B. M. A1 - Hetter, R. D. CY - W. A. Sands, B. K. Waters, and J. R. McBride (Eds.), Computerized adaptive testing: From inquiry to operation (pp. 131-140). Washington D.C.: American Psychological Association. ER - TY - CHAP T1 - Reliability and construct validity of CAT-ASVAB Y1 - 1997 A1 - Moreno, K. E. A1 - Segall, O. D. CY - W. A. Sands, B. K. Waters, and J. R. McBride (Eds.). Computerized adaptive testing: From inquiry to operation (pp. 169-179). Washington DC: American Psychological Association. ER - TY - CHAP T1 - Research antecedents of applied adaptive testing T2 - Computerized adaptive testing: From inquiry to practice Y1 - 1997 A1 - J. R. McBride ED - B. K. Waters ED - J. R. McBride KW - computerized adaptive testing AB - (from the chapter) This chapter sets the stage for the entire computerized adaptive testing Armed Services Vocational Aptitude Battery (CAT-ASVAB) development program by describing the state of the art immediately preceding its inception. By the mid-l970s, a great deal of research had been conducted that provided the technical underpinnings needed to develop adaptive tests, but little research had been done to corroborate empirically the promising results of theoretical analyses and computer simulation studies. In this chapter, the author summarizes much of the important theoretical and simulation research prior to 1977. In doing so, he describes a variety of approaches to adaptive testing, and shows that while many methods for adaptive testing had been proposed, few practical attempts had been made to implement it. Furthermore, the few instances of adaptive testing were based primarily on traditional test theory, and were developed in laboratory settings for purposes of basic research. The most promising approaches, those based on item response theory and evaluated analytically or by means of computer simulations, remained to be proven in the crucible of live testing. (PsycINFO Database Record (c) 2004 APA, all rights reserved). JF - Computerized adaptive testing: From inquiry to practice PB - American Psychological Association CY - Washington D.C. USA ER - TY - CHAP T1 - Technical perspective Y1 - 1997 A1 - J. R. McBride CY - W. A. Sands, B. K. Waters, and J. R. McBride (Eds.), Computerized adaptive testing: From inquiry to operation (pp. 29-44). Washington, DC: American Psychological Association. ER - TY - CHAP T1 - Validation of the experimental CAT-ASVAB system Y1 - 1997 A1 - Segall, D. O. A1 - Moreno, K. E. A1 - Kieckhaefer, W. F. A1 - Vicino, F. L. A1 - J. R. McBride CY - W. A. Sands, B. K. Waters, and J. R. McBride (Eds.), Computerized adaptive testing: From inquiry to operation. Washington, DC: American Psychological Association. ER - TY - CONF T1 - Current research in computer-based testing for personnel selection and classification in the United States T2 - Invited address to the Centre for Recruitment and Selection, Belgian Armed Forces" Y1 - 1996 A1 - J. R. McBride JF - Invited address to the Centre for Recruitment and Selection, Belgian Armed Forces" ER - TY - JOUR T1 - Methodologic trends in the healthcare professions: computer adaptive and computer simulation testing JF - Nurse Education Y1 - 1996 A1 - Forker, J. E. A1 - McDonald, M. E. KW - *Clinical Competence KW - *Computer Simulation KW - Computer-Assisted Instruction/*methods KW - Educational Measurement/*methods KW - Humans AB - Assessing knowledge and performance on computer is rapidly becoming a common phenomenon in testing and measurement. Computer adaptive testing presents an individualized test format in accordance with the examinee's ability level. The efficiency of the testing process enables a more precise estimate of performance, often with fewer items than traditional paper-and-pencil testing methodologies. Computer simulation testing involves performance-based, or authentic, assessment of the examinee's clinical decision-making abilities. The authors discuss the trends in assessing performance through computerized means and the application of these methodologies to community-based nursing practice. VL - 21 SN - 0363-3624 (Print)0363-3624 (Linking) N1 - Forker, J EMcDonald, M EUnited statesNurse educatorNurse Educ. 1996 Jul-Aug;21(4):13-4. ER - TY - ABST T1 - Missing responses and IRT ability estimation: Omits, choice, time limits, and adaptive testing (Research Report RR-96-30-ONR) Y1 - 1996 A1 - Mislevy, R. J. A1 - Wu, P.-K. CY - Princeton NJ: Educational Testing Service ER - TY - CONF T1 - Person-fit indices and their role in the CAT environment T2 - Paper presented at the annual meeting of the National Council on Measurement in Education Y1 - 1996 A1 - McLeod, L. D. A1 - Lewis, C. JF - Paper presented at the annual meeting of the National Council on Measurement in Education CY - New York ER - TY - JOUR T1 - Practical issues in large-scale computerized adaptive testing JF - Applied Measurement in Education Y1 - 1996 A1 - Mills, C. N., A1 - Stocking, M. L. VL - 9 ER - TY - ABST T1 - Preliminary cost-effectiveness analysis of alternative ASVAB testing concepts at MET sites Y1 - 1996 A1 - Hogan, P.F. A1 - Dall, T. A1 - J. R. McBride CY - Interim report to Defense Manpower Data Center. Fairfax, VA: Lewin-VHI, Inc. ER - TY - CONF T1 - A comparison of classification agreement between adaptive and full-length test under the 1-PL and 2-PL models T2 - Paper presented at the annual meeting of the American Educational Research Association Y1 - 1995 A1 - Lewis, M. J. A1 - Subhiyah, R. G. A1 - Morrison, C. A. JF - Paper presented at the annual meeting of the American Educational Research Association CY - San Francisco CA N1 - (cited in #RE98311) ER - TY - CONF T1 - Computer adaptive testing in a medical licensure setting: A comparison of outcomes under the one- and two- parameter logistic models T2 - Paper presented at the annual meeting of the American Educational Research Association Y1 - 1995 A1 - Morrison, C. A. A1 - Nungester, R. J. JF - Paper presented at the annual meeting of the American Educational Research Association CY - San Francisco ER - TY - CONF T1 - Equating the computerized adaptive edition of the Differential Aptitude Tests T2 - Paper presented at the annual meeting of the National Council on Measurement in Education. San Francisco Y1 - 1995 A1 - J. R. McBride JF - Paper presented at the annual meeting of the National Council on Measurement in Education. San Francisco CY - CA ER - TY - ABST T1 - An evaluation of alternative concepts for administering the Armed Services Vocational Aptitude Battery to applicants for enlistment Y1 - 1995 A1 - Hogan, P.F. A1 - J. R. McBride A1 - Curran, L. T. CY - DMDC Technical Report 95-013. Monterey, CA: Personnel Testing Division, Defense Manpower Data Center ER - TY - CONF T1 - The influence of examinee test-taking behavior motivation in computerized adaptive testing T2 - Paper presented at the annual meeting of the National Council on Measurement in Education Y1 - 1995 A1 - Kim, J. A1 - McLean, J. E. JF - Paper presented at the annual meeting of the National Council on Measurement in Education CY - San Francisco CA N1 - (ERIC No. ED392839) ER - TY - ABST T1 - The introduction and comparability of the computer-adaptive GRE General Test (GRE Board Professional Report 88-08ap; Educational Testing Service Research Report 95-20) Y1 - 1995 A1 - Schaeffer, G. A. A1 - Steffen, M. Golub-Smith, M. L. A1 - Mills, C. N. A1 - Durso, R. CY - Princeton NJ: Educational Testing Service ER - TY - CONF T1 - Item exposure rates for unconstrained and content-balanced computerized adaptive tests T2 - Paper presented at the annual meeting of the American Educational Research Association Y1 - 1995 A1 - Morrison, C. A1 - Subhiyah, R,, A1 - Nungester, R. JF - Paper presented at the annual meeting of the American Educational Research Association CY - San Francisco CA ER - TY - ABST T1 - Practical issues in large-scale high-stakes computerized adaptive testing (Research Report 95-23) Y1 - 1995 A1 - Mills, C. N. A1 - Stocking, M. L. CY - Princeton, NJ: Educational Testing Service. N1 - #MI95-23 ER - TY - JOUR T1 - Theoretical results and item selection from multidimensional item bank in the Mokken IRT model for polytomous items JF - Applied Psychological Measurement Y1 - 1995 A1 - Hemker, B. T. A1 - Sijtsma, K. A1 - Molenaar, I. W. VL - 19 ER - TY - CONF T1 - Early psychometric research in the CAT-ASVAB Project T2 - Paper presented at the 102nd Annual Convention of the American Psychological Association. Los Angeles Y1 - 1994 A1 - J. R. McBride JF - Paper presented at the 102nd Annual Convention of the American Psychological Association. Los Angeles CY - CA ER - TY - JOUR T1 - An application of Computerized Adaptive Testing to the Test of English as a Foreign Language JF - Dissertation Abstracts International Y1 - 1993 A1 - Moon, O. KW - computerized adaptive testing VL - 53 ER - TY - ABST T1 - Field test of a computer-based GRE general test (GRE Board Technical Report 88-8; Educational Testing Service Research Rep No RR 93-07) Y1 - 1993 A1 - Schaeffer, G. A. A1 - Reese, C. M. A1 - Steffen, M. A1 - McKinley, R. L. A1 - Mills, C. N. CY - Princeton NJ: Educational Testing Service. ER - TY - JOUR T1 - The application of latent class models in adaptive testing JF - Psychometrika Y1 - 1992 A1 - Macready, G. B. A1 - Dayton, C. M. VL - 57 ER - TY - JOUR T1 - CAT-ASVAB precision JF - Proceedings of the 34th Annual Conference of the Military Testing Association Y1 - 1992 A1 - Moreno, K. E., A1 - Segall, D. O. VL - 1 ER - TY - CHAP T1 - The development of alternative operational concepts Y1 - 1992 A1 - J. R. McBride A1 - Curran, L. T. CY - Proceedings of the 34th Annual Conference of the Military Testing Association. San Diego, CA: Navy Personnel Research and Development Center. ER - TY - CHAP T1 - Evaluation of alternative operational concepts Y1 - 1992 A1 - J. R. McBride A1 - Hogan, P.F. CY - Proceedings of the 34th Annual Conference of the Military Testing Association. San Diego, CA: Navy Personnel Research and Development Center. ER - TY - CONF T1 - Practical considerations for conducting studies of differential item functioning (DIF) in a CAT environment T2 - Paper presented at the annual meeting of the American Educational Research Association Y1 - 1992 A1 - Miller, T. R. JF - Paper presented at the annual meeting of the American Educational Research Association CY - San Francisco CA ER - TY - ABST T1 - Patterns of alcohol and drug use among federal offenders as assessed by the Computerized Lifestyle Screening Instrument Y1 - 1991 A1 - Robinson, D. A1 - Porporino, F. J. A1 - Millson, W. A. KW - computerized adaptive testing KW - drug abuse KW - substance use PB - Research and Statistics Branch, Correctional Service of Canada CY - Ottawa, ON. Canada SN - R-11 ER - TY - CONF T1 - What lies ahead? Computer technology and its implications for personnel testing T2 - Keynote address Y1 - 1991 A1 - J. R. McBride JF - Keynote address CY - NATO Workshop on Computer-based Assessment of Military Personnel, Brussels, Belgium ER - TY - ABST T1 - A comparison of Rasch and three-parameter logistic models in computerized adaptive testing Y1 - 1990 A1 - Parker, S.B. A1 - J. R. McBride CY - Unpublished manuscript ER - TY - BOOK T1 - Computerized adaptive testing: A primer (Eds.) Y1 - 1990 A1 - Wainer, H., A1 - Dorans, N. J. A1 - Flaugher, R. A1 - Green, B. F. A1 - Mislevy, R. J. A1 - Steinberg, L. A1 - Thissen, D. CY - Hillsdale NJ: Erlbaum ER - TY - CHAP T1 - Future challenges Y1 - 1990 A1 - Wainer, H., A1 - Dorans, N. J. A1 - Green, B. F. A1 - Mislevy, R. J. A1 - Steinberg, L. A1 - Thissen, D. CY - H. Wainer (Ed.), Computerized adaptive testing: A primer (pp. 233-272). Hillsdale NJ: Erlbaum. ER - TY - CHAP T1 - Item response theory, item calibration, and proficiency estimation Y1 - 1990 A1 - Wainer, H., A1 - Mislevy, R. J. CY - H. Wainer (Ed.), Computerized adaptive testing: A primer (pp. 65-102). Hillsdale NJ: Erlbaum. ER - TY - CHAP T1 - Testing algorithms Y1 - 1990 A1 - Wainer, H., A1 - Mislevy, R. J. CY - H. Wainer (Ed.), Computerized adaptive testing: A primer (pp. 103-135). Hillsdale NJ: Erlbaum. ER - TY - CHAP T1 - Testing algorithms Y1 - 1990 A1 - Thissen, D. A1 - Mislevy, R. J. CY - H. Wainer (Ed.), Computerized adaptive testing: A primer (pp. 103-135). Hillsdale NJ: Erlbaum. ER - TY - JOUR T1 - Adaptive and Conventional Versions of the DAT: The First Complete Test Battery Comparison JF - Applied Psychological Measurement Y1 - 1989 A1 - Henly, S. J. A1 - Klebe, K. J. A1 - J. R. McBride A1 - Cudeck, R. VL - 13 IS - 4 ER - TY - JOUR T1 - Adaptive and conventional versions of the DAT: The first complete test battery comparison JF - Applied Psychological Measurement Y1 - 1989 A1 - Henly, S. J. A1 - Klebe, K. J. A1 - J. R. McBride A1 - Cudeck, R. VL - 13 ER - TY - CONF T1 - Commercial applications of computerized adaptive testing T2 - C.E. Davis Chair, Computerized Adaptive Testing–Military and Commercial Developments Ten Years Later: Symposium conducted at the Annual Conference of the Military Testing Association (524-529) Y1 - 1989 A1 - J. R. McBride JF - C.E. Davis Chair, Computerized Adaptive Testing–Military and Commercial Developments Ten Years Later: Symposium conducted at the Annual Conference of the Military Testing Association (524-529) CY - San Antonio, TX ER - TY - JOUR T1 - Comparisons of paper-administered, computer-administered and computerized adaptive achievement tests JF - Journal of Educational Computing Research Y1 - 1989 A1 - Olson, J. B A1 - Maynes, D. D. A1 - Slawson, D. A1 - Ho, K AB - This research study was designed to compare student achievement scores from three different testing methods: paper-administered testing, computer-administered testing, and computerized adaptive testing. The three testing formats were developed from the California Assessment Program (CAP) item banks for grades three and six. The paper-administered and the computer-administered tests were identical in item content, format, and sequence. The computerized adaptive test was a tailored or adaptive sequence of the items in the computer-administered test. VL - 5 ER - TY - CONF T1 - A computerized adaptive mathematics screening test T2 - Paper presented at the Annual Meeting of the California Educational Research Association Y1 - 1989 A1 - J. R. McBride JF - Paper presented at the Annual Meeting of the California Educational Research Association CY - Burlingame, CA N1 - ERIC Document Reproduction Service No. ED 316 554) ER - TY - JOUR T1 - Trace lines for testlets: A use of multiple-categorical-response models JF - Journal of Educational Measurement Y1 - 1989 A1 - Thissen, D. A1 - Steinberg, L. A1 - Mooney, J.A. VL - 26 ER - TY - CONF T1 - A computerized adaptive version of the Differential Aptitude Tests T2 - Paper presented at the meeting of the American Psychological Association Y1 - 1988 A1 - J. R. McBride JF - Paper presented at the meeting of the American Psychological Association CY - Atlanta GA ER - TY - ABST T1 - The equivalence of scores from automated and conventional educational and psychological tests (College Board Report No. 88-8) Y1 - 1988 A1 - Mazzeo, J. A1 - Harvey, A. L. CY - New York: The College Entrance Examination Board. ER - TY - JOUR T1 - Item pool maintenance in the presence of item parameter drift JF - Journal of Educational Measurement Y1 - 1988 A1 - Bock, B. D., A1 - Muraki, E. A1 - Pfeiffenberger, W. VL - 25 ER - TY - ABST T1 - Refinement of the Computerized Adaptive Screening Test (CAST) (Final Report, Contract No MDA203 06-C-0373) Y1 - 1988 A1 - Wise, L. L. A1 - McHenry, J.J. A1 - Chia, W.J. A1 - Szenas, P.L. A1 - J. R. McBride CY - Washington, DC: American Institutes for Research. ER - TY - CONF T1 - Computerized adaptive testing made practical: The Computerized Adaptive Edition of the Differential Aptitude Tests T2 - Presented at the U.S. Department of Labor National Test Development Conference Y1 - 1987 A1 - J. R. McBride JF - Presented at the U.S. Department of Labor National Test Development Conference CY - San Francisco, CA ER - TY - CONF T1 - Equating the computerized adaptive edition of the Differential Aptitude Tests T2 - Paper presented at the meeting of the American Psychological Association Y1 - 1987 A1 - J. R. McBride A1 - Corpe, V. A. A1 - Wing, H. JF - Paper presented at the meeting of the American Psychological Association CY - New York ER - TY - CONF T1 - Comparison and equating of paper-administered, computer-administered, and computerized adaptive tests of achievement T2 - Paper presented at the annual meeting of the American Educational Research Association Y1 - 1986 A1 - Olsen, J. B. A1 - Maynes, D. D. A1 - Slawson, D. A1 - Ho, K JF - Paper presented at the annual meeting of the American Educational Research Association CY - San Francisco CA ER - TY - CONF T1 - Computerized adaptive achievement testing: A prototype T2 - Paper presented at the annual meeting of the National Council on Measurement in Education Y1 - 1986 A1 - J. R. McBride A1 - Moe, K. C. JF - Paper presented at the annual meeting of the National Council on Measurement in Education CY - San Francisco CA ER - TY - CONF T1 - A computerized adaptive edition of the Differential Aptitude Tests T2 - Paper presented at the meeting of the American Psychological Association Y1 - 1986 A1 - J. R. McBride JF - Paper presented at the meeting of the American Psychological Association CY - Washington DC N1 - ERIC No. ED 285 918) ER - TY - CONF T1 - A computerized adaptive edition of the Differential Aptitude Tests T2 - Presented at the National Assessment Conference of the Education Commission of the States Y1 - 1986 A1 - J. R. McBride JF - Presented at the National Assessment Conference of the Education Commission of the States CY - Boulder, CO ER - TY - ABST T1 - Armed Services Vocational Aptitude Battery: Development of an adaptive item pool (AFHLR-TR-85-19; Technical Rep No 85-19) Y1 - 1985 A1 - Prestwood, J. S. A1 - Vale, C. D. A1 - Massey, R. H. A1 - Welsh, J. R. CY - Brooks Air Force Base TX: Air Force Human Resources Laboratory ER - TY - JOUR T1 - Computerized adaptive testing JF - Educational Leadership Y1 - 1985 A1 - J. R. McBride VL - 43 ER - TY - CONF T1 - Computerized adaptive testing: An overview and an example T2 - Presented at the Assessment Conference of the Education Commission of the States Y1 - 1985 A1 - J. R. McBride JF - Presented at the Assessment Conference of the Education Commission of the States CY - Boulder, CO ER - TY - CHAP T1 - Reducing the predictability of adaptive item sequences Y1 - 1985 A1 - Wetzel, C. D. A1 - J. R. McBride CY - Proceedings of the 27th Annual Conference of the Military Testing Association, San Diego, 43-48. ER - TY - Generic T1 - Unidimensional and multidimensional models for item response theory T2 - Proceedings of the 1982 Computerized Adaptive Testing Conference Y1 - 1985 A1 - McDonald, R. P. JF - Proceedings of the 1982 Computerized Adaptive Testing Conference PB - University of Minnesota, Department of Psychology, Psychometrics Methods Program CY - Minneapolis, MN. USA ER - TY - CONF T1 - Validity of adaptive testing: A summary of research results T2 - Paper presented at the annual meeting of the American Psychological Association. Y1 - 1985 A1 - Sympson, J. B. A1 - Moreno, K. E. JF - Paper presented at the annual meeting of the American Psychological Association. N1 - #SY85-01 ER - TY - CONF T1 - A validity study of the computerized adaptive testing version of the Armed Services Vocational Aptitude Battery T2 - Proceedings of the 27th Annual Conference of the Military Testing Association Y1 - 1985 A1 - Moreno, K. E. A1 - Segall, D. O. A1 - Kieckhaefer, W. F. JF - Proceedings of the 27th Annual Conference of the Military Testing Association ER - TY - JOUR T1 - Bias and information of Bayesian adaptive testing JF - Applied Psychological Measurement Y1 - 1984 A1 - Weiss, D. J. A1 - J. R. McBride VL - 8 ER - TY - JOUR T1 - Bias and Information of Bayesian Adaptive Testing JF - Applied Psychological Measurement Y1 - 1984 A1 - Weiss, D. J. A1 - J. R. McBride VL - 8 IS - 3 ER - TY - JOUR T1 - Computerized diagnostic testing JF - Journal of Educational Measurement Y1 - 1984 A1 - MCArthur , D.L. A1 - Choppin, B. H. VL - 21 ER - TY - CONF T1 - The design of a computerized adaptive testing system for administering the ASVAB T2 - Presentation at the Annual Meeting of the American Educational Research Association Y1 - 1984 A1 - J. R. McBride JF - Presentation at the Annual Meeting of the American Educational Research Association CY - New Orleans, LA ER - TY - ABST T1 - Evaluation of computerized adaptive testing of the ASVAB Y1 - 1984 A1 - Hardwicke, S. A1 - Vicino, F. A1 - J. R. McBride A1 - Nemeth, C. CY - San Diego, CA: Navy Personnel Research and Development Center, unpublished manuscript ER - TY - JOUR T1 - Issues in item banking JF - Journal of Educational Measurement Y1 - 1984 A1 - Millman, J. A1 - Arter, J.A. VL - 1 ER - TY - JOUR T1 - Relationship Between Corresponding Armed Services Vocational Aptitude Battery (ASVAB) and Computerized Adaptive Testing (CAT) Subtests JF - Applied Psychological Measurement Y1 - 1984 A1 - Moreno, K. E. A1 - Wetzel, C. D. A1 - J. R. McBride A1 - Weiss, D. J. VL - 8 IS - 2 ER - TY - JOUR T1 - Relationship between corresponding Armed Services Vocational Aptitude Battery (ASVAB) and computerized adaptive testing (CAT) subtests JF - Applied Psychological Measurement Y1 - 1984 A1 - Moreno, K. E. A1 - Wetzel, C. D. A1 - J. R. McBride A1 - Weiss, D. J. KW - computerized adaptive testing AB - Investigated the relationships between selected subtests from the Armed Services Vocational Aptitude Battery (ASVAB) and corresponding subtests administered as computerized adaptive tests (CATs), using 270 17-26 yr old Marine recruits as Ss. Ss were administered the ASVAB before enlisting and approximately 2 wks after entering active duty, and the CAT tests were administered to Ss approximately 24 hrs after arriving at the recruit depot. Results indicate that 3 adaptive subtests correlated as well with ASVAB as did the 2nd administration of the ASVAB, although CAT subtests contained only half the number of items. Factor analysis showed CAT subtests to load on the same factors as the corresponding ASVAB subtests, indicating that the same abilities were being measured. It is concluded that CAT can achieve the same measurement precision as a conventional test, with half the number of items. (16 ref) VL - 8 N1 - Sage Publications, US ER - TY - JOUR T1 - Using microcomputers to administer tests: An alternate point of view JF - Educational Measurement: Issues and Practice Y1 - 1984 A1 - Millman, J. VL - 3(2) ER - TY - ABST T1 - Bias and information of Bayesian adaptive testing (Research Report 83-2) Y1 - 1983 A1 - Weiss, D. J. A1 - J. R. McBride CY - Minneapolis: University of Minnesota, Department of Psychology, Computerized Adaptive Testing Laboratory N1 - {PDF file, 1.066MB} ER - TY - BOOK T1 - Effects of item parameter error and other factors on trait estimation in latent trait based adaptive testing Y1 - 1983 A1 - Mattson, J. D. CY - Unpublished doctoral dissertation, University of Minnesota N1 - Dissertation Abstracts International, 44(3-B), 944. ER - TY - ABST T1 - An evaluation of one- and three-parameter logistic tailored testing procedures for use with small item pools (Research Report ONR83-1) Y1 - 1983 A1 - McKinley, R. L. A1 - Reckase, M. D. CY - Iowa City IA: American College Testing Program ER - TY - ABST T1 - Influence of fallible item parameters on test information during adaptive testing (Tech Rep 83-15). Y1 - 1983 A1 - Wetzel, C. D. A1 - J. R. McBride CY - San Diego CA: Navy Personnel Research and Development Center. N1 - #WE83-15 ER - TY - ABST T1 - Relationship between corresponding Armed Services Vocational Aptitude Battery (ASVAB) and computerized adaptive testing (CAT) subtests (TR 83-27) Y1 - 1983 A1 - Moreno, K. E. A1 - Wetzel, D. C. A1 - J. R. McBride A1 - Weiss, D. J. CY - San Diego CA: Navy Personnel Research and Development Center ER - TY - ABST T1 - Reliability and validity of adaptive ability tests in a military recruit population (Research Report 83-1) Y1 - 1983 A1 - J. R. McBride A1 - Martin, J. T. A1 - Weiss, D. J. CY - Minneapolis: Department of Psychology, Psychometric Methods Program, Computerized Testing Laboratory ER - TY - CHAP T1 - Reliability and validity of adaptive ability tests in a military setting Y1 - 1983 A1 - J. R. McBride A1 - Martin, J. T. CY - D. J. Weiss (Ed.), New horizons in testing: Latent trait test theory and computerized adaptive testing (pp. 224-236). New York: Academic Press. ER - TY - ABST T1 - Reliability and validity of adaptive vs. conventional tests in a military recruit population (Research Rep. No. 83-1). Y1 - 1983 A1 - Martin, J. T. A1 - J. R. McBride A1 - Weiss, D. J. CY - Minneapolis: University of Minnesota, Department of Psychology, Psychometric Methods Program, Computerized Adaptive Testing Laboratory. N1 - {PDF file, 2.787 MB} ER - TY - JOUR T1 - Adaptive EAP estimation of ability in a microcomputer environment JF - Applied Psychological Measurement Y1 - 1982 A1 - Bock, B. D., A1 - Mislevy, R. J. VL - 6 ER - TY - ABST T1 - Computerized adaptive testing project: Objectives and requirements (Tech Note 82-22) Y1 - 1982 A1 - J. R. McBride CY - San Diego CA: Navy Personnel Research and Development Center. (AD A118 447) N1 - #McB82-22 ER - TY - ABST T1 - Computerized Adaptive Testing system development and project management. Y1 - 1982 A1 - J. R. McBride CY - Minutes of the ASVAB (Armed Services Vocational Aptitude Battery) Steering Committee. Washington, DC: Office of the Assistant Secretary of Defense (Manpower, Reserve Affairs and Logistics), Accession Policy Directorate. ER - TY - CHAP T1 - The computerized adaptive testing system development project Y1 - 1982 A1 - J. R. McBride A1 - Sympson, J. B. CY - D. J. Weiss (Ed.), Proceedings of the 1982 Item Response Theory and Computerized Adaptive Testing Conference (pp. 342-349). Minneapolis: University of Minnesota, Department of Psychology. N1 - {PDF file, 296 KB} ER - TY - CONF T1 - Development of a computerized adaptive testing system for enlisted personnel selection T2 - Presented at the Annual Convention of the American Psychological Association Y1 - 1982 A1 - J. R. McBride JF - Presented at the Annual Convention of the American Psychological Association CY - Washington, DC ER - TY - RPRT T1 - A comparison of a Bayesian and a maximum likelihood tailored testing procedure Y1 - 1981 A1 - McKinley, R. L., A1 - Reckase, M. D. JF - Research Report 81-2 PB - University of Missouri, Department of Educational Psychology, Tailored Testing Research Laboratory CY - Columbia MO ER - TY - ABST T1 - Factors influencing the psychometric characteristics of an adaptive testing strategy for test batteries (Research Rep. No. 81-4) Y1 - 1981 A1 - Maurelli, V. A. A1 - Weiss, D. J. CY - Minneapolis: University of Minnesota, Department of Psychology, Psychometric Methods Program, Computerized Adaptive Testing Laboratory N1 - {PDF file, 1.689 MB} ER - TY - CHAP T1 - Adaptive verbal ability testing in a military setting Y1 - 1980 A1 - J. R. McBride CY - D. J. Weiss (Ed.), Proceedings of the 1979 Computerized Adaptive Testing Conference (pp. 4-15). Minneapolis MN: University of Minnesota, Department of Psychology, Psychometric Methods Program, Computerized Adaptive Testing Laboratory. N1 - {PDF file, 635 KB} ER - TY - JOUR T1 - Computer applications to ability testing JF - Association for Educational Data Systems Journal Y1 - 1980 A1 - McKinley, R. L., A1 - Reckase, M. D. VL - 13 ER - TY - JOUR T1 - Implied Orders Tailored Testing: Simulation with the Stanford-Binet JF - Applied Psychological Measurement Y1 - 1980 A1 - Cudeck, R. A1 - McCormick, D. J. A1 - N. Cliff VL - 4 IS - 2 ER - TY - JOUR T1 - Implied orders tailored testing: Simulation with the Stanford-Binet JF - Applied Psychological Measurement Y1 - 1980 A1 - Cudeck, R. A1 - McCormick, D. A1 - Cliff, N. A. VL - 4 ER - TY - ABST T1 - A successful application of latent trait theory to tailored achievement testing (Research Report 80-1) Y1 - 1980 A1 - McKinley, R. L. A1 - Reckase, M. D. CY - University of Missouri, Department of Educational Psychology, Tailored Testing Research Laboratory ER - TY - ABST T1 - Adaptive mental testing: The state of the art (Technical Report 423) Y1 - 1979 A1 - J. R. McBride CY - Alexandria VA: U.S. Army Research Institute for the Behavioral and Social Sciences. ER - TY - ABST T1 - Adaptive tests' usefulness for military personnel screening Y1 - 1979 A1 - J. R. McBride CY - In M. Wiskoff, Chair, Military Applications of Computerized Adaptive Testing. Symposium presented at the Annual Convention of the American Psychological Association, New York. ER - TY - ABST T1 - Computerized adaptive testing: The state of the art (ARI Technical Report 423) Y1 - 1979 A1 - J. R. McBride CY - Alexandria, VA: U.S. Army Research Institute for the Behavioral and Social Sciences. ER - TY - ABST T1 - An evaluation of computerized adaptive testing Y1 - 1979 A1 - J. R. McBride CY - In Proceedings of the 21st Military Testing Association Conference. SanDiego, CA: Navy Personnel Research and Development Center. ER - TY - JOUR T1 - Evaluation of implied orders as a basis for tailored testing with simulation data JF - Applied Psychological Measurement Y1 - 1979 A1 - Cliff, N. A. A1 - McCormick, D. VL - 3 ER - TY - JOUR T1 - Evaluation of Implied Orders as a Basis for Tailored Testing with Simulation Data JF - Applied Psychological Measurement Y1 - 1979 A1 - N. Cliff A1 - Cudeck, R. A1 - McCormick, D. J. VL - 3 IS - 4 ER - TY - JOUR T1 - Monte Carlo Evaluation of Implied Orders As a Basis for Tailored Testing JF - Applied Psychological Measurement Y1 - 1979 A1 - Cudeck, R. A1 - McCormick, D. A1 - N. Cliff VL - 3 IS - 1 ER - TY - JOUR T1 - Monte carlo evaluation of implied orders as a basis for tailored testing JF - Applied Psychological Measurement Y1 - 1979 A1 - Cudeck, R. A1 - McCormick, D. J. A1 - Cliff, N. A. VL - 3 ER - TY - CONF T1 - An adaptive test designed for paper-and-pencil testing T2 - Presentation to the convention of the Western Psychological Association Y1 - 1978 A1 - J. R. McBride JF - Presentation to the convention of the Western Psychological Association CY - San Francisco, CA ER - TY - CHAP T1 - Applications of latent trait theory to criterion-referenced testing Y1 - 1978 A1 - J. R. McBride CY - D.J. Weiss (Ed.), Proceedings of the 1977 Computerized Adaptive Testing Conference. Minneapolis, MN: University of Minnesota. ER - TY - BOOK T1 - A comparison of Bayesian and maximum likelihood scoring in a simulated stradaptive test Y1 - 1978 A1 - Maurelli, V. A. CY - Unpublished Masters thesis, St. Mary’s University of Texas, San Antonio TX ER - TY - ABST T1 - Evaluations of implied orders as a basis for tailored testing using simulations (Technical Report No. 4) Y1 - 1978 A1 - Cliff, N. A. A1 - Cudeck, R. A1 - McCormick, D. CY - Los Angeles CA: University of Southern California, Department of Psychology. N1 - #CL77-04 ER - TY - ABST T1 - Implied orders as a basis for tailored testing (Technical Report No. 6) Y1 - 1978 A1 - Cliff, N. A. A1 - Cudeck, R. A1 - McCormick, D. CY - Los Angeles CA: University of Southern California, Department of Psychology. N1 - #CL78-06 ER - TY - CHAP T1 - An adaptive test of arithmetic reasoning Y1 - 1977 A1 - J. R. McBride CY - the Proceedings of the Nineteenth Military Testing Association conference, San Antonio, TX. ER - TY - CHAP T1 - A brief overview of adaptive testing Y1 - 1977 A1 - J. R. McBride CY - D. J. Weiss (Ed.), Applications of computerized testing (Research Report 77-1). Minneapolis: University of Minnesota, Department of Psychology, Psychometric Methods Program N1 - 28 MB} ER - TY - CHAP T1 - Computerized Adaptive Testing research and development Y1 - 1977 A1 - J. R. McBride CY - H. Taylor, Proceedings of the Second Training and Personnel Technology Conference. Washington, DC: Office of the Director of Defense Research and Engineering. ER - TY - CHAP T1 - An empirical evaluation of implied orders as a basis for tailored testing Y1 - 1977 A1 - Cliff, N. A. A1 - Cudeck, R. A1 - McCormick, D. CY - D. J. Weiss (Ed.), Proceedings of the 1977 Computerized Adaptive Testing Conference. Minneapolis MN: University of Minnesota, Department of Psychology, Psychometric Methods Program. ER - TY - CHAP T1 - Implementation of Tailored Testing at the Civil Service Commission Y1 - 1977 A1 - McKillip, R. H. CY - D. J. Weiss (Ed.), Proceedings of the 1977 Computerized Adaptive Testing Conference. Minneapolis MN: University of Minnesota, Department of Psychology, Psychometric Methods Program ER - TY - JOUR T1 - Some Properties of a Bayesian Adaptive Ability Testing Strategy JF - Applied Psychological Measurement Y1 - 1977 A1 - J. R. McBride VL - 1 IS - 1 ER - TY - JOUR T1 - Some properties of a Bayesian adaptive ability testing strategy JF - Applied Psychological Measurement Y1 - 1977 A1 - J. R. McBride VL - 1 ER - TY - JOUR T1 - TAILOR-APL: An interactive computer program for individual tailored testing JF - Educational and Psychological Measurement Y1 - 1977 A1 - McCormick, D. A1 - Cliff, N. A. VL - 37 ER - TY - ABST T1 - Adaptive mental testing: The state of the art (Technical Report 423) Y1 - 1976 A1 - J. R. McBride CY - Washington DC: U.S. Army Research Institute for the Social and Behavioral Sciences. N1 - . ER - TY - CHAP T1 - Adaptive testing research at Minnesota: Some properties of a Bayesian sequential adaptive mental testing strategy Y1 - 1976 A1 - J. R. McBride CY - C. K. Clark (Ed.), Proceedings of the First Conference on Computerized Adaptive Testing (pp. 36-53). Washington DC: U.S. Government Printing Office. N1 - {PDF file, 960 KB} ER - TY - CHAP T1 - Bandwidth, fidelity, and adaptive tests Y1 - 1976 A1 - J. R. McBride CY - T. J. McConnell, Jr. (Ed.), CAT/C 2 1975: The second conference on computer-assisted test construction. Atlanta GA: Atlanta Public Schools. N1 - PDF file, 783 K ER - TY - CHAP T1 - Computer-assisted testing: An orderly transition from theory to practice Y1 - 1976 A1 - McKillip, R. H. A1 - Urry, V. W. CY - C. K. Clark (Ed.), Proceedings of the First Conference on Computerized Adaptive Testing (pp. 95-96). Washington DC: U.S. Government Printing Office. N1 - {PDF file, 191 KB} ER - TY - ABST T1 - Monte carlo results from a computer program for tailored testing (Technical Report No. 2) Y1 - 1976 A1 - Cudeck, R. A. A1 - Cliff, N. A. A1 - Reynolds, T. J. A1 - McCormick, D. J. CY - Los Angeles CA: University of California, Department of Psychology. N1 - #CU76-02 ER - TY - ABST T1 - Research on adaptive testing 1973-1976: A review of the literature Y1 - 1976 A1 - J. R. McBride CY - Unpublished manuscript, University of Minnesota ER - TY - BOOK T1 - Simulation studies of adaptive testing: A comparative evaluation Y1 - 1976 A1 - J. R. McBride CY - Unpublished doctoral dissertation, University of Minnesota, Minneapolis, MN ER - TY - ABST T1 - Some properties of a Bayesian adaptive ability testing strategy (Research Report 76-1) Y1 - 1976 A1 - J. R. McBride A1 - Weiss, D. J. CY - Minneapolis MN: Department of Psychology, Computerized Adaptive Testing Laboratory ER - TY - CHAP T1 - Scoring adaptive tests Y1 - 1975 A1 - J. R. McBride CY - D. J. Weiss (Ed.), Computerized adaptive trait measurement: Problems and Prospects (Research Report 75-5), pp. 17-25. Minneapolis MN: University of Minnesota, Department of Psychology, Psychometric Methods Program. N1 - {PDF file, 442 KB} ER - TY - CHAP T1 - Recent and projected developments in ability testing by computer Y1 - 1974 A1 - J. R. McBride A1 - Weiss, D. J. CY - Earl Jones (Ed.), Symposium Proceedings: Occupational Research and the Navy–Prospectus 1980 (TR-74-14). San Diego, CA: Navy Personnel Research and Development Center. ER - TY - ABST T1 - A word knowledge item pool for adaptive ability measurement (Research Report 74-2) Y1 - 1974 A1 - J. R. McBride A1 - Weiss, D. J. CY - Minneapolis MN: Department of Psychology, Computerized Adaptive Testing Laboratory ER - TY - BOOK T1 - A modification to Lord’s model for tailored tests Y1 - 1972 A1 - Mussio, J. J. CY - Unpublished doctoral dissertation, University of Toronto ER - TY - ABST T1 - Exploratory study of a sequential item test Y1 - 1962 A1 - Seeley, L. C. A1 - Morton, M. A. A1 - Anderson, A. A. CY - U.S. Army Personnel Research Office, Technical Research Note 129. ER - TY - JOUR T1 - Some empirical aspects of the sequential analysis technique as applied to an achievement examination JF - Journal of Experimental Education Y1 - 1950 A1 - Moonan, W. J. VL - 18 ER -